Uses of Class
chat.octet.model.beans.LlamaModelQuantizeParams
Packages that use LlamaModelQuantizeParams
-
Uses of LlamaModelQuantizeParams in chat.octet.model
Methods in chat.octet.model that return LlamaModelQuantizeParamsModifier and TypeMethodDescriptionstatic LlamaModelQuantizeParamsLlamaService.getLlamaModelQuantizeDefaultParams()Get llama model quantize default params.Methods in chat.octet.model with parameters of type LlamaModelQuantizeParamsModifier and TypeMethodDescriptionstatic intLlamaService.llamaModelQuantize(String sourceModelFilePath, String outputModelFilePath, LlamaModelQuantizeParams params) Quantize the model.