Package chat.octet.model
package chat.octet.model
-
ClassesClassDescriptionModel inference generator, Supports streaming output text and generating complete text.Llama.cpp APILLama model, which provides functions for generating and chatting conversations.Token decoder