dev.langchain4j.model.localai

Class LocalAiChatModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiChatModel

All Implemented Interfaces:

dev.langchain4j.model.chat.ChatLanguageModel

public class LocalAiChatModel
extends Object
implements dev.langchain4j.model.chat.ChatLanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LocalAiChatModel.LocalAiChatModelBuilder

Constructor Summary

Constructors

Constructor and Description
LocalAiChatModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Integer maxRetries, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method and Description
static LocalAiChatModel.LocalAiChatModelBuilder	builder()
dev.langchain4j.model.output.Response<dev.langchain4j.data.message.AiMessage>	generate(List<dev.langchain4j.data.message.ChatMessage> messages)
dev.langchain4j.model.output.Response<dev.langchain4j.data.message.AiMessage>	generate(List<dev.langchain4j.data.message.ChatMessage> messages, List<dev.langchain4j.agent.tool.ToolSpecification> toolSpecifications)
dev.langchain4j.model.output.Response<dev.langchain4j.data.message.AiMessage>	generate(List<dev.langchain4j.data.message.ChatMessage> messages, dev.langchain4j.agent.tool.ToolSpecification toolSpecification)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.ChatLanguageModel

generate, generate

Constructor Detail

LocalAiChatModel

public LocalAiChatModel(String baseUrl,
                        String modelName,
                        Double temperature,
                        Double topP,
                        Integer maxTokens,
                        Duration timeout,
                        Integer maxRetries,
                        Boolean logRequests,
                        Boolean logResponses)

Method Detail

generate

public dev.langchain4j.model.output.Response<dev.langchain4j.data.message.AiMessage> generate(List<dev.langchain4j.data.message.ChatMessage> messages)

Specified by:

generate in interface dev.langchain4j.model.chat.ChatLanguageModel

generate

public dev.langchain4j.model.output.Response<dev.langchain4j.data.message.AiMessage> generate(List<dev.langchain4j.data.message.ChatMessage> messages,
                                                                                              List<dev.langchain4j.agent.tool.ToolSpecification> toolSpecifications)

Specified by:

generate in interface dev.langchain4j.model.chat.ChatLanguageModel

generate

public dev.langchain4j.model.output.Response<dev.langchain4j.data.message.AiMessage> generate(List<dev.langchain4j.data.message.ChatMessage> messages,
                                                                                              dev.langchain4j.agent.tool.ToolSpecification toolSpecification)

Specified by:

generate in interface dev.langchain4j.model.chat.ChatLanguageModel

builder

public static LocalAiChatModel.LocalAiChatModelBuilder builder()