dev.langchain4j.model.localai

Class LocalAiStreamingChatModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiStreamingChatModel

All Implemented Interfaces:

dev.langchain4j.model.chat.StreamingChatLanguageModel

public class LocalAiStreamingChatModel
extends Object
implements dev.langchain4j.model.chat.StreamingChatLanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor and Description
LocalAiStreamingChatModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method and Description
static LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder	builder()
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, List<dev.langchain4j.agent.tool.ToolSpecification> toolSpecifications, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, dev.langchain4j.agent.tool.ToolSpecification toolSpecification, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate

Constructor Detail

LocalAiStreamingChatModel

public LocalAiStreamingChatModel(String baseUrl,
                                 String modelName,
                                 Double temperature,
                                 Double topP,
                                 Integer maxTokens,
                                 Duration timeout,
                                 Boolean logRequests,
                                 Boolean logResponses)

Method Detail

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
                     dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
                     List<dev.langchain4j.agent.tool.ToolSpecification> toolSpecifications,
                     dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
                     dev.langchain4j.agent.tool.ToolSpecification toolSpecification,
                     dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

builder

public static LocalAiStreamingChatModel.LocalAiStreamingChatModelBuilder builder()