Package dev.langchain4j.model.ollama

Class OllamaStreamingChatModel

java.lang.Object

dev.langchain4j.model.ollama.OllamaStreamingChatModel

All Implemented Interfaces:

dev.langchain4j.model.chat.StreamingChatLanguageModel

public class OllamaStreamingChatModel
extends Object
implements dev.langchain4j.model.chat.StreamingChatLanguageModel

Ollama API reference
Ollama API parameters.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OllamaStreamingChatModel.OllamaStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor

Description

OllamaStreamingChatModel(String baseUrl, String modelName, Double temperature, Integer topK, Double topP, Double repeatPenalty, Integer seed, Integer numPredict, Integer numCtx, List<String> stop, String format, dev.langchain4j.model.chat.request.ResponseFormat responseFormat, Duration timeout, Boolean logRequests, Boolean logResponses, Map<String,String> customHeaders, List<dev.langchain4j.model.chat.listener.ChatModelListener> listeners, Set<dev.langchain4j.model.chat.Capability> supportedCapabilities)

Method Summary

Modifier and Type	Method	Description
static OllamaStreamingChatModel.OllamaStreamingChatModelBuilder	builder()
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, List<dev.langchain4j.agent.tool.ToolSpecification> toolSpecifications, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)
Set<dev.langchain4j.model.chat.Capability>	supportedCapabilities()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

chat, defaultRequestParameters, generate, generate, generate

Constructor Details

OllamaStreamingChatModel

public OllamaStreamingChatModel(String baseUrl,
 String modelName,
 Double temperature,
 Integer topK,
 Double topP,
 Double repeatPenalty,
 Integer seed,
 Integer numPredict,
 Integer numCtx,
 List<String> stop,
 String format,
 dev.langchain4j.model.chat.request.ResponseFormat responseFormat,
 Duration timeout,
 Boolean logRequests,
 Boolean logResponses,
 Map<String,String> customHeaders,
 List<dev.langchain4j.model.chat.listener.ChatModelListener> listeners,
 Set<dev.langchain4j.model.chat.Capability> supportedCapabilities)

Method Details

builder

public static OllamaStreamingChatModel.OllamaStreamingChatModelBuilder builder()

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
 dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
 List<dev.langchain4j.agent.tool.ToolSpecification> toolSpecifications,
 dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

supportedCapabilities

public Set<dev.langchain4j.model.chat.Capability> supportedCapabilities()

Specified by:

supportedCapabilities in interface dev.langchain4j.model.chat.StreamingChatLanguageModel