dev.langchain4j.model.ollama

Class OllamaStreamingChatModel

java.lang.Object

dev.langchain4j.model.ollama.OllamaStreamingChatModel

All Implemented Interfaces:

dev.langchain4j.model.chat.StreamingChatLanguageModel

public class OllamaStreamingChatModel
extends Object
implements dev.langchain4j.model.chat.StreamingChatLanguageModel

Ollama API reference
Ollama API parameters.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	OllamaStreamingChatModel.OllamaStreamingChatModelBuilder

Constructor Summary

Constructors

Constructor and Description
OllamaStreamingChatModel(String baseUrl, String modelName, Double temperature, Integer topK, Double topP, Double repeatPenalty, Integer seed, Integer numPredict, List<String> stop, String format, Duration timeout)

Method Summary

Modifier and Type	Method and Description
static OllamaStreamingChatModel.OllamaStreamingChatModelBuilder	builder()
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate, generate, generate

Constructor Detail

OllamaStreamingChatModel

public OllamaStreamingChatModel(String baseUrl,
                                String modelName,
                                Double temperature,
                                Integer topK,
                                Double topP,
                                Double repeatPenalty,
                                Integer seed,
                                Integer numPredict,
                                List<String> stop,
                                String format,
                                Duration timeout)

Method Detail

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
                     dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

builder

public static OllamaStreamingChatModel.OllamaStreamingChatModelBuilder builder()