dev.langchain4j.model.localai

Class LocalAiStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiStreamingLanguageModel

All Implemented Interfaces:

dev.langchain4j.model.language.StreamingLanguageModel

public class LocalAiStreamingLanguageModel
extends Object
implements dev.langchain4j.model.language.StreamingLanguageModel

Constructor Summary

Constructors

Constructor and Description
LocalAiStreamingLanguageModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method and Description
void	generate(String prompt, dev.langchain4j.model.StreamingResponseHandler<String> handler)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.StreamingLanguageModel

generate

Constructor Detail

LocalAiStreamingLanguageModel

public LocalAiStreamingLanguageModel(String baseUrl,
                                     String modelName,
                                     Double temperature,
                                     Double topP,
                                     Integer maxTokens,
                                     Duration timeout,
                                     Boolean logRequests,
                                     Boolean logResponses)

Method Detail

generate

public void generate(String prompt,
                     dev.langchain4j.model.StreamingResponseHandler<String> handler)

Specified by:

generate in interface dev.langchain4j.model.language.StreamingLanguageModel