dev.langchain4j.model.localai

Class LocalAiStreamingLanguageModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiStreamingLanguageModel

All Implemented Interfaces:

dev.langchain4j.model.language.StreamingLanguageModel

public class LocalAiStreamingLanguageModel
extends Object
implements dev.langchain4j.model.language.StreamingLanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder

Constructor Summary

Constructors

Constructor and Description
LocalAiStreamingLanguageModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method and Description
static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder	builder()
void	generate(String prompt, dev.langchain4j.model.StreamingResponseHandler<String> handler)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.StreamingLanguageModel

generate

Constructor Detail

LocalAiStreamingLanguageModel

public LocalAiStreamingLanguageModel(String baseUrl,
                                     String modelName,
                                     Double temperature,
                                     Double topP,
                                     Integer maxTokens,
                                     Duration timeout,
                                     Boolean logRequests,
                                     Boolean logResponses)

Method Detail

generate

public void generate(String prompt,
                     dev.langchain4j.model.StreamingResponseHandler<String> handler)

Specified by:

generate in interface dev.langchain4j.model.language.StreamingLanguageModel

builder

public static LocalAiStreamingLanguageModel.LocalAiStreamingLanguageModelBuilder builder()