dev.langchain4j.model.localai

Class LocalAiLanguageModel

java.lang.Object

dev.langchain4j.model.localai.LocalAiLanguageModel

All Implemented Interfaces:

dev.langchain4j.model.language.LanguageModel

public class LocalAiLanguageModel
extends Object
implements dev.langchain4j.model.language.LanguageModel

See LocalAI documentation for more details.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	LocalAiLanguageModel.LocalAiLanguageModelBuilder

Constructor Summary

Constructors

Constructor and Description
LocalAiLanguageModel(String baseUrl, String modelName, Double temperature, Double topP, Integer maxTokens, Duration timeout, Integer maxRetries, Boolean logRequests, Boolean logResponses)

Method Summary

Modifier and Type	Method and Description
static LocalAiLanguageModel.LocalAiLanguageModelBuilder	builder()
dev.langchain4j.model.output.Response<String>	generate(String prompt)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.language.LanguageModel

generate

Constructor Detail

LocalAiLanguageModel

public LocalAiLanguageModel(String baseUrl,
                            String modelName,
                            Double temperature,
                            Double topP,
                            Integer maxTokens,
                            Duration timeout,
                            Integer maxRetries,
                            Boolean logRequests,
                            Boolean logResponses)

Method Detail

generate

public dev.langchain4j.model.output.Response<String> generate(String prompt)

Specified by:

generate in interface dev.langchain4j.model.language.LanguageModel

builder

public static LocalAiLanguageModel.LocalAiLanguageModelBuilder builder()