Package io.quarkiverse.langchain4j.watsonx

Class WatsonxStreamingChatModel

java.lang.Object

io.quarkiverse.langchain4j.watsonx.WatsonxModel

io.quarkiverse.langchain4j.watsonx.WatsonxStreamingChatModel

All Implemented Interfaces:

dev.langchain4j.model.chat.StreamingChatLanguageModel, dev.langchain4j.model.chat.TokenCountEstimator

public class WatsonxStreamingChatModel
extends WatsonxModel
implements dev.langchain4j.model.chat.StreamingChatLanguageModel, dev.langchain4j.model.chat.TokenCountEstimator

Nested Class Summary

Nested classes/interfaces inherited from class io.quarkiverse.langchain4j.watsonx.WatsonxModel

WatsonxModel.Builder

Constructor Summary

Constructors

Constructor	Description
WatsonxStreamingChatModel(WatsonxModel.Builder config)

Method Summary

Modifier and Type	Method	Description
int	estimateTokenCount(List<dev.langchain4j.data.message.ChatMessage> messages)
void	generate(List<dev.langchain4j.data.message.ChatMessage> messages, dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Methods inherited from class io.quarkiverse.langchain4j.watsonx.WatsonxModel

builder, generateBearerToken, retryOn, toFinishReason, toInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

generate, generate, generate, generate

Methods inherited from interface dev.langchain4j.model.chat.TokenCountEstimator

estimateTokenCount, estimateTokenCount, estimateTokenCount, estimateTokenCount

Constructor Details

WatsonxStreamingChatModel

public WatsonxStreamingChatModel(WatsonxModel.Builder config)

Method Details

generate

public void generate(List<dev.langchain4j.data.message.ChatMessage> messages,
 dev.langchain4j.model.StreamingResponseHandler<dev.langchain4j.data.message.AiMessage> handler)

Specified by:

generate in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

estimateTokenCount

public int estimateTokenCount(List<dev.langchain4j.data.message.ChatMessage> messages)

Specified by:

estimateTokenCount in interface dev.langchain4j.model.chat.TokenCountEstimator