Package io.quarkiverse.langchain4j.ollama

Interface OllamaRestApi

@Path("")
@Consumes("application/json")
@Produces("application/json")
@RegisterProvider(OllamaRestApiReaderInterceptor.class) @RegisterProvider(OpenAiRestApiWriterInterceptor.class)
public interface OllamaRestApi

This Microprofile REST client is used as the building block of all the API calls to HuggingFace. The implementation is provided by the Reactive REST Client in Quarkus.

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static class	OllamaRestApi.OllamaLogger	Introduce a custom logger as the stock one logs at the DEBUG level by default...
static class	OllamaRestApi.OllamaRestApiReaderInterceptor	This is needed because for some reason Vert.x is not giving us the entire content of the last chunk and this results in a json parsing exception.
static class	OllamaRestApi.OpenAiRestApiWriterInterceptor	The point of this is to properly set the stream value of the request so users don't have to remember to set it manually

Method Summary

Modifier and Type	Method	Description
ChatResponse	chat(ChatRequest request)
EmbeddingResponse	embeddings(EmbeddingRequest request)
static com.fasterxml.jackson.databind.ObjectMapper	objectMapper(com.fasterxml.jackson.databind.ObjectMapper defaultObjectMapper)
io.smallrye.mutiny.Multi<ChatResponse>	streamingChat(ChatRequest request)

Method Details

chat

@Path("/api/chat")
@POST
ChatResponse chat(ChatRequest request)

streamingChat

@Path("/api/chat")
@POST
@RestStreamElementType("application/json")
io.smallrye.mutiny.Multi<ChatResponse> streamingChat(ChatRequest request)

embeddings

@Path("/api/embeddings")
@POST
EmbeddingResponse embeddings(EmbeddingRequest request)

objectMapper

static com.fasterxml.jackson.databind.ObjectMapper objectMapper(com.fasterxml.jackson.databind.ObjectMapper defaultObjectMapper)