Package io.quarkiverse.langchain4j.huggingface.runtime.config

Interface EmbeddingModelConfig

public interface EmbeddingModelConfig

Field Summary

Fields

Modifier and Type	Field	Description
static final String	DEFAULT_INFERENCE_ENDPOINT_EMBEDDING

Method Summary

Modifier and Type	Method	Description
Optional<URL>	inferenceEndpointUrl()	The URL of the inference endpoint for the embedding.
Boolean	waitForModel()	If the model is not ready, wait for it instead of receiving 503.

Field Details

DEFAULT_INFERENCE_ENDPOINT_EMBEDDING

static final String DEFAULT_INFERENCE_ENDPOINT_EMBEDDING

See Also:

• Constant Field Values

Method Details

inferenceEndpointUrl

@WithDefault("https://api-inference.huggingface.co/pipeline/feature-extraction/sentence-transformers/all-MiniLM-L6-v2")
Optional<URL> inferenceEndpointUrl()

The URL of the inference endpoint for the embedding.

When using Hugging Face with the inference API, the URL is https://api-inference.huggingface.co/pipeline/feature-extraction/<model-id>, for example https://api-inference.huggingface.co/pipeline/feature-extraction/sentence-transformers/all-mpnet-base-v2.

When using a deployed inference endpoint, the URL is the URL of the endpoint. When using a local hugging face model, the URL is the URL of the local model.

waitForModel

@WithDefault("true")
Boolean waitForModel()

If the model is not ready, wait for it instead of receiving 503. It limits the number of requests required to get your inference done. It is advised to only set this flag to true after receiving a 503 error as it will limit hanging in your application to known places