| Interface | Description |
|---|---|
| LanguageModel |
Represents a LLM that has a simple text interface (as opposed to a chat interface).
|
| StreamingLanguageModel |
Represents a LLM that has a simple text interface (as opposed to a chat interface) and can stream responses one token at a time.
|
| TokenCountEstimator |
Represents an interface for estimating the count of tokens in various text types such as a text, prompt, text segment, etc.
|
Copyright © 2023. All rights reserved.