Package chat.octet.model.components.criteria

Interface StoppingCriteria

All Known Implementing Classes:

MaxTimeCriteria, StoppingCriteriaList, StoppingWordCriteria

public interface StoppingCriteria

Customize a controller to implement stop rule control for model inference.

Note: Referenced the Transformers document implementation.

Author:

William

Method Summary

Modifier and Type	Method	Description
boolean	criteria(int[] inputTokenIds, float[] scores, Object... args)	Stopping criteria

Method Details

criteria

boolean criteria(@Nullable
 int[] inputTokenIds,
 @Nonnull
 float[] scores,
 Object... args)

Stopping criteria

Parameters:

inputTokenIds - Indices of input sequence tokens in the vocabulary.

scores - Prediction scores of a language modeling head. These can be logits for each vocabulary.

args - Specific args to a stopping criteria.

Returns:

boolean `False` indicates we should continue, `True` indicates we should stop.