Package org.readium.r2.shared.util.tokenizer
See: Description
-
Enum Summary Enum Description TextUnit A text token unit which can be used with a TextTokenizer. -
Class Summary Class Description DefaultTextContentTokenizer A default cluster TextTokenizer taking advantage of the best capabilities of each Android version. IcuTextTokenizer Implementation of a TextTokenizer using ICU components to perform the actual tokenization while taking into account languages specificities. NaiveTextTokenizer A naive Tokenizer relying on java.text.BreakIterator to split the content.