Uses of Class
io.debezium.text.TokenStream.BasicTokenizer
Packages that use TokenStream.BasicTokenizer
-
Uses of TokenStream.BasicTokenizer in io.debezium.text
Methods in io.debezium.text that return TokenStream.BasicTokenizerModifier and TypeMethodDescriptionstatic TokenStream.BasicTokenizerTokenStream.basicTokenizer(boolean includeComments) Obtain a basicTokenStream.Tokenizerimplementation that ignores whitespace but includes tokens for individual symbols, the period ('.'), single-quoted strings, double-quoted strings, whitespace-delimited words, and optionally comments.