Uses of Interface
org.pipservices3.expressions.tokenizers.ITokenizer

Packages that use ITokenizer

Package	Description
org.pipservices3.expressions.calculator.tokenizers
org.pipservices3.expressions.csv
org.pipservices3.expressions.mustache.tokenizers
org.pipservices3.expressions.tokenizers
org.pipservices3.expressions.tokenizers.generic

Uses of ITokenizer in org.pipservices3.expressions.calculator.tokenizers

Classes in org.pipservices3.expressions.calculator.tokenizers that implement ITokenizer

Modifier and Type	Class	Description
class	ExpressionTokenizer	Implement tokenizer to perform lexical analysis for expressions.

Methods in org.pipservices3.expressions.calculator.tokenizers with parameters of type ITokenizer

Modifier and Type	Method	Description
Token	ExpressionNumberState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	ExpressionQuoteState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	ExpressionWordState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.

Uses of ITokenizer in org.pipservices3.expressions.csv

Classes in org.pipservices3.expressions.csv that implement ITokenizer

Modifier and Type	Class	Description
class	CsvTokenizer	Implements a tokenizer class for CSV files.

Methods in org.pipservices3.expressions.csv with parameters of type ITokenizer

Modifier and Type	Method	Description
Token	CsvQuoteState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	CsvSymbolState.nextToken(IScanner scanner, ITokenizer tokenizer)

Uses of ITokenizer in org.pipservices3.expressions.mustache.tokenizers

Classes in org.pipservices3.expressions.mustache.tokenizers that implement ITokenizer

Modifier and Type	Class	Description
class	MustacheTokenizer

Methods in org.pipservices3.expressions.mustache.tokenizers with parameters of type ITokenizer

Modifier and Type	Method	Description
Token	MustacheSpecialState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.

Uses of ITokenizer in org.pipservices3.expressions.tokenizers

Classes in org.pipservices3.expressions.tokenizers that implement ITokenizer

Modifier and Type	Class	Description
class	AbstractTokenizer	Implements an abstract tokenizer class.

Methods in org.pipservices3.expressions.tokenizers with parameters of type ITokenizer

Modifier and Type	Method	Description
Token	ITokenizerState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.

Uses of ITokenizer in org.pipservices3.expressions.tokenizers.generic

Classes in org.pipservices3.expressions.tokenizers.generic that implement ITokenizer

Modifier and Type	Class	Description
class	GenericTokenizer	Implements a default tokenizer class.

Methods in org.pipservices3.expressions.tokenizers.generic with parameters of type ITokenizer

Modifier and Type	Method	Description
Token	CCommentState.nextToken(IScanner scanner, ITokenizer tokenizer)	Either delegate to a comment-handling state, or return a token with just a slash in it.
Token	CppCommentState.nextToken(IScanner scanner, ITokenizer tokenizer)	Either delegate to a comment-handling state, or return a token with just a slash in it.
Token	GenericCommentState.nextToken(IScanner scanner, ITokenizer tokenizer)	Either delegate to a comment-handling state, or return a token with just a slash in it.
Token	GenericNumberState.nextToken(IScanner scanner, ITokenizer tokenizer)	Gets the next token from the stream started from the character linked to this state.
Token	GenericQuoteState.nextToken(IScanner scanner, ITokenizer tokenizer)	Return a quoted string token from a scanner.
Token	GenericSymbolState.nextToken(IScanner scanner, ITokenizer tokenizer)	Return a symbol token from a scanner.
Token	GenericWhitespaceState.nextToken(IScanner scanner, ITokenizer tokenizer)	Ignore whitespace (such as blanks and tabs), and return the tokenizer's next token.
Token	GenericWordState.nextToken(IScanner scanner, ITokenizer tokenizer)	Ignore word (such as blanks and tabs), and return the tokenizer's next token.