ExpressionTokenizer (pip-services3-expressions 3.0.0 API)

java.lang.Object
- org.pipservices3.expressions.tokenizers.AbstractTokenizer
- - org.pipservices3.expressions.calculator.tokenizers.ExpressionTokenizer

All Implemented Interfaces:

ITokenizer
```
public class ExpressionTokenizer
extends AbstractTokenizer
```
Implement tokenizer to perform lexical analysis for expressions.

- Field Summary
  - Fields inherited from class org.pipservices3.expressions.tokenizers.AbstractTokenizer
    _lastTokenType, _nextToken, _scanner
- Constructor Summary
  
  Constructors
  Constructor Description
  
  ExpressionTokenizer()
  Constructs an instance of this class.
- Method Summary
  - Methods inherited from class org.pipservices3.expressions.tokenizers.AbstractTokenizer
    clearCharacterStates, getCharacterState, getCommentState, getDecodeStrings, getMergeWhitespaces, getNumberState, getQuoteState, getScanner, getSkipComments, getSkipEof, getSkipUnknown, getSkipWhitespaces, getSymbolState, getUnifyNumbers, getWhitespaceState, getWordState, hasNextToken, nextToken, readNextToken, setCharacterState, setCommentState, setDecodeStrings, setMergeWhitespaces, setNumberState, setQuoteState, setScanner, setSkipComments, setSkipEof, setSkipUnknown, setSkipWhitespaces, setSymbolState, setUnifyNumbers, setWhitespaceState, setWordState, tokenizeBuffer, tokenizeBufferToStrings, tokenizeStream, tokenizeStreamToStrings
  - Methods inherited from class java.lang.Object
    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - ExpressionTokenizer
```
public ExpressionTokenizer()
                    throws Exception
```
    Constructs an instance of this class.
    
    Throws:
    
    Exception