public interface TokenType
The standard lexer token types common to all languages.
-
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final IElementTypeToken type for a character which is not valid in the position where it was encountered, according to the language grammar.static final IElementTypestatic final IElementTypestatic final IElementTypestatic final IElementTypeInternal token type used by the code formatter.static final IElementTypeToken type for a sequence of whitespace characters.
-
Field Details
-
WHITE_SPACE
Token type for a sequence of whitespace characters. -
BAD_CHARACTER
Token type for a character which is not valid in the position where it was encountered, according to the language grammar. -
NEW_LINE_INDENT
Internal token type used by the code formatter. -
ERROR_ELEMENT
-
CODE_FRAGMENT
-
DUMMY_HOLDER
-