Class Token


  • public class Token
    extends Object
    A token represents a logical chunk of a string. For example, a typical tokenizer would break the string "1.23 <= 12.3" into three tokens: the number 1.23, a less-than-or-equal symbol, and the number 12.3. A token is a receptacle, and relies on a tokenizer to decide precisely how to divide a string into tokens.
    • Constructor Detail

      • Token

        public Token​(TokenType type,
                     String value,
                     int line,
                     int column)
    • Method Detail

      • getType

        public TokenType getType()
        The token type.
      • getValue

        public String getValue()
        The token value.
      • getLine

        public int getLine()
        The line number where the token is.
      • getColumn

        public int getColumn()
        The column number where the token is.