String |
TokenStream.consume() |
Return the value of this token and move to the next token.
|
TokenStream |
TokenStream.consume(char expected) |
Attempt to consume this current token as long as it matches the expected character, or throw an exception if the token does
not match.
|
TokenStream |
TokenStream.consume(int expectedType) |
Attempt to consume this current token as long as it matches the expected character, or throw an exception if the token does
not match.
|
TokenStream |
TokenStream.consume(Iterable<String> nextTokens) |
Attempt to consume this current token as the next tokens as long as they match the expected values, or throw an exception
if the token does not match.
|
TokenStream |
TokenStream.consume(String expected) |
Attempt to consume this current token as long as it matches the expected value, or throw an exception if the token does not
match.
|
TokenStream |
TokenStream.consume(String[] nextTokens) |
Attempt to consume this current token as the next tokens as long as they match the expected values, or throw an exception
if the token does not match.
|
TokenStream |
TokenStream.consume(String expected,
String... expectedForNextTokens) |
Attempt to consume this current token as the next tokens as long as they match the expected values, or throw an exception
if the token does not match.
|
TokenStream |
TokenStream.consumeThrough(char expected) |
Attempt to consume all tokens until the specified token is consumed, and then stop.
|
TokenStream |
TokenStream.consumeThrough(char expected,
char skipMatchingTokens) |
Attempt to consume all tokens until the specified token is consumed, and then stop.
|
TokenStream |
TokenStream.consumeThrough(String expected) |
Attempt to consume all tokens until the specified token is consumed, and then stop.
|
TokenStream |
TokenStream.consumeThrough(String expected,
String skipMatchingTokens) |
Attempt to consume all tokens until the specified token is consumed, and then stop.
|
TokenStream |
TokenStream.consumeUntil(char expected) |
Attempt to consume all tokens until the specified token is found, and then stop before consuming that token.
|
TokenStream |
TokenStream.consumeUntil(char expected,
char skipMatchingTokens) |
Attempt to consume all tokens until the specified token is found, and then stop before consuming that token.
|
TokenStream |
TokenStream.consumeUntil(String expected) |
Attempt to consume all tokens until the specified token is found, and then stop before consuming that token.
|
TokenStream |
TokenStream.consumeUntil(String expected,
String... skipMatchingTokens) |
Attempt to consume all tokens until the specified token is found, and then stop before consuming that token.
|
TokenStream |
TokenStream.consumeUntilEndOrOneOf(String... stopTokens) |
Consume the token stream until one of the stop tokens or the end of the stream is found.
|
TokenStream |
TokenStream.start() |
Begin the token stream, including (if required) the tokenization of the input content.
|
protected void |
TokenStream.throwNoMoreContent() |
|
void |
TokenStream.BasicTokenizer.tokenize(TokenStream.CharacterStream input,
TokenStream.Tokens tokens) |
|
void |
TokenStream.Tokenizer.tokenize(TokenStream.CharacterStream input,
TokenStream.Tokens tokens) |
Process the supplied characters and construct the appropriate TokenStream.Token objects.
|