manifold.templates.tokenizer

Class Tokenizer

java.lang.Object

manifold.templates.tokenizer.Tokenizer

public class Tokenizer
extends java.lang.Object

Constructor Summary

Constructors

Constructor and Description
Tokenizer()

Method Summary

Modifier and Type	Method and Description
java.util.List<Token>	tokenize(java.lang.CharSequence text)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, jailbreak, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

tokenize

public java.util.List<Token> tokenize(java.lang.CharSequence text)