Uses of Class
net.java.sen.dictionary.CToken

Packages that use CToken

Package	Description
net.java.sen.compiler
net.java.sen.dictionary

Uses of CToken in net.java.sen.compiler

Fields in net.java.sen.compiler declared as CToken

Modifier and Type	Field and Description
CToken	StringCTokenTuple.value The tuple's CToken
CToken	StringCTokenTuple.value The tuple's CToken

Methods in net.java.sen.compiler with parameters of type CToken

Modifier and Type	Method and Description
void	VirtualTupleList.add(String string, CToken ctoken) Adds a StringCTokenTuple to the list.
void	VirtualTupleList.add(String string, CToken ctoken) Adds a StringCTokenTuple to the list.

Constructors in net.java.sen.compiler with parameters of type CToken

Constructor and Description
StringCTokenTuple(String key, CToken value)
StringCTokenTuple(String key, CToken value)

Uses of CToken in net.java.sen.dictionary

Fields in net.java.sen.dictionary declared as CToken

Modifier and Type	Field and Description
protected CToken	Tokenizer.unknownCToken A CToken representing an unknown morpheme
protected CToken	Tokenizer.unknownCToken A CToken representing an unknown morpheme

Methods in net.java.sen.dictionary that return CToken

Modifier and Type	Method and Description
CToken	CToken.clone()
CToken	CToken.clone()
CToken[]	Dictionary.commonPrefixSearch(CharIterator iterator) Searches for possible morphemes starting at the current position of a CharIterator.
CToken[]	Dictionary.commonPrefixSearch(CharIterator iterator) Searches for possible morphemes starting at the current position of a CharIterator.
CToken	Dictionary.getBOSToken() Gets a unique beginning-of-string CToken.
CToken	Dictionary.getBOSToken() Gets a unique beginning-of-string CToken.
CToken	Dictionary.getEOSToken() Gets a unique end-of-string CToken.
CToken	Dictionary.getEOSToken() Gets a unique end-of-string CToken.
CToken	Dictionary.getUnknownToken() Gets a unique unknown-morpheme CToken.
CToken	Dictionary.getUnknownToken() Gets a unique unknown-morpheme CToken.

Methods in net.java.sen.dictionary with parameters of type CToken

Modifier and Type	Method and Description
void	Node.setCToken(CToken ctoken)
void	Node.setCToken(CToken ctoken)
static void	CToken.write(DataOutput output, CToken token) Write a CToken to a DataOutput
static void	CToken.write(DataOutput output, CToken token) Write a CToken to a DataOutput