Uses of Class
net.java.sen.dictionary.Token

Packages that use Token

Package	Description
net.java.sen
net.java.sen.dictionary
net.java.sen.filter
net.java.sen.filter.reading
net.java.sen.filter.stream
org.apache.lucene.analysis.gosen

Uses of Token in net.java.sen

Methods in net.java.sen that return Token

Modifier and Type	Method and Description
Token	StreamTagger.next() Returns the next available token
Token	StreamTagger.next() Returns the next available token

Methods in net.java.sen that return types with arguments of type Token

Modifier and Type	Method and Description
List<Token>	StringTagger.analyze(char[] surface) Deprecated. use StringTagger.analyze(char[], List) instead.
List<Token>	StringTagger.analyze(char[] surface) Deprecated. use StringTagger.analyze(char[], List) instead.
List<Token>	StringTagger.analyze(char[] surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(char[] surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(String surface) Deprecated. use StringTagger.analyze(String, List) instead.
List<Token>	StringTagger.analyze(String surface) Deprecated. use StringTagger.analyze(String, List) instead.
List<Token>	StringTagger.analyze(String surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(String surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	ReadingProcessor.ReadingResult.getPossibleTokens(int position) Searches for possible tokens starting at the given position within the result's text
List<Token>	ReadingProcessor.ReadingResult.getPossibleTokens(int position) Searches for possible tokens starting at the given position within the result's text
List<Token>	ReadingProcessor.ReadingResult.getTokens() Gets the tokens resulting from analysis of the result's text. Note that although the returned data is isolated from any changes to the ReadingProcessor, it is not copied internally, and any changes you make to the returned data will be reflected by subsequent calls to this method on the same ReadingProcessor.ReadingResult object
List<Token>	ReadingProcessor.ReadingResult.getTokens() Gets the tokens resulting from analysis of the result's text. Note that although the returned data is isolated from any changes to the ReadingProcessor, it is not copied internally, and any changes you make to the returned data will be reflected by subsequent calls to this method on the same ReadingProcessor.ReadingResult object

Method parameters in net.java.sen with type arguments of type Token

Modifier and Type	Method and Description
List<Token>	StringTagger.analyze(char[] surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(char[] surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(String surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(String surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes

Uses of Token in net.java.sen.dictionary

Methods in net.java.sen.dictionary that return types with arguments of type Token

Modifier and Type	Method and Description
List<Token>	Viterbi.getBestTokens(Sentence sentence) Deprecated. use Viterbi.getBestTokens(Sentence, List) instead
List<Token>	Viterbi.getBestTokens(Sentence sentence) Deprecated. use Viterbi.getBestTokens(Sentence, List) instead
List<Token>	Viterbi.getBestTokens(Sentence sentence, List<Token> reuse) Analyses a sentence to find the most likely sequence of morphemes
List<Token>	Viterbi.getBestTokens(Sentence sentence, List<Token> reuse) Analyses a sentence to find the most likely sequence of morphemes
List<Token>	Viterbi.getPossibleTokens(Sentence sentence, int position) Gets the possible tokens from a Sentence at a given position.
List<Token>	Viterbi.getPossibleTokens(Sentence sentence, int position) Gets the possible tokens from a Sentence at a given position.

Method parameters in net.java.sen.dictionary with type arguments of type Token

Modifier and Type	Method and Description
List<Token>	Viterbi.getBestTokens(Sentence sentence, List<Token> reuse) Analyses a sentence to find the most likely sequence of morphemes
List<Token>	Viterbi.getBestTokens(Sentence sentence, List<Token> reuse) Analyses a sentence to find the most likely sequence of morphemes

Uses of Token in net.java.sen.filter

Methods in net.java.sen.filter that return types with arguments of type Token

Modifier and Type	Method and Description
List<Token>	StreamFilter.postProcess(List<Token> tokens) Post-processes analysed tokens
List<Token>	StreamFilter.postProcess(List<Token> tokens) Post-processes analysed tokens

Method parameters in net.java.sen.filter with type arguments of type Token

Modifier and Type	Method and Description
void	ReadingFilter.filterReadings(List<Token> tokens, ReadingNode readingNode) Filters readings
void	ReadingFilter.filterReadings(List<Token> tokens, ReadingNode readingNode) Filters readings
List<Token>	StreamFilter.postProcess(List<Token> tokens) Post-processes analysed tokens
List<Token>	StreamFilter.postProcess(List<Token> tokens) Post-processes analysed tokens

Uses of Token in net.java.sen.filter.reading

Method parameters in net.java.sen.filter.reading with type arguments of type Token

Modifier and Type	Method and Description
void	NumberFilter.filterReadings(List<Token> tokens, ReadingNode readingNode)
void	OverrideFilter.filterReadings(List<Token> tokens, ReadingNode readingNode)
void	OverrideFilter.filterReadings(List<Token> tokens, ReadingNode readingNode)
void	NumberFilter.filterReadings(List<Token> tokens, ReadingNode readingNode)

Uses of Token in net.java.sen.filter.stream

Methods in net.java.sen.filter.stream that return types with arguments of type Token

Modifier and Type	Method and Description
List<Token>	CommentFilter.postProcess(List<Token> tokens)
List<Token>	CompositeTokenFilter.postProcess(List<Token> tokens)
List<Token>	CompoundWordFilter.postProcess(List<Token> tokens)
List<Token>	CompoundWordFilter.postProcess(List<Token> tokens)
List<Token>	CompositeTokenFilter.postProcess(List<Token> tokens)
List<Token>	CommentFilter.postProcess(List<Token> tokens)

Method parameters in net.java.sen.filter.stream with type arguments of type Token

Modifier and Type	Method and Description
List<Token>	CommentFilter.postProcess(List<Token> tokens)
List<Token>	CompositeTokenFilter.postProcess(List<Token> tokens)
List<Token>	CompoundWordFilter.postProcess(List<Token> tokens)
List<Token>	CompoundWordFilter.postProcess(List<Token> tokens)
List<Token>	CompositeTokenFilter.postProcess(List<Token> tokens)
List<Token>	CommentFilter.postProcess(List<Token> tokens)

Uses of Token in org.apache.lucene.analysis.gosen

Methods in org.apache.lucene.analysis.gosen that return Token

Modifier and Type	Method and Description
Token	StreamTagger2.next()
Token	StreamTagger2.next()