public class CompositeTokenFilter extends Object implements StreamFilter
Tokens with a single
composite Token| Constructor and Description |
|---|
CompositeTokenFilter() |
| Modifier and Type | Method and Description |
|---|---|
List<Token> |
postProcess(List<Token> tokens)
Post-processes analysed tokens
|
void |
preProcess(Sentence sentence)
Pre-processes a sentence
|
void |
readRules(BufferedReader reader)
Reads the rules to apply as space-delimited text
|
public void readRules(BufferedReader reader) throws IOException
reader - The reader from which to read the rulesIOExceptionpublic void preProcess(Sentence sentence)
StreamFilterpreProcess in interface StreamFiltersentence - The sentence be pre-processedpublic List<Token> postProcess(List<Token> tokens)
StreamFilterpostProcess in interface StreamFiltertokens - The analysed tokens