| Package | Description |
|---|---|
| net.java.sen.dictionary | |
| net.java.sen.tokenizers.ja |
| Modifier and Type | Field and Description |
|---|---|
protected Dictionary |
Tokenizer.dictionary
The
Dictionary used to find possible morphemes |
protected Dictionary |
Tokenizer.dictionary
The
Dictionary used to find possible morphemes |
| Modifier and Type | Method and Description |
|---|---|
Dictionary |
Tokenizer.getDictionary() |
Dictionary |
Tokenizer.getDictionary() |
| Constructor and Description |
|---|
Morpheme(Dictionary dictionary,
int partOfSpeechIndex)
Builds a lazy proxy onto a part-of-speech stored in a Dictionary
|
Morpheme(Dictionary dictionary,
int partOfSpeechIndex)
Builds a lazy proxy onto a part-of-speech stored in a Dictionary
|
Tokenizer(Dictionary dictionary,
String unknownPartOfSpeechDescription)
Constructs a new
Tokenizer that uses the specified
Dictionary to find possible morphemes within a given string |
Tokenizer(Dictionary dictionary,
String unknownPartOfSpeechDescription)
Constructs a new
Tokenizer that uses the specified
Dictionary to find possible morphemes within a given string |
| Constructor and Description |
|---|
JapaneseTokenizer(Dictionary dictionary,
String unknownPartOfSpeechDescription)
Creates a JapaneseTokenizer with the given Dictionary
|
JapaneseTokenizer(Dictionary dictionary,
String unknownPartOfSpeechDescription)
Creates a JapaneseTokenizer with the given Dictionary
|