| Package | Description |
|---|---|
| net.java.sen.dictionary | |
| net.java.sen.tokenizers.ja |
| Modifier and Type | Field and Description |
|---|---|
protected Node |
Tokenizer.bosNode
A
Node representing a beginning-of-string |
protected Node |
Tokenizer.bosNode
A
Node representing a beginning-of-string |
protected Node |
Tokenizer.eosNode
A
Node representing an end-of-string |
protected Node |
Tokenizer.eosNode
A
Node representing an end-of-string |
Node |
Node.lnext
The next
Node returned for the same ending position
within the sentence by the Dictionary |
Node |
Node.lnext
The next
Node returned for the same ending position
within the sentence by the Dictionary |
Node |
Node.next
The next node on the best path through the
Node lattice |
Node |
Node.next
The next node on the best path through the
Node lattice |
Node |
Node.prev
The previous node on the best path through the
Node lattice |
Node |
Node.prev
The previous node on the best path through the
Node lattice |
Node |
Node.rnext
The next
Node returned for the same starting position
within the sentence by the Dictionary |
Node |
Node.rnext
The next
Node returned for the same starting position
within the sentence by the Dictionary |
| Modifier and Type | Method and Description |
|---|---|
Node |
Node.clone() |
Node |
Node.clone() |
Node |
Tokenizer.getBOSNode()
Creates a unique beginning-of-string
Node. |
Node |
Tokenizer.getBOSNode()
Creates a unique beginning-of-string
Node. |
Node |
Tokenizer.getEOSNode()
Creates a unique end-of-string
Node. |
Node |
Tokenizer.getEOSNode()
Creates a unique end-of-string
Node. |
Node |
Tokenizer.getUnknownNode(char[] surface,
int start,
int length,
int span)
Creates an "unknown morpheme"
Node with the specified
characteristics. |
Node |
Tokenizer.getUnknownNode(char[] surface,
int start,
int length,
int span)
Creates an "unknown morpheme"
Node with the specified
characteristics. |
abstract Node |
Tokenizer.lookup(SentenceIterator iterator,
char[] surface)
Searches for possible morphemes from the given SentenceIterator.
|
abstract Node |
Tokenizer.lookup(SentenceIterator iterator,
char[] surface)
Searches for possible morphemes from the given SentenceIterator.
|
| Modifier and Type | Method and Description |
|---|---|
int |
Dictionary.getCost(Node lNode2,
Node lNode,
Node rNode)
Retrieves the cost between three Nodes from the connection cost matrix
|
int |
Dictionary.getCost(Node lNode2,
Node lNode,
Node rNode)
Retrieves the cost between three Nodes from the connection cost matrix
|
| Constructor and Description |
|---|
Token(String surface,
Node node)
Creates a Token from a Node
|
Token(String surface,
Node node)
Creates a Token from a Node
|
| Modifier and Type | Method and Description |
|---|---|
Node |
JapaneseTokenizer.lookup(SentenceIterator iterator,
char[] surface) |
Node |
JapaneseTokenizer.lookup(SentenceIterator iterator,
char[] surface) |