org.dts.spell.tokenizer

Class AbstractWordTokenizer

java.lang.Object

org.dts.spell.tokenizer.AbstractWordTokenizer

All Implemented Interfaces:

WordTokenizer

Direct Known Subclasses:

DefaultWordTokenizer, FilteredTokenizer, MatcherWordTokenizer

public abstract class AbstractWordTokenizer
extends Object
implements WordTokenizer

Author:

DreamTangerine

Field Summary

Fields inherited from interface org.dts.spell.tokenizer.WordTokenizer

CHANGE_SEQUENCE, DELETE_CHARS, INSERT_CHARS

Constructor Summary

Constructors

Constructor and Description
AbstractWordTokenizer()

Method Summary

Modifier and Type	Method and Description
CharSequence	getCharSequence()
protected boolean	isStartOfSentence(CharSequence sequence, int start)
Word	nextWord(int index) Implementación por defecto.
Word	previousWord(int index) Implementaci�n por defecto.
void	setCharSequence(CharSequence sequence)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dts.spell.tokenizer.WordTokenizer

currentWord, updateCharSequence

Constructor Detail

AbstractWordTokenizer

public AbstractWordTokenizer()

Method Detail

nextWord

public Word nextWord(int index)

Implementación por defecto. No es muy óptima pero es genérica, se basa en currentWord. Es casi obligado reescribirla.

Specified by:

nextWord in interface WordTokenizer

Returns:

the next word.

previousWord

public Word previousWord(int index)

Implementaci�n por defecto. No es muy �ptima pero es gen�rica, se basa en currentWord.

Specified by:

previousWord in interface WordTokenizer

Returns:

the previous word where is index or null.

getCharSequence

public CharSequence getCharSequence()

Specified by:

getCharSequence in interface WordTokenizer

setCharSequence

public void setCharSequence(CharSequence sequence)

Specified by:

setCharSequence in interface WordTokenizer

isStartOfSentence

protected boolean isStartOfSentence(CharSequence sequence,
                                    int start)