Package org.opensearch.index.analysis

Class IcuNormalizerTokenFilterFactory

java.lang.Object

org.opensearch.index.AbstractIndexComponent

org.opensearch.index.analysis.AbstractTokenFilterFactory

org.opensearch.index.analysis.IcuNormalizerTokenFilterFactory

All Implemented Interfaces:

NormalizingTokenFilterFactory, TokenFilterFactory, IndexComponent

public class IcuNormalizerTokenFilterFactory
extends AbstractTokenFilterFactory
implements NormalizingTokenFilterFactory

Uses the ICUNormalizer2Filter to normalize tokens.

The name can be used to provide the type of normalization to perform.

The unicodeSetFilter attribute can be used to provide the UniCodeSet for filtering.

Field Summary

Fields inherited from class org.opensearch.index.AbstractIndexComponent

indexSettings, logger

Fields inherited from interface org.opensearch.index.analysis.TokenFilterFactory

IDENTITY_FILTER

Constructor Summary

Constructors

Constructor	Description
IcuNormalizerTokenFilterFactory(IndexSettings indexSettings, Environment environment, java.lang.String name, Settings settings)

Method Summary

Modifier and Type	Method	Description
org.apache.lucene.analysis.TokenStream	create(org.apache.lucene.analysis.TokenStream tokenStream)

Methods inherited from class org.opensearch.index.analysis.AbstractTokenFilterFactory

name

Methods inherited from class org.opensearch.index.AbstractIndexComponent

getIndexSettings, index

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.opensearch.index.analysis.NormalizingTokenFilterFactory

normalize

Methods inherited from interface org.opensearch.index.analysis.TokenFilterFactory

breaksFastVectorHighlighter, getAnalysisMode, getChainAwareTokenFilterFactory, getSynonymFilter, name

Constructor Detail

IcuNormalizerTokenFilterFactory

public IcuNormalizerTokenFilterFactory(IndexSettings indexSettings,
                                       Environment environment,
                                       java.lang.String name,
                                       Settings settings)

Method Detail

create

public org.apache.lucene.analysis.TokenStream create(org.apache.lucene.analysis.TokenStream tokenStream)

Specified by:

create in interface TokenFilterFactory