Package org.opensearch.index.analysis

Class IcuFoldingTokenFilterFactory

java.lang.Object

org.opensearch.index.AbstractIndexComponent

org.opensearch.index.analysis.AbstractTokenFilterFactory

org.opensearch.index.analysis.IcuFoldingTokenFilterFactory

All Implemented Interfaces:

NormalizingTokenFilterFactory, TokenFilterFactory, IndexComponent

public class IcuFoldingTokenFilterFactory
extends AbstractTokenFilterFactory
implements NormalizingTokenFilterFactory

Uses the ICUFoldingFilter. Applies foldings from UTR#30 Character Foldings.

Can be filtered to handle certain characters in a specified way (see http://icu-project.org/apiref/icu4j/com/ibm/icu/text/UnicodeSet.html) E.g national chars that should be retained (filter : "[^åäöÅÄÖ]").

The unicodeSetFilter attribute can be used to provide the UniCodeSet for filtering.

Field Summary

Fields inherited from class org.opensearch.index.AbstractIndexComponent

deprecationLogger, indexSettings, logger

Fields inherited from interface org.opensearch.index.analysis.TokenFilterFactory

IDENTITY_FILTER

Constructor Summary

Constructors

Constructor	Description
IcuFoldingTokenFilterFactory(IndexSettings indexSettings, Environment environment, String name, Settings settings)

Method Summary

Modifier and Type	Method	Description
org.apache.lucene.analysis.TokenStream	create(org.apache.lucene.analysis.TokenStream tokenStream)

Methods inherited from class org.opensearch.index.analysis.AbstractTokenFilterFactory

name

Methods inherited from class org.opensearch.index.AbstractIndexComponent

getIndexSettings, index

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.opensearch.index.analysis.NormalizingTokenFilterFactory

normalize

Methods inherited from interface org.opensearch.index.analysis.TokenFilterFactory

breaksFastVectorHighlighter, getAnalysisMode, getChainAwareTokenFilterFactory, getSynonymFilter, name

Constructor Details

IcuFoldingTokenFilterFactory

public IcuFoldingTokenFilterFactory(IndexSettings indexSettings,
 Environment environment,
 String name,
 Settings settings)

Method Details

create

public org.apache.lucene.analysis.TokenStream create(org.apache.lucene.analysis.TokenStream tokenStream)

Specified by:

create in interface TokenFilterFactory