Uses of Class
org.apache.lucene.analysis.TokenFilter

Packages that use TokenFilter

Package	Description
org.apache.lucene.analysis	Text analysis.
org.apache.lucene.analysis.ar	Analyzer for Arabic.
org.apache.lucene.analysis.bg	Analyzer for Bulgarian.
org.apache.lucene.analysis.bn	Analyzer for Bengali Language.
org.apache.lucene.analysis.boost	Provides various convenience classes for creating boosts on Tokens.
org.apache.lucene.analysis.br	Analyzer for Brazilian Portuguese.
org.apache.lucene.analysis.cjk	Analyzer for Chinese, Japanese, and Korean, which indexes bigrams.
org.apache.lucene.analysis.ckb	Analyzer for Sorani Kurdish.
org.apache.lucene.analysis.classic	Fast, general-purpose grammar-based tokenizers.
org.apache.lucene.analysis.commongrams	Construct n-grams for frequently occurring terms and phrases.
org.apache.lucene.analysis.compound	A filter that decomposes compound words you find in many Germanic languages into the word parts.
org.apache.lucene.analysis.core	Basic, general-purpose analysis components.
org.apache.lucene.analysis.cz	Analyzer for Czech.
org.apache.lucene.analysis.de	Analyzer for German.
org.apache.lucene.analysis.el	Analyzer for Greek.
org.apache.lucene.analysis.en	Analyzer for English.
org.apache.lucene.analysis.es	Analyzer for Spanish.
org.apache.lucene.analysis.fa	Analyzer for Persian.
org.apache.lucene.analysis.fi	Analyzer for Finnish.
org.apache.lucene.analysis.fr	Analyzer for French.
org.apache.lucene.analysis.ga	Analyzer for Irish.
org.apache.lucene.analysis.gl	Analyzer for Galician.
org.apache.lucene.analysis.hi	Analyzer for Hindi.
org.apache.lucene.analysis.hu	Analyzer for Hungarian.
org.apache.lucene.analysis.hunspell	A Java implementation of Hunspell stemming and spell-checking algorithms (Hunspell), and a stemming TokenFilter (HunspellStemFilter) based on it.
org.apache.lucene.analysis.icu	Analysis components based on ICU
org.apache.lucene.analysis.id	Analyzer for Indonesian.
org.apache.lucene.analysis.in	Analyzer for Indian languages.
org.apache.lucene.analysis.it	Analyzer for Italian.
org.apache.lucene.analysis.ja	Analyzer for Japanese.
org.apache.lucene.analysis.ko	Analyzer for Korean.
org.apache.lucene.analysis.lv	Analyzer for Latvian.
org.apache.lucene.analysis.minhash	MinHash filtering (for LSH).
org.apache.lucene.analysis.miscellaneous	Miscellaneous Tokenstreams.
org.apache.lucene.analysis.ngram	Character n-gram tokenizers and filters.
org.apache.lucene.analysis.no	Analyzer for Norwegian.
org.apache.lucene.analysis.pattern	Set of components for pattern-based (regex) analysis.
org.apache.lucene.analysis.payloads	Provides various convenience classes for creating payloads on Tokens.
org.apache.lucene.analysis.phonetic	Analysis components for phonetic search.
org.apache.lucene.analysis.pt	Analyzer for Portuguese.
org.apache.lucene.analysis.reverse	Filter to reverse token text.
org.apache.lucene.analysis.ru	Analyzer for Russian.
org.apache.lucene.analysis.shingle	Word n-gram filters.
org.apache.lucene.analysis.sinks	TeeSinkTokenFilter.
org.apache.lucene.analysis.snowball	TokenFilter and Analyzer implementations that use a modified version of Snowball stemmers.
org.apache.lucene.analysis.sr	Analyzer for Serbian.
org.apache.lucene.analysis.stempel	Stempel: Algorithmic Stemmer
org.apache.lucene.analysis.sv	Analyzer for Swedish.
org.apache.lucene.analysis.synonym	Analysis components for Synonyms.
org.apache.lucene.analysis.synonym.word2vec	Analysis components for Synonyms using Word2Vec model.
org.apache.lucene.analysis.te	Analyzer for Telugu Language.
org.apache.lucene.analysis.tr	Analyzer for Turkish.
org.apache.lucene.analysis.util	Utility functions for text analysis.
org.apache.lucene.monitor	Monitoring framework
org.apache.lucene.search.highlight	Highlighting search terms.
org.apache.lucene.search.suggest.analyzing	Analyzer based autosuggest.
org.apache.lucene.search.suggest.document	Support for document suggestion
org.apache.lucene.search.uhighlight	The UnifiedHighlighter -- a flexible highlighter that can get offsets from postings, term vectors, or analysis.

Uses of TokenFilter in org.apache.lucene.analysis

Subclasses of TokenFilter in org.apache.lucene.analysis

Modifier and Type	Class	Description
final class	CachingTokenFilter	This class can be used if the token attributes of a TokenStream are intended to be consumed more than once.
class	FilteringTokenFilter	Abstract base class for TokenFilters that may remove tokens.
class	GraphTokenFilter	An abstract TokenFilter that exposes its input stream as a graph
class	LowerCaseFilter	Normalizes token text to lower case.
class	StopFilter	Removes stop words from a token stream.

Uses of TokenFilter in org.apache.lucene.analysis.ar

Subclasses of TokenFilter in org.apache.lucene.analysis.ar

Modifier and Type	Class	Description
final class	ArabicNormalizationFilter	A TokenFilter that applies ArabicNormalizer to normalize the orthography.
final class	ArabicStemFilter	A TokenFilter that applies ArabicStemmer to stem Arabic words..

Uses of TokenFilter in org.apache.lucene.analysis.bg

Subclasses of TokenFilter in org.apache.lucene.analysis.bg

Modifier and Type	Class	Description
final class	BulgarianStemFilter	A TokenFilter that applies BulgarianStemmer to stem Bulgarian words.

Uses of TokenFilter in org.apache.lucene.analysis.bn

Subclasses of TokenFilter in org.apache.lucene.analysis.bn

Modifier and Type	Class	Description
final class	BengaliNormalizationFilter	A TokenFilter that applies BengaliNormalizer to normalize the orthography.
final class	BengaliStemFilter	A TokenFilter that applies BengaliStemmer to stem Bengali words.

Uses of TokenFilter in org.apache.lucene.analysis.boost

Subclasses of TokenFilter in org.apache.lucene.analysis.boost

Modifier and Type	Class	Description
final class	DelimitedBoostTokenFilter	Characters before the delimiter are the "token", those after are the boost.

Uses of TokenFilter in org.apache.lucene.analysis.br

Subclasses of TokenFilter in org.apache.lucene.analysis.br

Modifier and Type	Class	Description
final class	BrazilianStemFilter	A TokenFilter that applies BrazilianStemmer.

Uses of TokenFilter in org.apache.lucene.analysis.cjk

Subclasses of TokenFilter in org.apache.lucene.analysis.cjk

Modifier and Type	Class	Description
final class	CJKBigramFilter	Forms bigrams of CJK terms that are generated from StandardTokenizer or ICUTokenizer.
final class	CJKWidthFilter	A TokenFilter that normalizes CJK width differences: Folds fullwidth ASCII variants into the equivalent basic latin Folds halfwidth Katakana variants into the equivalent kana

Uses of TokenFilter in org.apache.lucene.analysis.ckb

Subclasses of TokenFilter in org.apache.lucene.analysis.ckb

Modifier and Type	Class	Description
final class	SoraniNormalizationFilter	A TokenFilter that applies SoraniNormalizer to normalize the orthography.
final class	SoraniStemFilter	A TokenFilter that applies SoraniStemmer to stem Sorani words.

Uses of TokenFilter in org.apache.lucene.analysis.classic

Subclasses of TokenFilter in org.apache.lucene.analysis.classic

Modifier and Type	Class	Description
class	ClassicFilter	Normalizes tokens extracted with ClassicTokenizer.

Methods in org.apache.lucene.analysis.classic that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	ClassicFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.commongrams

Subclasses of TokenFilter in org.apache.lucene.analysis.commongrams

Modifier and Type	Class	Description
final class	CommonGramsFilter	Construct bigrams for frequently occurring terms while indexing.
final class	CommonGramsQueryFilter	Wrap a CommonGramsFilter optimizing phrase queries by only returning single words when they are not a member of a bigram.

Methods in org.apache.lucene.analysis.commongrams that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	CommonGramsFilterFactory.create(TokenStream input)
TokenFilter	CommonGramsQueryFilterFactory.create(TokenStream input)	Create a CommonGramsFilter and wrap it with a CommonGramsQueryFilter

Uses of TokenFilter in org.apache.lucene.analysis.compound

Subclasses of TokenFilter in org.apache.lucene.analysis.compound

Modifier and Type	Class	Description
class	CompoundWordTokenFilterBase	Base class for decomposition token filters.
class	DictionaryCompoundWordTokenFilter	A TokenFilter that decomposes compound words found in many Germanic languages.
class	HyphenationCompoundWordTokenFilter	A TokenFilter that decomposes compound words found in many Germanic languages.

Methods in org.apache.lucene.analysis.compound that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	HyphenationCompoundWordTokenFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.core

Subclasses of TokenFilter in org.apache.lucene.analysis.core

Modifier and Type	Class	Description
final class	DecimalDigitFilter	Folds all Unicode digits in [:General_Category=Decimal_Number:] to Basic Latin digits (0-9).
final class	FlattenGraphFilter	Converts an incoming graph token stream, such as one from SynonymGraphFilter, into a flat form so that all nodes form a single linear chain with no side paths.
final class	LowerCaseFilter	Normalizes token text to lower case.
final class	StopFilter	Removes stop words from a token stream.
final class	TypeTokenFilter	Removes tokens whose types appear in a set of blocked types from a token stream.
final class	UpperCaseFilter	Normalizes token text to UPPER CASE.

Uses of TokenFilter in org.apache.lucene.analysis.cz

Subclasses of TokenFilter in org.apache.lucene.analysis.cz

Modifier and Type	Class	Description
final class	CzechStemFilter	A TokenFilter that applies CzechStemmer to stem Czech words.

Uses of TokenFilter in org.apache.lucene.analysis.de

Subclasses of TokenFilter in org.apache.lucene.analysis.de

Modifier and Type	Class	Description
final class	GermanLightStemFilter	A TokenFilter that applies GermanLightStemmer to stem German words.
final class	GermanMinimalStemFilter	A TokenFilter that applies GermanMinimalStemmer to stem German words.
final class	GermanNormalizationFilter	Normalizes German characters according to the heuristics of the German2 snowball algorithm.
final class	GermanStemFilter	A TokenFilter that stems German words.

Uses of TokenFilter in org.apache.lucene.analysis.el

Subclasses of TokenFilter in org.apache.lucene.analysis.el

Modifier and Type	Class	Description
final class	GreekLowerCaseFilter	Normalizes token text to lower case, removes some Greek diacritics, and standardizes final sigma to sigma.
final class	GreekStemFilter	A TokenFilter that applies GreekStemmer to stem Greek words.

Uses of TokenFilter in org.apache.lucene.analysis.en

Subclasses of TokenFilter in org.apache.lucene.analysis.en

Modifier and Type	Class	Description
final class	EnglishMinimalStemFilter	A TokenFilter that applies EnglishMinimalStemmer to stem English words.
final class	EnglishPossessiveFilter	TokenFilter that removes possessives (trailing 's) from words.
final class	KStemFilter	A high-performance kstem filter for english.
final class	PorterStemFilter	Transforms the token stream as per the Porter stemming algorithm.

Methods in org.apache.lucene.analysis.en that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	KStemFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.es

Subclasses of TokenFilter in org.apache.lucene.analysis.es

Modifier and Type	Class	Description
final class	SpanishLightStemFilter	A TokenFilter that applies SpanishLightStemmer to stem Spanish words.
final class	SpanishMinimalStemFilter	Deprecated. Use SpanishPluralStemFilter instead.
final class	SpanishPluralStemFilter	A TokenFilter that applies SpanishPluralStemmer to stem Spanish words.

Uses of TokenFilter in org.apache.lucene.analysis.fa

Subclasses of TokenFilter in org.apache.lucene.analysis.fa

Modifier and Type	Class	Description
final class	PersianNormalizationFilter	A TokenFilter that applies PersianNormalizer to normalize the orthography.
final class	PersianStemFilter	A TokenFilter that applies PersianStemmer to stem Persian words.

Uses of TokenFilter in org.apache.lucene.analysis.fi

Subclasses of TokenFilter in org.apache.lucene.analysis.fi

Modifier and Type	Class	Description
final class	FinnishLightStemFilter	A TokenFilter that applies FinnishLightStemmer to stem Finnish words.

Uses of TokenFilter in org.apache.lucene.analysis.fr

Subclasses of TokenFilter in org.apache.lucene.analysis.fr

Modifier and Type	Class	Description
final class	FrenchLightStemFilter	A TokenFilter that applies FrenchLightStemmer to stem French words.
final class	FrenchMinimalStemFilter	A TokenFilter that applies FrenchMinimalStemmer to stem French words.

Uses of TokenFilter in org.apache.lucene.analysis.ga

Subclasses of TokenFilter in org.apache.lucene.analysis.ga

Modifier and Type	Class	Description
final class	IrishLowerCaseFilter	Normalises token text to lower case, handling t-prothesis and n-eclipsis (i.e., that 'nAthair' should become 'n-athair')

Uses of TokenFilter in org.apache.lucene.analysis.gl

Subclasses of TokenFilter in org.apache.lucene.analysis.gl

Modifier and Type	Class	Description
final class	GalicianMinimalStemFilter	A TokenFilter that applies GalicianMinimalStemmer to stem Galician words.
final class	GalicianStemFilter	A TokenFilter that applies GalicianStemmer to stem Galician words.

Uses of TokenFilter in org.apache.lucene.analysis.hi

Subclasses of TokenFilter in org.apache.lucene.analysis.hi

Modifier and Type	Class	Description
final class	HindiNormalizationFilter	A TokenFilter that applies HindiNormalizer to normalize the orthography.
final class	HindiStemFilter	A TokenFilter that applies HindiStemmer to stem Hindi words.

Uses of TokenFilter in org.apache.lucene.analysis.hu

Subclasses of TokenFilter in org.apache.lucene.analysis.hu

Modifier and Type	Class	Description
final class	HungarianLightStemFilter	A TokenFilter that applies HungarianLightStemmer to stem Hungarian words.

Uses of TokenFilter in org.apache.lucene.analysis.hunspell

Subclasses of TokenFilter in org.apache.lucene.analysis.hunspell

Modifier and Type	Class	Description
final class	HunspellStemFilter	TokenFilter that uses hunspell affix rules and words to stem tokens.

Uses of TokenFilter in org.apache.lucene.analysis.icu

Subclasses of TokenFilter in org.apache.lucene.analysis.icu

Modifier and Type	Class	Description
final class	ICUFoldingFilter	A TokenFilter that applies search term folding to Unicode text, applying foldings from UTR#30 Character Foldings.
class	ICUNormalizer2Filter	Normalize token text with ICU's Normalizer2
final class	ICUTransformFilter	A TokenFilter that transforms text with ICU.

Uses of TokenFilter in org.apache.lucene.analysis.id

Subclasses of TokenFilter in org.apache.lucene.analysis.id

Modifier and Type	Class	Description
final class	IndonesianStemFilter	A TokenFilter that applies IndonesianStemmer to stem Indonesian words.

Uses of TokenFilter in org.apache.lucene.analysis.in

Subclasses of TokenFilter in org.apache.lucene.analysis.in

Modifier and Type	Class	Description
final class	IndicNormalizationFilter	A TokenFilter that applies IndicNormalizer to normalize text in Indian Languages.

Uses of TokenFilter in org.apache.lucene.analysis.it

Subclasses of TokenFilter in org.apache.lucene.analysis.it

Modifier and Type	Class	Description
final class	ItalianLightStemFilter	A TokenFilter that applies ItalianLightStemmer to stem Italian words.

Uses of TokenFilter in org.apache.lucene.analysis.ja

Subclasses of TokenFilter in org.apache.lucene.analysis.ja

Modifier and Type	Class	Description
final class	JapaneseBaseFormFilter	Replaces term text with the BaseFormAttribute.
final class	JapaneseCompletionFilter	A TokenFilter that adds Japanese romanized tokens to the term attribute.
final class	JapaneseHiraganaUppercaseFilter	A TokenFilter that normalizes small letters (捨て仮名) in hiragana into normal letters.
final class	JapaneseKatakanaStemFilter	A TokenFilter that normalizes common katakana spelling variations ending in a long sound character by removing this character (U+30FC).
final class	JapaneseKatakanaUppercaseFilter	A TokenFilter that normalizes small letters (捨て仮名) in katakana into normal letters.
class	JapaneseNumberFilter	A TokenFilter that normalizes Japanese numbers (kansūji) to regular Arabic decimal numbers in half-width characters.
final class	JapanesePartOfSpeechStopFilter	Removes tokens that match a set of part-of-speech tags.
final class	JapaneseReadingFormFilter	A TokenFilter that replaces the term attribute with the reading of a token in either katakana or romaji form.

Uses of TokenFilter in org.apache.lucene.analysis.ko

Subclasses of TokenFilter in org.apache.lucene.analysis.ko

Modifier and Type	Class	Description
class	KoreanNumberFilter	A TokenFilter that normalizes Korean numbers to regular Arabic decimal numbers in half-width characters.
final class	KoreanPartOfSpeechStopFilter	Removes tokens that match a set of part-of-speech tags.
final class	KoreanReadingFormFilter	Replaces term text with the ReadingAttribute which is the Hangul transcription of Hanja characters.

Uses of TokenFilter in org.apache.lucene.analysis.lv

Subclasses of TokenFilter in org.apache.lucene.analysis.lv

Modifier and Type	Class	Description
final class	LatvianStemFilter	A TokenFilter that applies LatvianStemmer to stem Latvian words.

Uses of TokenFilter in org.apache.lucene.analysis.minhash

Subclasses of TokenFilter in org.apache.lucene.analysis.minhash

Modifier and Type	Class	Description
class	MinHashFilter	Generate min hash tokens from an incoming stream of tokens.

Uses of TokenFilter in org.apache.lucene.analysis.miscellaneous

Subclasses of TokenFilter in org.apache.lucene.analysis.miscellaneous

Modifier and Type	Class	Description
final class	ASCIIFoldingFilter	This class converts alphabetic, numeric, and symbolic Unicode characters which are not in the first 127 ASCII characters (the "Basic Latin" Unicode block) into their ASCII equivalents, if one exists.
final class	CapitalizationFilter	A filter to apply normal capitalization rules to Tokens.
final class	CodepointCountFilter	Removes words that are too long or too short from the stream.
class	ConditionalTokenFilter	Allows skipping TokenFilters based on the current set of attributes.
class	DateRecognizerFilter	Filters all tokens that cannot be parsed to a date, using the provided DateFormat.
final class	DelimitedTermFrequencyTokenFilter	Characters before the delimiter are the "token", the textual integer after is the term frequency.
final class	DropIfFlaggedFilter	Allows Tokens with a given combination of flags to be dropped.
class	FingerprintFilter	Filter outputs a single token which is a concatenation of the sorted and de-duplicated set of input tokens.
final class	FixBrokenOffsetsFilter	Deprecated. Fix the token filters that create broken offsets in the first place.
final class	HyphenatedWordsFilter	When the plain text is extracted from documents, we will often have many words hyphenated and broken into two lines.
final class	KeepWordFilter	A TokenFilter that only keeps tokens with text contained in the required words.
class	KeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.
final class	KeywordRepeatFilter	This TokenFilter emits each incoming token twice once as keyword and once non-keyword, in other words once with KeywordAttribute.setKeyword(boolean) set to true and once set to false.
final class	LengthFilter	Removes words that are too long or too short from the stream.
final class	LimitTokenCountFilter	This TokenFilter limits the number of tokens while indexing.
final class	LimitTokenOffsetFilter	Lets all tokens pass through until it sees one with a start offset <= a configured limit, which won't pass and ends the stream.
final class	LimitTokenPositionFilter	This TokenFilter limits its emitted tokens to those with positions that are not greater than the configured limit.
final class	PatternKeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.
class	ProtectedTermFilter	A ConditionalTokenFilter that only applies its wrapped filters to tokens that are not contained in a protected set.
final class	RemoveDuplicatesTokenFilter	A TokenFilter which filters out Tokens at the same position and Term text as the previous token in the stream.
final class	ScandinavianFoldingFilter	This filter folds Scandinavian characters åÅäæÄÆ->a and öÖøØ->o.
final class	ScandinavianNormalizationFilter	This filter normalize use of the interchangeable Scandinavian characters æÆäÄöÖøØ and folded variants (aa, ao, ae, oe and oo) by transforming them to åÅæÆøØ.
final class	SetKeywordMarkerFilter	Marks terms as keywords via the KeywordAttribute.
final class	StemmerOverrideFilter	Provides the ability to override any KeywordAttribute aware stemmer with custom dictionary-based stemming.
final class	TrimFilter	Trims leading and trailing whitespace from Tokens in the stream.
final class	TruncateTokenFilter	A token filter for truncating the terms into a specific length.
final class	TypeAsSynonymFilter	Adds the TypeAttribute.type() as a synonym, i.e.
final class	WordDelimiterFilter	Deprecated. Use WordDelimiterGraphFilter instead: it produces a correct token graph so that e.g.
final class	WordDelimiterGraphFilter	Splits words into subwords and performs optional transformations on subword groups, producing a correct token graph so that e.g.

Methods in org.apache.lucene.analysis.miscellaneous that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	WordDelimiterFilterFactory.create(TokenStream input)	Deprecated.
TokenFilter	WordDelimiterGraphFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.ngram

Subclasses of TokenFilter in org.apache.lucene.analysis.ngram

Modifier and Type	Class	Description
final class	EdgeNGramTokenFilter	Tokenizes the given token into n-grams of given size(s).
final class	NGramTokenFilter	Tokenizes the input into n-grams of the given size(s).

Methods in org.apache.lucene.analysis.ngram that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	EdgeNGramFilterFactory.create(TokenStream input)
TokenFilter	NGramFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.no

Subclasses of TokenFilter in org.apache.lucene.analysis.no

Modifier and Type	Class	Description
final class	NorwegianLightStemFilter	A TokenFilter that applies NorwegianLightStemmer to stem Norwegian words.
final class	NorwegianMinimalStemFilter	A TokenFilter that applies NorwegianMinimalStemmer to stem Norwegian words.
final class	NorwegianNormalizationFilter	This filter normalize use of the interchangeable Scandinavian characters æÆäÄöÖøØ and folded variants (ae, oe, aa) by transforming them to åÅæÆøØ.

Uses of TokenFilter in org.apache.lucene.analysis.pattern

Subclasses of TokenFilter in org.apache.lucene.analysis.pattern

Modifier and Type	Class	Description
final class	PatternCaptureGroupTokenFilter	CaptureGroup uses Java regexes to emit multiple tokens - one for each capture group in one or more patterns.
final class	PatternReplaceFilter	A TokenFilter which applies a Pattern to each token in the stream, replacing match occurrences with the specified replacement string.
class	PatternTypingFilter	Set a type attribute to a parameterized value when tokens are matched by any of a several regex patterns.

Uses of TokenFilter in org.apache.lucene.analysis.payloads

Subclasses of TokenFilter in org.apache.lucene.analysis.payloads

Modifier and Type	Class	Description
final class	DelimitedPayloadTokenFilter	Characters before the delimiter are the "token", those after are the payload.
class	NumericPayloadTokenFilter	Assigns a payload to a token based on the TypeAttribute
class	TokenOffsetPayloadTokenFilter	Adds the OffsetAttribute.startOffset() and OffsetAttribute.endOffset() First 4 bytes are the start
class	TypeAsPayloadTokenFilter	Makes the TypeAttribute a payload.

Uses of TokenFilter in org.apache.lucene.analysis.phonetic

Subclasses of TokenFilter in org.apache.lucene.analysis.phonetic

Modifier and Type	Class	Description
final class	BeiderMorseFilter	TokenFilter for Beider-Morse phonetic encoding.
final class	DaitchMokotoffSoundexFilter	Create tokens for phonetic matches based on Daitch–Mokotoff Soundex.
final class	DoubleMetaphoneFilter	Filter for DoubleMetaphone (supporting secondary codes)
final class	PhoneticFilter	Create tokens for phonetic matches.

Uses of TokenFilter in org.apache.lucene.analysis.pt

Subclasses of TokenFilter in org.apache.lucene.analysis.pt

Modifier and Type	Class	Description
final class	PortugueseLightStemFilter	A TokenFilter that applies PortugueseLightStemmer to stem Portuguese words.
final class	PortugueseMinimalStemFilter	A TokenFilter that applies PortugueseMinimalStemmer to stem Portuguese words.
final class	PortugueseStemFilter	A TokenFilter that applies PortugueseStemmer to stem Portuguese words.

Uses of TokenFilter in org.apache.lucene.analysis.reverse

Subclasses of TokenFilter in org.apache.lucene.analysis.reverse

Modifier and Type	Class	Description
final class	ReverseStringFilter	Reverse token string, for example "country" => "yrtnuoc".

Uses of TokenFilter in org.apache.lucene.analysis.ru

Subclasses of TokenFilter in org.apache.lucene.analysis.ru

Modifier and Type	Class	Description
final class	RussianLightStemFilter	A TokenFilter that applies RussianLightStemmer to stem Russian words.

Uses of TokenFilter in org.apache.lucene.analysis.shingle

Subclasses of TokenFilter in org.apache.lucene.analysis.shingle

Modifier and Type	Class	Description
final class	FixedShingleFilter	A FixedShingleFilter constructs shingles (token n-grams) from a token stream.
final class	ShingleFilter	A ShingleFilter constructs shingles (token n-grams) from a token stream.

Uses of TokenFilter in org.apache.lucene.analysis.sinks

Subclasses of TokenFilter in org.apache.lucene.analysis.sinks

Modifier and Type	Class	Description
final class	TeeSinkTokenFilter	This TokenFilter provides the ability to set aside attribute states that have already been analyzed.

Uses of TokenFilter in org.apache.lucene.analysis.snowball

Subclasses of TokenFilter in org.apache.lucene.analysis.snowball

Modifier and Type	Class	Description
final class	SnowballFilter	A filter that stems words using a Snowball-generated stemmer.

Methods in org.apache.lucene.analysis.snowball that return TokenFilter

Modifier and Type	Method	Description
TokenFilter	SnowballPorterFilterFactory.create(TokenStream input)

Uses of TokenFilter in org.apache.lucene.analysis.sr

Subclasses of TokenFilter in org.apache.lucene.analysis.sr

Modifier and Type	Class	Description
final class	SerbianNormalizationFilter	Normalizes Serbian Cyrillic and Latin characters to "bald" Latin.
final class	SerbianNormalizationRegularFilter	Normalizes Serbian Cyrillic to Latin.

Uses of TokenFilter in org.apache.lucene.analysis.stempel

Subclasses of TokenFilter in org.apache.lucene.analysis.stempel

Modifier and Type	Class	Description
final class	StempelFilter	Transforms the token stream as per the stemming algorithm.

Uses of TokenFilter in org.apache.lucene.analysis.sv

Subclasses of TokenFilter in org.apache.lucene.analysis.sv

Modifier and Type	Class	Description
final class	SwedishLightStemFilter	A TokenFilter that applies SwedishLightStemmer to stem Swedish words.
final class	SwedishMinimalStemFilter	A TokenFilter that applies SwedishMinimalStemmer to stem Swedish words.

Uses of TokenFilter in org.apache.lucene.analysis.synonym

Subclasses of TokenFilter in org.apache.lucene.analysis.synonym

Modifier and Type	Class	Description
final class	SynonymFilter	Deprecated. Use SynonymGraphFilter instead, but be sure to also use FlattenGraphFilter at index time (not at search time) as well.
final class	SynonymGraphFilter	Applies single- or multi-token synonyms from a SynonymMap to an incoming TokenStream, producing a fully correct graph output.

Uses of TokenFilter in org.apache.lucene.analysis.synonym.word2vec

Subclasses of TokenFilter in org.apache.lucene.analysis.synonym.word2vec

Modifier and Type	Class	Description
final class	Word2VecSynonymFilter	Applies single-token synonyms from a Word2Vec trained network to an incoming TokenStream.

Uses of TokenFilter in org.apache.lucene.analysis.te

Subclasses of TokenFilter in org.apache.lucene.analysis.te

Modifier and Type	Class	Description
final class	TeluguNormalizationFilter	A TokenFilter that applies TeluguNormalizer to normalize the orthography.
final class	TeluguStemFilter	A TokenFilter that applies TeluguStemmer to stem Telugu words.

Uses of TokenFilter in org.apache.lucene.analysis.tr

Subclasses of TokenFilter in org.apache.lucene.analysis.tr

Modifier and Type	Class	Description
final class	ApostropheFilter	Strips all characters after an apostrophe (including the apostrophe itself).
final class	TurkishLowerCaseFilter	Normalizes Turkish token text to lower case.

Uses of TokenFilter in org.apache.lucene.analysis.util

Subclasses of TokenFilter in org.apache.lucene.analysis.util

Modifier and Type	Class	Description
final class	ElisionFilter	Removes elisions from a TokenStream.

Uses of TokenFilter in org.apache.lucene.monitor

Subclasses of TokenFilter in org.apache.lucene.monitor

Modifier and Type	Class	Description
(package private) final class	SuffixingNGramTokenFilter

Uses of TokenFilter in org.apache.lucene.search.highlight

Subclasses of TokenFilter in org.apache.lucene.search.highlight

Modifier and Type	Class	Description
(package private) final class	LimitTokenOffsetFilter	This is a simplified version of org.apache.lucene.analysis.miscellaneous.LimitTokenOffsetFilter to prevent a dependency on analysis-common.jar.
final class	OffsetLimitTokenFilter	This TokenFilter limits the number of tokens while indexing by adding up the current offset.

Uses of TokenFilter in org.apache.lucene.search.suggest.analyzing

Subclasses of TokenFilter in org.apache.lucene.search.suggest.analyzing

Modifier and Type	Class	Description
final class	SuggestStopFilter	Like StopFilter except it will not remove the last token if that token was not followed by some token separator.

Uses of TokenFilter in org.apache.lucene.search.suggest.document

Subclasses of TokenFilter in org.apache.lucene.search.suggest.document

Modifier and Type	Class	Description
final class	CompletionTokenStream	A ConcatenateGraphFilter but we can set the payload and provide access to config options.
private static final class	ContextSuggestField.PrefixTokenFilter	The ContextSuggestField.PrefixTokenFilter wraps a TokenStream and adds a set prefixes ahead.

Uses of TokenFilter in org.apache.lucene.search.uhighlight

Subclasses of TokenFilter in org.apache.lucene.search.uhighlight

Modifier and Type	Class	Description
private static final class	AnalysisOffsetStrategy.MultiValueTokenStream	Wraps an Analyzer and string text that represents multiple values delimited by a specified character.