Uses of Class
org.apache.lucene.analysis.TokenizerFactory

Packages that use TokenizerFactory

Package	Description
org.apache.lucene.analysis	Text analysis.
org.apache.lucene.analysis.classic	Fast, general-purpose grammar-based tokenizers.
org.apache.lucene.analysis.cn.smart	Analyzer for Simplified Chinese, which indexes words.
org.apache.lucene.analysis.core	Basic, general-purpose analysis components.
org.apache.lucene.analysis.custom	A general-purpose Analyzer that can be created with a builder-style API.
org.apache.lucene.analysis.email	Fast, general-purpose URLs and email addresses tokenizers.
org.apache.lucene.analysis.icu.segmentation	Tokenizer that breaks text into words with the Unicode Text Segmentation algorithm.
org.apache.lucene.analysis.ja	Analyzer for Japanese.
org.apache.lucene.analysis.ko	Analyzer for Korean.
org.apache.lucene.analysis.ngram	Character n-gram tokenizers and filters.
org.apache.lucene.analysis.path	Analysis components for path-like strings such as filenames.
org.apache.lucene.analysis.pattern	Set of components for pattern-based (regex) analysis.
org.apache.lucene.analysis.standard	Fast, general-purpose grammar-based tokenizer StandardTokenizer implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.
org.apache.lucene.analysis.synonym	Analysis components for Synonyms.
org.apache.lucene.analysis.th	Analyzer for Thai.
org.apache.lucene.analysis.wikipedia	Tokenizer that is aware of Wikipedia syntax.

Uses of TokenizerFactory in org.apache.lucene.analysis

Fields in org.apache.lucene.analysis with type parameters of type TokenizerFactory

Modifier and Type	Field	Description
private static final AnalysisSPILoader<TokenizerFactory>	TokenizerFactory.Holder.LOADER

Methods in org.apache.lucene.analysis that return TokenizerFactory

Modifier and Type	Method	Description
static TokenizerFactory	TokenizerFactory.forName(String name, Map<String,String> args)	looks up a tokenizer by name from context classpath

Methods in org.apache.lucene.analysis that return types with arguments of type TokenizerFactory

Modifier and Type	Method	Description
(package private) static AnalysisSPILoader<TokenizerFactory>	TokenizerFactory.Holder.getLoader()
static Class<? extends TokenizerFactory>	TokenizerFactory.lookupClass(String name)	looks up a tokenizer class by name from context classpath

Method parameters in org.apache.lucene.analysis with type arguments of type TokenizerFactory

Modifier and Type	Method	Description
static String	TokenizerFactory.findSPIName(Class<? extends TokenizerFactory> serviceClass)	looks up a SPI name for the specified tokenizer factory

Uses of TokenizerFactory in org.apache.lucene.analysis.classic

Subclasses of TokenizerFactory in org.apache.lucene.analysis.classic

Modifier and Type	Class	Description
class	ClassicTokenizerFactory	Factory for ClassicTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.cn.smart

Subclasses of TokenizerFactory in org.apache.lucene.analysis.cn.smart

Modifier and Type	Class	Description
final class	HMMChineseTokenizerFactory	Factory for HMMChineseTokenizer

Uses of TokenizerFactory in org.apache.lucene.analysis.core

Subclasses of TokenizerFactory in org.apache.lucene.analysis.core

Modifier and Type	Class	Description
class	KeywordTokenizerFactory	Factory for KeywordTokenizer.
class	LetterTokenizerFactory	Factory for LetterTokenizer.
class	WhitespaceTokenizerFactory	Factory for WhitespaceTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.custom

Fields in org.apache.lucene.analysis.custom declared as TokenizerFactory

Modifier and Type	Field	Description
private final TokenizerFactory	CustomAnalyzer.tokenizer

Fields in org.apache.lucene.analysis.custom with type parameters of type TokenizerFactory

Modifier and Type	Field	Description
private final SetOnce<TokenizerFactory>	CustomAnalyzer.Builder.tokenizer

Methods in org.apache.lucene.analysis.custom that return TokenizerFactory

Modifier and Type	Method	Description
TokenizerFactory	CustomAnalyzer.getTokenizerFactory()	Returns the tokenizer that is used in this analyzer.

Method parameters in org.apache.lucene.analysis.custom with type arguments of type TokenizerFactory

Modifier and Type	Method	Description
CustomAnalyzer.Builder	CustomAnalyzer.Builder.withTokenizer(Class<? extends TokenizerFactory> factory, String... params)	Uses the given tokenizer.
CustomAnalyzer.Builder	CustomAnalyzer.Builder.withTokenizer(Class<? extends TokenizerFactory> factory, Map<String,String> params)	Uses the given tokenizer.

Constructors in org.apache.lucene.analysis.custom with parameters of type TokenizerFactory

Modifier	Constructor	Description
(package private)	CustomAnalyzer(CharFilterFactory[] charFilters, TokenizerFactory tokenizer, TokenFilterFactory[] tokenFilters, Integer posIncGap, Integer offsetGap)

Uses of TokenizerFactory in org.apache.lucene.analysis.email

Subclasses of TokenizerFactory in org.apache.lucene.analysis.email

Modifier and Type	Class	Description
class	UAX29URLEmailTokenizerFactory	Factory for UAX29URLEmailTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.icu.segmentation

Subclasses of TokenizerFactory in org.apache.lucene.analysis.icu.segmentation

Modifier and Type	Class	Description
class	ICUTokenizerFactory	Factory for ICUTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.ja

Subclasses of TokenizerFactory in org.apache.lucene.analysis.ja

Modifier and Type	Class	Description
class	JapaneseTokenizerFactory	Factory for JapaneseTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.ko

Subclasses of TokenizerFactory in org.apache.lucene.analysis.ko

Modifier and Type	Class	Description
class	KoreanTokenizerFactory	Factory for KoreanTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.ngram

Subclasses of TokenizerFactory in org.apache.lucene.analysis.ngram

Modifier and Type	Class	Description
class	EdgeNGramTokenizerFactory	Creates new instances of EdgeNGramTokenizer.
class	NGramTokenizerFactory	Factory for NGramTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.path

Subclasses of TokenizerFactory in org.apache.lucene.analysis.path

Modifier and Type	Class	Description
class	PathHierarchyTokenizerFactory	Factory for PathHierarchyTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.pattern

Subclasses of TokenizerFactory in org.apache.lucene.analysis.pattern

Modifier and Type	Class	Description
class	PatternTokenizerFactory	Factory for PatternTokenizer.
class	SimplePatternSplitTokenizerFactory	Factory for SimplePatternSplitTokenizer, for producing tokens by splitting according to the provided regexp.
class	SimplePatternTokenizerFactory	Factory for SimplePatternTokenizer, for matching tokens based on the provided regexp.

Uses of TokenizerFactory in org.apache.lucene.analysis.standard

Subclasses of TokenizerFactory in org.apache.lucene.analysis.standard

Modifier and Type	Class	Description
class	StandardTokenizerFactory	Factory for StandardTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.synonym

Methods in org.apache.lucene.analysis.synonym that return TokenizerFactory

Modifier and Type	Method	Description
private TokenizerFactory	SynonymFilterFactory.loadTokenizerFactory(ResourceLoader loader, String cname)	Deprecated.
private TokenizerFactory	SynonymGraphFilterFactory.loadTokenizerFactory(ResourceLoader loader, String cname)

Uses of TokenizerFactory in org.apache.lucene.analysis.th

Subclasses of TokenizerFactory in org.apache.lucene.analysis.th

Modifier and Type	Class	Description
class	ThaiTokenizerFactory	Factory for ThaiTokenizer.

Uses of TokenizerFactory in org.apache.lucene.analysis.wikipedia

Subclasses of TokenizerFactory in org.apache.lucene.analysis.wikipedia

Modifier and Type	Class	Description
class	WikipediaTokenizerFactory	Factory for WikipediaTokenizer.