Module org.apache.lucene.analysis.smartcn

Package org.apache.lucene.analysis.cn.smart.hhmm

Class HHMMSegmenter

java.lang.Object

org.apache.lucene.analysis.cn.smart.hhmm.HHMMSegmenter

public class HHMMSegmenter
extends Object

Finds the optimal segmentation of a sentence into Chinese words

Field Summary

Fields

Modifier and Type	Field	Description
private static WordDictionary	wordDict

Constructor Summary

Constructors

Constructor	Description
HHMMSegmenter()

Method Summary

Modifier and Type	Method	Description
private SegGraph	createSegGraph(String sentence)	Create the SegGraph for a sentence.
private static int[]	getCharTypes(String sentence)	Get the character types for every character in a sentence.
List<SegToken>	process(String sentence)	Return a list of SegToken representing the best segmentation of a sentence

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

wordDict

private static WordDictionary wordDict

Constructor Details

HHMMSegmenter

public HHMMSegmenter()

Method Details

createSegGraph

private SegGraph createSegGraph(String sentence)

Create the SegGraph for a sentence.

Parameters:

sentence - input sentence, without start and end markers

Returns:

SegGraph corresponding to the input sentence.

getCharTypes

private static int[] getCharTypes(String sentence)

Get the character types for every character in a sentence.

Parameters:

sentence - input sentence

Returns:

array of character types corresponding to character positions in the sentence

See Also:

• Utility.getCharType(char)

process

public List<SegToken> process(String sentence)

Return a list of SegToken representing the best segmentation of a sentence

Parameters:

sentence - input sentence

Returns:

best segmentation as a List