# Package org.apache.lucene.analysis.icu.segmentation

package org.apache.lucene.analysis.icu.segmentation
Tokenizer that breaks text into words with the Unicode Text Segmentation algorithm.

Related Packages
Package
Description
org.apache.lucene.analysis.icu
Analysis components based on ICU
org.apache.lucene.analysis.icu.tokenattributes
Additional ICU-specific Attributes for text analysis.
Classes
Class
Description
DefaultICUTokenizerConfig
Default `ICUTokenizerConfig` that is generally applicable to many languages.
ICUTokenizer
Breaks text into words according to UAX #29: Unicode Text Segmentation (http://www.unicode.org/reports/tr29/)
ICUTokenizerConfig
Class that allows for tailored Unicode Text Segmentation on a per-writing system basis.
ICUTokenizerFactory
Factory for `ICUTokenizer`.