# Uses of Package
org.apache.lucene.analysis.tokenattributes

Packages that use org.apache.lucene.analysis.tokenattributes
Package
Description
org.apache.lucene.analysis.standard
Fast, general-purpose grammar-based tokenizer `StandardTokenizer` implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.
org.apache.lucene.analysis.tokenattributes
General-purpose attributes for text analysis.

Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.standard
Class
Description
CharTermAttribute
The term text of a Token.
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.tokenattributes
Class
Description
BytesTermAttribute
This attribute can be used if you have the raw term bytes to be indexed.
CharTermAttribute
The term text of a Token.
CharTermAttributeImpl
Default implementation of `CharTermAttribute`.
FlagsAttribute
This attribute can be used to pass different flags down the `Tokenizer` chain, e.g.
KeywordAttribute
This attribute can be used to mark a token as a keyword.
OffsetAttribute
The start and end character offset of a Token.
PackedTokenAttributeImpl
Default implementation of the common attributes used by Lucene: `CharTermAttribute` `TypeAttribute` `PositionIncrementAttribute` `PositionLengthAttribute` `OffsetAttribute` `TermFrequencyAttribute`
PayloadAttribute
The payload of a Token.
PayloadAttributeImpl
Default implementation of `PayloadAttribute`.
PositionIncrementAttribute
Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.
PositionLengthAttribute
Determines how many positions this token spans.
SentenceAttribute
This attribute tracks what sentence a given token belongs to as well as potentially other sentence specific attributes.
TermFrequencyAttribute
Sets the custom term frequency of a term within one document.
TermToBytesRefAttribute
This attribute is requested by TermsHashPerField to index the contents.
TypeAttribute
A Token's lexical type.