AnalyzedTokenInfo interface
Information about a token returned by an analyzer.
Properties
| end |
The index of the last character of the token in the input text. |
| position | The position of the token in the input text relative to other tokens. The first token in the input text has position 0, the next has position 1, and so on. Depending on the analyzer used, some tokens might have the same position, for example if they are synonyms of each other. |
| start |
The index of the first character of the token in the input text. |
| token | The token returned by the analyzer. |
Property Details
endOffset
The index of the last character of the token in the input text.
endOffset: numberProperty Value
number
position
The position of the token in the input text relative to other tokens. The first token in the input text has position 0, the next has position 1, and so on. Depending on the analyzer used, some tokens might have the same position, for example if they are synonyms of each other.
position: numberProperty Value
number
startOffset
The index of the first character of the token in the input text.
startOffset: numberProperty Value
number
token
The token returned by the analyzer.
token: stringProperty Value
string