Options
All
  • Public
  • Public/Protected
  • All
Menu

Interface TokenDictRule

An object defining a single tokenizaion rule.

Hierarchy

  • TokenDictRule

Index

Properties

Properties

part_of_speech

part_of_speech: string

The part of speech that the text string belongs to. For example noun. Custom parts of speech can be specified.

Optional readings

readings: string[]

Array of tokens that represent the content of the text field in an alternate character set.

text

text: string

The string to tokenize.

tokens

tokens: string[]

Array of tokens that the text field is split into when found.

Generated using TypeDoc