Type Alias TokenizerCallback

TokenizerCallback: (value: string) => QueryToken[]

Callback for tokenizing a value into a list of string tokens.

Type Declaration

- (value: string): QueryToken[]
- Parameters
  - value: string
    The value to tokenize.
  Returns QueryToken[]
  An array of tokens.