buildTokenLookup
function buildTokenLookup(localeCode?): TokenLookup;Defined in: packages/engine/src/lexer/tokenRegistration.ts:47
Build a TokenLookup from locale keywords, known units, and built-in phrases.
Merge order (later overrides earlier):
- Locale keywords (priority 0, lowest, can be overridden by providers)
- Built-in phrases (via locale phraseMap)
- Known units (checked AFTER keyword lookup fails, via unitNames set)
The resulting TokenLookup replaces the internal keyword map, unit set, phrase trie, and phraseStartWords in ExpressionLexer when set via ExpressionLexer.configuredLookup.
Parameters
Section titled “Parameters”| Parameter | Type | Default value | Description |
|---|---|---|---|
localeCode | string | 'en' | The locale code (e.g., “en”, “de”). Defaults to “en”. |
Returns
Section titled “Returns”TokenLookup
A frozen TokenLookup ready for consumption by the lexer.