This repository has been archived by the owner on Jul 6, 2022. It is now read-only.

Fix reservedKeyword lists and tokenizer priority #20

Open

inferrinizzard opened this issue Nov 2, 2021 · 0 comments

Owner

inferrinizzard commented Nov 2, 2021

Reserved Keyword lists can include the full list of reservedKeywords, but some additional support is required:

dedupe when building complete list
ensure tokenizer priority always matches higher priority categories first

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.