Overview
You can manage dictionary configurations in table configurations to use custom tokenizers. If the result of splitting a query by using the default tokenizer cannot meet your business requirements, you can configure the custom dictionary of the corresponding tokenizer to intervene in the tokenization result.
By default, the system provides the dictionary configuration V1, which contains eight types of tokenizer dictionaries. The following table describes the tokenizer dictionaries.
Dictionary type |
General-purpose Chinese text analyzer.dict |
Chinese e-commerce content analyzer of the general-purpose edition.dict |
Chinese game content analyzer of the general-purpose edition.dict |
Chinese education content analyzer.dict |
Chinese entertainment content analyzer.dict |
English e-commerce content analyzer of the general-purpose edition.dict |
Chinese IT content analyzer.dict |
Chinese e-commerce content analyzer.dict |
View custom intervention entries
In the left-side navigation pane, choose Configuration Management > Table Configuration. On the Table Configuration page, click the Dictionary Configurations tab. On the Dictionary Configurations tab, find the dictionary configuration version that you want to view and click View in the Actions column.