Overview
The general-purpose Chinese text analyzer (chn_standard) tokenizes text based on Chinese semantics. This analyzer is suitable for all industries over the entire network. Search units are the minimum granularity that is used for text analysis. The general-purpose Chinese text analyzer uses search units for text analysis and supports extended analysis. For example, if the value of a field in a document is the Chinese word for "chrysanthemum tea" (juhuacha), the analysis result splits into "juhua" (chrysanthemum), "cha" (tea), and "huacha" (flower tea), where "huacha" is an extended term of "cha."
Example:
Original content: juhuacha (Chinese for "chrysanthemum tea")
Analysis result: juhua cha huachaIntervene in text analysis
If you want to intervene in the analysis result that is returned by the general-purpose Chinese text analyzer, modify the chn_standard.dict dictionary in the advanced settings and then publish the modified version of advanced settings as a new version. An intervention entry is a medium-granularity entry. OpenSearch Vector Search Edition converts the intervention entry into search units when it performs a search. For example, you add "search engine" as an intervention entry to the dictionary. When a user searches for "search engine", OpenSearch Vector Search Edition finds a match in the dictionary and then continues to convert the intervention entry "search engine" into the following terms: "search" and "engine".
Usage notes
-
This analyzer applies only to fields of the TEXT data type. To use the analyzer, set the analyzer to chn_standard when you configure a schema.