Use the analysis-ik plug-in

Prerequisites

Your Elasticsearch cluster is in a normal state. You can check the cluster status on the Basic Information page.

Perform a standard update for IK dictionaries

1. Log on to the Alibaba Cloud Elasticsearch console.
2. In the top navigation bar, select the region where your cluster resides.
3. In the left-side navigation pane, click Elasticsearch Clusters. On the page that appears, find the target cluster and click its ID in the Cluster ID/Name column.
4. In the left-side navigation pane, click Plug-ins.
5. On the Built-in Plug-ins tab, find the analysis-ik plug-in and click Standard Update in the Actions column.
   
6. In the Standard Update pane, click Configure in the lower-right corner.
7. Select a method to upload a dictionary file from the drop-down list that is below the IK Main Dictionary section. Then, upload the dictionary file based on the following instructions.
   

   You can select the Upload DIC File or Add OSS File method.

   • Upload DIC File: If you select this method, click Upload DIC File and select the local file that you want to upload.
   • Add OSS File: If you select this method, specify Bucket Name and File Name, and click Add.

     Make sure that the bucket resides in the same region as your Elasticsearch cluster and the file to upload is a DIC file. If the content of the dictionary that is stored in OSS changes, you must manually upload the dictionary file again.

   Warning The following operation restarts your Elasticsearch cluster. Before you perform this operation, make sure that the restart does not affect your business.
8. Scroll down to the lower part of the pane, select This operation will restart the cluster. Continue?, and click Save.
   If you choose the standard update method, the system restarts your cluster no matter whether you upload a new dictionary file, remove a dictionary file, or update dictionary content.
9. After the cluster is restarted, log on to the Kibana console of the cluster and run the following command to check whether the new dictionary file takes effect.
   Note For more information about how to log on to the Kibana console, see Log on to the Kibana console.

   GET _analyze
   {
   "analyzer": "ik_smart",
   "text": ["Tokens in the new dictionary file"]
   }

Perform a rolling update for IK dictionaries

1. On the Built-in Plug-ins tab, find the analysis-ik plug-in and click Rolling Update in the Actions column.
   
2. In the Rolling Update pane, click Configure in the lower-right corner.
3. Select a method to upload a dictionary file from the drop-down list that is below the IK Main Dictionary section. Then, upload the dictionary file based on the following instructions.
   

   Note You cannot use the rolling update method to modify the built-in main dictionary. If you want to modify the built-in main dictionary, use the standard update method.

   You can select the Upload DIC File or Add OSS File method.

   • Upload DIC File: If you select this method, click Upload DIC File and select the local file that you want to upload.
   • Add OSS File: If you select this method, specify Bucket Name and File Name, and click Add.

     Make sure that the bucket resides in the same region as your Elasticsearch cluster and the file to upload is a DIC file. The dic_0.dic file is used in the following operations. If the content of the dictionary that is stored in OSS changes, you must manually upload the dictionary file again.

   Warning The following operation restarts your Elasticsearch cluster. Before you perform this operation, make sure that the restart does not affect your business.
4. Scroll down to the lower part of the pane, select This operation will restart the instance. Continue?, and click Save. If this is the first time that you upload a dictionary file, the system automatically restarts the cluster.

   After you click Save, the system performs a rolling update for the cluster. After the rolling update is completed, the new dictionary takes effect.

   If you want to add or remove tokens from dictionaries, perform the following steps to modify the dic_0.dic file:

5. In the Rolling Update pane, delete the existing dic_0.dic file and upload a new dictionary file. The new dictionary file must have the same name.
   This operation changes the content of the existing dictionary file in the cluster and uploads a new file that has the same name. The system does not need to restart the cluster for the update to take effect.
6. Click Save.
   The analysis-ik plug-in on the nodes of the Elasticsearch cluster automatically loads the dictionary file. The time that is required by each node to load the dictionary file varies. It requires about two minutes for all nodes to load the dictionary file. You can log on to the Kibana console of the Elasticsearch cluster and run the following command multiple times to verify the new dictionary file.

   Note For more information about how to log on to the Kibana console, see Log on to the Kibana console.

   GET _analyze
   {
   "analyzer": "ik_smart",
   "text": ["Tokens in the new dictionary file"]
   }

Configure a stopword list

Alibaba Cloud Elasticsearch provides a built-in stopword list. The list contains the following predefined tokens: a, an, and, are, as, at, be, but, by, for, if, in, into, is, it, no, not, of, on, or, such, that, the, their, then, there, these, they, this, to, was, will, with.

You can perform the following steps to remove tokens from the stopword list:

1. Download the default IK configuration file from the official website of open source Elasticsearch.
2. Decompress the downloaded package and open the stopword.dic dictionary file in the config folder.
3. Remove the tokens that you no longer require and save the dictionary file.
4. Change the name of the stopword.dic dictionary file to SYSTEM_STOPWORD.dic.
5. Upload the SYSTEM_STOPWORD.dic file to your Elasticsearch cluster. The file automatically overwrites the existing stopword list.
6. After the cluster is restarted, the new stopword list takes effect.