If you encounter slow queries when you use an ApsaraDB RDS database, you can synchronize data from the database to an Alibaba Cloud Elasticsearch cluster for data queries and analytics. Alibaba Cloud Elasticsearch is a Lucene-based, distributed, real-time search and analytics engine. It allows you to store, query, and analyze large amounts of datasets in near real time. You can use Data Transmission Service (DTS), Logstash, DataWorks, or Canal to synchronize data from an ApsaraDB RDS database to an Alibaba Cloud Elasticsearch cluster. This topic describes the use scenarios of each method. You can select an appropriate method based on your business requirements.
.), such as .monitoring, .Kibana, and .security. Otherwise, an error may occur in Kibana.
|Use DTS to synchronize data in real time||DTS uses binary logs to synchronize data. You can use DTS to synchronize data within milliseconds, without affecting the source database.||You require a high real-time performance for data synchronization.||
||Use DTS to dynamically synchronize MySQL data to an Alibaba Cloud Elasticsearch cluster|
|Use the logstash-input-jdbc plug-in to synchronize data||You can use the logstash-input-jdbc plug-in to query the data in an ApsaraDB RDS database and migrate the data to an Elasticsearch cluster. During data synchronization, the plug-in uses a round-robin method to identify the latest inserted or updated data in the database on a regular basis. Then, it queries all identified data at a time and migrates the data to an Elasticsearch cluster. The logstash-input-jdbc plug-in provides lower real-time performance than DTS. Data is synchronized within seconds.||
|Use DataWorks to synchronize offline data||DataWorks is a comprehensive service that provides modules such as Data Integration, DataStudio, and Data Quality. You can use DataWorks to import and store structured data, convert and develop the data, and then synchronize the processed data to Elasticsearch clusters or other data systems.||
||Use DataWorks to synchronize MySQL data to Elasticsearch|
|Use Canal to synchronize MySQL data||You can use binary logs to synchronize and subscribe to data in real time.||You require a high real-time performance for data synchronization.||
||Use Canal to synchronize MySQL data to Alibaba Cloud Elasticsearch|