Alibaba Cloud Elasticsearch best practices by scenario - Elasticsearch

Alibaba Cloud Elasticsearch provides best practices for AI search, data ingestion, migration, synchronization, and cluster management.

Scenario	Document
Data ingestion	Host log collection Collect ECS service logs with Filebeat Collect MySQL logs with self-managed Filebeat Collect Apache logs with Filebeat Collect system and Nginx service metrics with Metricbeat Collect system audit data and monitor file changes with Auditbeat Monitor ICMP and HTTP services with Heartbeat Collect Nginx logs with Elastic Agent Collect NetFlow logs with Elastic Agent Collect custom logs with Elastic Agent Application log collection Analyze Redis slow logs in real time with Alibaba Cloud Elasticsearch and Rsbeat Server data collection Collect system metrics with self-managed Metricbeat Use SkyWalking and Elasticsearch to implement end-to-end monitoring Monitor Alibaba Cloud Elasticsearch clusters in real time with Uptime Ingest data to Alibaba Cloud Elasticsearch with a self-managed APM Server Migrate data to Alibaba Cloud Elasticsearch with self-managed Logstash
Data migration	Data migration between Alibaba Cloud Elasticsearch clusters Migrate data using the Reindex API Migrate multi-type index data from earlier versions using reindex Migrate Elasticsearch roles and Kibana dashboards Migrate data from self-managed Elasticsearch to Alibaba Cloud Elasticsearch Migrate data from a self-managed Elasticsearch cluster to Alibaba Cloud Elasticsearch using the online migration tool Migrate data from a self-managed Elasticsearch cluster to Alibaba Cloud Elasticsearch using Alibaba Cloud Logstash Migrate data from a self-managed Elasticsearch cluster to Alibaba Cloud Elasticsearch using reindex Migrate data using elasticsearch-dump Migrate data from a self-managed Elasticsearch cluster to Alibaba Cloud Elasticsearch over a private connection Synchronize index schemas, templates, or ILM policies using scripts Migrate data from a self-managed Elasticsearch cluster to Alibaba Cloud Elasticsearch in full or incremental mode using Logstash Migrate data from third-party Elasticsearch services to Alibaba Cloud Elasticsearch Migrate Elasticsearch index data from Amazon OpenSearch Service to Alibaba Cloud Elasticsearch Migrate documents from a Solr cluster to Alibaba Cloud Elasticsearch
Data synchronization	ApsaraDB RDS for MySQL Synchronize data from ApsaraDB RDS for MySQL to Elasticsearch using Logstash Synchronize MySQL data to Alibaba Cloud Elasticsearch with DataWorks Use DTS to synchronize data from MySQL to Alibaba Cloud ES in real time Synchronize MySQL data to Alibaba Cloud ES using Canal ApsaraDB RDS for SQL Server Synchronize data from ApsaraDB RDS for SQL Server to Alibaba Cloud ES with DataWorks PolarDB-X Synchronize data from PolarDB-X (DRDS) to Elasticsearch using Logstash Synchronize data from PolarDB-X (DRDS) to Alibaba Cloud ES with DataWorks PolarDB for MySQL Synchronize data from a PolarDB for MySQL database to an Alibaba Cloud Elasticsearch cluster using DTS MongoDB Use Monstache to synchronize data from a MongoDB database to an Alibaba Cloud Elasticsearch cluster in real time MaxCompute Synchronize MaxCompute data to Alibaba Cloud ES with DataWorks Hadoop Synchronize Hadoop data to Alibaba Cloud ES with DataWorks Use ES-Hadoop to enable Hive to write data to and read data from Alibaba Cloud Elasticsearch Use ES-Hadoop to write data from HDFS to Elasticsearch Use ES-Hadoop to enable Apache Spark to write data to and read data from Alibaba Cloud Elasticsearch HBase Synchronize HBase data to Alibaba Cloud ES with DataWorks Log data Process and sync log data to ES using Real-time Computing Data from third-party products Synchronize data from Azure Event Hubs to Elasticsearch using Logstash