Elasticsearch:Overview of best practices

This topic provides an overview of the best practices of Alibaba Cloud Elasticsearch in various scenarios. You can view the best practices based on your business requirements.

Scenario	References
Elasticsearch data migration	Data migration between Alibaba Cloud Elasticsearch clusters Use the reindex API to migrate data Use the reindex operation to migrate data in a multi-type index of an earlier version Data migration from a self-managed Elasticsearch cluster Use OSS to migrate data from a self-managed Elasticsearch cluster to an Alibaba Cloud Elasticsearch cluster Use Alibaba Cloud Logstash to migrate data from a self-managed Elasticsearch cluster to an Alibaba Cloud Elasticsearch cluster Use the reindex API to migrate data from a self-managed Elasticsearch cluster to an Alibaba Cloud Elasticsearch cluster Migrate data from a self-managed Elasticsearch cluster to an Alibaba Cloud Elasticsearch cluster deployed in the new network architecture Data migration from third-party Elasticsearch services Migrate data from an Amazon ES domain to an Alibaba Cloud Elasticsearch cluster
Data synchronization from databases	Data synchronization from ApsaraDB RDS for MySQL Select a synchronization method Use DataWorks to synchronize data from a MySQL database to an Alibaba Cloud Elasticsearch cluster Use DTS to dynamically synchronize MySQL data to an Alibaba Cloud Elasticsearch cluster Use Canal to synchronize MySQL data to Alibaba Cloud Elasticsearch Data synchronization from DRDS Use DataWorks to synchronize data from a DRDS database to an Elasticsearch cluster in offline mode Use DTS to synchronize data from a PolarDB for MySQL database to an Alibaba Cloud Elasticsearch cluster Use Monstache to synchronize data from a MongoDB database to an Alibaba Cloud Elasticsearch cluster in real time
Data synchronization from big data cloud services	Use DataWorks to synchronize data from a MaxCompute project to an Alibaba Cloud Elasticsearch cluster Use Realtime Compute to process and synchronize data to an Alibaba Cloud Elasticsearch cluster Use DataWorks to synchronize data from a Hadoop cluster to an Alibaba Cloud Elasticsearch cluster
Data migration from storage services	Migrate documents from a Solr cluster to an Alibaba Cloud Elasticsearch cluster
Use of ES-Hadoop for data synchronization	Use ES-Hadoop to enable Hive to write data to and read data from Alibaba Cloud Elasticsearch Use ES-Hadoop to write HDFS data to Elasticsearch Use ES-Hadoop to enable Apache Spark to write data to and read data from Alibaba Cloud Elasticsearch
Log data collection and analysis	Overview of log synchronization and analysis Use user-created Filebeat to collect MySQL logs Use Alibaba Cloud Elasticsearch and Rsbeat to analyze Redis slow logs in real time
Sever data collection	Overview of best practices for server data collection Data collection for Alibaba Cloud Elasticsearch Use user-created Metricbeat to collect system metrics Use SkyWalking to implement end-to-end monitoring on Elasticsearch Use Uptime to monitor Alibaba Cloud Elasticsearch clusters in real time
Cluster management	Overview of cluster management Hot and cold data separation and lifecycle management Use ILM to manage Heartbeat indexes Use ILM to separate hot data from cold data Application of X-Pack advanced features Use the CCR feature to migrate data Integrate X-Pack with LDAP Use the RBAC mechanism provided by Elasticsearch X-Pack to implement access control Configure AD user authentication Integrated monitoring Use Elastic Stack to implement integrated monitoring for containers in Kubernetes Data management and visualization Use Terraform to manage Alibaba Cloud Elasticsearch clusters Use Curator Use the rollup mechanism to summarize traffic data Use Cerebro to access an Alibaba Cloud Elasticsearch cluster Notification of alerts for clusters Configure a DingTalk chatbot to receive alert notifications from X-Pack Watcher