The Alibaba Cloud Elasticsearch (ES) Kernel-enhanced Edition uses the AliES kernel developed by Alibaba Cloud. This kernel improves the performance and stability of ES instances and optimizes costs in various scenarios. We recommend that you use the Kernel-enhanced Edition of Alibaba Cloud ES if you require high write and query performance, improved cluster stability during business fluctuations, and lower storage costs for large data volumes.
Function introduction
The AliES kernel is an independent, cloud-native kernel branch developed by Alibaba Cloud. It is 100% compatible with open source ES features. Built on extensive experience with large-scale applications in various cloud scenarios, the AliES kernel provides comprehensive optimizations for hardware selection, cluster architecture, and the kernel engine.
It provides unique cloud-native architectures for read/write splitting and storage-compute separation. These architectures significantly improve performance and optimize costs for data writing and storage.
It offers many unique and advanced cloud-native features to enhance performance, improve stability, optimize costs, and refine functionality in multiple scenarios. These features help enterprises reduce costs and increase efficiency in the cloud.
The Alibaba Cloud ES Kernel-enhanced Edition includes basic and advanced enhancements:
Basic enhancements: These are provided as free plug-ins. The supported features vary by version. You can install and configure them as needed.
Advanced enhancements: You can enable these features as needed. After they are enabled, you are charged for the traffic and storage resources they generate. For pricing details, see ES billing items.
Basic enhancements
Enhancement category | Feature name | Feature description | Version 7.16 | Version 7.10 | Version 6.7 |
Performance enhancement | Analyticsearch retrieval and analysis | Improves query performance in log scenarios. It accelerates Kibana Discover queries and supports concurrent queries to significantly reduce query time. For more information, see Use the analytic-search plug-in. | × | Supported by kernel version 1.7.0 and later | × |
Physical replication plug-in | Provides an index-level switch for real-time incremental synchronization between primary and replica shards. This greatly reduces cluster CPU overhead and improves write performance by 60%. For more information, see Use the physical replication feature of the apack plug-in. | × | √ | Supported by kernel version 1.2.0 and later | |
Bulk write aggregation plug-in | Aggregates bulk write requests in batches based on a specified request size and time interval. This increases cluster write throughput by 20%. For more information, see Use the bulk aggregation plug-in (faster-bulk). | √ | √ | √ | |
Time-series query pruning | In time-series scenarios, queries crop data by time range. This improves the query performance for ranges on time-series fields by 30%. For more information, see Use the time-series query pruning feature. | √ | √ | √ | |
Stability improvement | QoS throttling plug-in | Implements index-level read/write throttling for the cluster. It downgrades indexes based on specified rules to control cluster read/write traffic and improve stability. For more information, see Use the cluster throttling plug-in (aliyun-qos). | √ | √ | √ |
Cost optimization | Index compression plug-in | Supports multiple compression algorithms, such as Brotli and Zstd, to compress index files. This reduces the index storage size by more than 40%. For more information, see: Versions 7.16 and 7.10: Use the aliyun-codec plug-in Version 6.7 (only for instances created before April 2024): Use the index compression plug-in (beta) (codec-compression) | √ | √ | √ |
Feature optimization | Timestream time-series plug-in | Supports creating, reading, updating, and deleting time-series indexes. It also supports downsample write queries and Prometheus Query Language (PromQL) queries. This greatly reduces the storage and usage costs for time-series data. For more information, see Introduction to the TimeStream time-series enhancement engine. | Supported by kernel version 1.8.0 and later | Supported by kernel version 1.7.0 and later | × |
Aliws tokenizer plug-in | Integrates an analyzer and a tokenizer from Alibaba DAMO Academy's NLP technology. It provides a more comprehensive tokenization dictionary for data retrieval and analysis. For more information, see Use the AliNLP tokenizer plug-in (analysis-aliws). | √ | √ | √ |
Advanced enhancements
Advanced enhancements are only supported by Alibaba Cloud ES version 7.10.
Feature name | Feature description | Billing description |
Indexing Service | Suitable for scenarios with high write transactions per second (TPS), large fluctuations in write traffic, and low queries per second (QPS), such as log retrieval and time-series metric analysis.
For more information, see Introduction to Indexing Service. | You are charged for the actual write traffic. |
Openstore intelligent hybrid storage | Suitable for scenarios that require long-term storage of massive data, have low data query QPS, and have a relatively high tolerance for query latency. Examples include log retrieval, metric analysis, and data archiving.
For more information, see OpenStore intelligent hybrid storage engine. | You are charged for the actual Openstore storage space. |
References
For more information about the open source features of each version, see Version features.
For more information about how to purchase an Alibaba Cloud ES instance, see Create an Alibaba Cloud Elasticsearch instance.