Alibaba Cloud Elasticsearch version comparison - Elasticsearch

Alibaba Cloud provides a variety of Elasticsearch versions. This topic describes the features that are supported in each version. You can select a version based on your business requirements.

Comparison between the Standard Edition and Kernel-enhanced Edition

Alibaba Cloud Elasticsearch offers two editions: Standard Edition and Kernel-enhanced Edition. The two editions support different cluster versions and features.

Item	Standard Edition	Kernel-enhanced Edition
Supported versions	8.9, 8.5, 7.7, 6.8, 6.3, 5.6, and 5.5	7.16, 7.10, and 6.7
Main features	All features provided by open source Elasticsearch are supported. All advanced features of the X-Pack plug-in are provided free of charge.	All features provided by open source Elasticsearch are supported. All advanced features of the X-Pack plug-in are provided free of charge. The optimized kernel AliES is used. This optimizes costs and improves cluster performance and stability in multiple scenarios.
Use scenarios	All use scenarios of Elasticsearch. Examples: information retrieval, search, log analysis, and vector retrieval.	All use scenarios of Elasticsearch. Especially suitable for the following scenarios: Enterprise-level scenarios that require high read and write performance. Log retrieval and analysis scenarios that involve a large number of write requests and a few read requests.
User profiles	Users who are familiar with Elasticsearch and have the ability to optimize cluster performance in various scenarios. Users who have planned their resources.	Users who have high optimization requirements for the write and query performance of clusters. Users who want to reduce the configuration and O&M costs of Elasticsearch in the cloud. Users who want to improve cluster stability in scenarios where workloads fluctuate. Users who want to reduce data storage costs.
Billable items	You are charged based on the specifications, storage space, and number of nodes in your cluster.	You are charged based on the specifications, storage space, and number of nodes in your cluster. The basic and advanced enhancements offered by the AliES kernel are provided free of charge as plug-ins. You can install the plug-ins based on your business requirements.

Open source version features

Both the Standard Edition and Kernel-enhanced Edition support all features provided by open source Elasticsearch. In the two editions, the advanced features of open source Elasticsearch of the Platinum edition are free of charge. This section describes the feature changes in different versions:

Note

V7.16, V7.10, and V6.7 clusters are of the Kernel-enhanced Edition. These clusters use the deeply optimized kernel AliES. This enables the clusters to provide enhancements based on open source features. For more information, see Features supported by the Kernel-enhanced Edition.

8.9

New features:

Mixed sorting of text and vector recall results is supported. For more information, see Reciprocal rank fusion (RRF).
The maximum number of vector dimensions is increased to 2,048. For more information, see Increase max number of vector dims to 2048.
The performance for brute-force searches is improved. For more information, see Improve brute force vector search speed.
Multiple fields can be used at the same time in k-nearest neighbors (k-NN) queries. For more information, see Allow more than one KNN search clause.
The built-in model ELSER is provided. ELSER is short for Elastic Learned Sparse EncodeR. For more information, see ELSER.
Scheduling management of distributed natural language processing (NLP) models is supported. For more information, see Make native inference generally available.
The performance for writing data with primary keys is improved. For more information, see Optimize primary keys.
The query performance of constant keyword fields is improved. For more information, see Skip shards when querying constant keyword fields.
Time series data streams (TSDSs) and the downsampling feature are supported. For more information, see TSDS and Downsample.
The memory for raw text is optimized, and ThreadLocal is removed. For more information, see Remove uses of deprecated LeafReader.

For more information about the feature changes, see What's new in 8.9.

8.5

New features:

HNSW-based vector similarity searches are supported. HNSW is short for Hierarchical Navigable Small World. For more information, see kNN search.
The TSDS feature is supported. For more information, see TSDS.
PyTorch models can be uploaded. For more information, see start-trained-model-deployment.
geo_grid queries are supported. For more information, see Geo-grid query.
Security-related configurations are simplified. For more information, see Start the Elastic Stack with security enabled automatically.
Lucene compression algorithms are improved to reduce index size.
The performance of range queries is enhanced.
Runtime fields of the lookup type are supported. For more information, see lookup-runtime-fields.
random_sampler aggregation is supported. For more information, see Random sampler aggregation.
The heap memory consumption of master nodes and data nodes is reduced.
Mapping types are no longer supported. You can use RESTful API compatibility to use mapping types. For more information, see rest-api-compatibility.
The index protection feature is supported. By default, users whose usernames are elastic can read data only from Elasticsearch built-in indexes.

For more information about the feature changes, see Breaking changes in 8.5.

7.16

New features:

SQL-based cross-cluster searches are supported.
Enrich policies of the range type are supported by ingest pipelines.
Cache is optimized to improve query performance.
Indexes can be added to and removed from data streams.
Cluster UUIDs and names are added to audit logs.

For more information about the feature changes, see Breaking changes in 7.16.

7.10

New features:

The compression of storage fields is improved, which reduces storage costs.
Event Query Language (EQL) is used to improve security.
The default value of search.max_buckets is changed from 10000 to 65535.
Queries that are not case-sensitive are supported. To implement such queries, you must set the optional parameter case_insensitive to true.

For more information about the feature changes, see Breaking changes in 7.10.

7.7

New features:

The default number of shards in the index template is changed from 5 to 1.
Mapping types are removed. You do not need to specify a mapping type when you define a mapping or an index template. For more information, see Removal of mapping types.
By default, a maximum of 10,000 documents can be returned for each request. If more than 10,000 matching documents exist, Elasticsearch returns only 10,000 matching documents. For more information, see track_total_hits 10000 default.
By default, a single data node can store a maximum of 1,000 shards. You can use the cluster.max_shards_per_node parameter to change this limit. For more information, see Cluster Shard Limit.
By default, a maximum of 500 scrolls can be performed. You can use the search.max_open_scroll_context parameter to change this limit. For more information, see Scroll Search Context.
The parent circuit breaker works based on the current memory usage. This is controlled by the indices.breaker.total.use_real_memory parameter. By default, the parent circuit breaker starts to work when the current memory usage reaches 95% of JVM heap memory usage. This indicates that Elasticsearch uses the maximum memory availability to avoid out of memory (OOM) issues. For more information, see Circuit Breaker.
The _all field is removed to improve search performance.
Intervals queries are supported. Elasticsearch searches for and returns documents based on the order and proximity of matching terms.
After the audit logging feature is enabled, audit events are persisted to <clustername>_audit.json in the file system of each node. The audit events cannot be stored in indexes. For more information, see Enabling audit logging.

For more information about the feature changes, see Breaking changes in 7.0.

6.x (6.3, 6.7, and 6.8)

New features:

An index can have only one type, and the _doc type is recommended.
The index lifecycle management (ILM) feature is introduced from V6.6.0 to reduce index O&M costs.
The historical data rollup feature is introduced to help summarize historical data.
Elasticsearch SQL, an X-Pack component, is supported in V6.3 and later. It enables SQL statements to be converted to domain-specific language (DSL) statements. This reduces costs for learning DSL.
The Composite, Parent, and Weighted Avg aggregation functions are supported.

For more information about the feature changes, see Breaking changes in 6.0.

5.x (5.5 and 5.6)

New features:

An index can have multiple types, and custom types are supported.
The STRING data type is replaced by the TEXT or KEYWORD data type.
The values of fields in indexes are changed from not_analyzed or no to true or false.
The DOUBLE data type is replaced by the FLOAT data type to reduce storage costs.
Java High Level REST Client is launched to replace Transport Client.

For more information about the feature changes, see Breaking changes in 5.0.

References

You can view the edition and version of your Alibaba Cloud Elasticsearch cluster on the Basic Information page of the cluster in the Elasticsearch console. For more information, see View the basic information of a cluster.
For information about how to purchase an Alibaba Cloud Elasticsearch cluster, see Create an Alibaba Cloud Elasticsearch cluster.
For information about how to evaluate the specifications and storage capacity of an Alibaba Cloud Elasticsearch cluster, see Evaluate specifications and storage capacity.