This topic describes the big data services supported in each E-MapReduce (EMR) version. You can select a version based on your business requirements.
Version introduction
EMR versions follow the EMR-a.b.c format, where:
a: indicates a major evolution of the technical architecture or core ecosystem. EMR V5.x series and EMR V3.x series are currently supported.
b: indicates that one or more services have been updated.
c: indicates that a compatibility bug has been fixed.
Services supported in each EMR version
Note The version of each service in an EMR cluster is typically the same as its corresponding open source version.
Each EMR version comes pre-installed with fixed service versions. We recommend that you do not modify the service versions. Additionally, services in EMR clusters cannot be upgraded. You must select a cluster based on your requirements for specific service versions.
When you create a cluster, only one version is available for each service. If you need to use multiple versions of a service, such as Spark 2 and Spark 3, you can install the required versions after creating a cluster and evaluate the compatibility and security risks.
In the following tables, a hyphen (-) indicates that the service is not integrated in the EMR version.
EMR V5.x series (based on Hadoop 3.x and Hive 3.x)
EMR V5.18.X and earlier
Service | EMR V5.18.X | EMR V5.17.X | EMR V5.16.X | EMR V5.15.X | EMR V5.14.X | EMR V5.13.X | EMR V5.12.X | EMR V5.11.X |
Hadoop-Common | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 |
HDFS | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 |
OSS-HDFS | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | EMR V5.12.2: 1.0.0 EMR V5.12.0: -
| - |
YARN | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 |
Hive | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 |
Spark 2 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 |
Spark 3 | 3.5.3 | 3.4.2 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 |
Tez | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 |
Trino | 422 | 422 | 422 | 422 | 422 | 422 | 389 | 389 |
Delta Lake | - | 3.0.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 |
Hudi | 0.15.0 | 0.14.0 | 0.14.0 | 0.13.1 | 0.13.1 | 0.13.1 | 0.12.2 | 0.12.2 |
Iceberg | 1.5.0 | 1.5.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 |
JindoData | - | - | - | - | 4.6.11 | 4.6.11 | 4.6.5 | EMR V5.11.1: 4.6.5 EMR V5.11.0: 4.6.4
|
Flume | 1.11.0 | 1.11.0 | 1.11.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 |
Kyuubi | 1.9.2 | 1.7.3 | 1.7.3 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.6.1 |
Knox | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 |
Impala | - | 4.3.0 | 4.3.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 |
OpenLDAP | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 |
Ranger | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 |
Ranger-plugin | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 |
Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 |
DLF-Auth | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 |
Presto | 0.283 | 0.283 | 0.283 | 0.283 | 0.283 | 0.278.3 | 0.278.3 | 0.278.3 |
StarRocks 2 | 2.5.22 | 2.5.22 | 2.5.13 | 2.5.12 | 2.5.12 | 2.5.8 | 2.5.5 | 2.5.1 |
StarRocks 3 | 3.2.11 | 3.2.11 | 3.1.5 | 3.1.2 | 3.1.2 | - | - | - |
ZooKeeper | 3.8.4 | 3.8.4 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 |
Celeborn | 0.5.2 | 0.4.0 | 0.3.2 | 0.3.1 | 0.3.0 | 0.2.2 | 0.2.2 | 0.2.0 |
Flink | 1.17.2 | 1.17.2 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 |
Flink Table Store | - | - | - | - | - | - | - | EMR V5.11.1: 0.3-ali-2 EMR V5.11.0: 0.3-ali
|
HBase | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 |
JindoCache | 6.5.3 | 6.5.3 | 6.2.0 | 6.1.1 | - | - | - | - |
Kudu | - | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 |
Paimon | 1.0-ali-1 | 0.9-ali-7 | 0.7-ali-1 | 0.6-ali-2 | 0.5-ali-1 | 0.5-ali-1 | 0.4-ali-1 | - |
Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 |
ClickHouse | 23.3.13.6 | 23.3.13.6 | 23.3.13.6 | 23.3.13.6 | 23.3.2.37 | 23.3.2.37 | 23.3.2.37 | 22.8.14.53 |
Doris | 2.1.4 | 2.1.4 | 1.2.7 | 1.2.7 | 1.2.4 | 1.2.4 | 1.2.4 | 1.2.1 |
Kafka | - | 2.13_3.6.1 | 2.13_3.6.1 | 2.13_3.6.1 | - | 2.13_3.2.1 | 2.13_3.2.1 | 2.13_3.2.1 |
Kafka Manager | - | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 | - | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 |
EMR V3.x series (based on Hadoop 2.x and Hive 2.x)
EMR V3.52.X and earlier
Service | EMR V3.52.X | EMR V3.51.X | EMR V3.50.X | EMR V3.49.X | EMR V3.48.X | EMR V3.47.X | EMR V3.46.X | EMR V3.45.X |
Hadoop-Common | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 |
HDFS | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 |
OSS-HDFS | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | EMR V3.46.2: 1.0.0 EMR V3.46.0: -
| - |
Hive | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 |
Spark 2 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 |
Spark 3 | 3.4.2 | 3.4.2 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 |
YARN | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 |
Trino | 422 | 422 | 422 | 422 | 422 | 422 | 389 | 389 |
Delta Lake | 3.0.0 | 3.0.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 |
Hudi | 0.15.0 | 0.14.0 | 0.14.0 | 0.13.1 | 0.13.1 | 0.13.1 | 0.12.2 | 0.12.2 |
Iceberg | 1.5.0 | 1.5.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 |
Flume | 1.11.0 | 1.11.0 | 1.11.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 |
Kyuubi | 1.9.2 | 1.7.3 | 1.7.3 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.6.1 |
Tez | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 |
OpenLDAP | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 |
Ranger | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 |
Ranger-plugin | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 |
Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 |
DLF-Auth | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 |
Presto | 0.283 | 0.283 | 0.283 | 0.283 | 0.283 | 0.283 | 0.278.3 | 0.278.3 |
StarRocks 2 | 2.5.22 | 2.5.22 | 2.5.13 | 2.5.12 | 2.5.12 | 2.5.12 | 2.5.5 | 2.4.3 |
StarRocks 3 | 3.2.11 | 3.2.11 | 3.1.5 | 3.1.2 | 3.1.2 | - | - | - |
ZooKeeper | 3.8.4 | 3.8.4 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 |
Knox | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 |
Celeborn | 0.5.2 | 0.4.0 | 0.3.2 | 0.3.1 | 0.3.0 | 0.3.0 | 0.2.2 | 0.2.0 |
Flink | 1.17.2 | 1.17.2 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 |
Flink Table Store | - | - | - | - | - | - | - | EMR V3.45.1: 0.3-ali-2 EMR V3.45.0: 0.3-ali
|
HBase | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 |
JindoCache | 6.5.3 | 6.5.3 | 6.2.0 | 6.1.1 | - | - | - | - |
JindoData | - | - | - | - | 4.6.11 | 4.6.11 | 4.6.5 | EMR V3.45.1: 4.6.5 EMR V3.45.0: 4.6.4
|
Kudu | - | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 |
Paimon | 0.9-ali-7 | 0.9-ali-7 | 0.7-ali-1 | 0.6-ali-2 | 0.5-ali-1 | 0.5-ali-1 | 0.4-ali-1 | - |
Phoenix | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 |
ClickHouse | 23.8.2.7 | 23.8.2.7 | 23.8.2.7 | 23.8.2.7 | 22.8.17.17 | 22.8.17.17 | 22.8.17.17 | 22.8.14.53 |
Doris | 2.1.4 | 2.1.4 | 1.2.7 | 1.2.7 | 1.2.4 | 1.2.4 | 1.2.4 | 1.2.1 |
Kafka | - | 2.12_2.4.1 | 2.12_2.4.1 | 2.12_2.4.1 | - | 2.12_2.4.1 | 2.12_2.4.1 | 2.12_2.4.1 |
Kafka Manager | - | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 | - | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 |