This topic describes the big data services that are supported in each E-MapReduce (EMR) version. You can select a version based on your business requirements.
Version introduction
EMR versions follow the Va.b.c format, where:
a: indicates a major evolution of the technical architecture or core ecosystem. EMR V5.x series and EMR V3.x series are supported.
b: indicates that one or more services are updated.
c: indicates that a compatibility bug is fixed.
Services supported in each EMR version
The version of each service in an EMR cluster is usually the same as that of its corresponding open source version.
Each EMR version is pre-installed with fixed service versions. We recommend that you do not change the service versions. In addition, services in EMR clusters cannot be upgraded. You must select a cluster based on your requirements for specific versions of services.
When you create a cluster, only one version is available for each service. If you want to use multiple versions of a service, such as Spark 2 and Spark 3, you can install the required versions after creating a cluster and evaluate the compatibility and security risks.
In the following tables, a hyphen (
-
) indicates that the service is not integrated in the EMR version.
EMR V5.x series (based on Hadoop 3.x and Hive 3.x)
Service | EMR V5.18.x | EMR V5.17.x | EMR V5.16.x | EMR V5.15.x | EMR V5.14.x | EMR V5.13.x | EMR V5.12.x | EMR V5.11.x |
Hadoop-Common | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 |
3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | |
1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 |
| - | |
3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | 3.2.1 | |
3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | 3.1.3 | |
2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | |
3.5.3 | 3.4.2 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | |
0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | |
422 | 422 | 422 | 422 | 422 | 422 | 389 | 389 | |
- | 3.0.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | |
0.15.0 | 0.14.0 | 0.14.0 | 0.13.1 | 0.13.1 | 0.13.1 | 0.12.2 | 0.12.2 | |
1.5.0 | 1.5.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | |
- | - | - | - | 4.6.11 | 4.6.11 | 4.6.5 |
| |
1.11.0 | 1.11.0 | 1.11.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | |
1.9.2 | 1.7.3 | 1.7.3 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.6.1 | |
1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | |
- | 4.3.0 | 4.3.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | |
2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | |
2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | |
Ranger-plugin | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 |
1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | |
2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | |
0.283 | 0.283 | 0.283 | 0.283 | 0.283 | 0.278.3 | 0.278.3 | 0.278.3 | |
2.5.22 | 2.5.22 | 2.5.13 | 2.5.12 | 2.5.12 | 2.5.8 | 2.5.5 | 2.5.1 | |
3.2.11 | 3.2.11 | 3.1.5 | 3.1.2 | 3.1.2 | - | - | - | |
3.8.4 | 3.8.4 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | |
0.5.2 | 0.4.0 | 0.3.2 | 0.3.1 | 0.3.0 | 0.2.2 | 0.2.2 | 0.2.0 | |
1.17.2 | 1.17.2 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | |
Flink Table Store | - | - | - | - | - | - | - |
|
2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | 2.4.9 | |
6.5.3 | 6.5.3 | 6.2.0 | 6.1.1 | - | - | - | - | |
- | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | |
1.0-ali-1 | 0.9-ali-7 | 0.7-ali-1 | 0.6-ali-2 | 0.5-ali-1 | 0.5-ali-1 | 0.4-ali-1 | - | |
5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | |
23.3.13.6 | 23.3.13.6 | 23.3.13.6 | 23.3.13.6 | 23.3.2.37 | 23.3.2.37 | 23.3.2.37 | 22.8.14.53 | |
2.1.4 | 2.1.4 | 1.2.7 | 1.2.7 | 1.2.4 | 1.2.4 | 1.2.4 | 1.2.1 | |
- | 2.13_3.6.1 | 2.13_3.6.1 | 2.13_3.6.1 | - | 2.13_3.2.1 | 2.13_3.2.1 | 2.13_3.2.1 | |
- | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 | - | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 |
EMR V3.x series (based on Hadoop 2.x and Hive 2.x)
Service | EMR V3.52.x | EMR V3.51.x | EMR V3.50.x | EMR V3.49.x | EMR V3.48.x | EMR V3.47.x | EMR V3.46.x | EMR V3.45.x |
Hadoop-Common | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 |
2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | |
1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 |
| - | |
2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | 2.3.9 | |
2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | 2.4.8 | |
3.4.2 | 3.4.2 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | 3.3.1 | |
2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | 2.8.5 | |
422 | 422 | 422 | 422 | 422 | 422 | 389 | 389 | |
3.0.0 | 3.0.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | |
0.15.0 | 0.14.0 | 0.14.0 | 0.13.1 | 0.13.1 | 0.13.1 | 0.12.2 | 0.12.2 | |
1.5.0 | 1.5.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | |
1.11.0 | 1.11.0 | 1.11.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | |
1.9.2 | 1.7.3 | 1.7.3 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.6.1 | |
0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | 0.10.2 | |
2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | 2.4.46 | |
2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | |
Ranger-plugin | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 |
1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | |
2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | |
0.283 | 0.283 | 0.283 | 0.283 | 0.283 | 0.283 | 0.278.3 | 0.278.3 | |
2.5.22 | 2.5.22 | 2.5.13 | 2.5.12 | 2.5.12 | 2.5.12 | 2.5.5 | 2.4.3 | |
3.2.11 | 3.2.11 | 3.1.5 | 3.1.2 | 3.1.2 | - | - | - | |
3.8.4 | 3.8.4 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | 3.6.3 | |
1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | |
0.5.2 | 0.4.0 | 0.3.2 | 0.3.1 | 0.3.0 | 0.3.0 | 0.2.2 | 0.2.0 | |
1.17.2 | 1.17.2 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | 1.15_vvr_6.0.4 | |
Flink Table Store | - | - | - | - | - | - | - |
|
1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.1 | |
6.5.3 | 6.5.3 | 6.2.0 | 6.1.1 | - | - | - | - | |
- | - | - | - | 4.6.11 | 4.6.11 | 4.6.5 |
| |
- | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | |
0.9-ali-7 | 0.9-ali-7 | 0.7-ali-1 | 0.6-ali-2 | 0.5-ali-1 | 0.5-ali-1 | 0.4-ali-1 | - | |
4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | 4.16.1 | |
23.8.2.7 | 23.8.2.7 | 23.8.2.7 | 23.8.2.7 | 22.8.17.17 | 22.8.17.17 | 22.8.17.17 | 22.8.14.53 | |
2.1.4 | 2.1.4 | 1.2.7 | 1.2.7 | 1.2.4 | 1.2.4 | 1.2.4 | 1.2.1 | |
- | 2.12_2.4.1 | 2.12_2.4.1 | 2.12_2.4.1 | - | 2.12_2.4.1 | 2.12_2.4.1 | 2.12_2.4.1 | |
- | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 | - | 3.0.0.6 | 3.0.0.6 | 3.0.0.6 |