This topic describes the version number format, version update records, and version release notes of E-MapReduce.

Version number format

E-MapReduce version numbers follow the a.b.c format. The details are as follows:

  • Letter a indicates that major changes have been made in the new version.
  • Letter b indicates that minor changes have been made to some components in the new version.
  • Letter c indicates that the new version has fixed several bugs and is forward compatible.

The following section describes the version number changes in version upgrades:

  • Upgrade from version 1.0.0 to 2.0.0: The value of letter a changes, indicating that major changes have been made in the new version. You must test that all existing jobs can run normally after the upgrade.
  • Upgrade from version 1.0.0 to 1.1.0: The value of letter b changes, indicating that minor changes have been made to some components in the new version. Most features remain unchanged after the upgrade. However, we recommend that you conduct a test to verify the upgrade.
  • Upgrade from version 1.0.0 to 1.0.1: The value of letter c changes, indicating that the new version is fully compatible with the previous version.

The bundled software, cluster creation, and cluster upgrade of each E-MapReduce release are described as follows:

  • Bundled software: The software and software version are fixed in each release of E-MapReduce. Currently, E-MapReduce does not support choosing different versions of software. We recommend that you do not change the software version.
  • Cluster creation: After you select a version of E-MapReduce and create a cluster with it, the cluster version is not upgraded automatically. Subsequent upgrades to the image used by this version will not affect clusters that have been created. However, the latest image will be used to create new clusters.
  • Cluster upgrade: When you upgrade the version of your cluster (for example, from version 1.0.x to 1.1.x), you must test that the existing jobs in the cluster can run normally in the new software environment.

Version update records

  • EMR-3.19.0 to EMR-3.22.0
    Version EMR-3.19.0 EMR-3.19.1 EMR-3.20.0 EMR-3.21.0 EMR-3.22.0
    Release time 2019.3 2019.4 2019.5 2019.6 2019.7
    Hadoop 2.8.5 2.8.5 2.8.5 2.8.5 2.8.5
    Knox 1.1.0 1.1.0 1.1.0 1.1.0 1.1.0
    ApacheDS 2.0.0 2.0.0 2.0.0 2.0.0 2.0.0
    Spark 2.4.1 2.4.1 2.4.2 2.4.3 2.4.3
    Hive 3.1.1 3.1.1 3.1.1 3.1.1 3.1.1
    Tez 0.9.1 0.9.1 0.9.1 0.9.1 0.9.1
    Pig 0.14.0 0.14.0 0.14.0 0.14.0 0.14.0
    Sqoop 1.4.7 1.4.7 1.4.7 1.4.7 1.4.7
    YARN 2.8.5 2.8.5 2.8.5 2.8.5 2.8.5
    HDFS 2.8.5 2.8.5 2.8.5 2.8.5 2.8.5
    Flink 1.7.2 1.7.2 1.7.2 1.7.2 1.7.2
    Druid 0.13.0 0.13.0 0.13.0 0.14.2 0.14.2
    HBase 1.4.9 1.4.9 1.4.9 1.4.9 1.4.9
    Phoenix 4.14.1 4.14.1 4.14.1 4.14.1 4.14.1
    Zookeeper 3.4.13 3.4.13 3.4.13 3.4.13 3.5.5
    Livy 0.60 0.60 0.60 0.60 0.60
    Presto 0.213 0.213 0.213 0.213 0.221
    Storm 1.2.2 1.2.2 1.2.2 1.2.2 1.2.2
    Impala 2.12.2 2.12.2 2.12.2 2.12.2 2.12.2
    Flume 1.8.0 1.8.0 1.8.0 1.8.0 1.8.0
    Hue 4.1.0 4.1.0 4.1.0 4.4.0 4.4.0
    Oozie 4.2.0 4.2.0 5.1.0 5.1.0 5.1.0
    Zeppelin 0.8.0 0.8.0 0.8.1 0.8.1 0.8.1
    Ranger 1.2.0 1.2.0 1.2.0 1.2.0 1.2.0
    Ganglia 3.7.2 3.7.2 3.7.2 3.7.2 3.7.2
    OS CentOS 7.4 CentOS 7.4 CentOS 7.4 CentOS 7.4 CentOS 7.4
    Tensorflow - - 1.8.0 1.8.0 1.8.0
    Kafka 2.11-1.1.1 1.1.1 2.11 1.1.1 1.1.1
    Superset 0.28.1 0.28.1 0.28.1 0.28.1 0.28.1
    Jupyter - - 4.4.0 4.4.0 4.4.0
    Analytics Zoo - - 0.2.0 0.5.0 0.5.0
    Bigboot - - 1.0.0 1.0.0 2.0.0
    OpenLDAP - - - - 2.4.44
    Kudu - - - - 1.10.0
  • EMR-3.15.0 to EMR-3.18.1
    Version EMR-3.15.0 EMR-3.16.0 EMR-3.17.0 EMR-3.18.1
    Release time 2018.11 2018.12 2019.1 2019.2
    Hadoop 2.7.2 2.7.2-1.3.2 2.7.2 2.8.5
    Knox 0.13.0 0.13.0 1.1.0 1.1.0
    ApacheDS 2.0.0 2.0.0 2.0.0 2.0.0
    Spark 2.3.2 2.3.2-1.0.1 2.3.2 2.3.2
    Hive 2.3.3 2.3.3-1.0.3 2.3.3 3.1.1
    Tez 0.9.1 0.9.1-1.0.2 0.9.1 0.9.1
    Pig 0.14.0 0.14.0 0.14.0 0.14.0
    Sqoop 1.4.7 1.4.7-1.0.0 1.4.7 1.4.7
    YARN 2.7.2 2.7.2 2.7.2 2.8.5
    HDFS 2.7.2 2.7.2 2.7.2 2.8.5
    Flink 1.4.0 1.6.2-1.0.0 1.6.2 1.6.2
    Druid 0.12.3 0.12.3-1.0.1 0.12.3 0.13.0
    HBase 1.1.1 1.1.1-1.0.2 1.1.1 1.4.9
    Phoenix 4.10.0 4.10.0-1.0.0 4.10.0 4.14.1
    Zookeeper 3.4.13 3.4.13 3.4.13 3.4.13
    Livy 0.50. 0.50. 0.50. 0.60.
    Presto 0.208 0.208 0.213 0.213
    Storm 1.1.2 1.2.2 1.2.2 1.2.2
    Impala 2.10.0 2.10.0-1.0.0 2.12.2 2.12.2
    Flume 1.8.0 1.8.0 1.8.0
    Hue 4.1.0 4.1.0 4.1.0 4.1.0
    Oozie 4.2.0 4.2.0 4.2.0 4.2.0
    Zeppelin 0.8.0 0.8.0 0.8.0 0.8.0
    Ranger 1.0.0 1.0.0 1.0.0 1.0.0
    Ganglia 3.7.2 3.7.2 3.7.2 3.7.2
    OS CentOS 7.4 CentOS 7.4 CentOS 7.4 CentOS 7.4
    Tensorflow 1.8.0 1.8.0 1.8.0 -
    Kafka 2.11-1.0.1 2.11-1.1.0 2.11-1.1.1 2.11-1.1.1
    Superset 0.27.0 0.28.1 0.28.1 0.28.1
    Jupyter 4.4.0 4.4.0 4.4.0 -
    Analytics Zoo 0.2.0 0.2.0 0.2.0 -
  • EMR3.11.0 to EMR-3.14.0
    Version EMR-3.11.0 EMR-3.12.0 EMR-3.13.0 EMR-3.14.0
    Release time 2018.6 2018.7 2018.8 2018.10
    Hadoop 2.7.2-emr-1.2.14 2.7.2-emr-1.2.14 2.7.2 2.7.2
    Knox 0.13.0 0.13.0 0.13.0 0.13.0
    ApacheDS 2.0.0 2.0.0 2.0.0 2.0.0
    Spark 2.2.1 2.3.1 2.3.1 2.3.1
    Hive 2.3.3 2.3.3 2.3.3 2.3.3
    Tez 0.9.1 0.9.1 0.9.1 0.9.1
    Pig 0.14.0 0.14.0 0.14.0 0.14.0
    Sqoop 1.4.6 1.4.7 1.4.7 1.4.7
    YARN 2.7.2 2.7.2 2.7.2 2.7.2
    HDFS 2.7.2 2.7.2 2.7.2 2.7.2
    Flink 1.4.0 1.4.0 1.4.0 1.4.0
    Druid 0.11.0 0.12.0 0.12.2 0.12.3
    HBase 1.1.1 1.1.1 1.1.1 1.1.1
    Phoenix 4.10.0 4.10.0 4.10.0 4.10.0
    Zookeeper 3.4.11 3.4.12 3.4.12 3.4.13
    Livy - - - -
    Presto 0.188 0.188 0.208 0.208
    Storm 1.1.2 1.1.2 1.1.2 1.1.2
    Impala 2.10.0 2.10.0 2.10.0 2.10.0
    Flume - - - -
    Hue 4.1.0 4.1.0 4.1.0 4.1.0
    Oozie 4.2.0 4.2.0 4.2.0 4.2.0
    Zeppelin 0.7.3 0.7.3 0.8.0 0.8.0
    Ranger 0.7.3 1.0.0 1.0.0 1.0.0
    Ganglia 3.7.2 3.7.2 3.7.2 3.7.2
    OS CentOS 7.4 CentOS 7.4 CentOS 7.4 CentOS 7.4
    Tensorflow - - 1.8.0 1.8.0
    Kafka - - 2.11-1.0.1 2.11-1.0.1
    Superset - - 0.25.6 0.25.6
    Jupyter - - - -
    Analytics Zoo - - - -
  • EMR-3.7.1 to EMR-3.10.1
    Version EMR-3.7.1 EMR-3.8.1 EMR-3.9.1 EMR-3.10.1
    Release time 2018.1 2018.1 2018.2 2018.4
    Hadoop 2.7.2-emr-1.2.10 2.7.2-emr-1.2.12 2.7.2-emr-1.2.13 2.7.2-emr-1.2.14
    Knox 0.13.0 0.13.0 0.13.0 0.13.0
    ApacheDS 2.0.0 2.0.0 2.0.0 2.0.0
    Spark 2.2.1 2.2.1 2.2.1 2.2.1
    Hive 2.3.2 2.3.2 2.3.2 2.3.2
    Tez 0.8.4 0.8.4 0.8.4 0.9.1
    Pig 0.14.0 0.14.0 0.14.0 0.14.0
    Sqoop 1.4.6 1.4.6 1.4.6 1.4.6
    YARN 2.7.2 2.7.2 2.7.2 2.7.2
    HDFS 2.7.2 2.7.2 2.7.2 2.7.2
    Flink - 1.4.0 1.4.0 1.4.0
    Druid - - 0.11.0 0.11.0
    HBase 1.1.1 1.1.1 1.1.1 1.1.1
    Phoenix 4.10.0 4.10.0 4.10.0 4.10.0
    Zookeeper 3.4.11 3.4.11 3.4.11 3.4.11
    Livy - - - -
    Presto 0.188 0.188 0.188 0.188
    Storm 1.0.1 1.0.1 1.0.1 1.1.2
    Impala 2.10.0 2.10.0 2.10.0 2.10.0
    Flume - - - -
    Hue 3.12.0 3.12.0 3.12.0 4.1.0
    Oozie 4.2.0 4.2.0 4.2.0 4.2.0
    Zeppelin 0.7.1 0.7.1 0.7.1 0.7.1
    Ranger - - 0.7.1 0.7.1
    Ganglia 3.7.2 3.7.2 3.7.2 3.7.2
    OS CentOS 7.4 CentOS 7.4 CentOS 7.4 CentOS 7.4
    Tensorflow - - - -
    Kafka - - - -
    Superset - - - -
    Jupyter - - - -
    Analytics Zoo - - - -
  • EMR-2.9.2 to EMR-2.11.0
    Version EMR-2.9.2 EMR-2.10.0 EMR-2.11.0
    Release time 2018.2 2018.4 2018.7
    Hadoop 2.7.2-emr-1.2.12 2.7.2-emr-1.2.12 2.7.2-emr-1.2.12
    Spark 1.6.3 1.6.3 1.6.3
    Hive 2.3.2 2.3.2 2.3.3
    Tez 0.8.4 0.9.1 0.9.1
    Pig 0.14.0 0.14.0 0.14.0
    Sqoop 1.4.6 1.4.6 1.4.6
    Hue 3.12.0 4.1.0 4.1.0
    Zeppelin 0.7.1 0.7.1 0.7.3
    HBase 1.1.1 1.1.1 1.1.1
    Phoenix 4.10.0 4.10.0 4.10.0
    Storm 1.0.1 1.1.2 1.1.2
    Presto 0.188 0.188 0.188.0
    Impala 2.10.0 2.10.0 2.10.0
    Zookeeper 3.4.6 3.4.11 3.4.11
    Oozie 4.2.0 4.2.0 4.2.0
    Ranger 0.7.1 0.7.1 0.7.3
    Ganglia 3.7.2 3.7.2 3.7.2
    OS CentOS 7.4 CentOS 7.4 CentOS 7.4
  • EMR-1.0.0 to EMR-1.3.0
    Version EMR-1.0.0 EMR-1.1.0 EMR-1.2.0 EMR-1.3.0
    Release time 2015.11 2016.3 2016.4 2016.5
    Hadoop 2.6.0 2.6.0 2.6.0 2.6.0-emr-1.1.1
    Spark 1.4.1 1.6.0 1.6.1 1.6.1
    Hive 1.0.1 1.0.1 2.0.0 2.0.0
    Pig 0.14.0 0.14.0 0.14.0 0.14.0
    Sqoop - - - 1.4.6
    Hue - - - 3.9.0
    Zeppelin - - - 0.5.6
    HBase - - 1.1.1 1.1.1
    Phoenix - - - -
    Zookeeper - - 3.4.6 3.4.6
    Ganglia 3.7.2 3.7.2 3.7.2 3.7.2
Note

About Hadoop version:

To ensure full compatibility with Alibaba Cloud Object Storage Service (OSS), we add the emr-core component based on the open-source Hadoop version, without making any changes to the existing APIs. The version number of the emr-core component is appended to the end of the Hadoop version.

Release notes

For more information about the description of each release of E-MapReduce, see: