This topic describes the release notes for E-MapReduce (EMR) V3.37.X, including the release dates, updates, and release version information.

Release dates

Version Date
EMR V3.37.1 September 2021
EMR V3.37.0 August 2021

Updates

  • EMR V3.37.1
    Service Description
    SmartData SmartData is updated to 3.7.1.
    Hue The issue that Impala cannot be used in a high-security cluster is fixed.
    Kudu Kerberos is supported.
  • EMR V3.37.0
    Service Description
    SmartData SmartData is updated to 3.7.0.
    Spark The incompatibility issue between Spark and Delta Lake is fixed.
    Delta Lake
    • The connectors for Delta Lake are updated. This way, you can use a storage handler to create tables and query data.
    • The exception that occurs when you perform an INSERT OVERWRITE operation on a partitioned table is fixed.
    • The exception that occurs when you perform an OPTIMIZE operation to write virtual fields to a file in the G-SCD scenario is fixed.
    YARN
    • Information about app IDs, CPU utilization, and memory usage is added to the REST APIs of containers for nodes.
    • The issue that the Application Master (AM) logs of an automatically released node cannot be viewed is fixed.
    • The data of a node that is automatically released based on the decommissioning logic of auto scaling can be deleted.
    • The Graceful Decommission logic of auto scaling is optimized. The node on which NodeManager runs is marked deprecated only after the NodeManager process is complete.
    ZooKeeper ZooKeeper is updated to 3.6.3.
    Flink
    • The SmartData service is added.
    • Object Storage Service (OSS) can be accessed in password-free mode when you log on to a DataFlow-Flink cluster in SSH mode and submit a job in the cluster.
    Impala The issue that the LIST operation is repeatedly performed on directly deleted OSS directories is fixed.
    Hue The UI display exception that occurs when you use Hue together with Oozie is fixed.
    Kudu Kudu is updated to 1.14.0.
    ClickHouse Some default configurations are updated.

Release version information

Service Version
HDFS 2.8.5
YARN 2.8.5
Hive 2.3.8
Spark 2.4.7
Knox 1.1.0
Tez 0.9.2
Ganglia 3.7.2
Sqoop 1.4.7
SmartData
EMR V3.37.0: 3.7.0
EMR V3.37.1: 3.7.1
Bigboot
Hudi 0.8.0
Delta Lake 0.6.1
OpenLDAP 2.4.44
Hue 4.9.0
HBase 1.4.9
ZooKeeper 3.6.3
Presto 338
Impala 3.4.0
Zeppelin 0.9.0
Flume 1.9.0
Livy 0.7.1
Superset 0.36.0
Ranger 1.2.0
Storm 1.2.2
Phoenix 4.14.1
ESS 1.0.0
Alluxio 2.5.0
Kudu 1.14.0
Oozie 5.2.1
Service Version
HDFS 2.8.5
Druid 0.20.1
ZooKeeper 3.6.3
Knox 1.1.0
Ganglia 3.7.2
SmartData
EMR V3.37.0: 3.7.0
EMR V3.37.1: 3.7.1
Bigboot
OpenLDAP 2.4.44
YARN 2.8.5
Superset 0.36.0
Service Version
HDFS 2.8.5
YARN 2.8.5
ZooKeeper 3.6.3
Knox 1.1.0
Flink 1.12-vvr-3.0.2
SmartData
EMR V3.37.0: 3.7.0
EMR V3.37.1: 3.7.1
Bigboot
OpenLDAP 2.4.44
Service Version
ZooKeeper 3.6.3
Ganglia 3.7.2
Kafka 1.1.1
Kafka-Manager 1.3.3.16
OpenLDAP 2.4.44
Knox 1.1.0
Ranger 1.2.0
Service Version
ZooKeeper 3.6.3
Ganglia 3.7.2
ClickHouse 20.8.12.2