This topic describes the release notes for E-MapReduce (EMR) V4.6.X, including the release date and updates.

Release date

January 15, 2021 for EMR V4.6.0

Updates

Service Description
SmartData SmartData is updated to 3.2.0.

For more information, see SmartData 3.2.X.

Spark
  • Spark is updated to 2.4.7.
  • jQuery is updated to 3.5.1.
  • Spark is compatible with Hive to automatically update table and partition sizes.
  • Spark metadata and job running information can be sent to DataWorks.
Hive
  • Metadata from Alibaba Cloud Data Lake Formation (DLF) in an HCatalog table is supported.
  • Hive metadata and job running information can be sent to DataWorks.
Metastore
  • The statistics feature for Hive is added.
  • Metadata from Alibaba Cloud DLF in an HCatalog table is supported.
  • Methods to obtain an STS token are optimized.
HDFS
  • jQuery is updated to 3.5.1.
  • HDFS is updated to 3.2.1.
YARN
  • YARN is updated to 3.2.1.
  • jQuery is updated to 3.5.1.
  • Configurations of Fair Scheduler are adjusted.
  • Timeline Server is optimized.
Zeppelin Zeppelin is updated to 0.9.0.
OpenLDAP
  • The audit feature is added.
  • By default, the SSL port 10636 is enabled.
  • Presto can be enabled with one click.
Hue Presto is supported.
EMRHook
  • The EMRHook service is added.
  • hive-hook is used to send Hive metadata and job running information to DataWorks.
  • spark-hook is used to send Spark metadata and job running information to DataWorks.

Release version information

Service Version
HDFS 3.2.1
YARN 3.2.1
Hive 3.1.2
Spark 2.4.7
Knox 1.1.0
Tez 0.9.2
Ganglia 3.7.2
Sqoop 1.4.7
SmartData 3.2.0
Bigboot 3.2.0
Hudi 0.6.0
OpenLDAP 2.4.44
Hue 4.4.0
HBase 2.1.9
ZooKeeper 3.5.6
Presto 338
Impala 3.4.0
Zeppelin 0.9.0
Flume 1.9.0
Livy 0.6.0
Superset 0.36.0
Ranger 2.1.0
Flink 1.10-vvr-1.0.2
Storm 1.2.2
ESS 1.0.0
Kudu 1.11.1
Oozie 5.1.0
Service Version
ESS 1.0.0
ZooKeeper 3.5.6
Ganglia 3.7.2
Kafka 2.4.1
Kafka-Manager 1.3.3.16
OpenLDAP 2.4.44
Knox 1.1.0
Ranger 2.1.0