All Products
Search
Document Center

E-MapReduce:Release notes for EMR V4.6.X

Last Updated:Apr 27, 2023

This topic describes the release notes for E-MapReduce (EMR) V4.6.X, including the release date, updates, and release version information.

Release date

January 15, 2021 for EMR V4.6.0

Updates

Service

Description

SmartData

SmartData is updated to 3.2.0.

For more information, see SmartData 3.2.X.

Spark

  • Spark is updated to 2.4.7.

  • jQuery is updated to 3.5.1.

  • Spark is compatible with Hive to automatically update table and partition sizes.

  • Spark metadata and job running information can be sent to DataWorks.

Hive

  • Metadata from Alibaba Cloud Data Lake Formation (DLF) in an HCatalog table is supported.

  • Hive metadata and job running information can be sent to DataWorks.

Metastore

  • The statistics feature for Hive is added.

  • Metadata from DLF in an HCatalog table is supported.

  • Methods to obtain an STS token are optimized.

HDFS

  • jQuery is updated to 3.5.1.

  • HDFS is updated to 3.2.1.

YARN

  • YARN is updated to 3.2.1.

  • jQuery is updated to 3.5.1.

  • Configurations of Fair Scheduler are adjusted.

  • Timeline Server is optimized.

Zeppelin

Zeppelin is updated to 0.9.0.

OpenLDAP

  • The audit feature is added.

  • By default, the SSL port 10636 is enabled.

  • Presto can be enabled with one click.

Hue

Presto is supported.

EMRHook

  • The EMRHook service is added.

  • hive-hook is used to send Hive metadata and job running information to DataWorks.

  • spark-hook is used to send Spark metadata and job running information to DataWorks.

Release version information

Hadoop clusters

Service

Version

HDFS

3.2.1

YARN

3.2.1

Hive

3.1.2

Spark

2.4.7

Knox

1.1.0

Tez

0.9.2

Ganglia

3.7.2

Sqoop

1.4.7

SmartData

3.2.0

Bigboot

3.2.0

Hudi

0.6.0

OpenLDAP

2.4.44

Hue

4.4.0

HBase

2.1.9

ZooKeeper

3.5.6

Presto

338

Impala

3.4.0

Zeppelin

0.9.0

Flume

1.9.0

Livy

0.6.0

Superset

0.36.0

Ranger

2.1.0

Flink

1.10-vvr-1.0.2

Storm

1.2.2

ESS

1.0.0

Kudu

1.11.1

Oozie

5.1.0

Shuffle Service clusters

Service

Version

ESS

1.0.0

Kafka clusters

Service

Version

ZooKeeper

3.5.6

Ganglia

3.7.2

Kafka

2.4.1

Kafka-Manager

1.3.3.16

OpenLDAP

2.4.44

Knox

1.1.0

Ranger

2.1.0