All Products
Search
Document Center

E-MapReduce:Release notes for EMR V5.9.X

Last Updated:Apr 27, 2023

This topic describes the release notes for E-MapReduce (EMR) V5.9.X, including the release dates, updates, and release version information.

Release dates

Version

Date

EMR V5.9.1

November 08, 2022

EMR V5.9.0

October 14, 2022

Updates

EMR V5.9.1

Service

Description

Kerberos

An external key distribution center (KDC) can be connected to the Kerberos service of an EMR cluster.

Kafka

Configuration items for startup commands can be added. Users can configure the startup parameters of the Kafka service based on their business requirements.

JindoData

  • JindoData is updated to 4.6.0.

  • The access path of OSS-HDFS can be modified.

Flink

Flink is updated to 1.13_vvr_4.0.15.

RSS

RSS is updated to 0.1.4.

EMR V5.9.0

Service

Description

Spark

  • Spark is updated to 3.3.

  • Kerberos authentication is supported.

Hudi

  • Hudi is updated to 0.12.0.

  • Spark 3.3 is supported.

  • Metastore can be used to manage metadata, and the acceleration feature is supported. For more information, see Use Hudi Metastore.

Flink

  • Kerberos authentication is supported.

  • Flink can be automatically connected to Data Lake Formation (DLF).

Iceberg

  • Iceberg is updated to 0.14.0.

  • Spark 3.3 is supported.

  • Kerberos authentication is supported.

JindoData

  • JindoData is updated to 4.5.1.

  • Alibaba Cloud resources can be accessed without an AccessKey pair.

Hadoop Common and HDFS

  • Kerberos authentication is supported.

  • The CVE-2022-25168 vulnerability is fixed.

Knox

Ranger is integrated with Knox. You can access the web UI of Ranger on the Access Links and Ports tab in the EMR console.

HBase

  • HBase is updated to 2.4.9.

  • Kerberos authentication is supported.

  • Node groups can be separately configured.

RSS

  • RSS is updated to 0.1.2.

  • Kerberos authentication is supported.

Doris

  • Doris is updated to 1.1.2.

  • Kerberos authentication is supported.

StarRocks

  • StarRocks is updated to 2.3.2.

  • Kerberos authentication is supported.

Kafka

  • Kafka is updated to 2.13_3.2.1.

  • Kerberos authentication is supported.

Delta Lake

  • Delta Lake is updated to 2.1.0.

  • Spark 3.3 is supported.

  • Kerberos authentication is supported.

Impala

  • DLF can be used to create views.

  • Kerberos authentication is supported.

Kudu

The Kudu service is added. The version is 1.14.0.

YARN, Ranger, Hive, Kyuubi, Tez, ZooKeeper, DLF-Auth, Phoenix, Sqoop, and Presto

Kerberos authentication is supported.

Release version information

DataLake clusters

Service

Version

HDFS

3.2.1

YARN

3.2.1

Hive

3.1.3

Spark 2

2.4.8

Spark 3

3.3.0

Tez

0.10.1

Presto

389

Delta Lake

2.1.0

Hudi

0.12.0

Iceberg

0.14.0

Impala

3.4.0

OpenLDAP

2.4.44

Ranger

2.1.0

DLF-Auth

2.0.0

ZooKeeper

3.6.3

Flume

1.9.0

JindoData

EMR V5.9.1: 4.6.0

EMR V5.9.0: 4.5.1

Knox

1.5.0

Kudu

1.14.0

Kyuubi

1.5.2

RSS

EMR V5.9.1: 0.1.4

EMR V5.9.0: 0.1.2

Sqoop

1.4.7

OLAP clusters

Service

Version

ZooKeeper

3.6.3

ClickHouse

22.3.8.39

Doris

1.1.2

StarRocks

2.3.2

Dataflow clusters

Service

Version

HDFS

3.2.1

YARN

3.2.1

Knox

1.5.0

OpenLDAP

2.4.44

ZooKeeper

3.6.3

Flink

EMR V5.9.1: 1.13_vvr_4.0.15

EMR V5.9.0: 1.13_vvr_4.0.13

Kafka

2.13_3.2.1

Kafka Manager

2.0.0.2

DataServing clusters

Service

Version

HDFS

3.2.1

JindoData

EMR V5.9.1: 4.6.0

EMR V5.9.0: 4.5.1

ZooKeeper

3.6.3

HBase

2.4.9

Phoenix

5.1.2

Custom clusters

Service

Version

HDFS

3.2.1

YARN

3.2.1

Hive

3.1.3

Spark 2

2.4.8

Spark 3

3.3.0

Tez

0.10.1

Presto

389

Delta Lake

2.1.0

Hudi

0.12.0

Iceberg

0.14.0

Impala

3.4.0

OpenLDAP

2.4.44

Ranger

2.1.0

DLF-Auth

2.0.0

ZooKeeper

3.6.3

Flink

EMR V5.9.1: 1.13_vvr_4.0.15

EMR V5.9.0: 1.13_vvr_4.0.13

Flume

1.9.0

HBase

2.4.9

JindoData

EMR V5.9.1: 4.6.0

EMR V5.9.0: 4.5.1

Knox

1.5.0

Kudu

1.14.0

Kyuubi

1.5.2

Phoenix

5.1.2

RSS

EMR V5.9.1: 0.1.4

EMR V5.9.0: 0.1.2

Sqoop

1.4.7

StarRocks

2.3.2