E-MapReduce:Release notes for EMR V5.8.X

Service

Description

Spark

LDAP authentication can be enabled with one click.

Hive

LDAP authentication can be enabled with one click.

Presto

• Presto is updated to 389.

  Delta Lake and Hudi connectors that are provided by the Presto community can be used.

  • The time travel and Z-Order features are not supported by the Delta Lake connector.

  • The Hudi connector cannot be used to query Merge on Read (MOR) tables.

• LDAP authentication can be enabled with one click.

Delta Lake

• Delta Lake is interconnected with Data Lake Formation (DLF) to support automatic management of tables in data lakes.

• The issue that the partition information cannot be automatically synchronized by using the CREATE TABLE AS statement is fixed.

• Metric information can be returned by the OPTIMIZE and VACUUM commands.

Hudi

Hudi is updated to 0.11.1.

Hadoop Common

The Hadoop Common service is added. This way, the issue that the configurations of HDFS, YARN, and JindoSDK are overwritten is fixed.

YARN

The auto scaling feature is enhanced.

Ranger

• Spark 2 and Spark 3 are supported.

• LDAP authentication can be enabled for Ranger UserSync with one click.

Kafka

The Kafka service is added. The service version ranges from 2.12 to 2.4.1.

HBase

The HBase service is added. The service version is 2.3.4.

Phoenix

The Phoenix service is added. The service version is 5.1.2.

Doris

Doris is updated to 1.1.1.

StarRocks

• StarRocks is updated to 2.3.0.

• The primary key model supports the DELETE WHERE syntax. The primary key indexes are stored in the persistent storage to reduce memory usage. For more information, see StarRocks version 2.3.

ClickHouse

• ClickHouse is updated to 22.3.8.39.

• The following issue is fixed: An out-of-memory (OOM) error occurs when you read large files from Object Storage Service (OSS).