E-MapReduce:Release notes for EMR V3.42.X

Service

Description

Hive

LDAP authentication can be enabled with one click.

Presto

• Presto is updated to 389.

  Delta Lake and Hudi connectors that are provided by the Presto community can be used.

  • The time travel and Z-Order features are not supported by the Delta Lake connector.

  • The Hudi connector cannot be used to query Merge on Read (MOR) tables.

• LDAP authentication can be enabled with one click.

Delta Lake

• Delta Lake is interconnected with Data Lake Formation (DLF) to support automatic management of tables in data lakes.

• Ranger authentication is supported.

• The issue that statistics about fields of the TIMESTAMP type cannot be collected is fixed.

• Metric information can be returned by the OPTIMIZE and VACUUM commands.

Hudi

Hudi is updated to 0.11.1.

Hadoop Common

The Hadoop Common service is added. This way, the issue that the configurations of HDFS, YARN, and JindoSDK are overwritten is fixed.

YARN

The auto scaling feature is enhanced.

Ranger

• Spark 2 and Spark 3 are supported.

• LDAP authentication can be enabled for Ranger UserSync with one click.

Kafka

Related topics are automatically created when CruiseControl is used.

HBase

The HBase service is added. The service version is 1.4.9.

Phoenix

The Phoenix service is added. The service version is 4.14.1.

Doris

Doris is updated to 1.1.1.

StarRocks

StarRocks is updated to 2.2.3.

ClickHouse

The following issue is fixed: An out-of-memory (OOM) error occurs when you read large files from Object Storage Service (OSS).