E-MapReduce:Release notes for EMR V3.40.X

Service

Description

JindoData

The JindoData service is added. The service version is 4.3.0

JindoSDK

JindoSDK is updated to 4.3.0.

Spark

Spark is updated to 3.2.1.

Hive

• The following issue is fixed: After speculative execution is enabled for Hive on Tez, both the original task and the speculative task are committed.

• The following issue is fixed: User-defined functions (UDFs) can be called only after you reload the functions.

Presto

The following issue is fixed: After a Hadoop cluster is initialized and the Presto service is added to the cluster, the Presto service fails to start.

Delta Lake

The incompatibility issue between Delta Lake and Streaming SQL is fixed.

Hudi

Hudi is updated to 0.10.1.

Iceberg

Iceberg is updated to 0.13.1.

YARN

• A feature that allows you to run an ApplicationMaster only on a core node is added.

• The issue that the value of the mareduce.map.java.opts parameter does not include taihaodoctor is fixed.

ZooKeeper

The configuration of Java Virtual Machine (JVM) parameters is optimized.

Flink

Flink, Impala, Flume, and Druid are adapted to JindoSDK 4.3.0.

Impala

Flume

Druid

Sqoop

The PostgreSQL version is updated.

Zeppelin

The issue that the Java Database Connectivity (JDBC) interpreter fails to start is fixed.

Ranger

Hudi tables are supported by the Spark plugin of Ranger 1.2.0.

Oozie

Log4j is updated to 2.17.2.

HBase

The issue that the RegionServer of HBase 1.4.9 fails to start is fixed.

DLF-Auth

DLF-Auth is updated to 2.0.0.