E-MapReduce:Release notes for EMR V3.36.X

Service

Description

SmartData

SmartData is updated to 3.6.1.

For more information, see SmartData 3.6.X.

Hive

• Hive is updated to 2.3.8.

• The issue that the output of the show create table command based on Data Lake Formation (DLF) metadata is inaccurate is fixed.

• The default parameters of Hive are optimized to improve the performance of Hive jobs.

• In the EMR console, the parameter names on the hive-env tab of the Configure tab for the Hive service are changed to uppercase. This facilitates the use of the parameters.

• The error message that is reported because of the incompatibility between the file system and Hive metastore when you write data to a Hive table is optimized.

HDFS

The data compression algorithm Zstandard is supported.

Flink

Flink is updated to 1.12-vvr-3.0.2.

Hudi

• Hudi is updated to 0.8.0.

• Hudi can be integrated with Spark SQL.

Spark

• In the EMR console, the parameter names on the spark-defaults tab of the Configure tab for the Spark service are optimized.

• The performance of log collection is optimized.

• The data compression algorithm Zstandard is supported.

Impala

The core dump error reported when you use HDFS is fixed.

Tez

The default parameters of Tez are optimized to improve the performance of Tez jobs.

Knox

• Knox is adapted to Kudu.

• Knox is adapted to Impala.

• Knox is adapted to HBase.

Phoenix

The issue that no JDBC driver is found when Hive or Spark SQL is used to access Phoenix tables is fixed.

ClickHouse

The application performance management (APM) feature is available. This feature is used to support monitoring and alerting.