This topic describes the release notes for E-MapReduce (EMR) V3.36.X, including the release date, updates, and release version information.

Release date

July 16, 2021 for EMR V3.36.1

Updates

Service Description
SmartData SmartData is updated to 3.6.1.

For more information, see SmartData 3.6.X overview.

Hive
  • Hive is updated to 2.3.8.
  • The issue that the output of the show create table command based on Data Lake Formation (DLF) metadata is inaccurate is fixed.
  • The default parameters of Hive are optimized to improve the performance of Hive jobs.
  • In the EMR console, the parameter names on the hive-env tab of the Configure tab for the Hive service are changed to uppercase. This facilitates the use of the parameters.
  • The error that is reported because of the incompatibility between the file system and Hive metastore when you write data to a Hive table is fixed.
HDFS The data compression algorithm Zstandard is supported.
Flink Flink is updated to 1.12-vvr-3.0.2.
Note Flink is removed from Hadoop clusters.
Hudi
  • Hudi is updated to 0.8.0.
  • Hudi can be integrated with Spark SQL.
Spark
  • In the EMR console, the parameter names on the spark-defaults tab of the Configure tab for the Spark service are optimized.
  • The performance of log collection is optimized.
  • The data compression algorithm Zstandard is supported.
Impala The core dump error reported when you use HDFS is fixed.
Tez The default parameters of Tez are optimized to improve the performance of Tez jobs.
Knox
  • Knox is adapted to Kudu.
  • Knox is adapted to Impala.
  • Knox is adapted to HBase.
Phoenix The issue that no JDBC driver is found when Hive or Spark SQL is used to access Phoenix tables is fixed.
ClickHouse The application performance management (APM) feature is available. This feature is used to support monitoring and alerting.

Release version information

Service Version
HDFS 2.8.5
YARN 2.8.5
Hive 2.3.8
Spark 2.4.7
Knox 1.1.0
Tez 0.9.2
Ganglia 3.7.2
Sqoop 1.4.7
SmartData 3.6.1
Bigboot 3.6.1
Hudi 0.8.0
OpenLDAP 2.4.44
Hue 4.9.0
HBase 1.4.9
ZooKeeper 3.6.2
Presto 338
Impala 3.4.0
Zeppelin 0.9.0
Flume 1.9.0
Livy 0.7.1
Superset 0.36.0
Ranger 1.2.0
Storm 1.2.2
Phoenix 4.14.1
ESS 1.0.0
Alluxio 2.5.0
Kudu 1.10.0
Oozie 5.2.1
Service Version
HDFS 2.8.5
Druid 0.20.1
ZooKeeper 3.6.2
Knox 1.1.0
Ganglia 3.7.2
SmartData 3.6.1
Bigboot 3.6.1
OpenLDAP 2.4.44
YARN 2.8.5
Superset 0.36.0
Service Version
HDFS 2.8.5
YARN 2.8.5
ZooKeeper 3.6.2
Knox 1.1.0
Flink 1.12-vvr-3.0.2
OpenLDAP 2.4.44
Service Version
ZooKeeper 3.6.2
Ganglia 3.7.2
Kafka 1.1.1
Kafka-Manager 1.3.3.16
OpenLDAP 2.4.44
Knox 1.1.0
Ranger 1.2.0
Service Version
ZooKeeper 3.6.2
Ganglia 3.7.2
ClickHouse 20.8.12.2