This topic describes the release notes of E-MapReduce (EMR) V3.30.X, including the release date and updates.

Release date

October 26, 2020 for EMR V3.30.0

Updates

Component Description
SmartData SmartData is updated to 3.0.0.

For more information, see SmartData 3.0.x.

Spark
  • Metadata from Alibaba Cloud Data Lake Formation (DLF) is supported.
  • Has dependencies are updated to 2.0.1.
  • Issues caused by backticks (`) in Streaming SQL are fixed.
  • The JAR package of Delta is removed. Delta is separately deployed.
  • Logs are stored in HDFS directories.
Hive
  • Metadata from Alibaba Cloud DLF is supported.
  • The issue caused when you read an empty Delta table directory and write data into a dummy file is fixed.
  • Has dependencies are updated to 2.0.1.
Presto
  • Metadata from Alibaba Cloud DLF is supported.
  • The limits on reading a Delta table are eliminated.
  • The issue of no Java Virtual Machine (JVM) configurations in high security mode is fixed.
  • Has dependencies are updated to 2.0.1.
HDFS
  • The Hot-swap Disk Module mode is supported.
  • Has dependencies are updated to 2.0.1.
YARN
  • Issues related to YARN RMZKStateStore are fixed.
  • Snappy files generated from Log Service are supported.
  • Directory configurations in Local mode of MapReduce are modified to resolve the problems that occur in directory permission checks.
  • The Hot-swap Disk Module mode is supported.
  • Logs are stored in HDFS directories.
  • Has dependencies are updated to 2.0.1.
Zookeeper
  • Internal IP addresses can be bound to Elastic Compute Service (ECS) instances to start service ports.
  • Has dependencies are updated to 2.0.1.
Flink-Vvp
  • Flink-VVP is updated to a version in the range of 1.11 to 2.2.2.
  • SQL and Autopilot features are supported.
Note Only Dataflow clusters support Flink-VVP.
Flink
  • Data can be written into Object Storage Service (OSS) in cache mode. Exactly-once semantics are supported based on the Flink checkpoint and the data sources that support data retransmission.
  • Features of open source Flink 1.11.1 are supported. An SQL statement can insert data into different destination tables or partitions and generate multiple channels of output.
  • Has dependencies are updated to 2.0.1.
Impala
  • Custom configuration of parameters on the catalogd.flgs, impalad.flgs, and statestored.flgs tabs is supported.
  • Shiro is updated to 1.6.0.
  • Has dependencies are updated to 2.0.1.
Tez
  • Default settings of AM memory parameters are optimized.
  • Has dependencies are updated to 2.0.1.
HAS Has dependencies are updated to 2.0.1.
Storm
Zeppelin
Ranger
OpenLDAP
Oozie
Knox
Kafka
HUE
HBase
Druid