This topic describes the release notes for E-MapReduce (EMR) V3.33.X, including the release date and updates.

Release date

January 15, 2021 for EMR V3.33.0

Updates

Component Description
SmartData SmartData is updated to 3.2.0.

For more information, see SmartData 3.2.X.

Spark
  • Spark is updated to 2.4.7.
  • jQuery is updated to 3.5.1.
  • Spark is compatible with Hive to automatically update table and partition sizes.
  • Spark metadata and job running information can be sent to DataWorks.
Hive
  • Hive is updated to 2.3.7.
  • Metadata from Alibaba Cloud Data Lake Formation (DLF) in an HCatalog table is supported.
  • Hive metadata and job running information can be sent to DataWorks.
Metastore
  • The statistics feature for Hive is added.
  • Metadata from Alibaba Cloud DLF in an HCatalog table is supported.
  • Methods to obtain an STS token are optimized.
HDFS jQuery is updated to 3.5.1.
YARN
  • jQuery is updated to 3.5.1.
  • Configurations of Fair Scheduler are adjusted.
  • Timeline Server is optimized.
Zeppelin Zeppelin is updated to 0.9.0.
Ranger
  • Audit log configurations of Hive are added.
  • Configurations of Log4j Audit are added.
OpenLDAP
  • The audit feature is added.
  • By default, the SSL port 10636 is enabled.
  • Presto can be enabled with one click.
Knox
  • Vulnerabilities of the Spring framework are fixed.
  • The issues caused when you view the Executors page on the web UI of Spark are fixed.
  • The issues occurred on the job status page of the web UI of Oozie are fixed.
Hue Presto is supported.
Druid Druid is updated to 0.20.0.
EmrHook
  • Software services are added.
  • hive-hook: sends Hive metadata and job running information to DataWorks.
  • spark-hook: sends Spark metadata and job running information to DataWorks.