Component | Description |
SmartData | SmartData is updated to 3.2.0. For more information, see SmartData 3.2.X. |
Spark | - Spark is updated to 2.4.7.
- jQuery is updated to 3.5.1.
- Spark is compatible with Hive to automatically update table and partition sizes.
- Spark metadata and job running information can be sent to DataWorks.
|
Hive | - Hive is updated to 2.3.7.
- Metadata from Alibaba Cloud Data Lake Formation (DLF) in an HCatalog table is supported.
- Hive metadata and job running information can be sent to DataWorks.
|
Metastore | - The statistics feature for Hive is added.
- Metadata from Alibaba Cloud DLF in an HCatalog table is supported.
- Methods to obtain an STS token are optimized.
|
HDFS | jQuery is updated to 3.5.1. |
YARN | - jQuery is updated to 3.5.1.
- Configurations of Fair Scheduler are adjusted.
- Timeline Server is optimized.
|
Zeppelin | Zeppelin is updated to 0.9.0. |
Ranger | - Audit log configurations of Hive are added.
- Configurations of Log4j Audit are added.
|
OpenLDAP | - The audit feature is added.
- By default, the SSL port 10636 is enabled.
- Presto can be enabled with one click.
|
Knox | - Vulnerabilities of the Spring framework are fixed.
- The issues caused when you view the Executors page on the web UI of Spark are fixed.
- The issues occurred on the job status page of the web UI of Oozie are fixed.
|
Hue | Presto is supported. |
Druid | Druid is updated to 0.20.0. |
EmrHook | - Software services are added.
- hive-hook: sends Hive metadata and job running information to DataWorks.
- spark-hook: sends Spark metadata and job running information to DataWorks.
|