Component | Description |
SmartData | SmartData is updated to 3.0.0. For more information, see SmartData 3.0.x. |
Spark | - Metadata from Alibaba Cloud Data Lake Formation (DLF) is supported.
- Has dependencies are updated to 2.0.1.
- Issues caused by backticks (`) in Streaming SQL are fixed.
- The JAR package of Delta is removed. Delta is separately deployed.
- Logs are stored in HDFS directories.
|
Hive | - Metadata from Alibaba Cloud DLF is supported.
- The issue caused when you read an empty Delta table directory and write data into a dummy file is fixed.
- Has dependencies are updated to 2.0.1.
|
Presto | - Metadata from Alibaba Cloud DLF is supported.
- The limits on reading a Delta table are eliminated.
- The issue of no Java Virtual Machine (JVM) configurations in high security mode is fixed.
- Has dependencies are updated to 2.0.1.
|
HDFS | - The Hot-swap Disk Module mode is supported.
- Has dependencies are updated to 2.0.1.
|
YARN | - Issues related to YARN RMZKStateStore are fixed.
- Snappy files generated from Log Service are supported.
- Directory configurations in Local mode of MapReduce are modified to resolve the problems that occur in directory permission checks.
- The Hot-swap Disk Module mode is supported.
- Logs are stored in HDFS directories.
- Has dependencies are updated to 2.0.1.
|
Zookeeper | - Internal IP addresses can be bound to Elastic Compute Service (ECS) instances to start service ports.
- Has dependencies are updated to 2.0.1.
|
Flink-Vvp | - Flink-VVP is updated to a version in the range of 1.11 to 2.2.2.
- SQL and Autopilot features are supported.
Note Only Dataflow clusters support Flink-VVP. |
Flink | - Data can be written into Object Storage Service (OSS) in cache mode. Exactly-once semantics are supported based on the Flink checkpoint and the data sources that support data retransmission.
- Features of open source Flink 1.11.1 are supported. An SQL statement can insert data into different destination tables or partitions and generate multiple channels of output.
- Has dependencies are updated to 2.0.1.
|
Impala | - Custom configuration of parameters on the catalogd.flgs, impalad.flgs, and statestored.flgs tabs is supported.
- Shiro is updated to 1.6.0.
- Has dependencies are updated to 2.0.1.
|
Tez | - Default settings of AM memory parameters are optimized.
- Has dependencies are updated to 2.0.1.
|
HAS | Has dependencies are updated to 2.0.1. |
Storm |
Zeppelin |
Ranger |
OpenLDAP |
Oozie |
Knox |
Kafka |
HUE |
HBase |
Druid |