This topic describes the release notes for E-MapReduce (EMR) Serverless Spark on December 11, 2024.
Overview
On December 11, 2024, the latest version of EMR Serverless Spark is released, featuring platform improvements, improved performance, and enhanced engine capabilities.
Platform updates
Feature | Description |
Gateway | The feature that allows you to create Kyuubi gateways is in public review. You can deploy Kyuubi and use Kyuubi Thrift interfaces to submit jobs to Serverless Spark. |
Access control | Hive Metastore with Kerberos authentication enabled is supported. This allows you to use Kerberos for account authentication when you submit jobs to Serverless Spark. |
Engine updates
Engine version | Description |
esr-4.0.0 (Spark 3.5.2, Scala 2.12) | Spark 3.5.2 is supported. |
esr-3.0.1 (Spark 3.4.3, Scala 2.12) esr-2.4.1 (Spark 3.3.1, Scala 2.12) | When you use the fusion acceleration feature, invalid data at the end is ignored during JSON data processing. |