Alibaba Cloud EMR Serverless Spark provides configuration management features to centrally store and manage global default configurations and security-related information and files for Spark. This feature simplifies the configuration process during task execution, ensures consistency and flexibility, and supports dynamic updates to meet diverse business requirements.
The configuration management feature provides two methods to manage and apply configurations:
Manage Spark configuration templates: Used to define global default configurations, supporting creation, editing, deletion, and recovery to default configurations.
Manage custom configuration files: Supports creating and managing personalized configurations based on specific requirements, flexibly controlling task execution environments, and ensuring configuration consistency and security.
Various tasks within a workspace (such as batch jobs, sessions, and Gateway) automatically apply these custom configuration files without requiring you to manually reference them.