E-MapReduce (EMR) Data Platform entered maintenance mode at 21:00 on February 21, 2022 (UTC+8), and data development features are no longer updated. If you still use EMR Data Platform for data development, migrate to DataWorks at the earliest opportunity.
What stopped and what still works
As of 21:00 on February 21, 2022 (UTC+8), the following data development operations are no longer supported in EMR Data Platform:
-
Creating projects
-
Creating and running jobs
-
Scheduling workflows
-
Operations and maintenance (O&M) for data development
Projects created before this date are not affected. You can continue to run jobs and schedule workflows in existing projects.
Capabilities available after migrating to DataWorks
DataWorks is an end-to-end data development and governance platform built on over 10 years of big data experience at Alibaba Group. EMR is deeply integrated with DataWorks.
After migrating, you gain the following capabilities that are not available in EMR Data Platform:
-
Data lake ingestion
-
Data modeling
-
Data development
-
Data scheduling
-
Data governance
-
Data security assurance
Migration process
The DataWorks on EMR team provides full technical support throughout the migration.
| Phase | Operation | Participant | Estimated duration |
|---|---|---|---|
| 1. Preparations | Review the Getting started with DataWorks on EMR topic and the Migrate EMR projects to DataWorks topic. Contact the DataWorks on EMR team if you have questions. | DataWorks on EMR team and customers | 1 day |
| 2. Migration | Create a DataLake cluster (recommended) or a custom cluster, then associate it with a DataWorks workspace. Migrate your EMR projects to DataWorks. The DataWorks on EMR team can perform the migration automatically on your behalf. For step-by-step instructions, see Getting started with DataWorks on EMR. For project migration details, see Migrate EMR projects to DataWorks. | DataWorks on EMR team and customers | 2-4 days |
| 3. Check | Update job configurations such as data paths. Verify that jobs run as expected in the new environment. | DataWorks on EMR team and customers | 2-4 weeks |
| 4. Completion | Suspend workflows in EMR Data Platform and use DataWorks for scheduling. Switch data development to the new cluster and suspend the original cluster. | DataWorks on EMR team and customers | 1 week |
Get migration support
To get help with your migration, search for DingTalk group ID 16970006464 to join the support group. An Alibaba Cloud engineer will contact you to plan your migration.