Migration Assistant

Updated at:
Copy as MD

Migration Assistant helps you quickly copy development assets across different DataWorks editions, Alibaba Cloud accounts, regions, and workspaces. You can migrate objects such as Auto Triggered Task, Manually Triggered Task, Resource, Function, Data Source, Table Metadata, and Component. Use Full Export, Incremental Export, or Custom Export to export these assets based on your business needs.

Limitations

  • New Data Studio lets you migrate the following objects: scheduled tasks, manual tasks, resources, functions, components, workflows, tables, and data sources. You cannot import or export ad hoc query, Data Service, and Data Quality objects.

  • Export packages from New Data Studio and legacy Data Studio are not interchangeable.

  • Legacy Data Studio does not support importing or exporting data quality nodes, composite nodes, or Data Push nodes.

  • All DataWorks editions support migrating jobs from open-source scheduling engines such as Oozie, Azkaban, and Airflow to the cloud. However, for DataWorks-to-DataWorks migrations, support for Migration Assistant varies by edition, as shown in the following table.

    DataWorks migration feature

    Basic Edition

    Standard Edition

    Professional Edition

    Enterprise Edition

    Number of DataWorks export packages supported per tenant

    Note
    • When you create an export task and the export succeeds, an export package is generated.

    • If the number of export packages exceeds the limit of your edition, you can only upgrade your edition to obtain more export packages. You cannot purchase additional export packages separately.

    Up to 10 (cumulative)

    Up to 30 (cumulative)

    Up to 100 (cumulative)

    Unlimited

    DataWorks import package size limit

    Local file upload

    30 MB

    30 MB

    30 MB

    30 MB

    OSS file upload

    Not supported

    Not supported

    Unlimited

    Unlimited

    Whether auto-commit and auto-deploy are supported during DataWorks import

    Not supported

    Not supported

    Supported

    Supported

  • Only an Alibaba Cloud account and workspace administrators can perform import and export operations. Members with other roles can only view the lists of import and export tasks.

Notes

  • Migration Assistant does not migrate data. To migrate data, use the batch synchronization feature.

  • Migration Assistant requires the desktop version of Google Chrome 69 or later.

Use cases

  • Back up tasks

    Back up task code to reduce the risk of data loss caused by accidental project deletion. We recommend that you set Export Type to Full Export.

  • Quickly replicate business flows

    Abstract common business flows and quickly replicate them. We recommend that you set Export Type to Custom Export.

  • Quickly create a test environment

    Replicate all task code to quickly set up a test environment. You only need to change the data input from the production database to test data. We recommend that you set Export Type to Full Export or Custom Export.

  • Hybrid cloud cross-region development

    Export code from the public cloud to a private cloud to perform data development on both the public cloud and the private cloud simultaneously. We recommend that you set Export Type to Custom Export.

  • Isolate the development environment from the production environment

    When the development environment and the production environment are completely isolated at the network level, you can use Migration Assistant to export tasks that have been developed in the development environment to the production environment.