Migration Assistant allows you to export data objects in your workspace, including auto triggered nodes, manually triggered nodes, resources, functions, table metadata, connections, script templates, and ad-hoc queries. This topic describes how to create and view export tasks.

Prerequisites

  • The Migration Assistant feature is in public preview. This feature is supported in the following regions: China (Hangzhou), China (Shanghai), China (Beijing), China (Zhangjiakou), China (Shenzhen), China (Chengdu), and Singapore (Singapore).
  • To create an export or import task, you must use an Alibaba Cloud account or be a workspace administrator. If you use a workspace as a Resource Access Management (RAM) user who is not assigned the administrator role, you can only view export and import tasks.

Background information

Migration Assistant allows you to export data objects in different modes. These modes include full export, incremental export, and custom export. You can choose an export mode that best suits your business scenario.
  • Full export tasks are used to export all the data objects in a workspace. For example, you can run a full export task to back up node code or clone the workspace to a test environment. When you run a full export task, data objects of the latest version are exported.

    Only saved data objects can be exported. If a node is saved in both the development environment and production environment, the node saved in the development environment is exported.

  • Incremental export tasks are used to export data objects that were modified on or after the specified date.
    Note You cannot configure a blacklist for incremental export tasks.
  • Custom export tasks are used to export data objects that you specify. For example, you can run a custom export task to extract a common workflow and clone it to other workspaces. If a workspace runs in both a production environment and a development environment that are completely isolated from each other, you can run a custom export task to export nodes from the development environment and import them to the production environment for deployment.

Go to the Migration Assistant page

  1. Log on to the DataWorks console.
  2. In the left-side navigation pane, click Workspaces.
  3. After you select the region where the required workspace resides, find the workspace and click Data Analytics.
  4. Click the Icon icon in the upper-left corner. Then, choose All Products > Other > Migration Assistant. By default, DataWorks migration > DataWorks export is displayed.

Create a full export task

  1. On the Export Tasks page, click Create Export Task in the upper-right corner.
  2. In the Create Export Task dialog box, configure the parameters as required.
    Full export
    Parameter Description
    Name The name of the export task. The name can contain only uppercase and lowercase letters, digits, underscores (_), and periods (.).
    Type The type of the export task. Select Full export for this parameter. A full export task is used to export all the auto triggered nodes, manually triggered nodes, table metadata, and connections that have been saved or committed in the current workspace.
    Blacklist Specifies whether to enable the blacklist feature for full export based on your business needs. If you select this check box, you can add the nodes and resources that do not need to be exported to a blacklist.
    Export Version The DataWorks version. Valid values: Standard and Private Cloud(V3.6.1-V3.11). The DataWorks version determines the format in which data objects are exported. Check the DataWorks version of the destination workspace before you create an export task.
    Remarks The description of the export task.
  3. Optional:Click Add to Blacklist and run the export task.
    If you select Add to Blacklist, perform the following steps to configure the blacklist:
    1. In the Create Export Task dialog box, click Add to Blacklist.
    2. On the Set Blacklist page, select the data objects that you do not want to export.
    3. Click Add Selected to Blacklist.
    4. Click Export in the upper-right corner.
    5. In the Export confirmation message, click Confirm.
  4. Optional:If you do not select Add to Blacklist, click Export in the Create Export Task dialog box.
  5. In the Export Progress dialog box, view the progress of the export task. After the task succeeds, click Back to Export Tasks.

Create an incremental export task

  1. On the Export Tasks page, click Create Export Task in the upper-right corner.
  2. In the Create Export Task dialog box, configure the parameters as required.
    Incremental export
    Parameter Description
    Name The name of the export task. The task name can contain only uppercase and lowercase letters, digits, underscores (_), and periods (.).
    Type The type of the export task. Select Incremental for this parameter. An incremental export task is used to export data objects that were modified on or after the specified date. Supported data objects include auto triggered nodes, manually triggered nodes, table metadata, and connections that have been saved or committed in the current workspace.
    Modified date The date on which data is modified. The data generated after this date is incremental data.
    Export Version The DataWorks version. Valid values: Standard and Private Cloud(V3.6.1-V3.11). The DataWorks version determines the format in which data objects are exported.
    Remarks The description of the export task.
  3. Click Export.

Create a custom export task

  1. On the Export Tasks page, click Create Export Task in the upper-right corner.
  2. In the Create Export Task dialog box, configure the parameters as required.
    Custom export
    Parameter Description
    Name The name of the export task. The task name can contain only uppercase and lowercase letters, digits, underscores (_), and periods (.).
    Type The type of the export task. Select Custom for this parameter. A custom export task is used to export data objects that you specify. Supported data objects include auto triggered nodes, manually triggered nodes, table metadata, and connections that have been saved or committed in the current workspace.
    Export Version The DataWorks version. Valid values: Standard and Private Cloud(V3.6.1-V3.11). The DataWorks version determines the format in which data objects are exported.
    Remarks The description of the export task.
  3. Click Select Export Objects.
  4. On the Export Objects page, select a type of data object that you want to export from the Export Object drop-down list.
    Migration Assistant allows you to export data objects in your workspace, including auto triggered nodes, manually triggered nodes, resources, functions, table metadata, connections, script templates, and ad-hoc queries.Export Object
  5. Select the objects that you want to export and click Add Selected to Export Package.
    You can also configure filter conditions such as Export Object, Object Type, and Export Environment to search for data objects. Then, click Add All to Export Package to add all the data objects that have been found to the package that you want to export.
  6. Click Export in the upper-right corner.

View and manage export tasks

On the Export Tasks page, you can view the name, type, creator, status, update time, and description of created export tasks. The operations that you can perform on export tasks vary based on their status.
  • If an export task is in the Successful state, you can perform the following operations on the task:
    • Click View Export Report in the Actions column. On the page that appears, view the task information in the Basic Information, Overview, and Details sections.View Export Report
    • Click Download in the upper-right corner to download the package of the export task.
    • Clone the export task.
      • Full export task for which the blacklist feature is not enabled: Click Clone in the Actions column. In the Clone dialog box, enter a task name in the Name field and click Export.
      • Full export task for which the blacklist feature is enabled: Click Clone in the Actions column. In the Clone dialog box, enter a task name in the Name field and click Add to Blacklist.

        On the Set Blacklist page, select the data objects that you do not want to export, click Add Selected to Blacklist, and then click Export in the upper-right corner.

      • Custom export task: Click Clone in the Actions column. In the Clone dialog box, enter a task name in the Name field and click Select Export Objects.

        On the Export Objects page, select the data objects that you want to export, click Add Selected to Export Package, and then click Export in the upper-right corner.

  • If an export task is in the Export failed state, you can click View Export Package, Download Export Package, or Re-export in the Actions column as required. To retry the export task, click Re-export.
  • If an export task is a custom export task that is in the Editing state, you can perform the following operations on the task:
    • Click Edit in the Actions column. On the Export Objects page, modify the data objects that you want to export.
    • Click View Export Package in the Actions column. On the Export Package Details page, view the task information in the Basic Information, Overview, and Details sections.
    • Click Delete in the Actions column. In the Delete message, click Ok to delete the task.
  • If an export task is a full export task that is in the Editing state, you can click Edit, Delete, or View Blacklist in the Actions column as required. If you click View Blacklist in the Actions column, you can check the blacklist and click Export to run the export task or click Close in the dialog box that appears.