MaxCompute:Migrate data from MaxCompute to Tablestore

Step 1: Create a source table in MaxCompute

1. Log on to the DataWorks console and select a region in the upper-left corner.

2. In the left navigation pane, click Workspace.

3. On the Workspaces page, find the target workspace. In the Actions column, choose Shortcuts > Data Development.

4. On the Data Studio page, create an ODPS SQL node and run the following statement to create a table named transs:

      CREATE TABLE transs
      (name    STRING,
      id    STRING,
      gender    STRING);

Step 2: Import data into the source table

1. Save the following sample data to a CSV file on your computer:

      qwe,145,F
      asd,256,F
      xzc,345,M
      rgth,234,F
      ert,456,F
      dfg,12,M
      tyj,4,M
      bfg,245,M
      nrtjeryj,15,F
      rwh,2344,M
      trh,387,F
      srjeyj,67,M
      saerh,567,M

2. In the left navigation pane, choose Data Integration > Data Upload and Download.

3. In the left navigation pane, click the upload icon and then click Upload Data.

4. Follow the on-screen instructions to upload the CSV file to the transs table.

Step 3: Create a destination table in Tablestore

1. Log on to the Tablestore console and create an instance.

2. Create a data table named trans with the following primary keys: For more information, see Create a data table.

   Primary key	Type
   name	STRING
   id	INTEGER

Step 4: Add data sources in DataWorks

Step 5: Create and run a batch synchronization job

1. Log on to the DataWorks console and select a region in the upper-left corner.

2. In the left navigation pane, choose Data Development and O&M > Data Development.

3. In the Select Workspace section, click Go to Data Studio.

4. In the left pane of Data Studio, click the icon and select Create Node > Data Integration > Batch Synchronization.

5. In the Create Node dialog, configure the following required fields: Click Confirm.

   Field	Value
   Source Type	MaxCompute(ODPS)
   Destination Type	Tablestore
   Name	Enter a name for the node

6. On the node configuration page, configure the following parameters: Keep the default values for all other parameters.

   Parameter	Value
   Data Source - Source	The MaxCompute data source that you added
   Data Source - Destination	The Tablestore data source that you added
   Source - Table	The MaxCompute table (transs)
   Destination - Table	The Tablestore table (trans)
   Runtime Resource	The resource group for Data Integration

7. Click the Run icon in the toolbar to run the batch synchronization job.

{
    "type": "job",
    "steps": [
        {
            "stepType": "odps",
            "parameter": {
                "partition": [],
                "datasource": "odps_first",
                "column": [
                    "name",
                    "id",
                    "gender"
                ],
                "table": "transs"
            },
            "name": "Reader",
            "category": "reader"
        },
        {
            "stepType": "ots",
            "parameter": {
                "datasource": "transs",
                "column": [
                    {
                        "name": "gender",
                        "type": "STRING"
                    }
                ],
                "writeMode": "UpdateRow",
                "table": "trans",
                "primaryKey": [
                    {
                        "name": "name",
                        "type": "STRING"
                    },
                    {
                        "name": "id",
                        "type": "INT"
                    }
                ]
            },
            "name": "Writer",
            "category": "writer"
        }
    ],
    "version": "2.0",
    "order": {
        "hops": [
            {
                "from": "Reader",
                "to": "Writer"
            }
        ]
    },
    "setting": {
        "errorLimit": {
            "record": "0"
        },
        "speed": {
            "throttle": false,
            "concurrent": 1
        }
    }
}

Step 6: Verify the migrated data

After the sync job runs, verify that the data is migrated to Tablestore.

1. Log on to the Tablestore console and select a region in the upper-left corner.

2. In the left navigation pane, click All Instances.

3. On the All Instances page, click the instance name to go to the Instance Management page.

4. Click the Instance Details tab.

5. In the Tables section, click the name of the trans data table.

6. On the data table management page, click the Query Data tab to view the migrated data.