Data Transport:Migrate data to the cloud and verify the migration result

Prerequisites

Your data is migrated to a Data Transport III device, the data migration task stops, and the device is powered off.

Return the device

1. Check the data migration task status

Run the following commands in sequence to check whether the data migration task is in the succeed state, and check whether the migrated data is consistent with that in the source file by performing CRC-64 verification.:

• Run the cdmgwclient command to go to the corresponding directory.

• Run the bash console.sh status <job_name> command to view the migration task status. Replace job_name with the actual migration task name.

2. Stop the data migration task

Run the following commands in sequence to stop the data migration task:

• beforepoweroff

3. Uninstall and lock a storage pool

Run the following command to uninstall and lock a storage pool:

• crypt close

4. Power off the Data Transport III device

Run the poweroff command to power off the device.

5. Check accessories

1. Make sure that the four optical transceiver modules are installed on a 25 Gbit/s optical port.

2. Make sure that the two power cords are complete.

3. Return the Data Transport III device through the specified logistics company that cooperates with Alibaba Cloud.

Migrate data to the cloud and verify the migration result

Grant permissions to a RAM role

Alibaba Cloud uses a specific RAM role to upload data in the Data Transport III device to the Object Storage Service (OSS) bucket that you specified. You must grant the required permissions to the RAM role. Perform the following steps to grant the required permissions to the RAM role:

• Log on to the OSS console.

• In the left-side navigation pane, click Buckets and click the name of the desired bucket.

• In the left-side navigation pane, choose Permission Control > Bucket Policy.

• On the Bucket Policy tab, select Add by Syntax. In the editor, click Edit, specify a custom bucket policy, and then click Save.

  • Grant the RAM role the permissions to list, read, and delete objects in and write objects to the destination bucket.

{
  "Version": "1",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "oss:List*",
        "oss:Get*",
        "oss:Put*",
        "oss:AbortMultipartUpload"
      ],
      "Principal": [
         "arn:sts::1737441177608761:assumed-role/mgw-data-transport-role/*"
      ],
      "Resource": [
        "acs:oss:*:<myuid>:<mybucket>",
        "acs:oss:*:<myuid>:<mybucket>/*"
      ]
    }
  ]
}

Migrate data to the cloud

Alibaba Cloud uses a specific RAM role that has the required permissions to migrate the data in the Data Transport III device to the cloud. After the data is migrated to the cloud, Alibaba Cloud provides you with a data migration report. You can verify the migration results based on the data migration report. At this point, the data migration task is complete.

Data migration report

After a data migration report is generated, the migration report files are stored in a specific OSS bucket. The directories in which migration report files are stored are shown in the following code block:

OSS://<bucket>/<prefix>/aliyun_import_report/<uid>/<jobid>/<runtimeid>/total_list/
OSS://<bucket>/<prefix>/aliyun_import_report/<uid>/<jobid>/<runtimeid>/failed_list/
OSS://<bucket>/<prefix>/aliyun_import_report/<uid>/<jobid>/<runtimeid>/skipped_list/

Verify the migration result

Data Transport only migrates data and does not ensure data consistency or integrity. After the migration task is complete, you must check all the migrated data and verify the data consistency between the source and destination data addresses. You must also revoke the permissions on the Data Transport III device granted to the specified RAM role.