This topic describes the precautions and procedure for data migration.

Precautions

When creating a migration job, you must note the following issues:
  • A migration job occupies the network resources of the source data address and destination data address. To ensure business continuity, we recommend that you specify a speed limit for a migration job or perform the migration job during off-peak hours.
  • Before a migration job is performed, files at the source data address and the destination data address are checked. The files at the destination data address are overwritten if the source files have the same name as the destination files and have a later modification time. If two files have the same name but different content, you must change the name of one file or back up the files.
  • Data Transport only allows you to migrate data of a single bucket at a time, rather than all data for an account.

Step 1: Create a source data address

  1. Log on to the Data Transport console.
  2. Choose Data Online Migration > Data Address, and click Create Data Address.
  3. In the Create Data Address dialog box, configure the required parameters, and click OK.
    Parameter Required Description
    Data Type Yes Select AWS S3 Inventory.
    Data Name Yes A data name is 3 to 63 characters in length. Special characters are not supported, except for hyphens (-) and underscores (_).
    Endpoint Yes Enter an AWS S3 endpoint. For more information, see Regions and endpoints.
    Bucket Yes Enter the name of an Amazon S3 bucket.

    The bucket name cannot contain invalid characters such as space, carriage return, and tab.

    AccessKeyId and SecretAccessKey Yes Enter the key used to access an AWS S3 bucket, and delete the key after the migration is complete.
    InventoryEndpoint Yes Enter the endpoint used to access an AWS S3 inventory. For more information, see Regions and endpoints.
    InventoryAccessKeyId and InventorySecretAccessKey Yes Enter the key used to access an AWS S3 inventory, and delete the key after the migration is complete.
    InventoryAddress Yes Enter the URL of an AWS S3 inventory, such as s3://{bucket}/{ObjectKey}. {bucket} is the name of the bucket where the inventory is located, and {ObjectKey} is the path of the manifest.json file.
  4. You must apply for whitelist permissions because this feature is in the public preview phase. Click Application.
  5. Enter the required information and submit the application for using this feature. After the application is approved, you will receive a short message service (SMS) notification.

Step 2: Create a destination data address

  1. Choose Data Online Migration > Data Address and click Create Data Address.
  2. In the Create Data Address dialog box, configure the required parameters, and click OK.
    Parameter Required Description
    Data Type Yes Select OSS.
    Data Region Yes Select a region where the destination data address is located.
    Data Name Yes A data name is 3 to 63 characters in length. Special characters are not supported, except for hyphens (-) and underscores (_).
    OSS Endpoint Yes
    Select an endpoint based on the region where your data is located.
    • You can use the following HTTP-based endpoint to access OSS from public networks: http://oss-cn-endpoint.aliyuncs.com.
    • You can also use the following HTTPS-based endpoint to access OSS from public networks: https://oss-cn-endpoint.aliyuncs.com.
    For more information, see Regions and endpoints.
    Note When migrating third-party data to OSS, you must use a public network endpoint to access OSS.
    AccessKeyId and AccessKeySecret Yes Enter an AccessKey pair that is used to migrate data. For more information, see Create an AccessKey pair.
    OSS Bucket Yes Select a bucket to store migrated data.
    OSS Prefix No An OSS prefix cannot start with a forward slash (/) and must end with a forward slash (/). For example, data/to/oss/. If you want to store data to the root directory of a bucket, you can leave the OSS Prefix parameter empty.
    Notice When the name of a file to be migrated at the source data address starts with a forward slash (/), you must add an OSS prefix to the file name. Otherwise, the migration job will fail. Assume that the name of a file to be migrated is /test/test.png. You must add the following OSS prefix to the file name: oss/. After a migration job is complete, an OSS file whose name is /test/test.png changes to oss//test/test.png.

Step 3: Create a migration job

  1. Choose Data Online Migration > Migration Jobs, and click Create Job.
  2. In the Create Job dialog box, read the Terms of Migration Service, select I understand the above terms and conditions, and apply for opening data migration service, and then click Next.
    Then, the Fee Reminder dialog box appears.OSS_billing request
  3. On the Job Config tab, configure the required parameters, and click Next.
    Parameter Required Description
    Job Name Yes A job name is 3 to 63 characters in length and can contain lowercase letters, digits, and hyphens (-). A job name cannot start or end with a hyphen (-).
    Source Data Address Yes Select a source data address that you have created.
    Destination Data Address Yes Select a destination data address that you have created.
    Notice If the source data address and the destination data address are located in different countries, you can submit a ticket to request permissions to create a cross-national migration job. You must ensure that your business is legitimate, data transit conforms to local rules and regulations, and data does not include illegal information.
    Specified Directory No
    • Do not filter: All data at the source data address is migrated.
    • Exclude: During migration, the files and subdirectories under the specified directory are not migrated.
    • Contain: During migration, only the files and subdirectories under the specified directory are migrated.
    Note
    • A directory cannot start with a forward slash (/) or a backslash (\), and cannot contain double slashes (//), periods (..), and quotation marks ("). The total length of characters you entered for the directories is constrained by a maximum size of 10 KB.
    • A directory must end with a forward slash (/), for example, docs/.
    • You can specify a maximum of 20 directories of the Exclude or Contain type.
    Migration Type Yes Full: performs a full data migration. After all data is migrated, a migration job is closed. You can submit the job again if the data at the source data address changes. In this case, the migration service only migrates the data that is changed after the previous job.
    Notice Before you start a migration job, Data Transport compares files of the source data address with those of the destination data address. If a source file has the same name as a destination file, the destination file is overwritten when one of the following conditions is met:
    • The content types of the source file and the destination file are different.
    • The source file is updated after the previous migration.
    • The size of the source file is different from that of the destination file.
  4. On the Performance tab, navigate to the Data Prediction section and specify the Data Size and File Count parameters.
    Note To ensure a successful migration, you must estimate the amount of data to be migrated. For more information, see Estimate the amount of data to be migrated.
  5. Optional. On the Performance tab, navigate to the Flow Control section, specify the Time Range and Max Flow parameters, and then click Add.
    Note To ensure business continuity, we recommend that you specify the Time Range and Max Flow parameters based on the fluctuation of workloads.
  6. Click Create and wait until the migration job is complete.