This topic describes the notes and procedure for data migration.

Notes

When you perform an online migration, take note of the following issues:
  • A migration job occupies the network resources of the source data address and destination data address. To ensure business continuity, we recommend that you specify a speed limit for a migration job or perform the migration job during off-peak hours.
  • Before a migration job is performed, files at the source data address and the destination data address are checked. The files at the destination data address are overwritten if the source files have the same name as the destination files and have a later modification time. If two files have the same name but different content, you must change the name of one file or back up the files.
  • Data Transport only allows you to migrate data of a single bucket at a time, rather than all data for an account.

Step 1: Create a source data address

  1. Log on to the Data Transport console.
  2. Choose Data Online Migration > Data Address, and click Create Data Address.
  3. In the Create Data Address panel, configure the following parameters and click OK.
    Parameter Required Description
    Data Type Yes Select AWS S3 Inventory.
    Data Name Yes Enter a name that is 3 to 63 characters in length. Special characters are not supported, except for hyphens (-) and underscores (_).
    Endpoint Yes Enter the endpoint of Amazon Simple Storage Service (Amazon S3). For more information, see Regions and endpoints.
    Bucket Yes The name of an AWS S3 bucket.

    The bucket name cannot contain invalid characters, such as spaces, line breaks, and tab characters.

    Access Key Id and Secret Access Key Yes Specify the key that is used to access the AWS S3 bucket. After the migration is complete, delete the key.
    InventoryEndpoint Yes Enter the endpoint that is used to access an AWS S3 inventory. For more information, see Regions and endpoints.
    Inventory AccessKey Id and Inventory Secret AccessKey Yes Specify the key that is used to access the AWS S3 inventory. After the migration is complete, delete the key.
    InventoryAddress Yes Enter the URL of the AWS S3 inventory, such as s3://{bucket}/{ObjectKey}. In the example, bucket specifies the name of the bucket where the inventory is located, and ObjectKey is the path of the manifest.json file.
  4. You must apply for whitelist permissions because this feature is in the public preview phase. Click Application.
  5. Enter the required information and submit the application for using this feature. After the application is approved, you will receive a short message service (SMS) notification.

Step 2: Create a destination data address

  1. Choose Data Online Migration > Data Address, and click Create Data Address.
  2. In the Create Data Address panel, configure the parameters and click OK.
    Parameter Required Description
    Data Type Yes Select OSS.
    Data Region Yes Select the region where the destination data address is located.
    Data Name Yes Enter a name that is 3 to 63 characters in length. Special characters are not supported, except for hyphens (-) and underscores (_).
    OSS Endpoint Yes
    Select an endpoint based on the region where your data is located.
    • http://oss-cn-endpoint.aliyuncs.com: indicates that you use an HTTP-based endpoint to access Object Storage Service (OSS) over the Internet.
    • https://oss-cn-endpoint.aliyuncs.com: indicates that you use an HTTPS-based endpoint to access OSS over the Internet.
    For more information, see Endpoint.
    Note When you migrate third-party data to OSS, you must access OSS from an Internet endpoint.
    Access Key Id and Access Key Secret Yes Specify the AccessKey pair that is used to migrate data. For more information, see Create an AccessKey pair.
    OSS Bucket Yes Select a bucket to store the migrated data.
    OSS Prefix No An OSS prefix cannot start with a forward slash (/) and must end with a forward slash (/). For example, you can specify data/to/oss/ as the OSS prefix. Do not specify this parameter if you want to migrate data to the root directory of the specified bucket.
    Notice If the name of a source file starts with a forward slash (/), you must specify an OSS prefix when you configure the destination data address. If no OSS prefix is specified, the migration job fails. For example, if the name of a file to be migrated is /test/test.png, you must specify an OSS prefix, such as oss/. After the migration job is completed, the name of the OSS file changes from /test/test.png to oss//test/test.png.

Step 3: Create a migration job

  1. Choose Data Online Migration > Migration Jobs, and click Create Job.
  2. In the Create Job panel, read the Terms of Migration Service and select I understand the above terms and conditions, and apply for opening data migration service. Click Next.
    Then, the Fee Reminder dialog box appears.OSS_billing request
  3. On the Job Config tab, configure the following parameters and click Next.
    Parameter Required Description
    Job Name Yes Enter a name that is 3 to 63 characters in length. The name can contain only lowercase letters, digits, and hyphens (-). It cannot start or end with a hyphen (-).
    Source Data Address Yes Select the source data address that you have created.
    Destination Data Address Yes Select the destination data address that you have created.
    Notice The source data address may be located in a different country than the destination data address. In this case, before you configure the migration job, you must submit a ticket to request permissions to create cross-country migration jobs. You must commit that your business is legitimate, data transit conforms to local rules and regulations, and your data does not contain illegal information.
    Specified Directory No
    • Do not filter: All the data at the source data address is migrated.
    • Exclude: The files and subdirectories in the excluded directories are not migrated.
    • Contain: Only the files and subdirectories in the specified directories are migrated.
    Note
    • A directory cannot start with a forward slash (/) or a backslash (\), and cannot contain double slashes (//), double periods (..), or double quotation marks ("). The character string that consists of all the specified directory names cannot exceed 10 KB in size.
    • A directory must end with a forward slash (/). For example, you can specify docs/ as the directory.
    • You can specify a maximum of 20 directories of the Exclude or Contain type.
    Migration Type Yes Full: The system runs a full migration job. After all data is migrated, a migration job is closed. You can submit the job again if the data at the source data address changes. In this case, the system migrates only the data that is changed after the previous job.
    Notice Before you start a full migration job, the system compares files at the source data address with those at the destination data address. If a source file has the same name as a destination file, the destination file is overwritten when one of the following conditions is met:
    • The content types of the source file and the destination file are different.
    • The source file has a later last modification time than the destination file.
    • The size of the source file is different from that of the destination file.
  4. On the Performance tab, navigate to the Data Prediction section and specify the Data Size and File Count parameters.
    Note To ensure a successful migration, estimate the amount of data to be migrated as accurately as possible. For more information, see Estimate the amount of data to be migrated.
  5. Optional. On the Performance tab, navigate to the Flow Control section, specify the Time Range and Max Flow parameters, and then click Add.
    Note To ensure business continuity, we recommend that you specify the Time Range and Max Flow parameters based on the workload peaks and troughs.
  6. Click Create and wait until the migration job is completed.