This topic describes how to migrate data by using Data Transport.

Precautions

When you perform online migration, take note of the following items:
  • A migration task occupies the network resources of the source and destination data addresses. To ensure business continuity, we recommend that you configure a rate limit for migration jobs or run migration jobs during off-peak hours.
  • Before the system starts a migration job, the system checks the files at the source data address and the destination data address. If a source file and a destination file have the same name and the source file is updated later than the destination file, the destination file is overwritten. If you want to keep both files, we recommend that you change the name of one file or back up the destination file.
  • Symbolic links that exist at the source data address are skipped during the migration.
  • Empty directories that exist at the source data address are skipped during the migration.

Step 1: Create a source data address

  1. Log on to the Alibaba Cloud Data Transport console.
  2. In the left-side navigation pane, choose Data Online Migration > Data Address. On the page that appears, click Create Data Address.
  3. In the Create Data Address panel, configure the parameters and click OK. The following table describes the parameters.
    Parameter Required Description
    Data Type Yes Select NAS.
    Data Name Yes Enter a name. The name must be 3 to 63 characters in length. The name cannot contain special characters except for hyphens (-) and underscores (_)
    Data Region Yes Select the region where the Network Attached Storage (NAS) file system is located.

    If you set the NAS Type parameter to Alibaba Cloud, select the region where the Apsara File Storage NAS file system is located. If you set the NAS Type parameter to Others, select the region of the Alibaba Cloud virtual private cloud (VPC) to which the third-party NAS file system is attached.

    NAS Type Yes Select the source NAS file system based on the actual conditions.
    • Alibaba Cloud: a NAS file system that is created on Alibaba Cloud.
    • Others: a NAS file system that is created on a third-party platform. You must mount the file system to an Alibaba Cloud VPC.
    File System This parameter is required only if you set the NAS Type parameter to Alibaba Cloud. Select the NAS file system whose data you want to migrate.
    Mount Point This parameter is required only if you set the NAS Type parameter to Alibaba Cloud. Select the mount target of the NAS file system.
    Notice You can mount the NAS file system only to a target that resides in a VPC. Mount targets in the classic network are not supported.
    VPC This parameter is required only if you set the NAS Type parameter to Others. Select a VPC to which the NAS file system is mounted.
    Switches This parameter is required only if you set the NAS Type parameter to Others. Select a vSwitch for the NAS file system.
    NAS Address This parameter is required only if you set the NAS Type parameter to Others. Enter the IP address of the NAS server. This IP address must be accessible to the VPC.
    Sub Folder No Enter the directory in which the data you want to migrate is stored. If you do not specify this parameter, the default value is the root directory (/).
    Notice If you specify a subdirectory, make sure that the subdirectory exists on the NAS server. Otherwise, the source data address fails to be created.
    Connection Method This parameter is required only if you set the NAS Type parameter to Others. Select a protocol type.
    Connection Password This parameter is required only if you set the NAS Type parameter to Others. Specify whether a password is required.
    • No Password: No password is required to access the NAS service.
    • Use Password: A username and a password are required to access the NAS service. You must enter a valid username and password.
    Note For more information about the status of a data address, see View the status of a data address.
  4. Optional:If the system prompts that the feature is in public preview, click Application to apply to use the feature.
  5. Optional:Enter the required information and submit the application. After the application is approved, the system notifies you by text message.

Step 2: Create a destination data address

  1. In the left-side navigation pane, choose Data Online Migration > Data Address. On the page that appears, click Create Data Address.
  2. In the Create Data Address panel, configure the parameters and click OK. The following table describes the parameters.
    Parameter Required Description
    Data Type Yes Select OSS.
    Data Name Yes Enter a name. The name must be 3 to 63 characters in length. The name cannot contain special characters except for hyphens (-) and underscores (_)
    Data Region Yes Select the region where the destination data address is located.
    Enable Transfer Acceleration No For Data Online Migration to use the transfer acceleration feature provided by Object Storage Service (OSS), you must enable the transfer acceleration feature for buckets. The transfer acceleration feature takes effect within 30 minutes after it is enabled. After you enable the feature, wait for 30 minutes before you create a migration job.
    Notice If you use the transfer acceleration feature to access your OSS buckets, you are charged additional fees for transfer acceleration. For more information, see Transfer acceleration.
    OSS Endpoint Yes Select an endpoint based on the region in which your data is stored. For more information, see Regions and endpoints.
    AccessKey Id Yes Specify the AccessKey pair that is used to migrate data. For more information, see Create a Resource Access Management (RAM) user and grant required permissions to the RAM user.
    AccessKey Secret Yes
    OSS Bucket Yes Select a bucket to store the migrated data.
    OSS Prefix No An OSS prefix cannot start with a forward slash (/) but must end with a forward slash (/). For example, you can specify data/to/oss/ as the OSS prefix. If you want to migrate data to the root directory of the specified bucket, do not specify this parameter.

Step 3: Create a migration job

  1. In the left-side navigation pane, choose Data Online Migration > Migration Jobs. On the page that appears, click Create Job.
  2. In the Create Job panel, read the terms of the migration service and select I understand the above terms and conditions, and apply for opening data migration service. Then, click Next.
  3. In the Fee Reminder dialog box, click Yes, Go Ahead.
  4. In the Job Config step, configure the parameters and click Next. The following table describes the parameters.
    Parameter Required Description
    Job Name Yes Enter a job name. The name must be 3 to 63 characters in length and can contain only lowercase letters, digits, and hyphens (-). It cannot start or end with a hyphen (-).
    Source Data Address Yes Select the source data address that you created.
    Destination Data Address Yes Select the destination data address that you created.
    Specified Directory No Specify directories in which the files and subdirectories are migrated or not migrated.
    • Do not filter: All data from the source data address is migrated.
    • Exclude: The files and subdirectories in the specified directories are not migrated.
    • Contain: Only the files and subdirectories in the specified directories are migrated.
    Note
    • Before you configure the Specified Directory parameter, you must configure a whitelist. For more information, see Advanced features.
    • A directory name cannot start with a forward slash (/) or a backslash (\), and cannot contain double slashes (//), double periods (..), or double quotation marks ("). The character string that consists of all the specified directory names cannot exceed 10 KB in length.
    • A directory name must end with a forward slash (/). For example, you can specify docs/ as the directory name.
    • You can specify up to 20 directories of the Exclude or Contain type.
    Migration Type Yes Select the data migration mode.
    • Full: The system migrates all data from the source data address to the destination data address. You must configure the Start Time Point of File parameter. The system migrates all data whose last modification time is later than the specified time. After all data is migrated, the migration job ends.

      If you change the data at the source data address after the migration job is completed, you can submit another job to migrate all data. In this case, the system migrates only the changed data.

    • Incremental: The system runs a migration job based on the values that you specified for the Migration Interval and Migration Times parameters.
      • You must configure the Start Time Point of File parameter. During the first migration, the system migrates all data whose last modification time is later than the specified time. After the first migration job is completed, incremental migration jobs are performed based on the value that you specified for the Migration Interval parameter. For each incremental migration, the system migrates only the data that is created or modified after the previous migration starts and before the current migration starts.
      • If you set the Migration Times parameter to N, full migration is performed once and then incremental migration is performed (N - 1) times.

        For example, the current time is 08:00, March 10, 2019 and you set the Migration Interval parameter to 1, the Migration Times parameter to 5, and the Start Time Point of File parameter to 08:00, March 5, 2019. When the first migration starts, the system migrates all files whose last modification time is between 08:00, March 5, 2019 and 08:00, March 10, 2019. In this example, the first migration requires one hour to complete and the second migration starts at 10:00, March 10, 2019. The duration from 08:00 to 10:00 consists of one hour for the first migration process and one hour for the migration interval. During the second migration, the system migrates the files whose last modification time is between 08:00, March 10, 2019 and 10:00, March 10, 2019. The migration job consists of one full migration and four incremental migrations.

    Notice Before you start a full or incremental migration job, the system compares the files at the source data address with the files at the destination data address. If a source file has the same name as a destination file, the destination file is overwritten when one of the following conditions is met:
    • The Content-Type values of the source file and the destination file are different.
    • The last modification time of the source file is later than that of the destination file.
    • The size of the source file is different from that of the destination file.
    Start Time Point of File Yes Specify a time to filter data to be migrated. Data will be migrated if it is created or modified after the specified time.
    • All: All files are migrated.
    • Assign: Only the files that are created or modified after the specified time are migrated.

      For example, if you set the time to 08:00:00, November 1, 2018, only the files that are created or modified after 08:00:00, November 1, 2018 are migrated.

    Migration Interval This parameter is required when you set the Migration Type parameter to Incremental. The default value is 1 and the maximum value is 24. Unit: hours.
    Migration Times This parameter is required when you set the Migration Type parameter to Incremental. The default value is 1 and the maximum value is 30.
    File Overwrite Method Yes The method that is used to process the source file whose name is the same as that of a destination file. Valid values:
    • LastModified: If a source file has the same name as a destination file, the system compares the last modification time that is indicated by the LastModified property of the files.
      • If the last modification time of the source file is later than that of the destination file, the source file is migrated and the destination file is overwritten.
      • If the last modification time of the source file is earlier than that of the destination file, the source file is not migrated and the destination file is retained.
      • If the two files have the same last modification time, the system checks the values of the Size and Content-Type properties of the files.

        If the files have the same Size and Content-Type values, the source file is not migrated. If the two files have different values of at least one property, the source file is migrated and the destination file is overwritten.

    • Condition: If a source file has the same name as a destination file, the system compares the values of the LastModified, Size, and Content-Type properties of the two files.
      • If all property values of the two files are the same, the source file is not migrated.
      • If the two files have different values of at least one property, the source file is migrated and the destination file is overwritten.
    • All: If a source file has the same name as a destination file, the system performs no comparison and directly overwrites the destination file with the source file.
    • No: If a source file has the same name as a destination file, the system performs no comparison and directly skips the source file in the migration.
  5. In the Performance step, navigate to the Data Prediction section and configure the Data Size and File Count parameters.
    Note To ensure a successful migration, we recommend that you estimate the amount of data that you want to migrate as accurately as possible. For more information, see Estimate the amount of data that you want to migrate.
  6. Optional:In the Performance step, navigate to the Flow Control section, specify the Time Range and Max Flow(MB/s) parameters, and then click Add.
    Note To ensure business continuity, we recommend that you configure the Time Range and Max Flow(MB/s) parameters based on the traffic fluctuations.
  7. Click Create and wait until the migration job is completed.

View the status of a data address

After you create a NAS data address, one of the following states is displayed for the data address:
  • Normal: The data address is created.
  • Creating: The data address is being created. The first NAS data address requires approximately 3 minutes to create. If the data address remains in the Creating state for an extended period of time, you can click Refresh in the upper-right corner to check the latest state of the data address.
  • Invalid: An exception has occurred in the process of creating the address. Check your settings and verify whether Data Online Migration can access the NAS service. If the exception persists, submit a ticket.

Success stories

For examples of migrating data from a NAS file system to an OSS bucket, see Migrate data from an on-premises NAS file system to OSS for an entertainment company.