This topic describes how to migrate data by using Data Transport.

Usage notes

When you perform an online migration, take note of the following information:
  • If the source data addresses and the destination data addresses are NAS endpoints in the same region, the migration is performed over the internal network of Alibaba Cloud by default even if you select public endpoints as the data addresses.
  • A migration job occupies the network resources of the source data address and the destination data address. To ensure business continuity, we recommend that you configure a rate limit for your migration job or run your migration job during off-peak hours.
  • Before a migration job starts, the system checks the files at the source data address and the destination data address. If a source file has the same name as a destination file and the source file is updated later than the destination file, the destination file is overwritten during the migration. If the two files have different content, you must change the name of one file or back up the destination file.
  • Symbolic links that exist at the source data address are skipped during migration.

Step 1: Create a source data address

  1. Log on to the Alibaba Cloud Data Transport console.
  2. In the left-side navigation pane, choose Data Online Migration > Data Address. On the page that appears, click Create Data Address.
  3. In the Create Data Address panel, configure the parameters and click OK.
    Parameter Required Description
    Data Type Yes Select NAS.
    Data Region Yes Select the region where the Network Attached Storage (NAS) file system is located.

    If you select Alibaba Cloud for NAS Type, select the region where the Apsara File Storage NAS file system is located. If you select Others for NAS Type, select the region of the virtual private cloud (VPC) to which the third-party NAS file system is attached.

    Data Name Yes Enter a name that is 3 to 63 characters in length. Special characters are not supported, except for hyphens (-) and underscores (_).
    NAS Type Yes Select the source of the NAS file system based on the actual scenario.
    • Alibaba Cloud: a NAS file system that is created on Alibaba Cloud.
    • Others: a NAS file system that is created on a third-party platform. You must mount the file system within an Alibaba Cloud VPC.
    File System Yes (only for Apsara File Storage NAS) Select the corresponding NAS file system.
    Mount Point Yes (only for Apsara File Storage NAS) Select the mount target of the NAS file system.
    Notice You can mount a NAS file system only within a VPC. The classic network is not supported.
    VPC Yes (only for third-party NAS services) Select a VPC to which the NAS file system is attached.
    Switches Yes (only for third-party NAS services) Select a vSwitch for the NAS file system.
    NAS Address Yes (only for third-party NAS services) Enter the private IP address of the third-party NAS server that is located in the VPC.
    Sub Folder Optional Enter the directory where the data to be migrated is located. If you do not set this parameter, the default value is the root directory (/).
    Notice If you specify a subdirectory, you must make sure that the subdirectory exists on the NAS server. Otherwise, the data address fails to be created.
    Connection Method Yes (only for third-party NAS services) Select a protocol type for NAS.
    Connection Password Yes (only for third-party NAS services) Specify whether a password is required.
    • No Password: No password is required to access the NAS service.
    • Use Password: A username and a password are required to access the NAS service. You must enter a valid username and password.
    Note For more information about the status of a new data address, see Data address status.
  4. Optional:If the system prompts that this feature is in public preview, click Application to apply to use the feature.
  5. Enter the required information and submit the application for public preview. After the application is approved, the system sends a text message to notify you.

Step 2: Create a destination data address

  • If the destination NAS data address is located in the same VPC as the source NAS data address, see Step 1: Create a source data address.
  • If the destination NAS data address is located in a different VPC from the source NAS data address, configure the destination data address based on the following instructions:
    • Data Type: Select NAS.
    • Data Region: Select the region that is the same as that of the source NAS data address.
    • NAS Type: Select Others.
    • VPC: Select the VPC that is the same as that of the source NAS data address.
    • Switches: Select the vSwitch that is the same as that of the source NAS data address.
    • NAS Address: If the NAS type of the destination NAS data address is Alibaba Cloud, enter the mount target of the NAS file system. If the NAS type of the destination NAS data address is Others, enter the private IP address of the NAS file system within the VPC.
    • For more information, see Step 1: Create a source data address.

Step 3: Create a migration job

  1. Choose Data Online Migration > Migration Jobs and click Create Job.
  2. In the Create Job dialog box, read the Terms of Migration Service, select I understand the above terms and conditions, and apply for enabling the data migration service, and then click Next.
    Then, the Fee Reminder message that reminds you of the request fee appears. Click Yes, Go Ahead. OSS request fee
  3. On the Job Config tab, configure the parameters and click Next.
    Parameter Required Description
    Job Name Yes Enter a job name. The name must meet the following requirements:
    • The name must be 3 to 63 characters in length.
    • The name can contain lowercase letters, digits, and underscores (_).
    • The name cannot start or end with a hyphen (-).
    Source Data Address Yes Select the source data address that you created.
    Destination Data Address Yes Select the destination data address that you created.
    Notice The source data address may be located in a different country from the destination data address. In this case, before you configure the migration job, you must submit a ticket to request permissions to create cross-country migration jobs. You must commit that your business is legitimate, the data transit process conforms to local rules and regulations, and your data does not contain illegal information.
    Specified Directory No
    • Do not filter: All data from the source data address is migrated.
    • Exclude: The files and subdirectories in the excluded directories are not migrated.
    • Contain: Only the files and subdirectories in the specified directories are migrated.
    Note
    • A directory name cannot start with a forward slash (/) or a backslash (\), and cannot contain double slashes (//), double periods (..), or double quotation marks ("). The character string that consists of all the specified directory names cannot exceed 10 KB in length.
    • A directory name must end with a forward slash (/). For example, you can specify docs/ as the directory name.
    • You can specify a maximum of 20 directories of the Exclude or Contain type.
    Migration Type Yes
    • Full: The system runs a full migration job. You must specify the Start Time Point of File parameter. The system migrates the data whose last modification time is later than the specified start time. After all data is migrated, the migration job is ended. If the data at the source data address changes, you can submit the job again. In this case, the system migrates only the data that is changed after the previous job.
    • Incremental: The system runs the migration job based on the specified Migration Interval and Migration Times parameters. You must specify the Start Time Point of File parameter. During the first migration, the system migrates the full data that is modified after the specified start time. After the first migration is complete, incremental migrations are performed based on the specified Migration Interval parameter. For each incremental migration, the system migrates only the data that is created or modified after the previous migration started and before the current migration starts. If you set Migration Times to N, full migration is performed once and then incremental migration is performed (N - 1) times. For example, you set Migration Interval to 1 hour, Migration Times to 5, and Start Time Point of File to 08:00, March 5, 2019, and the current time is 08:00, March 10, 2019. When the first migration starts, the system migrates the files that are last modified between 08:00, March 5, 2019 and 08:00, March 10, 2019. In this example, the first migration requires 1 hour to complete and the second migration starts at 10:00, March 10, 2019. The duration from 08:00 to 10:00 includes the 1 hour that the first migration requires and the migration interval of 1 hour. During the second migration, the system migrates the files that are last modified between 08:00, March 10, 2019 and 10:00, March 10, 2019. The migration job consists of one full migration and four incremental migrations.
    Notice
    Before you start a migration job of the Full or Incremental type, the system compares files at the source data address with those at the destination data address. If a source file has the same name as a destination file, the destination file is overwritten when one of the following conditions is met:
    • The source file has a later last modification time than the destination file.
    • The size of the source file is different from that of the destination file.
    Start Time Point of File Yes (only for full and incremental migrations)
    • All: All files are migrated.
    • Assign: Only the files that are created or modified after the specified time are migrated. For example, if you set the start time point to 08:00:00, November 01, 2018, only the files that are created or modified after 08:00:00, November 01, 2018 are migrated. Files that are created or modified before the specified time are skipped.
    Migration Interval Yes (only for incremental migrations) The default value is 1 hour and the maximum value is 24 hours.
    Migration Times Yes (only for incremental migrations) The default value is 1 and the maximum value is 30.
  4. Click Next. In the Performance step, navigate to the Data Prediction section and configure the Data Size and File Count parameters.
    Note To ensure a successful migration, we recommend that you estimate the amount of data to be migrated as accurately as possible.
  5. Optional:On the Performance tab, navigate to the Flow Control section, specify the Time Range and Max Flow(MB/s) parameters, and then click Add.
    Note To ensure business continuity, we recommend that you configure the Time Range and Max Flow parameters based on the workload peaks and troughs.
  6. Click Create and wait until the migration job is completed.

View the status of a data address

After you create a NAS data address, one of the following states is displayed for the data address:
  • Normal: The data address is created.
  • Creating: About 3 minutes are required to create the first NAS data address. If the state of the data address remains in the Creating state for a long time, you can click Refresh in the upper-right corner to update the status.
  • Invalid: An error has occurred when you create the data address. You can check your settings and check whether Data Online Migration is allowed to access the NAS service. If this issue persists, submit a ticket.