All Products
Search
Document Center

Data Online Migration:What is Data Online Migration?

Last Updated:Apr 24, 2024

Alibaba Cloud Data Online Migration is a data channel between different storage services. You can use Data Online Migration to migrate data from third-party sources such as Amazon Web Services (AWS) and Tencent Cloud Object Storage (COS) to Alibaba Cloud Object Storage Service (OSS). You can also use Data Online Migration to flexibly migrate data between Alibaba Cloud OSS buckets.

Benefits

Data Online Migration is a secure, efficient, and easy-to-use online data migration service. This service helps you migrate data from different cloud service providers to Alibaba Cloud over the Internet.

Support for data migration from major cloud service providers to Alibaba Cloud OSS

  • Data Online Migration allows you to migrate data from different Alibaba Cloud data sources to OSS buckets. The supported data sources include HTTP or HTTPS sources, OSS buckets in different accounts, and OSS buckets in different regions.

  • Data Online Migration allows you to migrate data from Qiniu Cloud Object Storage (KODO), Tencent COS, and Amazon Simple Storage Service (Amazon S3) to Alibaba Cloud OSS.

  • Data Online Migration allows you to migrate data from a local file system to Alibaba Cloud OSS.

Flexible data migration methods

New version

  • Filter rule: You can filter files by the time when they were last modified. After you specify the filter condition, only the files that were modified within the specified time period are migrated.

  • Migration time: You can specify the start and end time of a migration task.

  • Flexible throttling: You can modify throttling policies during data migration to flexibly control the bandwidth. It takes a certain amount of time for the modified throttling policies to take effect.

Note

For more information, see the migration tutorials.

Previous version

  • Full migration: The system runs a full migration task for the data that is generated or modified after the specified point in time.

  • Incremental migration: The system runs migration tasks for a specific number of times at the specified interval.

Secure and efficient data transmission methods

  • Automatic identification of data to be migrated: The system automatically compares the data in the source with the data in the destination before the migration.

    • New version: If you configure the system to not overwrite destination files that have the same names as source files when you create a migration task, the source files that have the same names as the destination files are skipped in the migration. This helps reduce data duplicates and data transmission costs.

    • Previous version: If the name and size of a source file are the same as those of a destination file and the modification time of the source file is earlier than that of the destination file, the source file is skipped. This helps reduce data duplicates and data transmission costs.

      Warning

      If you migrate multiple versions of data, the version order or data consistency is not guaranteed.

  • Migration monitoring: You can monitor the status, traffic, and progress of migration tasks.

  • Migration reports:

    • New version: You can query migration reports in Simple Log Service after you choose to push migration logs to Simple Log Service when you create a migration task.

    • Previous version: The system provides migration reports to show the result of each migration task. The result includes the success rate, number of migrated files, migrated files, verification result, number of failed files, failed files, and causes of failures.

  • Important

    The migration reports are only for your reference. For accurate results, you must manually verify the data consistency.

  • Retry on failures: If some files in a migration task fail to be migrated, you can migrate the failed files again.

Billing

Data Online Migration is in public preview. You can use the service free of charge. The following billable items are involved in a migration task:

  • When you read data from the source data address, you are charged outbound Internet traffic fees and API request fees by the storage service provider of the source data address.

  • When you write data to the destination data address, you are charged API request fees by OSS for writing and verifying data. For more information about OSS billing, see Billing overview.

  • Before you create a migration task to migrate data of the Archive storage class, you must manually restore the data. You are charged for the restoration operation. In some cases, the restoration fees are high. For more information, contact the service provider that offers the source bucket.

Terms of service

For more information, see Data Transport Terms of Service.

Use now

Log on to the Data Migration console to use Data Online Migration.

Related services

In addition to Data Online Migration, Alibaba Cloud also provides Data Transport. Data Transport helps you efficiently and securely transmit large-scale data. You can migrate terabytes or petabytes of local data to Alibaba Cloud by using custom Data Transport devices. Data Transport helps you improve the efficiency of large-scale data transmission and prevent security issues. For more information, see Data Transport.