By Thomas Poon, Solutions Architect
Cloud Object Storage is a widely used technology for public cloud providers. Alibaba Cloud Object Storage Service (OSS), AWS S3, and Azure Blob Storage are some notable examples of object storage products hosted on the cloud.
Alibaba Cloud has recently released Data Migration Service, a console GUI tool that helps customers migrate Object Storage services from other sources to Alibaba Cloud OSS.
In this article, I will show you how to migrate from AWS S3 to Alibaba Cloud OSS. Data Migration Service is not limited to AWS S3, you can use it with other products as well. If you want to migrate from other sources, the steps will be similar because the tool is very easy to use.
Let's get started with the tutorial.
I have created a bucket named "frombuckettp" in AWS S3 Singapore, and have stored files in the basic bucket.
Additionally, I have two folders with files inside of them. The figure below shows the contents of folder1.
Next, get the API Key and Secret from "My Security Credentials"
If you don't have one, you can create new access key. Then, save your access key and secret, we will use it during the migration.
Next, log in to the Alibaba Cloud console and navigate to OSS. Click + to create a new bucket.
Create the destination bucket "tobuckettp" in Region "Hong Kong".
You will see an empty bucket named "tobuckettp" created.
Next, navigate to the Data Migration Service console https://mgw.console.aliyun.com. You can also locate this feature under "Data Transport".
Then you will see this screen:
Now we will create two data addresses, using AWS S3 as source and Alibaba Cloud OSS as destination.
Click "Create Data Address".
You will see a list of supported data types under "Data Type".
Fill in the following information and click OK. You'll need to enter information such as the endpoint, bucket, and access keys.
Next, create the OSS endpoint by clicking "Create Data Address".
Similarly, input your Alibaba Cloud ECS AK/AKS, and bucket information "tobuckettp". Once completed, click OK.
After completing all the necessary setups, we can now we start the actual migration.
Navigate to Migration Jobs and click Create Job.
Accept the terms and conditions of Migration Service and click "Next".
Just input the arbitrary job name, source data address and destination data address and click "Next".
If you know the Data Size and File Count information, you can specify them here and the tool will try prioritize the task based on the input. Click "Create" when you have completed the settings.
You should see the job status is "Creating", which will then change to "Migrating".
You can click on "Manage" to see the status of your migration.
Once the task is finished, you can go back to the OSS console to confirm that your migration is successful. Under the Files tab of "tobuckettp" bucket, you should see all data from S3 are now migrated to OSS.
That's it! Alibaba Cloud Data Migration Service tool is easy to use and can help you speed up your migration process.
Alibaba Cloud MaxCompute - May 9, 2019
Alibaba Clouder - December 26, 2018
ApsaraDB - April 28, 2020
Alibaba EMR - May 26, 2021
Alibaba Clouder - December 30, 2020
Alibaba Clouder - March 11, 2019
Provides scalable, distributed, and high-performance block storage and object storage services in a software-defined manner.Learn More
An encrypted and secure cloud storage service which stores, processes and accesses massive amounts of data from anywhere in the worldLearn More
Block-level data storage attached to ECS instances to achieve high performance, low latency, and high reliabilityLearn More
Build a Data Lake with Alibaba Cloud Object Storage Service (OSS) with 99.9999999999% (12 9s) availability, 99.995% SLA, and high scalabilityLearn More
More Posts by Alibaba Clouder