Import data from PolarDB-X 2.0 to Tablestore - Tablestore

You can use Data Transmission Service (DTS) to synchronize or migrate data from PolarDB-X 2.0 to Tablestore.

Background information

Alibaba Cloud Data Transmission Service (DTS) is a real-time data streaming service that supports data transmission between various data sources, such as relational database management system (RDBMS) databases, NoSQL databases, and online analytical processing (OLAP) databases. DTS provides the data synchronization, data migration, change tracking, data integration, and data processing features to help you manage data based on a secure, scalable, and highly available architecture. For more information, see What is DTS?

Scenarios

Big data analysis and processing
If you want to perform complex analysis and generate reports for a large amount of business data stored in PolarDB, you can migrate the data to Tablestore. The distributed architecture and highly concurrent read and write capabilities of Tablestore allow you to perform fast data queries and ad hoc queries in big data business intelligence (BI) and OLAP scenarios.
Log and event data processing
If you want to process large amounts of log and event data generated by Internet services, IoT devices, or applications, you can migrate the data to Tablestore for more efficient storage and analysis. Tablestore is suitable for processing semi-structured or unstructured data to easily perform log analysis, monitoring and alerting, and trend prediction.
Cost optimization and archiving
If data stored in relational databases continuously increases, you can migrate infrequently accessed historical data from the relational databases to Tablestore. This reduces storage costs and ensures that data is accessible for compliance audit or historical analysis.

Data import schemes

Select an appropriate import scheme based on the actual data migration scenario. The following table describes the import schemes.

Import scheme

Description

Migrate data from PolarDB-X 2.0 to Tablestore

Data migration is performed to migrate data to the cloud. For example, you can migrate data from on-premises databases, self-managed databases on Elastic Compute Service (ECS) instances, or third-party cloud databases to Alibaba Cloud databases. Data migration is a one-off task. You can release the database instance after you migrate data. Migration types include schema migration, full data migration, and incremental data migration.

If you use incremental migration, you can use several features that are similar to data synchronization features. However, incremental migration is less flexible than data synchronization. For example, you cannot modify the data that you want to migrate in incremental mode without interrupting business or perform two-way incremental migration.

Synchronize data from PolarDB-X 2.0 to Tablestore

Data synchronization is performed to synchronize data between two data sources in real time. This process is suitable for various scenarios, such as active geo-redundancy, disaster recovery, cross-border data synchronization, load balancing, cloud BI systems, and real-time data warehousing. Data synchronization is a continuous task. After you create a data synchronization task, data is continuously synchronized to maintain data consistency between the source and the destination. Synchronization types include schema synchronization, full data synchronization, and incremental data synchronization.

How data import works

Data migration process

A complete data migration process consists of the following migration types: schema migration, full data migration, and incremental data migration. To keep the source database operational during data migration, select all migration types when you configure a data migration task.

Data synchronization process

DTS can synchronize ongoing data changes between two data sources. In most cases, data synchronization is used to replicate data from online transaction processing (OLTP) databases to OLAP databases. A data synchronization task consists of the following phases:

Initial synchronization: DTS collects incremental data and then loads the schema and existing data of the source database to the destination database.
Real-time data synchronization: DTS synchronizes ongoing data changes and keeps the destination database in sync with the source database.

Billing

Data migration

Migration type	Instance configuration fee	Internet traffic fee
Schema migration and full data migration	Free of charge.	Free of charge.
Incremental data migration	Charged. For more information, see Billing overview.	Free of charge.

Data synchronization

Synchronization type	Task configuration fee
Schema synchronization and full data synchronization	Free of charge.
Incremental data synchronization	Charged. For more information, see Billing overview.

Tablestore

After you import data to Tablestore, you are charged by Tablestore for storage usage based on the amount of stored data.
When you use a migration tool to access Tablestore, you are charged by Tablestore for read and write throughput based on the read and write requests. You are separately charged for metered read and write capacity units (CUs) and reserved read and write CUs. The type of the instance you access determines whether metered read and write CUs or reserved read and write CUs are consumed.
Note
For information about instance types and CUs, see Instances and Read and write throughput.