Data Integration supports offline integration, real-time integration, and whole database migration integration methods. This topic describes the data source types supported by offline integration, real-time integration, and whole database migration.
Scenarios for different integration types
Integration type | Scenarios |
Offline integration | Applicable to scenarios such as data migration to the cloud and cloud data migration to on-premises business systems. For example, you can migrate data from an on-premises MySQL database to ApsaraDB RDS. |
Whole database migration | Applicable to scenarios such as synchronizing data from databases in data centers or self-built databases on ECS to offline data warehouses (Hive) and big data compute services. For example, you can migrate data from a self-built MySQL database on ECS to MaxCompute. |
Real-time integration | Applicable to scenarios where data changes in the entire database or all tables of the source data source are integrated into the destination data source in real time, achieving real-time data synchronization between the source and destination data sources. |
Data sources supported by offline integration
Data source | Read | Write |
Big data storage data sources | ||
MaxCompute | Support | Support |
Hive | supported | Support |
Hologres | Support | Support |
Impala | supported | Support |
TDH Inceptor | Support | supported |
Kudu | supported | Support |
StarRocks | Support | supported |
Hudi | supported | Support |
Doris | Support | supported |
GreenPlum | Support | Support |
TDengine | Support | Not supported |
ArgoDB | Support | Supported features |
Paimon | Not supported | Not supported |
SelectDB | Support | Support |
Databricks | Support | Support |
Amazon Redshift | Support | Support |
DolphinDB | Support | Not supported |
File data sources | ||
HDFS | Support | Support |
FTP | Support | supported |
OSS | Support | supported |
Amazon S3 | Support | Support |
Message queue data sources | ||
Log Service | Support | Not supported |
Kafka | Support | Support |
DataHub | Support | supported |
Relational data sources | ||
PolarDB | Support | Support |
PolarDB-X (formerly DRDS) | Support | Support |
MySQL | supported | Support |
SAP HANA | supported | Support |
Microsoft SQL Server | Supported | Support |
PostgreSQL | Support | supported |
AnalyticDB for MySQL 2.0 | supported | Not supported |
AnalyticDB for MySQL 3.0 | supported | Support |
AnalyticDB for PostgreSQL | Support | supported |
OceanBase | Support | Support |
Oracle | Support | Support |
Vertica | supported | Support |
IBM DB2 | Support | Support |
Teradata | Support | supported |
ClickHouse | supported | Support |
Dameng (DM) | Support | Support |
GBase 8a | supported | supported |
KingbaseES | Support | Support |
TiDB | supported | supported |
GoldenDB | Support | supported |
OpenGauss | Support | Support |
GaussDB (DWS) | supported | Support |
Amazon RDS for PostgreSQL | Support | Support |
Amazon RDS for MySQL | Support | Support |
Amazon RDS for SQL Server | supported | Support |
Amazon RDS for Oracle | Support | supported |
Amazon RDS for DB2 | supported | Support |
TDSQL for MySQL | Support | supported |
PolarDB-X 2.0 | Support | Support |
GBase 8c | Support | Supported |
NoSQL data sources | ||
HBase0.9.4 | Not supported | Not supported |
HBase1.1x | Support | Support |
HBase2.0 | supported | Support |
Elasticsearch | supported | Support |
MongoDB | supported | supported |
Tablestore | Support | Support |
Aliyun HBase | Not supported | Not supported |
Redis | Support | Not supported |
Lindorm (compute engine) | Support | Support |
Easysearch | Support | Support |
OpenSearch | Not supported | Supported |
Semi-structured storage data sources | ||
API | Support | Support |
SAP Table | Support | Not supported |
Salesforce | supported | Not supported |
Data sources supported by whole database migration
Data source type | Data source | References |
Source data source | MySQL, Oracle, Microsoft SQL Server, OceanBase, IBM DB2, MaxCompute, FTP, TDengine, Hive, PostgreSQL, DM (Dameng), Amazon Redshift, Amazon RDS for PostgreSQL, Amazon RDS for MySQL, Amazon RDS for SQL Server, Amazon RDS for Oracle, Amazon RDS for DB2, TDSQL for MySQL, DolphinDB, PolarDB-X 2.0, and GBase 8c. . | |
Destination data source | ArgoDB, Hive, TDH Inceptor, MaxCompute, AnalyticDB for PostgreSQL, StarRocks, SelectDB, Doris, GaussDB (DWS), Lindorm (compute engine), Databricks. |
Data sources supported by real-time integration
Real-time computing engine | Data source | References |
Flink on YARN |
| |
Flink on K8s |
| |
Realtime Compute for Apache Flink (VVP) |
|