Data integration supports offline integration, real-time integration, and full database migration. This topic describes the data sources supported by offline integration, real-time integration, and full database migration.
Scenarios for different integration types
Integration type | Scenarios |
Offline integration | Use for scenarios such as migrating data to the cloud or migrating cloud data to on-premises business systems. For example, migrate data from a local MySQL database to an Alibaba Cloud ApsaraDB RDS instance. |
Full database migration | Use to synchronize data from a database in your data center or a self-managed database on an ECS instance to an offline data warehouse, such as Hive, or a big data computing service. For example, migrate data from a self-managed MySQL database on an ECS instance to MaxCompute. |
Real-time integration | Use to integrate data changes from an entire database or all tables in a source data source to a destination data source in real time. This keeps the source and destination data sources synchronized. |
Data sources supported for offline integration
Data source | Read | Write |
Big Data Storage Source | ||
MaxCompute | Supported | Supported |
Hive | Supported | Supported |
Hologres | Supported | Supported |
Impala | Supported | Supported |
TDH Inceptor | Supported | Supported |
Kudu | Supported | Supported |
StarRocks | Supported | Supported |
Hudi | Supported | Supported |
Doris | Supported | Supported |
GreenPlum | Supported | Supported |
TDengine | Supported | Not supported |
ArgoDB | Supported | Supported |
SelectDB | Supported | Supported |
Databricks | Supported | Supported |
Amazon Redshift | Supported | Supported |
DolphinDB | Supported | Supported |
Snowflake | Supported | Supported |
Data Lake Formation | Supported | Supported |
File Data Source | ||
HDFS | Supported | Supported |
FTP | Supported | Supported |
OSS | Supported | Supported |
Amazon S3 | Supported | Supported |
Message queue | ||
Log Service | Supported | Not supported |
Kafka | Supported | Supported |
DataHub | Supported | Supported |
Relational Data Source | ||
PolarDB | Supported | Supported |
PolarDB-X (formerly DRDS) | Supported | Supported |
MySQL | Supported | Supported |
SAP HANA | Supported | Supported |
Microsoft SQL Server | Supported | Supported |
PostgreSQL | Supported | Supported |
AnalyticDB for MySQL 2.0 | Supported | Not supported |
AnalyticDB for MySQL 3.0 | Supported | Supported |
AnalyticDB for PostgreSQL | Supported | Supported |
OceanBase | Support | Supported |
Oracle | Supported | Supported |
Vertica | Supported | Supported |
IBM DB2 | Supported | Supported |
Teradata | Supported | Supported |
ClickHouse | Supported | Supported |
DM (Dameng) | Supported | Supported |
GBase 8a | Supported | Supported |
KingbaseES | Supported | Supported |
TiDB | Supported | Supported |
GoldenDB | Supported | Supported |
OpenGauss | Support | Supported |
GaussDB (DWS) | Supported | Supported |
Amazon RDS for PostgreSQL | Supported | Supported |
Amazon RDS for MySQL | Supported | Supported |
Amazon RDS for SQL Server | Supported | Supported |
Amazon RDS for Oracle | Supported | Supported |
Amazon RDS for DB2 | Supported | Supported |
TDSQL for MySQL | Supported | Supported |
PolarDB-X2.0 | Supported | Supported |
GBase 8c | Supported | Supported |
TDSQL for PostgreSQL | Supported | Supported |
OushuDB | Supported | Supported |
NoSQL Data Source | ||
HBase0.9.4 | Not supported | Not supported |
HBase1.1x | Supported | Supported |
HBase2.0 | Supported | Supported |
Elasticsearch | Supported | Supported |
MongoDB | Supported | Supported |
Tablestore | Supported | Supported |
Aliyun HBase | Not supported | Not supported |
Redis | Not supported | Supported |
Easysearch | Supported | Supported |
OpenSearch | Supported | Supported |
InfluxDB | Supported | Supported |
Lindorm | Supported | Supported |
Semi-structured storage | ||
API | Supported | Supported |
SAP Table | Supported | Not supported |
Salesforce | Supported | Not supported |
Lark Bitable | Supported | Supported |
Data sources supported for full database migration
Data source type | Data source | References |
Source data source | MySQL, Oracle, Microsoft SQL Server, OceanBase, IBM DB2, MaxCompute, FTP, TDengine, Hive, PostgreSQL, DM (Dameng), Amazon Redshift, Amazon RDS for PostgreSQL, Amazon RDS for MySQL, Amazon RDS for SQL Server, Amazon RDS for Oracle, Amazon RDS for DB2, TDSQL for MySQL, DolphinDB, PolarDB-X2.0, GBase 8c . | |
Destination data source | ArgoDB, TDH Inceptor, OushuDB, Hive, MaxCompute, AnalyticDB for PostgreSQL, StarRocks, SelectDB, Doris, GaussDB (DWS), Lindorm, Databricks, Data Lake Formation. |
Data sources supported for real-time integration
Real-time computing engine | Data source | References | |
Apache Flink (open source Flink) | Flink on YARN |
| |
Flink on Kubernetes |
| ||
Alibaba Cloud Realtime Compute for Flink (VVP) |
| ||