Before you configure a data synchronization solution or node, you can select the feature that you want to use to configure the solution or node based on the types of your data sources. This topic describes the read and write operations supported by different data synchronization features of Data Integration from the data source dimension.
Supported data source types and data read and write operations
Data Integration provides the batch synchronization feature, real-time synchronization feature, and solution-based synchronization feature. You can determine the feature that you need to use to configure a data synchronization solution or node based on the data source types supported by the features.
- The batch synchronization feature provides Reader and Writer plug-ins for you to read data from and write data to data sources.
- The real-time synchronization feature allows you to configure a data synchronization node by using different data sources to synchronize incremental data from a single table or all tables in a database in real time.
- The solution-based synchronization feature provides data synchronization solutions that are used to synchronize data between different data sources in various scenarios, such as batch synchronization of data from all tables in a database, and one-time full synchronization and real-time incremental synchronization.
Note For more information about how to configure a data synchronization solution or node by using the related feature, see Overview of the batch synchronization feature, Overview of the real-time synchronization feature, and Overview of the solution-based synchronization feature.
| Data source type | Batch synchronization | Real-time synchronization | Solution-based synchronization | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Read data from a single table | Write data to a single table | Read incremental data from a single table | Write incremental data to a single table | Read incremental data from all tables in a database | Write incremental data of all tables in a database to a destination | Read data from all tables in a database in offline mode | Write data of all tables in a database to a destination in offline mode | Read full data at a time and incremental data in real time from a table or all tables in a database | Write full data and incremental data of a table or all tables in a database to a destination | |
| Amazon S3 data source |  | - | - | - | - | - | - | - | - | - |
| AnalyticDB for MySQL 2.0 data source | | | - | - | - | - | | - | - | - |
| AnalyticDB for MySQL 3.0 data source | | | - | | - | | | - | - | |
| AnalyticDB for PostgreSQL data source | | | - | - | - | - | | - | - | - |
ApsaraDB For Oceanbase | | | - | - | | - | - | - | | - |
| ClickHouse data source | | | - | - | - | - | - | - | - | - |
| DataHub data source | | | | | - | | - | - | - | |
| Db2 data source | | | - | - | - | - | | - | - | - |
| DM data source | | | - | - | - | - | | - | - | - |
| DRDS (PolarDB-X) data source | | | - | - | - | - | | - | | - |
Elasticsearch | | | - | | - | - | - | | - | |
| FTP data source | | | - | - | - | - | - | - | - | - |
GBase8a |
|
| - | - | - | - | - | - | - | - |
HBase |
|
| - | - | - | - | - | - | - | - |
| HDFS data source | | | - | - | - | - | - | - | - | - |
Hive | | | - | - | - | - | | - | - | - |
Hologres |
|
| - | | - | | - | - | - | |
| HybridDB for MySQL data source | | | - | - | - | - | | - | - | - |
| Kafka data source | | | | | - | | - | - | - | |
| KingbaseES data source | | | - | - | - | - | - | - | - | - |
| Lindorm data source | | | - | - | - | - | - | - | - | - |
| LogHub (SLS) data source | | | | - | - | - | - | - | - | - |
| MaxCompute data source | | | - | | - | | - | | - | |
| Maxgraph data source | - | | - | - | - | - | - | - | - | - |
| Memcache data source | - | | - | - | - | - | - | - | - | - |
| MetaQ data source | | - | - | - | - | - | - | - | - | - |
| MongoDB data source | | | - | - | | - | - | - | | - |
| MySQL data source | | | | - | | - | | - | | - |
| OpenSearch data source | - | | - | - | - | - | - | - | - | - |
| Oracle data source | | | - | - | - | - | | - | | - |
| OSS data source | | | - | - | - | - | - | | - | - |
| OTSStream data source | | - | - | - | - | - | - | - | - | - |
| PolarDB data source | | | | - | | - | | - | | - |
| PostgreSQL data source | | | - | - | - | - | | - | | - |
| Redis data source | - | | - | - | - | - | - | - | - | - |
| RestAPI data source | | | - | - | - | - | - | - | - | - |
| SAP HANA data source | | | - | - | - | - | - | - | - | - |
| StarRocks data source | | | - | - | - | - | - | - | - | - |
| Stream data source | | | - | - | - | - | - | - | - | - |
| SQL Server data source | | | - | - | - | - | | - | - | - |
| Tablestore data source | | | - | - | - | - | - | - | - | - |
| TSDB data source | - | | - | - | - | - | - | - | - | - |
Vertica | | | - | - | - | - | - | - | - | - |