All Products
Search
Document Center

Dataphin:Real-time integration

Last Updated:Mar 05, 2025

Dataphin offers real-time integration capabilities, enabling the integration of data changes from the entire database or all tables from the source to the target in real-time, thus achieving real-time data synchronization between the two.

Overview of features

image

Real-time Integration and Synchronization of Multiple Data Sources: Real-time integration aggregates and combines multiple sources into the target, forming a real-time synchronization link for data synchronization.

Data Source Selection: Real-time integration allows for selection methods including the entire database, specific tables, or exclusion tables, and carries out real-time incremental synchronization to the target.

  • Entire Database: Synchronizes all data from the entire database in real-time.

  • Selected Tables: Synchronizes only the chosen tables from the source in real-time. Non-selected tables will not be synchronized.

  • Exclusion Tables: Synchronizes tables not listed in the exclusion selection in real-time. Excluded tables will not be synchronized.

Data sources supported by real-time integration

Alibaba Cloud Real-time Computing Engine Flink (VVP)

Source Data Source

Target Data Source

Target Output

  • MySQL

  • PostgreSQL

  • Oracle

MaxCompute

Real-time integration to MaxCompute

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

MySQL

Real-time integration to MySQL

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

Oracle

Real-time integration to Oracle

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

  • IBM DB2

Kafka

Real-time integration to Kafka

  • MySQL

  • PostgreSQL

  • Oracle

DataHub

Real-time integration to DataHub

  • MySQL

  • PostgreSQL

  • Oracle

Microsoft SQL Server

Real-time integration to Microsoft SQL Server

  • MySQL

  • PostgreSQL

  • Oracle

Databricks

Real-time integration to Databricks

Apache Flink (YARN)

Source Data Source

Target Data Source

Target Output

  • MySQL

  • PostgreSQL

  • Oracle

MaxCompute

Real-time integration to MaxCompute

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

MySQL

Real-time integration to MySQL

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

Oracle

Real-time integration to Oracle

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

  • IBM DB2

Kafka

Real-time integration to Kafka

  • MySQL

  • PostgreSQL

  • Oracle

DataHub

Real-time integration to DataHub

  • MySQL

  • PostgreSQL

  • Oracle

  • Kafka

Hive

Real-time integration to Hive

Note

Alibaba Cloud EMR 5.x is not supported as a destination database.

  • MySQL

  • PostgreSQL

  • Oracle

Microsoft SQL Server

Real-time integration to Microsoft SQL Server

  • MySQL

  • PostgreSQL

  • Oracle

Databricks

Real-time integration to Databricks

Apache Flink (K8s)

Source Data Source

Target Data Source

Target Output

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

MySQL

Real-time integration to MySQL

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

Oracle

Real-time integration to Oracle

  • MySQL

  • Microsoft SQL Server

  • PostgreSQL

  • Oracle

Kafka

Real-time integration to Kafka

  • MySQL

  • PostgreSQL

  • Oracle

Microsoft SQL Server

Real-time integration to Microsoft SQL Server

  • MySQL

  • PostgreSQL

  • Oracle

Databricks

Real-time integration to Databricks