Overview

Concept

The real-time synchronization feature synchronizes data changes in a source database to a destination database in real time, for example, when you add, modify, or delete data. If you synchronize all previous data and configure a real-time sync node, all data in the source database is synchronized to the destination database after the node is run. The real-time synchronization feature ensures that the destination database has all the data in the source database and that data is up-to-date.

Billing method

• The real-time synchronization feature is free of charge. However, you must pay for the exclusive resource group for Data Integration that you use. For more information, see Performance metrics and billing standards of exclusive resource groups for Data Integration.
• The real-time synchronization feature is supported in all DataWorks editions. For more information, see Feature comparison among DataWorks editions.

Supported regions

Highlights of real-time synchronization

• Diverse data stores
  • Star-shaped combination is supported. Each supported source data store can be combined with a supported destination data store to synchronize data.
  • The feature will soon allow you to use one node to read data from one data store and write data to multiple data stores.
• Sync solution
  • You can synchronize the full data and incremental data from a database to MaxCompute and Hologres.
  • The solution can synchronize all existing data and incremental data.
• Real-time monitoring and extraction

  The feature can extract data from table shards, a single table, and multiple tables in a database, and extract messages about data definition language (DDL) operations.

• Data processing

  The feature supports data filtering and string replacement.

• Monitoring and alerting
  • The feature monitors the service latency, failovers, dirty data, heartbeats, and failures.
  • It can send alerts to you by email, phone, and DingTalk.
• Minimal impacts on the source data store

  The feature is optimized for this support.

• Graphical development
  • You can perform drag-and-drop operations to develop nodes. No coding is required.
  • The feature is easy to use even for the beginners.

Supported data stores

• Source data stores such as MySQL, Oracle, Kafka, DataHub, LogHub, and PolarDB
• Destination data stores such as MaxCompute, Hologres, Kafka, and DataHub
• Data conversion features such as data filtering and string replacement

More data stores are supported over time. For more information, see Supported data stores.

How to use real-time synchronization

Architecture diagram of real-time synchronization