Data Integration supports the following types of plug-ins for real-time synchronization: reader, writer, and transformation.

Note Currently, the real-time synchronization feature is in phased release stage. To activate this feature, submit a ticket.
Type Plug-in Reference
Reader MySQL binlog reader MySQL binlog reader
Oracle Change Data Capture (CDC) reader Oracle CDC reader
Datahub reader Datahub reader
LogHub reader LogHub reader
Kafka reader Kafka reader
Writer Datahub writer Datahub writer
Kafka writer Kafka writer
Transformation Data filtering Data filtering
Groovy Groovy
String replacement String replacement
Note
  • You cannot run a real-time sync node on the node configuration tab. Instead, you must run a real-time sync node in the production environment after saving and committing the node.
  • Real-time sync nodes can only run on exclusive resource groups for data integration. For more information, see Exclusive resource groups for Data Integration instances.

Basic settings

After you specify the reader, writer, and transformation plug-ins to create a real-time sync node, you can click the Basic Setting tab in the right-side navigation pane to configure this sync node.
Parameter Description
Description The description of the real-time sync node.
JVM Parameter The Java virtual memory (JVM) allocated for the real-time sync node. If the value is empty, Data Integration automatically allocates JVM based on your node settings.
Dirty Records Allowed The maximum number of dirty data records allowed. If you set this parameter to 0, no dirty data records are allowed. If the value is empty, the node continues no matter whether dirty data records exist.
Resource Group The exclusive resource group for data integration on which the real-time sync node is run.
Note For more information about exclusive resource groups for data integration, see Exclusive resource groups for Data Integration instances.