DataWorks data integration synchronizes incremental and full data from Tablestore to MaxCompute.
How it works
DataWorks data integration performs offline (batch) data synchronization. An offline data tunnel defines the source and destination data sources and datasets, and uses data extraction plugins (Readers) and data writing plugins (Writers) with a simplified intermediate data format to transmit data between structured and semi-structured data sources.
To synchronize Tablestore data to MaxCompute, configure Tablestore Reader plugins and MaxCompute Writer plugins in an offline sync task.
-
Tablestore Reader plugins
The Tablestore Reader plugin varies based on the synchronization method.
Synchronization method
Plugin
Description
Full export
Tablestore (OTS) Reader
Reads data from Tablestore tables. You can specify a timestamp range to extract incremental data. For more information, see Tablestore data source.
Incremental synchronization
OTSStream Reader
Exports incremental data from Tablestore tables. For more information, see Tablestore Stream data source.
-
MaxCompute Writer plugin
For both full export and incremental synchronization, DataWorks uses the MaxCompute Writer plugin to write data to MaxCompute. For more information, see MaxCompute data source.
Synchronization methods
To export full data from Tablestore to MaxCompute in a single operation for backup or other purposes, see Export full data to MaxCompute.