Serverless synchronization tasks in Data Integration let you run full-database real-time sync from MySQL to a destination data warehouse without managing resource groups or configuring network connectivity. Each task automatically handles schema migration, full data initialization, and ongoing real-time synchronization.
Limitations
Supported regions: China (Hangzhou), China (Shanghai), China (Beijing), China (Zhangjiakou), China (Shenzhen), China (Hong Kong), UK (London), US (Silicon Valley), US (Virginia), Japan (Tokyo), Germany (Frankfurt), Malaysia (Kuala Lumpur)
Supported synchronization types:
MySQL to Hologres — full-database real-time synchronization
MySQL to MaxCompute — full-database real-time synchronization
MySQL to StarRocks — full-database real-time synchronization
Data sources must be in the same region as the task and belong to your Alibaba Cloud account.
Prerequisites
Before you begin, make sure you have:
A DataWorks workspace in a supported region
A MySQL instance and a destination instance (Hologres, MaxCompute, or StarRocks)
Virtual Private Cloud (VPC) CIDR blocks for the source and destination that do not overlap
The AliyunBSSOrderAccess and AliyunDataWorksFullAccess RAM policies attached to the user that will start the task
Serverless synchronization tasks use pay-as-you-go billing. Billing starts when the task starts and stops when the task stops or fails. Deleting a task is irreversible and releases the associated order.
How it works
Each serverless synchronization task runs three sequential phases:
Schema migration — creates the destination schema and tables based on the source structure.
Full data initialization — copies all existing data from the source to the destination.
Real-time synchronization — continuously applies changes (DDL and DML operations) from the source to the destination.
Understanding these phases helps you interpret the progress shown on the task details page.
Create and run a serverless synchronization task
Step 1: Create a serverless synchronization task
Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose Data Integration > Data Integration. On the page that appears, select the desired workspace and click Go to Data Integration.
In the left-side navigation pane, click Serverless Synchronization Task.
In the Serverless Synchronization Task section, select a Source and a Destination, then click Create Serverless Synchronization Task.
Step 2: Configure basic information
Configure the source and destination connection details directly on the configuration page — no need to add data sources in advance.
After filling in the connection details, click Test to verify connectivity.
| Data source type | Connectivity test behavior |
|---|---|
| Alibaba Cloud RDS, Hologres | Passes automatically if no IP address whitelist is configured. If a whitelist is configured, add the required IP addresses first. |
For the full list of IP addresses to whitelist, see Configure network connectivity and an IP address whitelist.
Step 3: Configure the task
Follow the on-screen instructions to configure synchronization settings for your task type. The available options vary depending on the source-destination combination you selected.
For advanced configurations — including schema name mapping, destination table properties, and DDL/DML write rules — see Advanced configurations.
Step 4: Complete the configuration
Click Complete to save the configuration. The first time you click Complete, a configuration check runs automatically. This check is non-blocking and does not prevent the configuration from saving.
Start the task
On the task list page, start the task. Starting the task triggers a mandatory configuration check. If the check fails, the task cannot start. The check items vary by synchronization type.
When starting a task for the first time, the system verifies that the user has the AliyunBSSOrderAccess and AliyunDataWorksFullAccess policies. If either policy is missing, the task cannot start.
Monitor the task
Click the entry in the Name/ID or Execution Overview column to open the task details page.
| Tab | What it shows |
|---|---|
| Basic information | Data source details, Order ID, and synchronization solution |
| Execution status | Step-by-step execution status, runtime log, failover details, and resource utilization |
| Details | Progress of each phase: schema migration, full data initialization, and real-time synchronization |
View billing for a task
Each serverless synchronization task is billed through a task order, not a resource group. To find the order:
Open the task details page and go to the Basic information tab.
Copy the Order ID.
Go to the Alibaba Cloud Orders page and search by the Order ID.
For pricing details, see Performance metrics of DataWorks serverless resource groups.
Modify the task
In the Actions column of the task, click Edit to open the configuration page.
Add, delete, or modify synchronization tables, then click Complete.
In the Actions column, click Apply Updates.
When you click Apply Updates, a pre-check runs automatically. If the pre-check fails, the update is blocked. The pre-check has fewer items than the initial start check — because resources are already initialized, it skips the resource preparation phase.
Advanced configurations
Configure source and rules
By default, the task writes data to a destination schema or table with the same name as the source. If the schema or table does not exist in the destination, it is created automatically.
To rename destination schemas or tables, use:
Customize Mapping Rules for Destination Schema Names — replaces a fixed prefix in source schema names with a different prefix in the destination
Customize Mapping Rules for Destination Table Names — replaces a fixed prefix in source table names with a different prefix in the destination
Configure the destination table
Define how the task writes to the destination table:
| Option | Description |
|---|---|
| Write to existing or new table | Choose whether to write to an existing table or create a new one |
| Add fields | Add extra fields to the destination table |
| Partitioned table | Specify whether to write to a partitioned table |
| Partition Field | Set the partition field name |
| Storage Mode | Set the storage mode for the destination table |
| Value Assignment | Configure value assignment rules |
After configuring the table options, click Apply and Refresh Mapping to map source tables to destination tables based on your rules.
Configure write rules
The source can generate DDL and DML operations. Configure message processing policies to control how the task handles these operations at the destination:
DDL message processing policies — see DDL message processing rules
DML message processing policies — see DML message processing policies