During incremental replication, the Current Offset marks the timestamp of the latest datawritten to the destination instance. When a task skips or re-processes changes from a specific time window, you can change this offset in the Incremental Write module of a Data Transmission Service (DTS) synchronization or migration instance.
When to change the offset
| Situation | Direction | Effect |
|---|---|---|
| Re-apply data changes from a past time period | Move offset backward (earlier time) | DTS re-executes changes from that time through the current offset |
| Skip data changes for a time period | Move offset forward (later time) | DTS skips changes for that period |
| Resume a failed task whose offset no longer exists | Move offset forward | DTS resumes from the new offset |
Prerequisites
Before you begin, ensure that you have:
-
A data synchronization or migration instance with an incremental task. For synchronization setup, see Overview of data synchronization solutions. For migration setup, see Overview of data migration solutions
-
An instance that has entered the Incremental Write phase
-
An instance whose Status is not Modifying Objects
Limitations
-
Instances where both source and destination are Tair/Redis do not support offset changes.
-
You cannot change the offset of a data synchronization instance if its Status is Modifying Objects.
-
For distributed instances, the change applies only to the current subtask, not all subtasks.
-
The selectable range for the new offset defaults to the last seven days. This range may vary based on the Incremental Write module runtime and instance latency.
Potential impacts
Changing the offset can cause data loss or inconsistency. Review the following impacts before proceeding.
-
Forward offset (later than the current offset): data changes in the skipped period are not written to the destination. This may cause data loss or inconsistency.
-
Backward offset (earlier than the current offset): data changes in that period are re-executed on the destination. Re-executing INSERT and DDL operations may cause data duplication conflicts.
-
If the instance is paused, it automatically resumes after you change the offset.
-
If you change the offset to a time before you added tables using Reselect Objects, data for those new tables between the new offset time and when you added them is not synchronized. Example: The Incremental Data Collection task is processing data from time A to B. At time C, you use Reselect Objects to add
table1. If you then set the offset back to time D (before C), data fortable1between time D and C is lost.
Change the offset
Step 1: Go to the task list
From the DTS console
-
Log on to the DTS console.
-
In the navigation pane, click Data Synchronization or Data Migration.
-
(Optional) In the upper-left corner, select the region where the instance resides.
From the DMS console
The actual steps may vary depending on the DMS layout. For details, see Simple Mode console and Customize the layout and style of the DMS console.
-
Log on to the Data Management (DMS) service.
-
In the top menu bar, choose Data + AI > Data Transmission (DTS) > Data Synchronization or Data + AI > Data Transmission (DTS) > Data Migration.
-
(Optional) To the right of Data Synchronization Tasks or Data Migration Tasks, select the region where the instance resides.
Step 2: Pause the task
In the Actions column for the instance, click
and select Pause Task.
Step 3: Open the Incremental Write module
-
Click the instance ID to open the instance details page.
-
In the navigation pane, click Task Management.
-
In the Progress section, click the Incremental Write module.
Step 4: Set the new offset
-
On the Basic Information tab, click Change Offset next to Current Offset.
-
Read the Precautions and click Next.
-
In the Modify Incremental Write Offset dialog box, click the Offset field and select a date and time from the available range.
-
Click OK.
-
In the Note dialog box, click OK.
Step 5: Verify the result
After the instance completes initialization, check Current Offset on the Basic Information tab of the Incremental Write module.
-
Click
to refresh the page and monitor initialization progress and the Current Offset. -
After Current Offset updates, run data validation to confirm the data meets your expectations. See Configure data validation.