Migration data filtering

Last Updated: Dec 11, 2017

When configuring a data migration task, you can use migration data filters to filter data records in the source table object by extracting records that fulfill specified conditions. This is applicable to scenarios such as regular incremental data replication and table splitting.

This document describes how to configure Where clauses in SQL for filtering migration data.

Limit

SQL filtering clauses only apply to existing data migration and do not affect the incremental data.

Configure SQL filtering clauses

The SQL filtering function can be called during the Migration object and type configuration stage, within the creation of a migration task. It is used for specific table objects rather than database objects.

Follow these steps to configure SQL filtering clauses:

  1. Select the table object to be migrated from the Migration objects box, and add it to the Selected objects box.

  2. Click Edit under the newly added table object that you want to configure SQL filtering clauses.

    Note: The Edit button appears when the mouse is over the specific object in the Selected objects box.

    edit

  3. On the Edit table page, enter the SQL Where clause in the Filtering condition block, and click Verify syntax.

    The SQL Where clause follows the standard database SQL Where syntax, supporting calculation and simple functions. For example, to migrate records whose ID number is greater than 1000, enter the clause: id>1000.

    condition

  4. Click OK to complete.

After the SQL filtering configuration, the data migration task will only migrate tables with records that fulfill the specified conditions.

Thank you! We've received your feedback.