edit-icon download-icon

Set control parameters for data synchronization channel

Last Updated: Apr 04, 2018

Channel control for the data integration synchronization tasks is mainly used to control the synchronization speed and number of concurrent tasks.

Maximum job rate

The maximum job rate refers to the maximum possible speed of the data synchronization jobs, and the actual speed is subject to the network environment and database configuration.

Number of concurrent jobs

For a single concurrent synchronization job: Number of concurrent jobs * Transmission rate of a single concurrent job = Total transmission rate of jobs.

The following explains how to determine the number of concurrent jobs when the maximum job rate is specified.

  • If the data source is an online service database, we recommend that you set a moderate number of concurrent jobs to minimize the impact on the online service database.
  • If you require higher data synchronization rate, we recommend that you select the maximum job rate and a high number of concurrent jobs.

Representations of the maximum job rate and number of concurrent jobs in JSON

  • mbps: The maximum rate of concurrent jobs. For example, if the “mbps” is “1”, the maximum job rate is 1 Mbit/s.

  • concurrent: The number of concurrent jobs. For example, if the “concurrent” is “1”, the number of concurrent jobs is 1.

Maximum number of errors

The maximum number of errors indicates the maximum number of dirty data records. The following shows an example:

  • If it is set to 0, no dirty data is allowed.

  • If it is left blank, dirty data is allowed, in which case Data Integration records and prints part of dirty data to make it easier for you to check if any dirty data occurs.

Task resource group

It can be used to execute synchronous tasks. When adding resource groups, you can bind multiple machines. For more information, see Add scheduling resources.

View logs

Go to Operation Center > Cycle Instance, locate the synchronization node, and right-click View log.

chakan

Thank you! We've received your feedback.