All Products
Search
Document Center

Data Transmission Service:Create a DTS dedicated cluster

Last Updated:Aug 09, 2023

The increasing number of Data Transmission Service (DTS) tasks causes high resource usage, such as high CPU utilization and memory usage, which may affect your business. You can create DTS dedicated clusters and configure DTS data migration, data synchronization, and change tracking tasks in the clusters. This way, resources are isolated for these tasks and the stability of the tasks is improved. This topic describes how to create a DTS dedicated cluster.

Prerequisites

Your Alibaba Cloud account is assigned the system default role AliyunDTSDefaultRole if you want to create a DTS dedicated cluster as a RAM user. Then, you can grant the AliyunDTSFullAccess permission to the RAM user by using your Alibaba Cloud account.

Important

For more information about how to assign the system default role AliyunDTSDefaultRole to your Alibaba Cloud account and how to grant the AliyunDTSFullAccess permission to a RAM user by using your Alibaba Cloud account, see Authorize DTS to access Alibaba Cloud resources and Use a system policy to authorize a RAM user to manage DTS instances.

Benefits

You can create only DTS data migration, data synchronization, and change tracking tasks in a DTS dedicated cluster. A DTS dedicated cluster has the following benefits:

  • DTS dedicated clusters provide independent resources that are isolated from the resources used by DTS instances of other users. Your DTS instances that run in DTS dedicated clusters can never be affected by DTS instances of other users. In addition, you can control the loads of DTS dedicated clusters to enhance the stability of your business.

  • In a DTS dedicated cluster, you can allocate the resources of the entire cluster to a single DTS instance to improve the performance of the DTS instance. This allows you to write large amounts of data to the source database and synchronize the data to the destination database in real time.

  • You are charged only for the resources of a DTS dedicated cluster. You do not need to pay any fee when you create a DTS instance in a DTS dedicated cluster. The cost is further reduced if you enable the overcommitment mode for a DTS dedicated cluster compared with that of purchasing a large number of DTS instances.

Limits

  • DTS dedicated clusters support only the subscription billing method. You must pay when you create a DTS dedicated cluster.

  • You are charged only for the resources of a DTS dedicated cluster. You do not need to pay any fee when you create a DTS instance in a DTS dedicated cluster.

  • DTS dedicated clusters can be created only in the following regions: China (Hangzhou), China (Shanghai), China (Beijing), Japan (Tokyo), and US (Virginia).

  • If you want to configure a DTS data synchronization task in a DTS dedicated cluster, the source database, destination database, and DTS dedicated cluster must reside in the same region.

  • The number of nodes and the size of disks in a DTS dedicated cluster cannot be reduced.

  • You can create up to five DTS dedicated clusters in a single region. If you need to create more than five DTS dedicated clusters in a region, contact Alibaba Cloud technical support to add your account to the whitelist for creating more DTS dedicated clusters.

    Note

    We recommend that you create two or more DTS dedicated clusters to implement disaster recovery. Make sure that the available resources, such as the CPU, memory, disks, and DTS units (DUs), in a cluster are greater than 1/N. Otherwise, switchovers may fail due to insufficient hardware resources. N is the number of nodes in a cluster. For example, if you have three nodes in a cluster, the available resources must be greater than one-third of the total resources of the cluster.

  • If the usage of resources such as the CPU, memory, or disks in a DTS dedicated cluster exceeds 80%, you must scale up the cluster at the earliest opportunity. The Service Level Agreement is not applicable to task failures or switchover failures caused by insufficient resources.

  • After a DTS dedicated cluster is created, the system reserves 5% of the disk space for defragmentation and to ensure that the system runs properly even if the disk is full.

Billing

For more information about the billing of DTS dedicated clusters, see Billing of DTS dedicated clusters.

Procedure

  1. Go to the Dedicated Cluster page.

  2. In the top navigation bar, select the region in which you want to create a DTS dedicated cluster.

  3. On the Cluster Task page, click Create Dedicated Cluster.

  4. Configure the parameters described in the following table based on your business requirements.

    Parameter

    Description

    Billing Method

    Select Subscription.

    Cluster Type of DTS Instance

    Select Dedicated Cluster.

    Region

    Select the region in which you want to create the DTS dedicated cluster.

    Note

    The region of a DTS dedicated cluster cannot be changed after the cluster is created.

    Dedicated Cluster

    This parameter is set to Data Migration, Data Synchronization, and Change Tracking and cannot be changed.

    Specification of Dedicated Cluster Nodes

    This parameter is set to 15 DTS Units and cannot be changed.

    Note
    • DTS dedicated clusters support only the node specifications of 15 DUs. A DU indicates the minimum hardware resources that are required to run a DTS task. 15 DUs indicate that you can configure up to 15 DTS tasks on a single node that is not overcommitted. The hardware resources allocated to each DTS task are isolated from each other. You can also allocate multiple DUs to a single DTS task.

    • You can enable the overcommitment mode for a DTS dedicated cluster. For more information, see Set an overcommit ratio for a DTS dedicated cluster. If the overcommit ratio is set to 200%, the number of DUs on a node is increased from 15 to 30, though the actual hard resources remain unchanged. This way, you can configure up to 30 DTS tasks on a single node. However, if the overcommitment mode is enabled, hardware resource contention occurs among DTS tasks, and each DTS task may obtain only 50% of the hardware resources that the task should obtain if the resources are not overcommitted. Therefore, the overcommitment mode can be enabled only in the following scenarios:

      • The amount of incremental data to be synchronized is small.

      • The DTS data synchronization tasks run in different time periods.

    • For more information about the comparison between specifications of DTS dedicated clusters and public clusters, see Migrate a DTS instance between a dedicated cluster and a public cluster.

    Storage Space of Dedicated Cluster Node

    Select the storage space of each node in the DTS dedicated cluster. Valid values: 1024 to 30720. Unit: GB. The value must be increased in increments of 512 GB.

    Note

    After a DTS dedicated cluster is created, you can increase the disk space of nodes for more storage space. For more information, see Increase the storage space of nodes in a DTS dedicated cluster.

    Destination Region

    By default, the value of this parameter is the same as the value of Region and cannot be changed.

    Duration

    Select a subscription duration for the DTS dedicated cluster. Valid monthly subscription durations range from one month to nine months. Valid yearly subscription durations range from one year to three years.

    Important

    If you want to enable auto-renewal for the cluster, select Auto-renewal and make sure that you have sufficient balance within your account before the system automatically renews the cluster.

    Number of Dedicated Cluster Nodes

    Select the number of nodes in the DTS dedicated cluster. Default value: 2. Valid values: 2 to 100.

    Note
    • When you purchase a DTS dedicated cluster, you can select the number of nodes within the range of 2 to 100. We recommend that you purchase at least two nodes to implement disaster recovery.

    • After a DTS dedicated cluster is created, you can add more nodes to the cluster. For more information, see Scale out a DTS dedicated cluster.

  5. After the configuration is complete, purchase the DTS dedicated cluster.

    1. Click Buy Now.

    2. On the Confirm Order page, view the configurations, read the Terms of Service, and then select the check box to agree to the Terms of Service.

    3. Click Pay. On the Purchase page, complete the payment by following the on-screen instructions.

      Note

      You can also click Add to Cart to purchase the DTS dedicated cluster together with other services. For more information, see Pay for orders in the cart.

  6. Check whether the DTS dedicated cluster is created.

    1. After you complete the payment, click Console to go to the DTS console.

    2. In the left-side navigation pane, click Dedicated Cluster.

    3. In the top navigation bar, select the region in which the DTS dedicated cluster resides.

    4. Check whether the created DTS dedicated cluster is in the cluster list.

      • If the DTS dedicated cluster is displayed, the cluster is created. If the cluster is in the Running state, the DTS dedicated cluster is created and initialized.

      • If the DTS dedicated cluster is not displayed, wait for one minute to five minutes. Then, refresh the page. If the DTS dedicated cluster is still not displayed, check whether the issues that are described in the following table occur. If none of the issues occur, contact Alibaba Cloud technical support.

        The following table describes the possible causes and solutions if you cannot find a DTS dedicated cluster in the cluster list.

        Cause

        Solution

        The DTS dedicated cluster does not belong to the region that you select.

        In the top navigation bar, select the region in which the DTS dedicated cluster resides.

        The DTS dedicated cluster fails to be created due to insufficient resources.

        A DTS dedicated cluster may fail to be created due to insufficient resources. In this case, the DTS dedicated cluster is refunded. Go to the Orders page in the Billing Management console and check whether you receive the refund.

Pay for orders in the cart

If you purchase a subscription DTS dedicated cluster, you can also click Add to Cart to pay for orders in the cart in a lump sum after you complete the parameter settings. You can perform the following steps to pay for orders in the cart:

  1. On the right side of the page, click the Cart icon.

  2. In the Cart panel, select the services that you want to buy and click Proceed to Checkout.

  3. On the Cart page, check whether the orders that you want to pay are selected.

    • If the orders that you want to pay are selected, click Buy Now.

    • If the orders that you want to pay are not selected, select the orders and click Buy Now.

  4. On the Confirm Order page, read and select the check box to agree to the Terms of Service and click Pay.

  5. On the Purchase page, complete the payment by following the on-screen instructions.