This topic describes the billing standards, scale-out, renewal, and expiration of DataWorks exclusive resources. This topic also describes the scenarios and limits of DataWorks exclusive resources.

DataWorks provides exclusive resource groups for scheduling and exclusive resource groups for Data Integration. These resources deliver optimal performance.
Note
  • The system sends you a notification if you have an overdue payment. In this case, you must complete the overdue payment at the earliest opportunity to avoid service suspension.

    If you have other questions, submit a ticket.

  • The peak hours for DataWorks tenants to run nodes are from 00:00 to 09:00 each day. If you use shared resource groups during the peak hours, you share resources with other tenants.

    When tenants share resources, some tenants may preempt the resources. If you have high requirements on the output time of nodes, use exclusive resource groups to run the nodes. Regardless of the edition of DataWorks, you do not need to pay extra fees for the node instances that are run on exclusive resource groups. For more information, see Exclusive resource group mode.

Limits

  • When you create an exclusive resource group for Data Integration or an exclusive resource group for scheduling, you must confirm the region of the exclusive resource group. An exclusive resource group for Data Integration can access data stores only in the virtual private clouds (VPCs) that reside in the same region as the resource group.

    When you bind an exclusive resource group for Data Integration or an exclusive resource group for scheduling to a VPC, select the vSwitch that is associated with the data stores that you want to access.

  • Before an exclusive resource group can access your data store, you must add it to the whitelist of the data store to make sure that it has the permissions to access the data store.
  • An exclusive resource group for Data Integration cannot access data stores that are deployed on a classic network of Alibaba Cloud. If your data store is deployed on the classic network, we recommend that you use shared resource groups to run sync nodes.
  • The software environment, such as Python, of exclusive resource groups for scheduling cannot be customized.
  • Exclusive resource groups for scheduling support node types such as Shell nodes, ODPS SQL nodes, ODPS MR nodes, PyODPS nodes, ODPS Script nodes, control nodes, level-1 sync nodes, SQL script templates, ODPS Spark nodes, and OSS Object Inspection nodes.
  • Exclusive resource groups for Data Integration support only level-2 sync nodes.
    Note
    • Level-1 sync nodes: the sync nodes that are committed and scheduled.
    • Level-2 sync nodes: the sync nodes that are run.

Exclusive resources for scheduling

To concurrently run a large number of nodes, you need exclusive computing resources to make sure that nodes are run as scheduled. In this case, you can use exclusive resources for scheduling.
Note Exclusive resources for scheduling in a single order can be used in only one exclusive resource group for scheduling. The resources cannot be split among multiple exclusive resource groups for scheduling. After you pay for the order, you can increase the number of resources in the order to scale out the resources.
  • Billing standards

    Exclusive resources for scheduling are billed in subscription mode. You can select appropriate specifications for billing as needed. For more information, see Performance metrics and billing standards of exclusive resource groups for scheduling.

  • Scale-out
    You can scale out the exclusive resources for scheduling in each order based on your business needs. You need to pay only for the added resources from the time when you scale out the resources to the time when the original order expires.
    Note
    • Scale-out increases the number of resources but does not upgrade their CPU and memory configurations.
    • Scale-out allows you to add only resources of the same specifications as the purchased resources in the current order.
    • After you scale out the resources in an order, the new configuration takes effect within 20 minutes after you pay for the order.
  • Renewal

    You can renew the exclusive resources for scheduling in an order before the order expires or within 30 days after the order expires. If you do not renew your subscription within 15 days after expiration, the services for resources in the order are suspended immediately after this 15-day period.

  • Expiration
    • Service suspension

      By default, the system sends expiration notifications to the mobile number and email address that are bound to your Alibaba Cloud account eight days, 12 days, and 14 days before your order for exclusive resources for scheduling expires. If you do not renew your subscription within 15 days after expiration, the services for resources in the order are suspended immediately after this 15-day period.

    • Resource release

      After exclusive resources for scheduling expire, they are retained for 15 days. If you do not renew your subscription within 15 days, the instances are released after this 15-day period.

      The system sends release notifications to the mobile number and email address that are bound to your Alibaba Cloud account one day before the exclusive resources for scheduling are released.

Exclusive resources for Data Integration

To concurrently run a large number of data integration nodes, you need exclusive computing resources to make sure that data is transmitted in a fast and reliable manner. In this case, you can use exclusive resources for Data Integration.
Notice
  • To allow an exclusive resource group for Data Integration to access data stores in a VPC, you must bind the exclusive resource group to the VPC. Then, the system adds a route for the exclusive resource group. This way, the exclusive resource group can be accessed in the VPC.
  • Exclusive resources for Data Integration ensure the number of threads that a data synchronization instance can simultaneously run, not the number of data synchronization instances that can be simultaneously run. To guarantee the number of data integration node instances that can simultaneously run, you can purchase exclusive resources for scheduling.
  • Billing standards
    Exclusive resources for Data Integration are billed in subscription mode. You can select appropriate specifications for billing as needed. For more information, see Performance metrics and billing standards of exclusive resource groups for Data Integration.
    Note Running a data integration node not only consumes concurrent threads in exclusive resources for Data Integration, but also consumes concurrent instances in exclusive resources for scheduling. A data integration node instance consumes a concurrent instance.

    Assume that you purchase four exclusive resources for Data Integration with the specifications of 8 cores and 16 GiB memory for a workspace in the China (Hangzhou) region and the subscription period is one year. For sync node instances that are run on these exclusive resources, the fee is: 4 × USD 152.45/month × 12 months = USD 7,317.60.

    Within the one-year validity period, DataWorks charges no additional fees for the number of concurrent instances generated by sync nodes that are run on the exclusive resources. The generated Internet traffic is separately billed.

  • Scale-out
    You can scale out the exclusive resources for Data Integration in each order based on your business needs. You need to pay only for the added resources from the time when you scale out the resources to the time when the original order expires.
    Note
    • Exclusive resources for Data Integration in a single order can be used in only one exclusive resource group for Data Integration. The resources cannot be split among multiple exclusive resource groups for Data Integration. After you pay for the order, you can increase the number of resources in the order to scale out the resources.
    • Scale-out increases the number of resources but does not upgrade their CPU and memory configurations.
    • Scale-out allows you to add only resources of the same specifications as the purchased resources in the current order.
    • After you scale out the resources in an order, the new configuration takes effect within 20 minutes after you pay for the order.
  • Renewal

    You can renew the exclusive resources for Data Integration in an order before the order expires or within 30 days after the order expires. If you do not renew your subscription within 15 days after expiration, the services for resources in the order are suspended immediately after this 15-day period.

  • Expiration
    • Service suspension

      By default, the system sends expiration notifications to the mobile number and email address that are bound to your Alibaba Cloud account eight days, 12 days, and 14 days before your order for exclusive resources for Data Integration expires. If you do not renew your subscription within 15 days after expiration, the services for resources in the order are suspended immediately after this 15-day period.

    • Resource release

      After exclusive resources for Data Integration expire, they are retained for 15 days. If you do not renew your subscription within 15 days, the instances are released after this 15-day period.

      The system sends release notifications to the mobile number and email address that are bound to your Alibaba Cloud account one day before the exclusive resources for Data Integration are released.

Note

Scenarios of exclusive resources

  • Exclusive resources are used in exclusive mode. This helps isolate resources between tenants and between different nodes of the same tenant.

    If a large number of nodes are concurrently run on default resources, the nodes may be delayed because they need to wait for resources. In this case, we recommend that you use exclusive resources for scheduling and exclusive resources for Data Integration.

  • Exclusive resources can be accessed over the Internet.
    • If you need to access the Internet services or user-created services by using PyODPS, we recommend that you use exclusive resources for scheduling.
    • If you need to access the Internet services or user-created services by using Shell, we recommend that you use exclusive resources for scheduling.
  • You can decide the specifications of exclusive resources. If you need to run resource-consuming nodes, we recommend that you use exclusive resources for scheduling.