This topic describes the billing standards, scale-out, renewal, and expiration of DataWorks exclusive resources. This topic also describes the scenarios and limits of DataWorks exclusive resources.

DataWorks provides exclusive resource groups for scheduling and exclusive resource groups for Data Integration.These resources deliver optimal performance.
Note
  • If you have an overdue payment, the system sends you a notification. In this case, you must renew your subscription at the earliest opportunity to prevent service suspension.

    If you have other questions, submit a ticket.

  • The peak hours for DataWorks tenants are from 00:00 to 09:00 each day. If you use shared resource groups during the peak hours, you share resources with other tenants.

    In this case, some tenants may preempt the resources. If you have high requirements on the output time of nodes, use exclusive resource groups to run the nodes. Regardless of the DataWorks edition you use, you do not need to pay extra fees for the node instances that are run on exclusive resource groups. For more information, see Exclusive resource group mode.

Limits

  • If you create an exclusive resource group for Data Integration or an exclusive resource group for scheduling,you must confirm the region of the exclusive resource group. Exclusive resource groups for Data Integrationcan access data sources only in the virtual private clouds (VPCs) that reside in the same region as the resource group.

    If you associate an exclusive resource group for Data Integration or an exclusive resource group for scheduling with a VPC,you must select the vSwitch that is associated with the data sources that you want to access.

  • Before an exclusive resource group can access your data source, you must add the resource group to a whitelist of the data source to make sure that the resource group has the permissions to access the data source.
  • An exclusive resource group for Data Integrationcannot access data sources that are deployed in the classic network. If your data source is deployed in the classic network, we recommend that you use shared resource groups to run synchronization nodes.
  • The software environment, such as Python, of exclusive resource groups for scheduling cannot be customized.
  • Exclusive resource groups for scheduling support node types such as Shell nodes, ODPS SQL nodes, ODPS MR nodes, PyODPS nodes, ODPS Script nodes, control nodes, level-1 synchronization nodes, SQL script templates, ODPS Spark nodes, and OSS Object Inspection nodes.
  • Exclusive resource groups for Data Integration support only level-2 synchronization nodes.
    Note
    • Level-1 synchronization nodes: the synchronization nodes that are committed and scheduled.
    • Level-2 synchronization nodes: the synchronization nodes that are run.

Exclusive resource groups for scheduling

To run a large number of nodes in parallel, you must use exclusive computing resources to make sure that nodes are run as scheduled. In this case, you can use exclusive resources for scheduling.
Note Exclusive resources for scheduling that are in the same order can only be used in one exclusive resource group. The resources cannot be split among multiple exclusive resource groups. After you pay for the order, you can increase the quantity of resources in the order to scale out the resources.
  • Billing standards

    Exclusive resources for scheduling are billed in subscription mode. You can select appropriate specifications as needed. For more information, see Performance metrics and billing standards of exclusive resource groups for scheduling.

  • Scale-out
    You can scale out the exclusive resources for scheduling in each order based on your business needs. You only need to pay for the added resources that are used from the time you scale out the resources to the time the original order expires.
    Note
    • Scale-out increases the quantity of resources but does not upgrade their CPU or memory configurations.
    • Scale-out allows you to add only resources of the same specifications as the purchased resources in the current order.
    • After you scale out the resources in an order, the new configuration takes effect within 20 minutes after you pay for the order.
  • Renewal

    You can renew the exclusive resources for scheduling in an order before the order expires or within 30 days after the order expires. If you do not renew your subscription within 15 days after expiration, the services that use the resources in the order are suspended immediately after this 15-day grace period.

  • Expiration
    • Service suspension

      By default, the system sends expiration notifications to both the mobile number and email address that are bound to your Alibaba Cloud account on the 14th day, 12th day, and 8th day before your order for the exclusive resources for scheduling expires. If you do not renew your subscription within 15 days after expiration, the services that use the resources in the order are suspended immediately after this 15-day grace period.

    • Resource release

      After exclusive resources for scheduling expire, they are retained for 15 days. If you do not renew your subscription within 15 days, the instances are released after this 15-day grace period.

      The system sends release notifications to both the mobile number and email address that are bound to your Alibaba Cloud account one day before the exclusive resources for scheduling are released.

Exclusive resource groups for Data Integration

To run a large number of data integration nodes in parallel, you must use exclusive computing resources to make sure that data is transmitted in a fast and reliable manner. In this case, you can use exclusive resources for Data Integration.
Notice
  • To allow an exclusive resource group for Data Integration to access data sources in a VPC, you must associate the exclusive resource group with the VPC. Then, the system adds a route for the exclusive resource group. This way, the exclusive resource group can access all the data sources in the VPC.
  • Exclusive resources for Data Integration guarantee the number of threads that a data synchronization instance can simultaneously run, not the number of data synchronization instances that can be simultaneously run. To guarantee the number of data integration node instances that can simultaneously run, you can purchase exclusive resources for scheduling.
  • Billing standards
    Exclusive resources for Data Integration are billed in subscription mode. You can select appropriate specifications as needed. For more information, see Performance metrics and billing standards of exclusive resource groups for Data Integration.
    Note Running a data integration node not only consumes parallel threads in exclusive resources for Data Integration, but also consumes parallel instances in exclusive resources for scheduling. One data integration node instance consumes one parallel instance.

    For example, if you purchase four exclusive resources for Data Integration with the specifications of 8 cores and 16 GiB of memory for a workspace in the China (Hangzhou) region and the subscription period is one year, the fee for the synchronization node instances that are run on these exclusive resources is calculated by using the following formula: 4 × USD 152.45/month × 12 months = USD 7,317.60.

    Within the one-year validity period, DataWorks charges no additional fees for the number of parallel instances generated by synchronization nodes that are run on the exclusive resources. The generated Internet traffic is separately billed.

  • Scale-out
    You can scale out the exclusive resources for Data Integration in each order based on your business needs. You only need to pay for the added resources that are used from the time you scale out the resources to the time the original order expires.
    Note
    • Exclusive resources for Data Integration in one order can be used in only one exclusive resource group for Data Integration. The resources cannot be split among multiple exclusive resource groups for Data Integration. After you pay for the order, you can increase the quantity of resources in the order to scale out the resources.
    • Scale-out increases the quantity of resources but does not upgrade their CPU or memory configurations.
    • Scale-out allows you to add only resources of the same specifications as the purchased resources in the current order.
    • After you scale out the resources in an order, the new configuration takes effect within 20 minutes after you pay for the order.
  • Renewal

    You can renew the exclusive resources for Data Integration in an order before the order expires or within 30 days after the order expires. If you do not renew your subscription within 15 days after expiration, the services that use the resources in the order are suspended immediately after this 15-day grace period.

  • Expiration
    • Service suspension

      By default, the system sends expiration notifications to both the mobile number and email address that are bound to your Alibaba Cloud account on the 14th day, 12th day, and 8th day before your order for the exclusive resources for Data Integration expires. If you do not renew your subscription within 15 days after expiration, the services that use the resources in the order are suspended immediately after this 15-day grace period.

    • Resource release

      After exclusive resources for Data Integration expire, they are retained for 15 days. If you do not renew your subscription within 15 days, the instances are released after this 15-day grace period.

      The system sends release notifications to both the mobile number and email address that are bound to your Alibaba Cloud account one day before the exclusive resources for Data Integration are released.

Note

Scenarios of exclusive resources

  • Exclusive resources are used in exclusive mode. This helps isolate resources between tenants and between different nodes of the same tenant.

    If a large number of nodes are run in parallel on default resources, the nodes may be delayed because they need to wait for resources. In this case, we recommend that you use exclusive resources for scheduling and exclusive resources for Data Integration..

  • Exclusive resources can be used to access Internet services.
    • If you need to access Internet services or self-managed services by using PyODPS, we recommend that you use exclusive resources for scheduling.
    • If you need to access Internet services or self-managed services by using Shell, we recommend that you use exclusive resources for scheduling.
  • You can choose the specifications of exclusive resources based on your needs. If you need to run resource-consuming nodes, we recommend that you use exclusive resources for scheduling.