This topic describes the billing standards, scale-out, renewal, and expiration of DataWorks exclusive resources. This topic also describes the scenarios and limits of DataWorks exclusive resources.

DataWorks provides exclusive resource groups for scheduling and exclusive resource groups for Data Integration. These resources deliver optimal performance.
Note
  • If you have an overdue payment, the system sends you a notification. In this case, you must renew your subscription at the earliest opportunity to prevent service suspension.

    If you have other questions, submit a ticket.

  • The peak hours for DataWorks tenants are from 00:00 to 09:00 each day. If you use shared resource groups during the peak hours, you share resources with other tenants.

    In this case, some tenants may preempt the resources. If you have high requirements on the output time of nodes, use exclusive resource groups to run the nodes. Regardless of the DataWorks edition you use, you do not need to pay extra fees for the node instances that are run on exclusive resource groups. For more information, see Exclusive resource group mode.

You can purchase these resources on the DataWorks Exclusive Resources (Subscription) page.

Limits

  • Before you use an exclusive resource for Data Integration or an exclusive resource for scheduling to access a data source that is deployed in a virtual private cloud (VPC) or other networks, you must select a network connectivity solution for an exclusive resource group for Data Integration or an exclusive resource group for scheduling. For more information, see Select a network connectivity solution.
  • An exclusive resource group for Data Integration cannot access a data source that is deployed on the classic network of Alibaba Cloud.
  • The software environment, such as Python, of exclusive resource groups for scheduling cannot be customized.
  • Exclusive resource groups for Data Integration support only level-2 synchronization nodes.
    Note
    • Level-1 synchronization nodes: the synchronization nodes that are committed and scheduled.
    • Level-2 synchronization nodes: the synchronization nodes that are run.

Exclusive resources for scheduling

To run a large number of nodes in parallel, you must use exclusive computing resources to make sure that nodes are run as scheduled. In this case, you can use exclusive resources for scheduling.
Note Each time you purchase exclusive resources for scheduling, the resources belong to only one exclusive resource group for scheduling. After an exclusive resource group for scheduling is created, you can scale out the resource group by adding resources to the resource group.
  • Billing standards

    Exclusive resources for scheduling are billed in subscription mode. You can select appropriate specifications based on your business requirements. For more information, see Performance metrics and pricing of exclusive resource groups for scheduling.

  • Scale-out
    You can scale out the exclusive resources for scheduling in each order based on your business requirements. You need only to pay for the added resources that are used from the time you scale out the resource group to the time the original order expires.
    Note
    • A scale-out increases only the number of resources in your resource group but does not upgrade the vCPU and memory specifications of the resources.
    • When you perform a scale-out for your resource group, you can add only resources of the same specifications as existing resources in the resource group.
    • After you perform a scale-out for your resource group, the new configuration takes effect within 20 minutes after you pay for your order.
  • Renewal

    You can renew your exclusive resource group for scheduling before the resource group expires or within 30 days after the resource group expires. If you do not renew the resource group within 15 days after the resource group expires, the system immediately suspends the resource group.

  • Expiration
    • Suspension

      By default, the system sends expiration notifications to the mobile phone number and email address that are bound to your Alibaba Cloud account 14 days, 12 days, and 8 days before your exclusive resource group for scheduling expires. If you do not renew the resource group within 15 days after the resource group expires, the system immediately suspends the resource group.

    • Release

      After exclusive resources for scheduling expire, they are retained for 15 days. If you do not renew the resource group within 15 days after the resource group is suspended, the system releases the resource group.

      The system sends release notifications to the mobile phone number and email address that are bound to your Alibaba Cloud account one day before the system releases your exclusive resource group for scheduling.

Exclusive resources for Data Integration

If a large number of Data Integration nodes must be run in parallel, exclusive computing resource groups are required to ensure fast and reliable data transmission. In this case, you can use exclusive resources for Data Integration.
Notice
  • To allow an exclusive resource group for Data Integration to access a data source in a VPC, you must associate the exclusive resource group with the VPC. Then, the system adds a route for the exclusive resource group. This way, the exclusive resource group can access all data sources in the VPC.
  • Exclusive resources for Data Integration guarantee the number of threads that a data synchronization node instance can simultaneously run, not the number of data synchronization node instances that can be simultaneously run. To guarantee the number of data synchronization node instances that can simultaneously run, you can purchase exclusive resources for scheduling.
    Note Only exclusive resource groups can be used to ensure that data synchronization nodes can be scheduled as expected. The shared resource group for Data Integration (for debugging) is shared by all tenants. All nodes that are configured to be run in parallel must wait in a queue to use the shared resources, and therefore the shared resource group for Data Integration cannot guarantee all nodes can be scheduled on time. If you want the instances of a data synchronization node to be scheduled on time, purchase an exclusive resource group for scheduling.
  • Billing standards
    Exclusive resources for Data Integration are billed in subscription mode. You can select appropriate specifications as needed. For more information, see Performance metrics and pricing of exclusive resource groups for Data Integration.
    Note When data synchronization nodes run, exclusive resource groups for Data Integration are used to compute data and resource groups for scheduling are used to schedule the nodes. You are charged based on the specifications that you select for the exclusive resource groups for Data Integration and the resource groups for scheduling. The usage of the exclusive resources for Data Integration is measured by vCPU and memory and the usage of the exclusive resources for scheduling is measured by the number of data synchronization nodes that run on the resource groups for scheduling.

    For example, if you purchase four exclusive resources for Data Integration with the specifications of 8 cores and 16 GiB of memory for a workspace in the China (Hangzhou) region and the subscription period is one year, the fee for the synchronization node instances that are run on these exclusive resources is calculated by using the following formula: 4 × USD 152.45/month × 12 months = USD 7,317.60.

    Within the one-year validity period, DataWorks charges no additional fees for the number of parallel instances generated by synchronization nodes that are run on the exclusive resources. The generated Internet traffic is separately billed.

  • Scale-out
    You can scale out the exclusive resources for Data Integration in each order based on your business requirements. You need only to pay for the added resources that are used from the time you scale out the resource group to the time the original order expires.
    Note
    • Each time you purchase exclusive resources for Data Integration, the resources belong to only one exclusive resource group for Data Integration. After an exclusive resource group for Data Integration is created, you can scale out the resource group by adding resources to the resource group.
    • A scale-out increases only the number of resources in your resource group but does not upgrade the vCPU and memory specifications of the resources.
    • When you perform a scale-out for your resource group, you can add only resources of the same specifications as existing resources in the resource group.
    • After you perform a scale-out for your resource group, the new configuration takes effect within 20 minutes after you pay for your order.
  • Renewal

    You can renew your exclusive resource group for Data Integration before the resource group expires or within 30 days after the resource group expires. If you do not renew the resource group within 15 days after the resource group expires, the system immediately suspends the resource group.

  • Expiration
    • Suspension

      By default, the system sends expiration notifications to the mobile phone number and email address that are bound to your Alibaba Cloud account 14 days, 12 days, and 8 days before your exclusive resource group for Data Integration expires. If you do not renew the resource group within 15 days after the resource group expires, the system immediately suspends the resource group.

    • Release

      After exclusive resources for Data Integration expire, they are retained for 15 days. If you do not renew the resource group within 15 days after the resource group is suspended, the system releases the resource group.

      The system sends release notifications to the mobile phone number and email address that are bound to your Alibaba Cloud account one day before the system releases your exclusive resource group for Data Integration.

Note

Scenarios of exclusive resources

  • Exclusive resources are used in exclusive mode. This helps isolate resources between tenants and between different nodes of the same tenant.

    If a large number of nodes are run in parallel on default resources, the nodes may be delayed because they need to wait for resources. In this case, we recommend that you use exclusive resources for scheduling and exclusive resources for Data Integration.

  • Exclusive resources can be used to access Internet services.
    • If you need to access Internet services or self-managed services by using PyODPS, we recommend that you use exclusive resources for scheduling.
    • If you need to access Internet services or self-managed services by using Shell, we recommend that you use exclusive resources for scheduling.
  • You can choose the specifications of exclusive resources based on your business requirements. If you need to run resource-consuming nodes, we recommend that you use exclusive resources for scheduling.