All Products
Search
Document Center

Platform For AI:Work with dedicated resource groups

Last Updated:Feb 22, 2024

Dedicated resource groups are classified into subscription and pay-as-you-go resource groups. These group types are subject to different lifecycles and billing rules. You can select a type based on your business requirements. This topic describes how to create and manage dedicated resource groups, and scale Elastic Compute Service (ECS) instances (nodes) deployed in the groups.

Background information

You can deploy model services to dedicated resource groups. This is ideal for scenarios where you want to deploy and run a large number of services and you have strict real-time requirements on the responsiveness of the services. You can scale the resources in dedicated resource groups as needed after the services are deployed in the groups.

  • Resource group types

    Dedicated resource groups are classified into subscription and pay-as-you-go resource groups. These group types determine the types of nodes you can deploy on them. You can select a type based on your business requirements.

  • Create a dedicated resource group

    The Elastic Algorithm Service (EAS) module of Platform for AI (PAI) provides subscription and pay-as-you-go dedicated resource groups. You can select a group type based on your business requirements.

  • Manage the instances in a dedicated resource group

    You can purchase or release nodes of a dedicated resource group as needed to maximize resource utilization.

  • Manage dedicated resource groups

    On the details page of a dedicated resource group, you can view the nodes that you purchased and the model services that are deployed. You can also delete resource groups that you no longer need.

Resource group types

Dedicated resource groups are classified into subscription and pay-as-you-go resource groups. In this topic, these two resource group types are described as subscription resource groups and pay-as-you-go resource groups. The following table compares subscription and pay-as-you-go resource groups.

Type

Billing method

Resource group management

Supported resource type

Subscription resource group

Subscription

You can purchase an instance, renew a subscription instance, release a pay-as-you-go instance, and delete a resource group. For more information, see Manage the instances in a resource group.

You can view the supported resource types on the EAS pre-payment for dedicated machine buy page.

Pay-as-you-go resource group

Pay-as-you-go

Go to the EAS post-payment for dedicated machine buy page.

Create a dedicated resource group

  1. Go to the EAS-Online Model Services page.

    1. Log on to the PAI console.

    2. In the left-side navigation pane, click Workspaces. On the Workspace list page, click the name of the workspace that you want to manage.

    3. In the left-side navigation pane, choose Model Deployment > Elastic Algorithm Service (EAS) to go to the EAS-Online Model Services page.

  2. Create a resource group

    You can create subscription or pay-as-you-go resource groups as needed.

    Create a subscription resource group.

    1. On the EAS-Online Model Services page, click the Resource Group tab and choose Create Resource Group > Create Resource Group (Subscription). Configure the following parameters on the EAS pre-payment for dedicated machine page.

      Parameter

      Description

      Billing method

      Select Subscription.

      Region

      Select the region and zone where the resource group resides.

      Node Type

      Select an instance type. For information about the supported GPU and CPU specifications, refer to the information on the EAS pre-payment for dedicated machine page.

      Note

      The valid values of the Node Type parameter vary based on the region that you select.

      System Disk

      Select a system disk capacity. Valid values for each instance: 200 to 2000. Unit: GB. Each instance has a free quota of 200 GB. You are charged for the storage capacity that exceeds the free quota. For more information, see Billing of EAS.

      Billing Method

      Select Create Resource Group or Existing Resource Group.

      If you select Existing Resource Group, you must configure the Resource Group ID parameter.

      Resource Group ID

      Select a resource group ID from the drop-down list. For information about how to view the ID of a dedicated resource group, see Manage dedicated resource groups.

      Purchase Quantity

      Specify the number of instances that you want to purchase. Valid values: 1 to 9999.

      Validity Period

      Valid values: 1 Month, 2 Months, 3 Months, and 6 Months.

      Auto-renewal

      Specify whether to enable auto-renewal for the resource group.

    2. Click Buy Now.

      After you complete the payment, the system automatically allocates resources. You can view all created resource groups and modify the names of the resource groups on the Resource Group tab.

      Note

      If the system fails to create the resource group due to insufficient resources in the selected region, the system automatically issues a full refund.

    Create a pay-as-you-go resource group

    1. On the EAS-Online Model Services page, click the Resource Group tab and choose Create Resource Group > Create Resource Group (Pay-As-You-Go). Configure the following parameters on the EAS post-payment for dedicated machine buy page.

      Parameter

      Description

      Region

      Select the region and zone where the resource group resides.

      Node Type

      Select an instance type. For information about the supported GPU and CPU specifications, refer to the information on the EAS post-payment for dedicated machine buy page.

      Note

      The valid values of the Node Type parameter vary based on the region that you select.

      System Disk

      Select a system disk capacity. Valid values for each instance: 200 to 2000. Unit: GB. Each instance has a free quota of 200 GB. You are charged for the storage capacity that exceeds the free quota. For more information, see Billing of EAS.

      Billing Method

      Select Create Resource Group or Existing Resource Group.

      If you select Existing Resource Group, you must configure the Resource Group ID parameter.

      Resource Group ID

      Select a resource group ID from the drop-down list.

      Purchase Quantity

      Specify the number of instances that you want to purchase. Valid values: 1 to 9999.

    2. Click Buy Now.

      After you complete the payment, the system automatically allocates resources. You can view all created resource groups and modify the names of the resource groups on the Resource Group tab.

Manage the instances in a resource group

  • Purchase instances for a resource group

    If the resources in a resource group are insufficient, you can purchase instances for the group.

    1. On the Resource Group tab, click the name of the resource group that you want to view.

    2. Click Purchase Node and select Subscription Node or . For more information, see the Create a dedicated resource group section.

  • Renew the nodes in a dedicated resource group

    You can extend the subscription duration of a resource group. For example, if you renew a subscription resource group for one month, the subscription duration of the resource group is extended by one month.

    1. On the Nodes tab of the details page of the dedicated resource group, click the 更多 icon in the Actions column of a subscription instance and select Renew from the drop-down list.

    2. On the page that appears, configure the Duration parameter, click Buy Now, and then complete the payment.

  • To stop the scheduling of a node that is in the Running state, find the node and click Stop Scheduling or Clear Node in the Actions column. To resume the scheduling of a node, find the node and click Restart Scheduling in the Actions column.

  • To view the details of a node, click the ID of the node to go to the details page. On the details page, you can find the service instance that you want to manage and click Restart in the Actions column to restart the service instance. You can also click Logs to view the logs of the service instance.

  • Delete nodes from a dedicated resource group

    Important

    Unexpired subscription nodes cannot be released. To release an unexpired subscription node, contact your account manager.

    On the details page of the dedicated group, find the instance that you want to delete, and choose image>Delete to delete the instance.

Manage dedicated resource groups

  • View the details of a dedicated resource group

    1. On the Resource Group tab, find the resource group that you want to manage and click the name of the resource group. You can also find the resource group and click Details in the Actions column.

    2. On the details page, you can perform the operations described in the following table.

      Operation

      Description

      View the ID of a resource group

      A resource group ID is the unique identifier of a resource group. A resource group ID is required when you use the EASCMD client to deploy a model.image

      Modify the name of a resource group

      Click the 编辑 icon to the right of a resource group name to modify the name. We recommend that you use a name that identifies your business. Resource group names are used to select resource groups when you deploy models as online services in the EAS console.

      View all instances in a resource group

      Click the Nodes tab.

      View the services that are deployed in a resource group

      Click the Services tab.

  • Delete a dedicated resource group

    On the Resource Group tab, find the resource group that you want to delete and click Delete in the Actions column.

References

  • After you create a resource group, you can deploy model services to the group. For more information, see Model service deployment by using the PAI console.

  • You can enable virtual private cloud (VPC) direct connect for services deployed in a dedicated resource group. For more information, see Configure network connectivity.

  • You can configure log collection for a resource group. After the configuration is complete, the system collects the logs generated by EAS services that are deployed in the resource group and stores the logs in your Simple Log Service. For more information, see Configure log collection for a resource group.