MaxCompute Management allows operations, administration, and management (OAM) personnel to view the running status of jobs, query the consumption of storage resources, and configure quota groups. This topic describes how to use MaxCompute Management.

Prerequisites

You have purchased subscription-billed MaxCompute compute units.
Note
  • If you do not purchase enough compute units, you cannot take advantage of the computing resources and MaxCompute Management offered by MaxCompute.
  • If you disable the AccessKey pair of your Alibaba Cloud account, you are unable to log on to MaxCompute Management by using a RAM user under this account.

Log on to MaxCompute Management

To log on to MaxCompute Management, follow these steps:
  1. Log on to the DataWorks console.
  2. In the left-side navigation pane, choose Compute Engines > MaxCompute. In the top navigation bar, select a region.
  3. In the Subscription section, click CUs. The MaxCompute Management page appears.#

Overview

On the Overview page, you can query CU Usage, Total CU, Storage, CU Usage Trend, and Storage Trend by quota group and time range.**
Field Description
Quota Group The quota group that you want to query. By default, it is left blank, which indicates that all quota groups are queried.

You can select a time range from the date and time picker next to the Quota Group search box. By default, data in the past 24 hours is queried.

CU Usage The number of compute units used by all projects in a specific quota group at the end of a time range.
Total CU
  • If you do not specify a quota group, the total number of compute units is calculated by using the following formula:

    Total number of compute units = Number of reserved compute units of an order at the end of a time range + Number of non-reserved compute units of an order at the end of a time range

  • If you specify a quota group, the total number of compute units is calculated by using the following formula:

    Total number of compute units = Maximum quota of reserved compute units of a specific quota group at the end of a time range + Maximum quota of non-reserved compute units of a specific quota group at the end of a time range
Storage The storage capacity used by all projects in a specific quota group at the end of a time range.
Request Trend The trend in the number of compute units, including reserved and non-reserved compute units, to be requested by all projects in a specific quota group in a time range.
CU Usage Trend The trend in the number of compute units, including reserved and non-reserved compute units, actually used by all projects in a specific quota group in a time range.
Total CU The trend in the total number of compute units, including reserved and non-reserved compute units, used in a specific quota group in a time range.
Storage Trend The trend in the storage capacity used by all projects in a specific quota group in a time range.

View the running status of jobs

The running status of jobs is collected every two minutes.
  1. In the left-side navigation pane, click Jobs. The Job Snapshot page appears.
  2. Select the quota group you want to query and the time range to view the status of all the jobs in the quota group. You can view historical job snapshots.
    Note On the Overview page, you can click any time point on the CU Usage Trend chart to view all historical job snapshots of all projects in a specific quota group at that moment.
    The following table describes the fields in the job list. **
    Field Description
    InstanceID The ID of the job instance. Each MaxCompute job runs as an instance. You can click an instance ID to switch to the Logview page and view the progress of a specific job. For more information, see Logview.
    Account The account of the person who runs the MaxCompute job. You can find the person responsible for the job based on the account information. If the job occupies too many resources and affects the running of other jobs, you can contact the person to stop the job. For more information about how to stop a job, see Kill Instance.
    Project Name The name of the project to which the instance belongs.
    Skynet Id The ID of the DataWorks node on which the job is running. If it is not specified, the job is not initiated by a DataWorks node.
    CPU Usage(%) The percentage of the total CPU resources of the quota group used by the job.
    Storage Usage(%) The percentage of the total memory resources of the quota group used by the job.
    Submission Time The time the instance is submitted.
    Waiting Time The time spent waiting for available resources to run the instance.
    Operating Duration The running duration of the instance.
    Status The running status of the instance.
    Priority The execution priority of the job.

    The value ranges from 0 to 9. A smaller value indicates a higher priority.
  3. Enable automatic refresh and customize Refreshing every.**

    To disable automatic refresh, click 暂停.

Terminate a job

Job submitters can terminate unnecessary jobs one after another or in batches. Job submitters can terminate up to 10 jobs in a batch.
  1. On the Job Snapshot page, click Terminate Job above the job list.
  2. In the Terminate Job dialog box that appears, set Instance List and Tips.00
  3. Click Run to terminate the job.

View the operation records of job snapshots

MaxCompute Management allows you to view the operation records of job snapshots generated in up to seven days.
  1. In the left-side navigation pane, click Jobs.
  2. On the page that appears, click the Operation Record tab to view the operation records of job snapshots.**
  3. Find an operation record and click Detail in the Actions column to view its details.

Query the consumption of storage resources

You can view the consumption of storage resources on the Yearly/Monthly Project List page. Data about storage resources is collected every hour.
  1. In the left-side navigation pane, click Project. On the Yearly/Monthly Project List page that appears, you can view the used storage capacity of a project. You can also filter quota groups in the upper-right corner to view the storage capacity.
  2. Click the name of a specific project to view the storage watermark of that project in a certain period.
  3. Select a time range from the date and time picker and click OK.

Query the consumption of compute units

You can view the consumption of compute units on the Yearly/Monthly Quota Group List page. Data about compute units is collected every two minutes.
  1. In the left-side navigation pane, click Quota. The Yearly/Monthly Quota Group List page appears.
  2. Click the name of a resource group to view its resource consumption.
  3. Select a time range from the date and time picker and click OK.
    Note The interval at which data is displayed depends on the selected time range.

Configure a quota group

You can configure a quota group, such as creating, modifying, or deleting a quota group, on the Yearly/Monthly Quota Group List page.

The following table describes the operations in detail.
Operation Description Step
Create a quota group You can create a quota group. After a quota group is created, click Project in the left-side navigation pane. On the page that appears, find a project and click Modify in the Actions column to add the project to the quota group. Then, the computing tasks of the project use the computing resources of the quota group by default.
  1. Click Create Quota Group.
  2. In the Create Quota Group dialog box that appears, set Quota Group Name, Minimum CU Quota, Maximum CU Quota, Maximum Elastic CU Quota, and Tag in sequence.
    Note
    • A tag is used to specify the quota group of a job. If the tag of a quota group is the same as the quota tag set when you submit a job, this job is preferentially scheduled to this quota group. For more information, see quota tags.
    • Make sure that the tag name is unique. Otherwise, jobs will be randomly scheduled to one of the quota groups that have the same tag instead of being evenly scheduled to multiple quota groups.
  3. Click Run to create the quota group.
Modify the settings of a quota group You can modify the settings of a quota group.
  1. Find the quota group for which you want to change the number of compute units and click Modify in the Actions column.
  2. In the Modify Quota Group dialog box that appears, change the values of Minimum Reserved CU Quota, Maximum Reserved CU Quota, Maximum Non-Reserved CU Quota, and Tag, and click Run to complete the modification.
Delete a quota group You can delete a quota group. If a quota group contains projects, you must migrate the projects to another group before you delete the quota group.
  1. Find the quota group that you want to delete and click Delete in the Actions column.
  2. In the Delete Quota Group dialog box that appears, click Run to delete the quota group.
Note
  • If you increase or reduce the number of compute units, both Maximum CU Quota and Minimum CU Quota required for the default quota group change, but remain unchanged for other quota groups.
  • If you reduce the number of compute units to a value less than the Minimum CU Quota value of the default quota group, the downgrade fails.
  • Maximum CU Quota indicates the maximum amount of compute resources that a quota group can use. Minimum CU Quota indicates the minimum amount of compute resources that must be reserved for a quota group.

Quota group configuration example

Assume that two departments are assigned 60 reserved compute units and zero non-reserved compute units. You can allocate the resources by using one of the following methods:
  • Resources are exclusively used by each department.

    [Maximum CU Quota,Minimum CU Quota,Maximum Elastic CU Quota]: group A [40,40,0]; group B [20,20,0]

  • Resources are used by two departments on a first come, first served basis.

    [Maximum CU Quota,Minimum CU Quota,Maximum Elastic CU Quota]: group A [60,40,0]; group B [40,20,0]

Scheduling sequence of quota groups

Currently, you cannot set the scheduling sequence for quota groups. Resources are used on a first come, first served basis and cannot be preempted. Assume that two departments are assigned 60 compute units and you set [Maximum CU Quota,Minimum CU Quota,Maximum Elastic CU Quota] to [40,20,0] for group A and [30,10,0] for group B. If group A uses 40 compute units first, group B can only use the remaining 20 compute units and cannot preempt resources being used by group A. However, if group A releases 10 compute units after a period of use, group B can then use 30 compute units.

Change the quota group of a project

You can change the quota group of a project. Resource isolation can be achieved for new quota groups by changing the quota group of a project.
  1. In the left-side navigation pane, click Project. The Yearly/Monthly Project List page appears.
  2. Find the project for which you want to change the quota group and click Modify in the Actions column. The Modify Quota Group Info dialog box appears.
  3. Select a quota group from the Quota Name drop-down list.
  4. Click Run to complete the modification.