MaxCompute Management allows operations, administration, and management (OAM) personnel to view the running status of jobs, query the consumption of storage resources, and configure quota groups. This topic describes how to use MaxCompute Management.
- If you do not purchase enough compute units, you cannot take advantage of the computing resources and MaxCompute Management offered by MaxCompute.
- If you disable the AccessKey pair of your Alibaba Cloud account, you are unable to log on to MaxCompute Management by using a RAM user under this account.
Log on to MaxCompute Management
- Log on to the DataWorks console.
- In the left-side navigation pane, choose Compute Engines > MaxCompute. In the top navigation bar, select a region.
- In the Subscription section, click CUs. The MaxCompute Management page appears.
|Quota Group||The quota group that you want to query. By default, it is left blank, which indicates that all quota groups are queried.
You can select a time range from the date and time picker next to the Quota Group search box. By default, data in the past 24 hours is queried.
|CU Usage||The number of compute units used by all projects in a specific quota group at the end of a time range.|
|Storage||The storage capacity used by all projects in a specific quota group at the end of a time range.|
|Request Trend||The trend in the number of compute units, including reserved and non-reserved compute units, to be requested by all projects in a specific quota group in a time range.|
|CU Usage Trend||The trend in the number of compute units, including reserved and non-reserved compute units, actually used by all projects in a specific quota group in a time range.|
|Total CU||The trend in the total number of compute units, including reserved and non-reserved compute units, used in a specific quota group in a time range.|
|Storage Trend||The trend in the storage capacity used by all projects in a specific quota group in a time range.|
View the running status of jobs
- In the left-side navigation pane, click Jobs. The Job Snapshot page appears.
- Select the quota group you want to query and the time range to view the status of all the jobs in the quota group. You can view historical job snapshots.
Note On the Overview page, you can click any time point on the CU Usage Trend chart to view all historical job snapshots of all projects in a specific quota group at that moment.The following table describes the fields in the job list.
Field Description InstanceID The ID of the job instance. Each MaxCompute job runs as an instance. You can click an instance ID to switch to the Logview page and view the progress of a specific job. For more information, see Logview. Account The account of the person who runs the MaxCompute job. You can find the person responsible for the job based on the account information. If the job occupies too many resources and affects the running of other jobs, you can contact the person to stop the job. For more information about how to stop a job, see Kill Instance. Project Name The name of the project to which the instance belongs. Skynet Id The ID of the DataWorks node on which the job is running. If it is not specified, the job is not initiated by a DataWorks node. CPU Usage(%) The percentage of the total CPU resources of the quota group used by the job. Storage Usage(%) The percentage of the total memory resources of the quota group used by the job. Submission Time The time the instance is submitted. Waiting Time The time spent waiting for available resources to run the instance. Operating Duration The running duration of the instance. Status The running status of the instance. Priority The execution priority of the job.
The value ranges from 0 to 9. A smaller value indicates a higher priority.
- Enable automatic refresh and customize Refreshing every.
To disable automatic refresh, click .
Terminate a job
- On the Job Snapshot page, click Terminate Job above the job list.
- In the Terminate Job dialog box that appears, set Instance List and Tips.
- Click Run to terminate the job.
View the operation records of job snapshots
- In the left-side navigation pane, click Jobs.
- On the page that appears, click the Operation Record tab to view the operation records of job snapshots.
- Find an operation record and click Detail in the Actions column to view its details.
Query the consumption of storage resources
- In the left-side navigation pane, click Project. On the Yearly/Monthly Project List page that appears, you can view the used storage capacity of a project. You can also filter quota groups in the upper-right corner to view the storage capacity.
- Click the name of a specific project to view the storage watermark of that project in a certain period.
- Select a time range from the date and time picker and click OK.
Query the consumption of compute units
- In the left-side navigation pane, click Quota. The Yearly/Monthly Quota Group List page appears.
- Click the name of a resource group to view its resource consumption.
- Select a time range from the date and time picker and click OK.
Note The interval at which data is displayed depends on the selected time range.
Configure a quota group
You can configure a quota group, such as creating, modifying, or deleting a quota group, on the Yearly/Monthly Quota Group List page.
|Create a quota group||You can create a quota group. After a quota group is created, click Project in the left-side navigation pane. On the page that appears, find a project and click Modify in the Actions column to add the project to the quota group. Then, the computing tasks of the project use the computing resources of the quota group by default.||
|Modify the settings of a quota group||You can modify the settings of a quota group.||
|Delete a quota group||You can delete a quota group. If a quota group contains projects, you must migrate the projects to another group before you delete the quota group.||
- If you increase or reduce the number of compute units, both Maximum CU Quota and Minimum CU Quota required for the default quota group change, but remain unchanged for other quota groups.
- If you reduce the number of compute units to a value less than the Minimum CU Quota value of the default quota group, the downgrade fails.
- Maximum CU Quota indicates the maximum amount of compute resources that a quota group can use. Minimum CU Quota indicates the minimum amount of compute resources that must be reserved for a quota group.
Quota group configuration example
- Resources are exclusively used by each department.
[Maximum CU Quota,Minimum CU Quota,Maximum Elastic CU Quota]: group A [40,40,0]; group B [20,20,0]
- Resources are used by two departments on a first come, first served basis.
[Maximum CU Quota,Minimum CU Quota,Maximum Elastic CU Quota]: group A [60,40,0]; group B [40,20,0]
Scheduling sequence of quota groups
Currently, you cannot set the scheduling sequence for quota groups. Resources are used on a first come, first served basis and cannot be preempted. Assume that two departments are assigned 60 compute units and you set [Maximum CU Quota,Minimum CU Quota,Maximum Elastic CU Quota] to [40,20,0] for group A and [30,10,0] for group B. If group A uses 40 compute units first, group B can only use the remaining 20 compute units and cannot preempt resources being used by group A. However, if group A releases 10 compute units after a period of use, group B can then use 30 compute units.
Change the quota group of a project
- In the left-side navigation pane, click Project. The Yearly/Monthly Project List page appears.
- Find the project for which you want to change the quota group and click Modify in the Actions column. The Modify Quota Group Info dialog box appears.
- Select a quota group from the Quota Name drop-down list.
- Click Run to complete the modification.