The resource observation feature allows you to view the usage of resources in resource groups of MaxCompute Tunnel and computing resource groups in a specific period of time. For example, you can view the CPU utilization, memory usage, and parallelism. The resource groups of MaxCompute Tunnel include shared resource groups and exclusive resource groups. You can view the data of each metric to optimize and adjust the execution plan and resource allocation of jobs. This helps improve job efficiency and performance.
Supported regions
The following table describes the regions in which the resource observation feature can be used to observe resources of MaxCompute Tunnel and computing resources.
Resource type | Supported region |
Resources of MaxCompute Tunnel | China (Hangzhou), China (Shanghai), China (Beijing), China (Shenzhen), and China (Chengdu) |
Computing resources | China (Hangzhou), China (Shanghai), China (Beijing), China (Zhangjiakou), China (Shenzhen), China (Hong Kong), US (Silicon Valley), US (Virginia), Malaysia (Kuala Lumpur), Japan (Tokyo), Germany (Frankfurt), Indonesia (Jakarta), UK (London), and Singapore |
Resources of MaxCompute Tunnel
You can view the usage of resources in shared resource groups and subscription-based exclusive resource groups of MaxCompute Tunnel. You can also view metrics that are collected at specific time ranges of a project.
Procedure
Log on to the MaxCompute console. In the top navigation bar, select a region.
In the left-side navigation pane, click Resource Observation.
On the Resource Observation page, click the Data Transmission Service tab.
Select a level-1 quota, project, and time range to query the data of each metric.
Metrics
Metric | Description |
Request Parallelism | The request parallelism of a resource group, including the parallelism of upload requests, the parallelism of download requests, and the parallelism of all requests. The metric data is displayed in a curve chart. |
Throughput(B/s) | The throughput of a resource group, including the upload throughput and download throughput. The metric data is displayed in a curve. |
Top N Access Tables(Concurrent number) | If you select Tunnel Batch Upload from the Mode of use drop-down list and select testtable from the Table Name drop-down list, the parallelism of the testtable table that is uploaded by using Tunnel Batch in the current resource group is obtained. The metric data is displayed in a curve. |
Source IP Address(B/s) | If you select Tunnel Batch Upload from the Mode of use drop-down list and select testtable from the Table Name drop-down list, the amount of data that is transmitted per second from each source IP address of the testtable table that is uploaded by using Tunnel Batch in the current resource group is obtained. The metric data is displayed in a curve. |
Number of Error Codes | The number of times the status codes 500 and 429 are reported for a resource group. |
Quotas and associated projects: allow you to identify the projects that define a level-2 quota as the default quota.
Computing resources
You can view the consumption of CUs in a subscription or pay-as-you-go quota.
Procedure
Log on to the MaxCompute console. In the top navigation bar, select a region.
In the left-side navigation pane, click Resource Observation.
On the Resource Observation page, click the Computing Resources tab.
Select a level-1 quota and a time range to query the data of each metric.
NoteThe Resource Observation page in the MaxCompute console is provided to improve user experience on the chart display. A maximum of 60 time points can be displayed for each metric in a chart. Therefore, if the selected time range is greater than one hour, the average aggregation algorithm is used and the aggregation data within the time range is displayed in a chart by default. The average aggregation data is the number of minutes within the selected time range divided by 60. You can set the Aggregation Algorithm parameter to Maximum based on your business requirements to analyze the resource consumption in a more comprehensive manner.
Click the
icon on the left side of the desired level-2 quota to view the resource consumption trend chart of the level-2 quota. You can view the charts of multiple level-2 quotas at the same time. View the list of projects that are associated with each level-2 quota.
Metrics
Metric | Description |
CPU Resources | The trend of the CPU utilization of the current quota. Click a time point to view the job snapshot list that corresponds to the time point. |
Memory Resources (Unit: MB/100) | The trend of the memory usage of the current quota group. Important The pay-as-you-go resources come from a shared resource pool. These resources are consumed to run computing jobs. Computing jobs compete for resources, and the resources that can be used by each job are not limited. If a user continuously requests a large number of resources, MaxCompute limits the resource usage of the user to ensure that other users can use pay-as-you-go computing resources. |
Quotas and associated projects: allow you to identify the projects that define a level-2 quota as the default quota.
References
After you view the data of each metric, you can optimize and adjust the execution plan and resource allocation of jobs based on your business requirements.
You can reconfigure resources. For more information about how to configure quota plans and time plans in a quota resource group, see Configure quotas.
You can configure job priorities. For more information, see Job priority.