MaxCompute's Tenant-level Information Schema is an enhanced version of the project-level Information Schema. It extends the ANSI SQL-92 standard with MaxCompute-specific fields and views, giving you SQL access to metadata and job history across all projects in your Alibaba Cloud account.
Each Alibaba Cloud account includes a built-in, read-only project named SYSTEM_CATALOG. All metadata and job history data are stored exclusively under SYSTEM_CATALOG.INFORMATION_SCHEMA.
Tenant-level vs. project-level Information Schema
| Dimension | Tenant-level | Project-level |
|---|---|---|
| Data scope | All projects in your Alibaba Cloud account | The current project only |
| Access path | SYSTEM_CATALOG.INFORMATION_SCHEMA.<view> |
INFORMATION_SCHEMA.<view> |
| Metadata Centers | Scoped to the Metadata Center of the queried region | Scoped to the current project's region |
| Job history retention | 14 days (TASKS_HISTORY, TUNNELS_HISTORY) | N/A |
Use the Tenant-level Information Schema when you need a unified view across projects — for example, auditing access permissions, tracking job resource consumption, or analyzing data usage patterns at the tenant level.
How it works
The Tenant-level Information Schema provides two categories of views:
-
Metadata views — browse and retrieve metadata such as tables, columns, schemas, roles, and permissions across all projects.
-
Usage history views — analyze job runtime metrics including resource consumption, runtime duration, and data processing volume to optimize jobs or plan compute capacity.
Each view has a defined data freshness level and retention period. Data older than the retention period is no longer available. To retain historical data beyond 14 days or back up job history using snapshots, periodically export data from INFORMATION_SCHEMA to local tables or specified projects.
When exporting data, explicitly specify field names in your SELECT statement. Avoid INSERT INTO SELECT * FROM information_schema.<view> — if new fields are added to a view, wildcard exports may fail or produce inconsistent results.
Limitations
-
No cross-Metadata Center access. The Information Schema only covers the Metadata Center where the queried region is located. Metadata Centers are grouped as follows:
-
All regions in the Chinese mainland (Shanghai, Hangzhou, Beijing, Shenzhen, Chengdu, Zhangjiakou, and Ulanqab) form one Metadata Center.
-
Hong Kong (China) forms one Metadata Center.
-
Each region outside China forms one Metadata Center.
-
Finance Cloud (Shanghai Finance Zone and Shenzhen Finance Zone) forms one Metadata Center.
-
Alibaba Gov Cloud (Beijing) forms one Metadata Center.
-
-
`SYSTEM_CATALOG` is read-only. Run queries from projects in the same region as the data you want to query.
-
SQL access only. Access views through MaxCompute SQL analysis, the latest version of the client, DataStudio in DataWorks, or SQL scheduling nodes.
-
Near-real-time data. Metadata views have latency of approximately 3 hours. For applications that require high metadata timeliness, use the SDK or CLI to retrieve metadata for specific objects directly.
Billing
Compute fees
-
Pay-as-you-go projects: Querying Information Schema views incurs standard query fees, calculated based on the underlying expanded SQL. Views are optimized using range clustered tables to reduce input data volume and query costs. For TASKS_HISTORY and TUNNELS_HISTORY, query the previous day's data after 06:00 daily and avoid querying the current day's data — this minimizes input volume and reduces fees.
-
Subscription projects: Queries consume purchased compute units (CUs).
Storage fees
Information Schema views do not incur storage fees.
View list
Metadata views
Most metadata views are near-real-time with approximately 3-hour latency. QUOTA_USAGE provides real-time snapshots. Each view has a system-defined retention period; data older than the retention period becomes unavailable.
| View | Description |
|---|---|
| CATALOGS | List of projects |
| CATALOG_PRIVILEGES | Project-level permissions |
| COLUMNS | Column information for tables in each project |
|
Data masking rule information for each project. |
|
|
Data masking information for table columns in each project. |
|
| COLUMN_LABEL_GRANTS | Label authorization for table columns in each project |
| COLUMN_LABELS | Column-level label information for tables in each project |
| COLUMN_PRIVILEGES | Column-level permission information for tables in each project |
| INSTALLED_PACKAGES | Installed packages in each project |
| PACKAGE_PRIVILEGES | Package authorization information |
| PACKAGE_OBJECTS | Objects in packages |
| PARTITIONS | Table partition information for each project |
| PARTITION_ACCESS_INFO | Partition access statistics for each project |
| RESOURCES | Resource information for each project |
| RESOURCE_PRIVILEGES | Resource permission information for each project |
| ROLES | Project-level and account-level roles |
| SCHEMAS | Schema information for projects |
| TABLES | Table information for each project |
| TABLE_ACCESS_INFO | Table access statistics for each project |
| TABLE_LABEL_GRANTS | Table-level label authorization information |
| TABLE_LABELS | Label information for tables in each project |
| TABLE_PRIVILEGES | Table permission information for each project |
| UDF_PRIVILEGES | UDF authorization information for each project |
| UDFS | UDF information for each project |
| UDF_RESOURCES | Resource dependencies for UDFs in each project |
| USERS | List of users |
| USER_ROLES | Role assignments for users |
| VOLUMES | Volume information (~3-hour latency) |
| FOREIGN_SERVERS | Foreign server information (~3-hour latency) |
| QUOTA_USAGE | Real-time subscription compute quota usage |
Usage history views
| View | Description | Latency | Retention |
|---|---|---|---|
| TASKS | Real-time snapshots of currently running jobs | Second-level latency. Currently in private preview with no Service Level Agreement (SLA) guarantee. | N/A (real-time only) |
| TASKS_HISTORY | Completed job history across all projects (partitioned table) | ~3 hours | 14 days |
| TUNNELS_HISTORY | Tunnel upload and download history (partitioned table) | — | 14 days |
Query examples
Run queries from an SQL-executable project in the same region as your data.
Query table metadata across all projects:
-- Switch to an SQL-executable project in your tenant.
USE <project_name>;
SET odps.namespace.schema=true;
SELECT * FROM SYSTEM_CATALOG.INFORMATION_SCHEMA.tables;
Query job history with a date filter:
-- Switch to an SQL-executable project in your tenant.
USE <project_name>;
SET odps.namespace.schema=true;
SELECT * FROM SYSTEM_CATALOG.INFORMATION_SCHEMA.tasks_history
WHERE ds = 'yyyymmdd'
LIMIT 100;
Grant RAM users access
By default, only the Alibaba Cloud account (main account) can access Information Schema data. To allow a Resource Access Management (RAM) user (sub-account) to query these views, create a tenant-level role with the appropriate policy and assign it to the RAM user.
Only the main account or a RAM user with the Super_Administrator or Admin role at the account level can perform this authorization.
-
Log on to the MaxCompute console and select a region.MaxCompute console
-
In the left navigation pane, choose Manage Configurations > Tenants.
-
On the Tenants page, click the Roles tab.
-
Click Add Role. In the dialog box, enter a Role Name and Policy Content, then click OK. The following policy grants access to all views under
SYSTEM_CATALOG.INFORMATION_SCHEMA:{ "Statement": [ { "Action": [ "odps:Describe", "odps:Select" ], "Effect": "Allow", "Resource": [ "acs:odps:*:catalogs/system_catalog/schemas/information_schema/tables/*" ] }, { "Action": [ "odps:List" ], "Effect": "Allow", "Resource": [ "acs:odps:*:catalogs/system_catalog/schemas/information_schema" ] } ], "Version": "1" } -
On the Tenants page, click the Users tab.
-
Click Add Member. In the dialog box, select or add the accounts to assign the role to. In the Batch Set Roles area, select the role you created, click
, then click OK. For details on user management, see User Planning and Management.
Usage notes
Fields that return NULL when the query acceleration cache is hit
The following fields in TASKS_HISTORY return NULL when an SQL job hits the query acceleration caching mechanism:
-
input_records -
output_records -
input_bytes -
lowfrequency_storage_input_bytes -
longterm_storage_input_bytes -
oss_input_bytes -
tablestore_input_bytes -
output_bytes -
input_tables -
output_tables
Time fields in TASKS_HISTORY
TASKS_HISTORY records three timestamps per job:
-
submit_time— when the job instance was created (submitted to the queue) -
start_time— when the job began executing (for example, when SQL compilation started) -
end_time— when the job finished
The ds partition field is archived based on the UTC+8 time zone of the job's start_time.Archived based on the UTC+8 time zone of the request's start_time.Archived based on the UTC+8 time zone of the job's start_time.
Resource consumption fields in TASKS_HISTORY
-
cost_cpu— total CPU consumption. A value of 100 represents 1 core × 1 second. For example, 10 cores running for 5 seconds results incost_cpu = 10 × 100 × 5 = 5000. -
cost_mem— total memory consumption in MB × seconds. -
cost_indicators— detailed resource information, suitable for job resource analysis and optimization.
Partition and table access time
The last_access_time field in PARTITIONS and TABLES is a reference value. It may differ from the actual last access time by up to 24 hours. Data collection for this field started progressively in July 2023. The value is not collected for:
-
Data not accessed after the upgrade
-
Data accessed via ALGO jobs or Hologres direct read
For partitioned tables, last_access_time in TABLES is NULL — check individual partition records in the PARTITIONS view instead.
CATALOGS
List of projects.
| Field | Type | Description |
|---|---|---|
| catalog_name | STRING | Project name |
| status | STRING | Project status. Values: Normal, Frozen |
| create_time | DATETIME | Project creation time |
| owner_id | STRING | Project owner ID |
| owner_name | STRING | Alibaba Cloud account name of the project owner |
| settings | STRING | Project property settings |
| region | STRING | Project region |
CATALOG_PRIVILEGES
Project-level permissions, such as CreateInstance and ListTable.
| Field | Type | Description |
|---|---|---|
| catalog_name | STRING | Project name |
| user_catalog | STRING | Project to which the authorized account belongs |
| user_name | STRING | Authorized account |
| user_id | STRING | Authorized account ID |
| grantor | STRING | Grantor account. Reserved field |
| privilege_type | STRING | Permission type |
COLUMNS
Column information for tables in each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table. Currently NULL |
| table_name | STRING | Table name |
| column_name | STRING | Column name |
| ordinal_position | BIGINT | Column ordinal number |
| column_default | STRING | Column default value |
| is_nullable | BOOLEAN | Whether NULL values are allowed |
| data_type | STRING | Data type, such as STRING or BIGINT |
| column_comment | STRING | Column comment |
| is_partition_key | BOOLEAN | Whether the column is a partition key |
| is_primary_key | BOOLEAN | Whether the column is a primary key |
COLUMN_DATA_MASKING_POLICIES
Data masking information for table columns in each project.
|
Field |
Type |
Value |
|
table_catalog |
STRING |
Project name of the table. |
|
table_schema |
STRING |
Schema of the table. |
|
table_name |
STRING |
Table name. |
|
column_name |
STRING |
Column name. |
|
policy_name |
STRING |
Policy name. |
COLUMN_LABEL_GRANTS
Label authorization information for table columns in each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table |
| table_name | STRING | Table name |
| column_name | STRING | Column name |
| user_catalog | STRING | Project name of the user |
| user_name | STRING | User name |
| user_id | STRING | User ID |
| grantor | STRING | Grantor account. Reserved field |
| label_level | STRING | Granted label level |
| expired | DATETIME | Expiration time |
COLUMN_LABELS
Column-level label information for tables in each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table. Currently NULL |
| table_name | STRING | Table name |
| column_name | STRING | Column name |
| label_type | STRING | Label type |
| label_level | STRING | Label level |
COLUMN_PRIVILEGES
Column-level permission information for tables in each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table |
| table_name | STRING | Table name |
| column_name | STRING | Column name |
| user_catalog | STRING | Project name of the user |
| user_name | STRING | User name |
| user_id | STRING | User ID |
| grantor | STRING | Grantor account. Reserved field |
| privilege_type | STRING | Permission type |
DATA_MASKING_POLICIES
Data masking rule information for each project.
|
Field |
Type |
Value |
|
policy_catalog |
Project name to which the policy belongs. |
|
|
policy_name |
Policy name. |
|
|
policy_type |
Policy data masking type. |
|
|
user_name |
Restricted account. |
|
|
user_id |
Restricted account ID. |
|
|
is_default |
Indicates whether it is the default policy. |
|
|
create_time |
Creation time of the policy. |
|
|
last_modified_time |
Last update time of the policy. |
|
|
options |
Policy option parameters. |
INSTALLED_PACKAGES
Installed packages in each project.
| Field | Type | Description |
|---|---|---|
| installed_package_catalog | STRING | Project where the package is installed |
| package_catalog | STRING | Project to which the package belongs |
| package_name | STRING | Package name |
| installed_time | STRING | Installation time |
| allowed_label | STRING | Shared label settings |
PACKAGE_PRIVILEGES
Package authorization information.
| Field | Type | Description |
|---|---|---|
| package_catalog | STRING | Project to which the package belongs |
| package_name | STRING | Package name |
| user_catalog | STRING | Project to which the authorized user belongs |
| user_name | STRING | Authorized user name |
| user_id | STRING | Authorized user ID |
| grantor | STRING | Grantor account. Reserved field |
| privilege_type | STRING | Permission type |
PACKAGE_OBJECTS
Objects in packages.
| Field | Type | Description |
|---|---|---|
| package_catalog | STRING | Project to which the package belongs |
| package_name | STRING | Package name |
| object_schema | STRING | Schema to which the object belongs |
| object_type | STRING | Type of the package object |
| object_name | STRING | Name of the package object |
| column_name | STRING | Table column name. Applies only when object_type is table |
| allowed_privilege | STRING | Shared permission settings |
| allowed_label | STRING | Shared label settings |
PARTITIONS
Table partition information for each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table |
| table_name | STRING | Table name |
| partition_name | STRING | Partition name |
| create_time | DATETIME | Partition creation time |
| last_modified_time | DATETIME | Last update time of the partition |
| last_access_time | DATETIME | Last access time of the partition. Reference value; may differ from the actual time by up to 24 hours. Data collection started progressively in July 2023. Not collected for data accessed via ALGO jobs or Hologres direct read |
| data_length | BIGINT | Partition data size, in bytes |
| is_archived | BOOLEAN | Reserved field |
| is_exstore | BOOLEAN | Reserved field |
| storage_tier | STRING | Storage tier. Values: standard, lowfrequency (IA storage class), longterm |
| cluster_type | STRING | Clustering type. Values: HASH, RANGE |
| number_buckets | BIGINT | Number of buckets for a clustered table. 0 indicates dynamic determination at job execution time |
| lifecycle_enabled | BOOLEAN | Whether partition lifecycle is enabled |
PARTITION_ACCESS_INFO
Partition access statistics for each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table. default for non-Layer 3 model projects |
| table_name | STRING | Table name |
| partition_name | STRING | Partition name |
| access_count | BIGINT | Number of accesses on the archive date |
| access_bytes | BIGINT | Total data accessed on the archive date, in bytes |
| ds | STRING | Data archive date |
RESOURCES
Resource information for each project.
| Field | Type | Description |
|---|---|---|
| resource_catalog | STRING | Project name of the resource |
| resource_schema | STRING | Schema of the resource |
| resource_name | STRING | Resource name |
| resource_type | STRING | Resource type. Values: archive, py, jar, table |
| owner_id | STRING | ID of the resource owner |
| owner_name | STRING | Alibaba Cloud account name of the resource owner |
| create_time | DATETIME | Resource creation time |
| last_modified_time | DATETIME | Last update time of the resource |
| size | BIGINT | Storage space occupied by the resource, in bytes |
| comment | STRING | Resource comment |
| is_temp_resource | BOOLEAN | Whether the resource is temporary |
RESOURCE_PRIVILEGES
Resource permission information for each project.
| Field | Type | Description |
|---|---|---|
| resource_catalog | STRING | Project name of the resource |
| resource_schema | STRING | Schema of the resource |
| resource_name | STRING | Resource name |
| user_catalog | STRING | Project of the authorized account |
| user_name | STRING | Authorized account name |
| user_id | STRING | Authorized account ID |
| grantor | STRING | Grantor account. Reserved field |
| privilege_type | STRING | Permission type |
ROLES
Project-level and account-level roles.
| Field | Type | Description |
|---|---|---|
| role_catalog | STRING | Project name of the role. NULL indicates a tenant-level role |
| role_name | STRING | Role name |
| role_label | STRING | Role label |
| comment | STRING | Role comment |
SCHEMAS
Schema information for projects.
| Field | Type | Description |
|---|---|---|
| schema_catalog | STRING | Project name where the schema resides |
| schema_name | STRING | Schema name |
| owner_id | STRING | Alibaba Cloud account ID of the schema owner |
| owner_name | STRING | Alibaba Cloud account name of the schema owner |
| create_time | DATETIME | Schema creation time |
| last_modified_time | DATETIME | Last update time of the schema |
| schema_type | STRING | Schema type |
| comment | STRING | Schema comment |
TABLES
Table information for each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table |
| table_name | STRING | Table name |
| table_type | STRING | Table type. Values: MANAGED_TABLE, VIRTUAL_VIEW, EXTERNAL_TABLE, MATERIALIZED_VIEW |
| is_partitioned | BOOLEAN | Whether the table is partitioned |
| owner_id | STRING | ID of the table owner |
| owner_name | STRING | Alibaba Cloud account name of the table owner |
| create_time | STRING | Table creation time |
| last_modified_time | STRING | Last update time of the table data |
| last_access_time | STRING | Last access time of the table. Reference value; may differ from actual time by up to 24 hours. NULL for partitioned tables — see the PARTITIONS view for per-partition values. Data collection started progressively in July 2023 |
| data_length | BIGINT | Data volume in bytes. NULL for partitioned tables — see the PARTITIONS view for per-partition values |
| table_comment | STRING | Table comment |
| lifecycle | BIGINT | Lifecycle, in days |
| lifecycle_enabled | BOOLEAN | Whether lifecycle recycling is enabled |
| is_archived | BOOLEAN | Reserved field |
| table_exstore_type | STRING | Optional. Identifies whether the table is a logical or physical extreme storage table. Values: EXSTORE_TABLE_VIRTUAL, EXSTORE_TABLE_PHYSICAL |
| storage_tier | STRING | Storage tier. Values: standard, lowfrequency (IA storage class), longterm |
| cluster_type | STRING | Clustering type. Values: HASH, RANGE |
| number_buckets | BIGINT | Number of buckets for a clustered table. 0 indicates dynamic determination at job execution time |
| view_original_text | STRING | View definition for VIRTUAL_VIEW type tables |
| has_primary_key | BOOLEAN | Whether the table has a primary key column |
| is_transactional | BOOLEAN | Whether the table is transactional |
| is_delta_table | BOOLEAN | Whether the table is a Delta Table |
| table_storage | STRING | Table storage service |
| table_format | STRING | Table storage format, such as ORC or Parquet |
TABLE_ACCESS_INFO
Table access statistics for each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table. default for non-Layer 3 model projects |
| table_name | STRING | Table name |
| access_count | BIGINT | Number of accesses on the archive date |
| access_bytes | BIGINT | Total data accessed on the archive date, in bytes |
| ds | STRING | Data archive date |
TABLE_LABEL_GRANTS
Table-level label authorization information.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table |
| table_name | STRING | Table name |
| user_catalog | STRING | Project to which the authorized account belongs |
| user_name | STRING | Authorized account |
| user_id | STRING | Authorized account ID |
| grantor | STRING | Grantor account. Reserved field |
| label_level | STRING | Label level |
| expired | DATETIME | Expiration time |
TABLE_LABELS
Label information for tables in each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table. Currently NULL |
| table_name | STRING | Table name |
| label_type | STRING | Label type |
| label_level | BIGINT | Label level |
TABLE_PRIVILEGES
Table permission information for each project.
| Field | Type | Description |
|---|---|---|
| table_catalog | STRING | Project name of the table |
| table_schema | STRING | Schema of the table. Currently NULL |
| table_name | STRING | Table name |
| user_catalog | STRING | Project of the authorized account |
| user_name | STRING | Authorized account |
| user_id | STRING | Authorized account ID |
| grantor | STRING | Grantor account. Reserved field |
| privilege_type | STRING | Permission type |
| expired | DATETIME | Permission expiration time |
UDF_PRIVILEGES
UDF authorization information for each project.
| Field | Type | Description |
|---|---|---|
| udf_catalog | STRING | Project where the UDF resides |
| udf_schema | STRING | Schema where the UDF resides |
| udf_name | STRING | UDF name |
| user_catalog | STRING | Project of the authorized account |
| user_name | STRING | Authorized account |
| user_id | STRING | Authorized account ID |
| grantor | STRING | Grantor account. Reserved field |
| privilege_type | STRING | Permission type |
UDFS
UDF information for each project.
| Field | Type | Description |
|---|---|---|
| udf_catalog | STRING | Project where the UDF resides |
| udf_schema | STRING | Schema where the UDF resides. Currently NULL |
| udf_name | STRING | UDF name |
| owner_id | STRING | ID of the UDF owner |
| owner_name | STRING | Alibaba Cloud account name of the UDF owner |
| create_time | DATETIME | Creation time |
| last_modified_time | DATETIME | Last update time |
UDF_RESOURCES
Resource dependencies for UDFs in each project.
| Field | Type | Description |
|---|---|---|
| udf_catalog | STRING | Project where the UDF resides |
| udf_schema | STRING | Schema where the UDF resides |
| udf_name | STRING | UDF name |
| resource_catalog | STRING | Project where the resource resides |
| resource_schema | STRING | Schema where the resource resides |
| resource_name | STRING | Resource name |
USERS
List of users.
| Field | Type | Description |
|---|---|---|
| user_catalog | STRING | Project name of the user. NULL indicates a tenant-level user |
| identity_provider | STRING | Account type. Values: ALIYUN, RAM, RAMRole |
| user_name | STRING | User name |
| user_id | STRING | User ID |
| user_label | STRING | User label |
USER_ROLES
Role assignments for users.
| Field | Type | Description |
|---|---|---|
| user_role_catalog | STRING | Project name of the role. NULL indicates a tenant-level role |
| role_name | STRING | Role name |
| user_name | STRING | User name |
| user_id | STRING | User ID |
VOLUMES
MaxCompute volume information. Approximately 3-hour latency.
| Field | Type | Description |
|---|---|---|
| volume_catalog | STRING | Project where the volume resides |
| volume_name | STRING | Volume name |
| volume_type | STRING | Volume type. Values: INTERNAL, EXTERNAL |
| owner_id | STRING | ID of the volume owner |
| owner_name | STRING | Alibaba Cloud account name of the volume owner |
| create_time | DATETIME | Volume creation time |
| last_modified_time | DATETIME | Last update time of the volume data |
| location | STRING | Volume storage path |
| comment | STRING | Volume comment |
| storage_provider | STRING | Volume storage engine |
| role_arn | STRING | Volume storage access role ARN |
| lifecycle | BIGINT | Volume lifecycle, in days |
| options | STRING | Volume option parameters |
FOREIGN_SERVERS
Foreign server information. Approximately 3-hour latency.3 hours
| Field | Type | Description |
|---|---|---|
| server_name | STRING | Server name |
| server_type | STRING | Server type |
| owner_id | STRING | ID of the server owner |
| owner_name | STRING | Alibaba Cloud account name of the server owner |
| create_time | DATETIME | Server creation time |
| last_modified_time | DATETIME | Last update time |
| options | STRING | Server option parameters |
QUOTA_USAGE
Real-time snapshots of subscription compute quota usage for monitoring compute resource consumption.
| Field | Type | Description |
|---|---|---|
| name | STRING | Quota name |
| create_time | DATETIME | Quota creation time |
| last_modified_time | DATETIME | Last update time of the quota |
| cpu_elastic_quota_max | BIGINT | Non-reserved CPU upper limit, in core*100 |
| cpu_elastic_quota_min | BIGINT | Non-reserved CPU lower limit, in core*100 |
| cpu_elastic_quota_used | BIGINT | Non-reserved CPU usage, in core*100 |
| mem_elastic_quota_max | BIGINT | Non-reserved memory upper limit, in MB |
| mem_elastic_quota_min | BIGINT | Non-reserved memory lower limit, in MB |
| mem_elastic_quota_used | BIGINT | Non-reserved memory usage, in MB |
| cpu_adhoc_quota | BIGINT | Elastic reserved CPU, in core*100 |
| cpu_adhoc_quota_used | BIGINT | Elastic reserved CPU usage, in core*100 |
| mem_adhoc_quota | BIGINT | Elastic reserved memory, in MB |
| mem_adhoc_quota_used | BIGINT | Elastic reserved memory usage, in MB |
| cpu_quota_max | BIGINT | Reserved CPU upper limit, in core*100 |
| cpu_quota_min | BIGINT | Reserved CPU lower limit, in core*100 |
| cpu_quota_used | BIGINT | Reserved CPU usage, in core*100 |
| mem_quota_max | BIGINT | Reserved memory upper limit, in MB |
| mem_quota_min | BIGINT | Reserved memory lower limit, in MB |
| mem_quota_used | BIGINT | Reserved memory usage, in MB |
| region | STRING | Region where the quota resides |
TASKS
Real-time snapshots of currently running jobs. Second-level latency.
TASKS is currently in private preview with no Service Level Agreement (SLA) guarantee and will be gradually released.
| Field | Type | Description |
|---|---|---|
| task_catalog | STRING | Project name of the task |
| task_name | STRING | Job name |
| task_type | STRING | Job type. Values: SQL, CUPID (Spark or Mars), SQLCost, SQLRT (query acceleration), LOT (MaxCompute MapReduce), PS (Parameter Server), AlgoTask (machine learning) |
| inst_id | STRING | Instance ID |
| status | STRING | Job status. Values: Running, Waiting |
| owner_id | STRING | Alibaba Cloud account ID of the job submitter |
| owner_name | STRING | Alibaba Cloud account name of the job submitter |
| start_time | DATETIME | Job start time |
| priority | BIGINT | Job priority |
| signature | STRING | Job signature |
| quota_name | STRING | Compute Quota name |
| cpu_usage | BIGINT | Current CPU usage, in core*100 |
| mem_usage | BIGINT | Current memory usage, in MB |
| gpu_usage | BIGINT | Current GPU usage, in cards*100 |
| total_cpu_usage | BIGINT | Accumulated CPU usage, in core*100*seconds |
| total_mem_usage | BIGINT | Accumulated memory usage, in MB*seconds |
| total_gpu_usage | BIGINT | Accumulated GPU usage, in cards*100*seconds |
| cpu_min_ratio | BIGINT | Current CPU occupancy ratio of the job's guaranteed queue watermark |
| mem_min_ratio | BIGINT | Current memory occupancy ratio of the job's guaranteed queue watermark |
| gpu_min_ratio | BIGINT | Current GPU occupancy ratio of the job's guaranteed queue watermark |
| cpu_max_ratio | BIGINT | Current CPU occupancy ratio of the job's highest elastic queue watermark |
| mem_max_ratio | BIGINT | Current memory occupancy ratio of the job's highest elastic queue watermark |
| gpu_max_ratio | BIGINT | Current GPU occupancy ratio of the job's highest elastic queue watermark |
| settings | STRING | Information passed by the upstream scheduler or user, in JSON format. Includes fields such as USERAGENT, BIZID, SKYNET_ID, and SKYNET_NODENAME |
| ext_platform_id | STRING | ID of the upstream task scheduling platform |
| ext_node_id | STRING | Node ID of the upstream schedule |
| ext_bizdate | STRING | Data timestamp of the upstream scheduled task |
| ext_task_id | STRING | Node instance ID of the upstream schedule |
| ext_dagtype | STRING | Running mode of the upstream scheduling instance |
| ext_node_name | STRING | Node name of the upstream schedule |
| ext_node_onduty | STRING | ID of the upstream scheduling node owner |
| ext_node_priority | BIGINT | Priority of the upstream scheduling node |
| ext_node_cyctype | STRING | Scheduling cycle type of the upstream scheduling node |
| ext_subtask_id | STRING | Subtask ID of the upstream scheduling node |
| additional_info | STRING | Additional information. Reserved field |
TASKS_HISTORY
Completed job history across all projects. Partitioned by date, retaining data for the last 14 days with approximately 3-hour latency.
All ext_* fields require the job submitter to actively pass this information when initiating a job. For field conventions, see Job Common Identifier Conventions.
Several fields return NULL when an SQL job hits the query acceleration caching mechanism. See Fields that return NULL when the query acceleration cache is hit for the full list.
| Field | Type | Description |
|---|---|---|
| task_catalog | STRING | Project name of the task |
| task_name | STRING | Job name |
| task_type | STRING | Job type. Values: SQL, CUPID (Spark or Mars), SQLCost, SQLRT (query acceleration), LOT (MaxCompute MapReduce), PS (Parameter Server), AlgoTask (machine learning; no resource consumption or data scan information) |
| inst_id | STRING | Job instance ID |
| status | STRING | Job status at data collection time (not real-time). Values: Terminated, Failed, Cancelled |
| owner_id | STRING | Alibaba Cloud account ID of the job submitter |
| owner_name | STRING | Alibaba Cloud account name of the job submitter |
| result | STRING | Job execution error message |
| priority | BIGINT | Job priority |
| submit_time | DATETIME | Job submission time (instance generation time) |
| start_time | DATETIME | Job start time (for example, SQL compilation start time) |
| end_time | DATETIME | Job end time |
| input_records | BIGINT | Number of input records. NULL when the query acceleration cache is hit |
| output_records | BIGINT | Number of output records. NULL when the query acceleration cache is hit |
| input_bytes | BIGINT | Standard storage input data volume, in bytes. NULL when the query acceleration cache is hit |
| lowfrequency_storage_input_bytes | BIGINT | IA storage class input data volume, in bytes. NULL when the query acceleration cache is hit |
| longterm_storage_input_bytes | BIGINT | Long-term storage input data volume, in bytes. NULL when the query acceleration cache is hit |
| oss_input_bytes | BIGINT | OSS foreign table input data volume, in bytes. NULL when the query acceleration cache is hit |
| tablestore_input_bytes | BIGINT | Tablestore foreign table input data volume, in bytes. NULL when the query acceleration cache is hit |
| output_bytes | BIGINT | Output data volume, in bytes. NULL when the query acceleration cache is hit |
| input_tables | STRING | List of input tables (SQL jobs only). NULL when the query acceleration cache is hit |
| output_tables | STRING | List of output tables (SQL jobs only). NULL when the query acceleration cache is hit |
| operation_text | STRING | Job statement, up to 256 KB |
| signature | STRING | Job signature |
| quota_name | STRING | Compute Quota name |
| complexity | DOUBLE | SQL job complexity |
| cost_cpu | DOUBLE | CPU consumption. 100 = 1 core × 1 second. Example: 10 cores × 5 seconds = 5,000 |
| cost_mem | DOUBLE | Memory consumption, in MB × seconds |
| cost_indicators | STRING | Detailed resource information for job resource analysis and optimization |
| settings | STRING | Information passed by the upstream scheduler or user, in JSON format. Includes fields such as USERAGENT, BIZID, SKYNET_ID, and SKYNET_NODENAME |
| ext_platform_id | STRING | ID of the upstream task scheduling platform |
| ext_node_id | STRING | Node ID of the upstream schedule |
| ext_bizdate | STRING | Data timestamp of the upstream scheduled task |
| ext_task_id | STRING | Node instance ID of the upstream schedule |
| ext_dagtype | STRING | Running mode of the upstream scheduling instance |
| ext_node_name | STRING | Node name of the upstream schedule |
| ext_node_onduty | STRING | ID of the upstream scheduling node owner |
| ext_node_priority | BIGINT | Priority of the upstream scheduling node |
| ext_node_cyctype | STRING | Reserved field |
| ext_subtask_id | STRING | Subtask ID of the upstream scheduling node |
| ds | STRING | Data archive date. Archived based on the UTC+8 time zone of the job's start_time |
TUNNELS_HISTORY
Tunnel upload and download history. Partitioned by date, retaining data for the last 14 days.
| Field | Type | Description |
|---|---|---|
| tunnel_catalog | STRING | Project to which the operated resource belongs |
| tunnel_schema | STRING | Schema to which the operated resource belongs. Currently NULL |
| session_id | STRING | Session ID |
| operate_type | STRING | Operation type. Values: UPLOADLOG, DOWNLOADLOG, DOWNLOADINSTANCELOG, STORAGEAPIREAD, STORAGEAPIWRITE |
| tunnel_type | STRING | Channel type. Values: TUNNEL LOG, TUNNEL INSTANCE LOG |
| request_id | STRING | Request ID |
| object_type | STRING | Operation object type. Values: TABLE, INSTANCE |
| object_name | STRING | Operation object name (table name or instance ID) |
| partition_spec | STRING | Partition for partitioned table uploads or downloads. Example: time=20130222, loc=beijing |
| data_size | BIGINT | Data size, in bytes |
| block_id | BIGINT | Block number for tunnel uploads. Valid only when operate_type is UPLOADLOG; otherwise empty |
| offset | BIGINT | Starting record offset for downloads (starting from 0) |
| length | BIGINT | Number of records uploaded or downloaded in this operation |
| owner_id | STRING | Alibaba Cloud account ID of the operator |
| owner_name | STRING | Alibaba Cloud account name of the operator |
| start_time | DATETIME | Request start time |
| end_time | DATETIME | Request end time |
| client_ip | STRING | IP address of the client initiating the tunnel request |
| user_agent | STRING | User agent, containing client information such as Java version and operating system |
| columns | STRING | Columns specified when downloading data via tunnel |
| quota_name | STRING | Tunnel quota group name |
| app_tag | STRING | Custom tag |
| ds | STRING | Data collection date (for example, ds=20190101). Archived based on the UTC+8 time zone of the request's start_time |