All Products
Search
Document Center

MaxCompute:Tenant-level Information Schema

Last Updated:Apr 03, 2024

Information Schema is the metadata service of MaxCompute. This topic describes the features, limits, precautions, metadata views, and authorization for RAM users of tenant-level Information Schema.

Background information

The Information Schema service of MaxCompute provides information such as project metadata and historical data. Fields and views that are specific to MaxCompute are added to ANSI SQL-92 Information Schema.

Tenant-level Information Schema is an enhancement of Information Schema. If the tenant-level Information Schema service is activated for your Alibaba Cloud account, a project named SYSTEM_CATALOG is automatically created within the Alibaba Cloud account and a built-in schema named INFORMATION_SCHEMA is provided. You can access the read-only views that are provided by the built-in schema to query the metadata and historical data of all projects within your Alibaba Cloud account. The following table describes the metadata views.

View

Description

Timeliness

Delay

CATALOGS

Lists projects.

Quasi-real-time view

Online data is displayed in metadata views with a delay of approximately 3 hours.

CATALOG_PRIVILEGES

Lists the permissions at the project level.

COLUMNS

Displays information about the table fields in a project.

COLUMN_LABEL_GRANTS

Displays the authorization information of a table column label in a project.

COLUMN_LABELS

Displays information about a table column label in a project.

COLUMN_PRIVILEGES

Displays a table column permission in a project.

INSTALLED_PACKAGES

Displays information about an installed package in a project.

PACKAGE_PRIVILEGES

Displays the authorization information of a package.

PACKAGE_OBJECTS

Displays the object information of a package.

PARTITIONS

Displays information about the table partitions in a project.

RESOURCES

Displays resource information in a project.

RESOURCE_PRIVILEGES

Displays the permission information of resources in a project.

ROLES

Displays project-level roles and tenant-level roles.

TABLES

Displays the table information in a project.

TABLE_LABEL_GRANTS

Displays information about label-based access control.

TABLE_LABELS

Displays the label information of tables in a project.

TABLE_PRIVILEGES

Displays the permission information of tables in a project.

UDF_PRIVILEGES

Displays the permission information of user-defined functions (UDFs) in a project.

UDFS

Displays the UDF information in a project.

UDF_RESOURCES

Displays the resource dependencies of UDFs in a project.

USERS

Lists users.

USER_ROLES

Displays the information about the role that the user assumes.

SCHEMAS

Displays the schema information of a project.

TASKS

Displays real-time snapshots of the jobs that are running. This view is used to monitor jobs in real time.

Online data is displayed in metadata views with a delay of a few seconds. This view is in public preview without SLA guarantee and will be available in the future.

TASKS_HISTORY

Displays the history of completed jobs in a project. The history of completed jobs is stored in a partitioned table and the data of the previous 14 days is retained.

Online data is displayed in metadata views with a delay of approximately 3 hours.

TUNNELS_HISTORY

Displays historical data that is uploaded or downloaded in batch mode by using a tunnel. The historical data is stored in a partitioned table and the data of the previous 14 days is retained.

Features

Tenant-level Information Schema provides the following features:

  • The metadata views of the Information Schema service allow you to browse and retrieve metadata.

  • The usage information views of the Information Schema service allow you to optimize jobs and plan resources. For example, you can analyze the metrics of a job, such as the resource consumption, running duration, and amount of processed data.

  • Different views have different validity periods or default retention periods. Data that exceeds the retention period is inaccessible. You can export data from Information Schema to a MaxCompute table to back up the data at a specific interval. This backup applies to historical data that requires a longer storage period.

    Note

    When you export data, we recommend that you explicitly specify the field names of the view. If you do not explicitly specify the field names of the view, you may fail to back up data by running insert into select * from information_schema.*** after some fields are inserted into a MaxCompute table.

Fees

The fees for Information Schema vary based on the following scenarios:

  • For projects that use pay-as-you-go computing resources, you are charged based on the SQL statements that you execute to query a view of Information Schema. Range-clustered tables are used in the views of Information Schema to reduce the amount of input query data and improve query performance. If you query the TASKS_HISTORY and TUNNELS_HISTORY views, we recommend that you query the data of the previous day after 6:00:00 every day. To minimize the input data amount of queries and reduce the query cost, we recommend that you do not query data of the current day.

  • For projects that use subscription computing resources, the compute units (CUs) that you purchased are consumed when you query views of Information Schema.

  • You do not need to pay storage fees for the views of Information Schema.

Limits

Tenant-level Information Schema has the following limits:

  • This feature is available. If you activate MaxCompute before August 1, 2023 and do not use MaxCompute, you may not have data when you use MaxCompute. If you want to use tenant-level Information Schema, apply for trial use of new features to upgrade MaxCompute to a version that supports tenant-level Information Schema.

  • Information Schema provides metadata views of the current user and does not support access to the metadata across metadata centers. Metadata centers are divided by region based on the following rules:

    • Regions in the Chinese mainland, including China (Shanghai), China (Hangzhou), China (Beijing), China (Shenzhen), China (Chengdu), and China (Zhangjiakou), are considered a metadata center.

    • The China (Hong Kong) region is considered a metadata center.

    • Each region outside China is considered a metadata center.

    • Alibaba Finance Cloud including the China East 2 Finance region and the China South 1 Finance region is considered a metadata center.

    • China North 2 Ali Gov 1 is considered a metadata center.

  • The built-in SYSTEM_CATALOG project is a read-only project. To query metadata, you must run a job in the project in the related region. For more information about the examples on how to query metadata, see Examples.

  • You can execute SQL statements to access tables only by using SQL Analysis of MaxCompute, the latest version of the MaxCompute client, DataStudio of DataWorks, or SQL scheduling nodes of DataWorks.

Precautions

When you use tenant-level Information Schema, take note of the following items:

  • Quasi-real-time views are provided for metadata system tables. For applications that require high metadata timeliness, we recommend that you use an SDK or CLI to obtain the metadata of a specified object.

  • Metadata and historical job data are stored only in SYSTEM_CATALOG.INFORMATION_SCHEMA. If you want to take snapshots of historical data or obtain a job history of more than 14 days, you can regularly back up the data in SYSTEM_CATALOG. INFORMATION_SCHEMA to a specified project.

Examples

The following examples show how to query metadata.

  • Example 1: Query the metadata of all tables in the specified project.

    -- Query the metadata of all tables in a project for which the tenant can execute SQL statements.
    use <project_name>;
    set odps.namespace.schema=true;
    select * from  SYSTEM_CATALOG.INFORMATION_SCHEMA.tables;
  • Example 2: Query the historical data of all jobs in the metadata center in which the specified project resides, and add a date field to filter data.

    -- Query the historical data of all jobs in a project for which the tenant can execute SQL statements.
    use <project_name>;
    set odps.namespace.schema=true;
    select * from  SYSTEM_CATALOG.INFORMATION_SCHEMA.tasks_history where ds='yyyymmdd' limit 100;

Authorization for RAM users

Views of Information Schema contain all tenant-level user data. By default, Alibaba Cloud accounts can view the data. If a RAM user wants to view the data, the RAM user must be granted the required permissions.

Note

Only an Alibaba Cloud account or a RAM user that is assigned the tenant-level Super_Administrator role or the tenant-level Admin role can grant permissions.

  1. Log on to the MaxCompute console.

  2. In the left-side navigation pane, choose Tenants > Roles. On the Roles page, click Add Role.

  3. In the Add Role dialog box, configure Role Name and Policy Content. Then, click OK.

    For example, you can add a role and grant the role the permissions to query all views under SYSTEM_CATALOG.INFORMATION_SCHEMA. The following sample code provides an example of the policy document.

    {
        "Statement":[
            {
                "Action":[
                    "odps:Describe",
                    "odps:Select"
                ],
                "Effect":"Allow",
                "Resource":[
                    "acs:odps:*:catalogs/system_catalog/schemas/information_schema/tables/*"
                ]
            },
            {
                "Action":[
                    "odps:List"
                ],
                "Effect":"Allow",
                "Resource":[
                    "acs:odps:*:catalogs/system_catalog/schemas/information_schema"
                ]
            }
        ],
        "Version":"1"
    }
  4. In the left-side navigation pane, choose Tenants > Users. To assign the role that you create to a new user, perform the following operations: On the Users page, click Add Member. In the Add Member dialog box, select a user to which you want to assign the role that you create from the list of RAM users, select the role that you create in the Batch Set Roles field, and then click OK. To assign the role that you create to an existing RAM user, perform the following operations: On the Users page, find the RAM user to which you want to assign the role that you create and click Modify Role in the Actions column. In the Edit Role dialog box, select the role that you create in the Available Roles section and click OK.

    Note

    For more information about user management, see User planning and management.

CATALOGS

Lists projects.

Field

Data type

Description

catalog_name

STRING

The name of the project.

status

STRING

Valid values: Allowed and Alldenied.

create_time

DATETIME

The time when the project was created.

owner_id

STRING

The ID of the project owner.

owner_name

STRING

The name of the project owner.

settings

STRING

The project property settings.

region

STRING

The region in which the project resides.

CATALOG_PRIVILEGES

Lists the permissions at the project level, such as CreateInstance and ListTable.

Field

Data type

Description

catalog_name

STRING

The name of the project.

user_catalog

STRING

The project to which the authorized account belongs.

user_name

STRING

The name of the account to which permissions are granted.

user_id

STRING

The ID of the account to which the permissions are granted.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

privilege_type

STRING

The type of the permission.

COLUMNS

Displays information about the table fields in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

column_name

STRING

The name of the column.

ordinal_position

BIGINT

The serial number of the column.

column_default

STRING

The default value of the column.

is_nullable

BOOLEAN

Specifies whether the NULL value is allowed.

data_type

STRING

The data type of the column, such as STRING and BIGINT.

column_comment

STRING

The comments on the column.

is_partition_key

BOOLEAN

Specifies whether the column is a partition key.

COLUMN_LABEL_GRANTS

Displays the authorization information of a table column label in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

column_name

STRING

The name of the column.

user_catalog

STRING

The name of the project to which the user belongs.

user_name

STRING

The name of the user.

user_id

STRING

The ID of the user.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

label_level

STRING

The granted level of the label.

expired

DATETIME

The time when the authorization expires.

COLUMN_LABELS

Displays information about a table column label in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

column_name

STRING

The name of the column.

label_type

STRING

The type of the label.

label_level

STRING

The level of the label.

COLUMN_PRIVILEGES

Displays a table column permission in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

column_name

STRING

The name of the column.

user_catalog

STRING

The name of the project to which the user belongs.

user_name

STRING

The name of the user.

user_id

STRING

The ID of the user.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

privilege_type

STRING

The type of the permission.

INSTALLED_PACKAGES

Displays information about an installed package in a project.

Field

Data type

Description

installed_package_catalog

STRING

The name of the project for which the package is installed.

package_catalog

STRING

The project to which the package belongs.

package_name

STRING

The name of the package.

installed_time

STRING

The time when the package was installed.

allowed_label

STRING

The shared label.

PACKAGE_PRIVILEGES

Displays the authorization information of a package.

Field

Data type

Description

package_catalog

STRING

The project to which the package belongs.

package_name

STRING

The name of the package.

user_catalog

STRING

The project to which the authorized user belongs.

user_name

STRING

The name of the user to which the permissions are granted.

user_id

STRING

The ID of the user to which the permissions are granted.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

privilege_type

STRING

The type of the permission.

PACKAGE_OBJECTS

Displays the object information of a package.

Field

Data type

Description

package_catalog

STRING

The project to which the package belongs.

package_name

STRING

The name of the package.

object_schema

STRING

The schema to which the object in the package belongs. The current value is NULL.

object_type

STRING

The type of the object in the package.

object_name

STRING

The name of the object in the package.

column_name

STRING

The name of the table column. You must set object_type to table in advance.

allowed_privilege

STRING

The shared permission.

allowed_label

STRING

The shared label.

PARTITIONS

Displays information about the table partitions in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

partition_name

STRING

The name of the partition.

create_time

DATETIME

The time when the partition was created.

last_modified_time

DATETIME

The time when the partition was last modified.

last_access_time

DATETIME

The time when the partition was last accessed.

Note

The data collection method is upgraded from July 2023. The time specified by the last_access_time parameter for a partition that is not accessed after the upgrade or is accessed by using ALGO jobs or the direct read method of Hologres cannot be collected.

data_length

BIGINT

The data size of the partition. Unit: bytes.

is_archived

BOOLEAN

A reserved field.

is_exstore

BOOLEAN

A reserved field.

storage_tier

STRING

Tiered storage identification. Valid values:

  • standard: the Standard storage.

  • lowfrequency: the IA storage.

  • longterm: the long-term storage.

cluster_type

STRING

The clustering type of the MaxCompute table. Valid values:

  • HASH

  • RANGE

number_buckets

BIGINT

Optional. The number of buckets in the clustered table. The value 0 indicates that the number of buckets dynamically changes when a job is running.

lifecycle_enabled

BOOLEAN

Specifies whether the lifecycle is enabled on the partition.

RESOURCES

Displays resource information in a project.

Field

Data type

Description

resource_catalog

STRING

The name of the project to which the resource belongs.

resource_schema

STRING

The schema of the resource. The current value is NULL.

resource_name

STRING

The resource name.

resource_type

STRING

The type of the resource. Valid values:

  • archive

  • py

  • jar

  • table

owner_id

STRING

The ID of the resource owner.

owner_name

STRING

The name of the Alibaba Cloud account of the resource owner.

create_time

DATETIME

The time when the resource was created.

last_modified_time

DATETIME

The time when the table was last modified.

size

BIGINT

The storage space that is occupied by the resource. Unit: bytes.

comment

STRING

The comments on the resource.

is_temp_resource

BOOLEAN

Specifies whether the resource is a temporary resource.

RESOURCE_PRIVILEGES

Displays the permission information of resources in a project.

Field

Data type

Description

resource_catalog

STRING

The name of the project to which the resource belongs.

resource_schema

STRING

The schema of the resource. The current value is NULL.

resource_name

STRING

The resource name.

user_catalog

STRING

The project to which the authorized account belongs.

user_name

STRING

The name of the account to which the permissions are granted.

user_id

STRING

The ID of the account to which the permissions are granted.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

privilege_type

STRING

The type of the permission.

ROLES

Displays project-level roles and tenant-level roles.

Field

Data type

Description

role_catalog

STRING

The name of the project to which the role belongs. If a tenant-level role is used, the value of this parameter is NULL.

role_name

STRING

The name of the role.

role_label

STRING

The label of the role.

comment

STRING

The comments on the role.

TABLES

Displays the table information in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

table_type

STRING

The type of the table. Valid values:

  • MANAGED_TABLE

  • VIRTUAL_VIEW

  • EXTERNAL_TABLE

  • MATERIALIZED_VIEW

is_partitioned

BOOLEAN

Specifies whether the table is a partitioned table.

owner_id

STRING

The ID of the table owner.

owner_name

STRING

The name of the Alibaba Cloud account of the table owner.

create_time

STRING

The time when the data table was created.

last_modified_time

STRING

The time when the table data was last modified.

last_access_time

STRING

The time when the table data was last queried.

Note

The data collection method is upgraded from July 2023. The time specified by the last_access_time parameter for a table that is not accessed after the upgrade or is accessed by using ALGO jobs or the direct read method of Hologres cannot be collected.

data_length

BIGINT

The size of data. Unit: bytes.

  • If the table is a non-partitioned table, the value of this parameter is the size of the table data.

  • If the table is a partitioned table, the system does not calculate the size of the table data. In this case, the value of this parameter is NULL. The PARTITIONS view includes the data size of each partition in a partitioned table.

table_comment

STRING

The comments on the table.

lifecycle

BIGINT

The lifecycle of the table. Unit: days.

lifecycle_enabled

BOOLEAN

Specifies whether the lifecycle is enabled.

is_archived

BOOLEAN

A reserved field.

table_exstore_type

STRING

Optional. This parameter specifies whether the current table is a logical or physical table of the extreme storage table. Valid values:

  • EXSTORE_TABLE_VIRTUAL

  • EXSTORE_TABLE_PHYSICAL

storage_tier

STRING

Tiered storage identification. Valid values:

  • standard: the Standard storage.

  • lowfrequency: the IA storage.

  • longterm: the long-term storage.

cluster_type

STRING

The clustering type of the MaxCompute table. Valid values:

  • HASH

  • RANGE

number_buckets

BIGINT

The number of buckets in the clustering table. The value 0 indicates that the number of buckets dynamically changes when a job is running.

view_original_text

STRING

The view definition in the table of the VIRTUAL_VIEW type.

TABLE_LABEL_GRANTS

Displays information about label-based access control.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

user_catalog

STRING

The project to which the authorized account belongs.

user_name

STRING

The name of the account to which permissions are granted.

user_id

STRING

The ID of the account to which the permissions are granted.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

label_level

STRING

The level of the label.

expired

DATATIME

The time when the authorization expires.

TABLE_LABELS

Displays the label information of tables in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

label_type

STRING

The type of the label.

label_level

BIGINT

The level of the label.

TABLE_PRIVILEGES

Displays the permission information of tables in a project.

Field

Data type

Description

table_catalog

STRING

The name of the project to which the table belongs.

table_schema

STRING

The schema of the table. The current value is NULL.

table_name

STRING

The name of the table.

user_catalog

STRING

The project to which the authorized account belongs.

user_name

STRING

The name of the account to which permissions are granted.

user_id

STRING

The ID of the account to which the permissions are granted.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

privilege_type

STRING

The type of the permission.

TASKS

Displays real-time snapshots of the jobs that are running. This view is used to monitor jobs in real time.

Field

Data type

Description

task_catalog

STRING

The name of the project to which the job belongs.

task_name

STRING

The name of the job.

task_type

STRING

The type of the job. Valid values:

  • SQL: an SQL job.

  • CUPID: a Spark or Mars job.

  • SQLCost: an SQL cost estimation job.

  • SQLRT: an MCQA SQL job.

  • LOT: a MapReduce job.

  • PS: a job of the parameter server (PS) of Platform for AI (PAI).

  • AlgoTask: a PAI job.

inst_id

STRING

The ID of the instance that is created for the job.

status

STRING

The job state. Valid values:

  • Running

  • Waiting

owner_id

STRING

The ID of the Alibaba Cloud account that submits the job.

owner_name

STRING

The name of the Alibaba Cloud account that submits the job.

start_time

DATETIME

The time when the job starts.

priority

BIGINT

The priority of the job.

signature

STRING

The job signature.

quota_name

STRING

The name of the computing quota.

cpu_usage

BIGINT

The current CPU utilization. The value of this parameter is calculated by using the following formula: Number of CPU cores × 100.

mem_usage

BIGINT

The current memory usage. Unit: MB.

gpu_usage

BIGINT

The current GPU utilization. The value of this parameter is calculated by using the following formula: Number of GPUs × 100.

total_cpu_usage

BIGINT

The accumulated CPU utilization. The value of this parameter is calculated by using the following formula: Number of CPU cores × 100 × Duration for which the job runs (seconds).

total_mem_usage

BIGINT

The accumulated memory usage. The value of this parameter is calculated by using the following formula: Current memory usage (MB) × Duration for which the job runs (seconds).

total_gpu_usage

BIGINT

The accumulated GPU utilization. The value of this parameter is calculated by using the following formula: Number of GPUs × 100 × Duration for which the job runs (seconds).

cpu_min_ratio

BIGINT

The ratio of the CPU utilization of the job to the minimum CPU utilization.

mem_min_ratio

BIGINT

The ratio of the memory consumed by the job to the minimum memory usage.

gpu_min_ratio

BIGINT

The ratio of the GPUs consumed by the job to the minimum GPU utilization.

cpu_max_ratio

BIGINT

The ratio of the CPU utilization of the job to the maximum CPU utilization.

mem_max_ratio

BIGINT

The ratio of the memory consumed by the job to the maximum memory usage.

gpu_max_ratio

BIGINT

The ratio of the GPUs consumed by the job to the maximum GPU utilization.

settings

STRING

The information that is scheduled by the upper layer application or specified by users. The information is saved in the JSON format. The information includes fields such as USERAGENT, BIZID, SKYNET_ID, and SKYNET_NODENAME.

additional_info

STRING

The additional information. This is a reserved field.

TASKS_HISTORY

Displays the history of completed jobs in a project. The data of the previous 14 days is retained.

Field

Data type

Description

task_catalog

STRING

The name of the project to which the job belongs.

task_name

STRING

The name of the job.

task_type

STRING

The type of the job. Valid values:

  • SQL: an SQL job.

  • CUPID: a Spark or Mars job.

  • SQLCost: an SQL cost estimation job.

  • SQLRT: an MCQA SQL job.

  • LOT: a MapReduce job.

  • PS: a job of the PS of PAI.

  • AlgoTask: a PAI job. No resource consumption and data scanning information are available.

inst_id

STRING

The ID of the instance that is created for the job.

status

STRING

The status of the job at the point in time when data is collected. This is not a real-time state. Valid values:

  • Terminated: The job is complete.

  • Failed: The job fails.

  • Cancelled: The job is canceled.

owner_id

STRING

The ID of the Alibaba Cloud account that submits the job.

owner_name

STRING

The name of the Alibaba Cloud account that submits the job.

result

STRING

The error message that appears if an error occurs in the job.

priority

BIGINT

The priority of the job.

submit_time

DATETIME

The time when the job is submitted, which is the time when the instance is generated.

start_time

DATATIME

The time when the job starts. For example, you can set this parameter to the time when SQL statements start to be executed for code compilation.

end_time

DATATIME

The time when the job is complete.

input_records

BIGINT

The number of input records.

Note

If an SQL job meets the conditions of the caching mechanism for MaxCompute Query Acceleration (MCQA), the value of this parameter is NULL.

output_records

BIGINT

The number of output records.

Note

If an SQL job meets the conditions of the caching mechanism for MCQA, the value of this parameter is NULL.

input_bytes

BIGINT

The amount of input data for the Standard storage. Unit: bytes.

Note

If an SQL job meets the conditions of the caching mechanism for MCQA, the value of this parameter is NULL.

lowfrequency_storage_input_bytes

BIGINT

The amount of input data for the IA storage. Unit: bytes.

Note

If an SQL job meets the conditions of the caching mechanism for MaxCompute Query Acceleration (MCQA), the value of this parameter is NULL.

longterm_storage_input_bytes

BIGINT

The amount of input data for the long-term storage. Unit: bytes.

Note

If an SQL job meets the conditions of the caching mechanism for MaxCompute Query Acceleration (MCQA), the value of this parameter is NULL.

oss_input_bytes

BIGINT

The amount of input data for the OSS external table. Unit: bytes.

Note

If an SQL job meets the conditions of the caching mechanism for MaxCompute Query Acceleration (MCQA), the value of this parameter is NULL.

tablestore_input_bytes

BIGINT

The amount of input data for the Tablestore external table. Unit: bytes.

Note

If an SQL job meets the conditions of the caching mechanism for MaxCompute Query Acceleration (MCQA), the value of this parameter is NULL.

output_bytes

BIGINT

The amount of output data. Unit: bytes.

Note

If an SQL job meets the conditions of the caching mechanism for MCQA, the value of this parameter is NULL.

input_tables

STRING

The list of input tables. This parameter is available only for SQL jobs.

Note

If an SQL job meets the conditions of the caching mechanism for MCQA, the value of this parameter is NULL.

output_tables

STRING

The list of output tables. This parameter is available only for SQL jobs.

Note

If an SQL job meets the conditions of the caching mechanism for MCQA, the value of this parameter is NULL.

operation_text

STRING

The job statement. The statement cannot exceed 256 KB in size.

signature

STRING

The job signature.

quota_name

STRING

The name of the computing quota.

complexity

DOUBLE

The complexity of the SQL job.

cost_cpu

DOUBLE

The CPU utilization of the job. The value of this parameter is calculated by using the following formula: Number of CPU cores × 100 × Duration for which the job runs (seconds). The value 100 indicates that one CPU core runs for one second. For example, if 10 CPU cores run for 5 seconds, cost_cpu is 5000, which is calculated by using the following formula: 10 × 100 × 5.

cost_mem

DOUBLE

The memory usage of the job. The value of this parameter is calculated by using the following formula: Current memory usage (MB) × Duration for which the job runs (seconds).

settings

STRING

The information that is scheduled by the upper layer application or specified by users. The information is saved in the JSON format. The information includes fields such as USERAGENT, BIZID, SKYNET_ID, and SKYNET_NODENAME.

ext_platform_id

STRING

The ID of the upper-layer scheduling platform.

ext_node_id

STRING

The ID of the upper-layer scheduling node.

ext_bizdate

STRING

The business date of the upper-layer scheduling task.

ext_task_id

STRING

The ID of the task of the upper-layer scheduling node.

ext_dagtype

STRING

The mode in which the upper-layer scheduling node runs.

ext_node_name

STRING

The name of the upper-layer scheduling node.

ext_node_onduty

STRING

The ID of the owner of the upper-layer scheduling node.

ext_node_priority

BIGINT

The priority of the upper-layer scheduling node.

ext_node_cyctype

STRING

A reserved field.

ext_subtask_id

STRING

The subtask ID of the upper-layer scheduling node.

ds

STRING

The date on which the data was archived. Data is archived by the UTC+8 time zone based on start_time of jobs.

TUNNELS_HISTORY

Displays historical data that is uploaded and downloaded at the same time over a data tunnel. Data of the previous 14 days is retained.

Field

Data type

Description

tunnel_catalog

STRING

The project to which the resource belongs.

tunnel_schema

STRING

The schema of the resource on which the operation is performed. The current value is NULL.

session_id

STRING

The ID of the session.

operate_type

STRING

The type of the change to the instance. Valid values:

  • UPLOADLOG

  • DOWNLOADLOG

  • DOWNLOADINSTANCELOG

  • STORAGEAPIREAD

  • STORAGEAPIWRITE

tunnel_type

STRING

The type of the tunnel. Valid values:

  • TUNNEL LOG

  • TUNNEL INSTANCE LOG

request_id

STRING

The request ID.

object_type

STRING

The type of the object on which the operation is performed. Valid values:

  • TABLE

  • INSTANCE

object_name

STRING

The name of the object on which the operation is performed. The value can be a table name or an instance ID.

partition_spec

STRING

The partition in the partitioned table to which data is uploaded or from which data is downloaded. Example: time=20130222, loc=beijing.

data_size

BIGINT

The size of the data. Unit: bytes.

block_id

BIGINT

The ID of the block that is uploaded by using a tunnel. This parameter is available only if operate_type is set to UPLOADLOG. Otherwise, this parameter is left empty.

offset

BIGINT

The number of records to skip before data is downloaded. By default, the download starts from record 0.

length

BIGINT

The number of records that are downloaded or uploaded. The number of records that are downloaded is the value of the specified length.

owner_id

STRING

The ID of the Alibaba Cloud account of the operator.

owner_name

STRING

The name of the Alibaba Cloud account of the operator.

start_time

DATATIME

The start time of the request.

end_time

DATATIME

The end time of the request.

client_ip

STRING

The IP address of the client that initiates the request.

user_agent

STRING

The information about the user agent, which is the client that initiates the request. The information may be the Java version or the operating system.

columns

STRING

The columns that are specified when data is downloaded by using a tunnel.

quota_name

STRING

The name of the Tunnel quota group.

ds

STRING

The data collection date. Example: ds=20190101. Data is archived by the UTC+8 time zone based on start_time of requests.

UDF_PRIVILEGES

Displays the permission information of UDFs in a project.

Field

Data type

Description

udf_catalog

STRING

The name of the project to which the UDF belongs.

udf_schema

STRING

The schema of the UDF. The current value is NULL.

udf_name

STRING

The name of the UDF.

user_catalog

STRING

The project to which the authorized account belongs.

user_name

STRING

The name of the account to which permissions are granted.

user_id

STRING

The ID of the account to which the permissions are granted.

grantor

STRING

The account that grants the permissions to a RAM user. This is a reserved field.

privilege_type

STRING

The type of the permission.

UDFS

Displays the UDF information in a project.

Field

Data type

Description

udf_catalog

STRING

The name of the project to which the UDF belongs.

udf_schema

STRING

The schema of the UDF. The current value is NULL.

udf_name

STRING

The name of the UDF.

owner_id

STRING

The ID of the UDF owner.

owner_name

STRING

The name of the Alibaba Cloud account of the UDF owner.

create_time

DATATIME

The time when the UDF was created.

last_modified_time

DATATIME

The time when the UDF was last modified.

UDF_RESOURCES

Displays the resource dependencies of UDFs in a project.

Field

Data type

Description

udf_catalog

STRING

The name of the project to which the UDF belongs.

udf_schema

STRING

The schema of the UDF. The current value is NULL.

udf_name

STRING

The name of the UDF.

resource_catalog

STRING

The name of the project to which the resource belongs.

resource_schema

STRING

The schema of the resource.

resource_name

STRING

The resource name.

USERS

Lists users.

Field

Data type

Description

user_catalog

STRING

The name of the project to which the user belongs. The value NULL indicates a tenant-level user.

identity_provider

STRING

The type of the account. Valid values:

  • ALIYUN

  • RAM

  • RAMRole

user_name

STRING

The name of the user.

user_id

STRING

The ID of the Alibaba Cloud user.

user_label

STRING

The label of the user.

USER_ROLES

Displays the information about the role that the user assumes.

Field

Data type

Description

user_role_catalog

STRING

The name of the project to which the role belongs. The value NULL indicates a tenant-level role.

role_name

STRING

The name of the role.

user_name

STRING

The name of the user.

user_id

STRING

The ID of the Alibaba Cloud user.

SCHEMAS

Displays the schema information of a project.

Field

Data type

Description

schema_catalog

STRING

The name of the project to which the schema belongs.

schema_name

STRING

The name of the schema.

owner_id

STRING

The ID of the Alibaba Cloud account to which the schema belongs.

owner_name

STRING

The name of the Alibaba Cloud account to which the schema belongs.

create_time

DATATIME

The time when the schema was created.

last_modified_time

DATATIME

The time when the schema was last modified.

schema_type

STRING

The type of the schema.

comment

STRING

The comments on the schema.

QUOTA_USAGE

Displays real-time snapshots of resource usage of the subscription computing quota. This view is used to monitor the consumption of computing resources in real time.

Field

Data type

Description

name

STRING

The name of the quota.

create_time

DATETIME

The time when the quota was created.

last_modified_time

DATETIME

The time when the quota was last updated.

cpu_elastic_quota_max

BIGINT

The maximum CPU quota for non-reserved CUs. Unit: Cores × 100.

cpu_elastic_quota_min

BIGINT

The minimum CPU quota for non-reserved CUs. Unit: Cores × 100.

cpu_elastic_quota_used

BIGINT

The CPU utilization for non-reserved CUs in the quota. Unit: Cores × 100.

mem_elastic_quota_max

BIGINT

The maximum memory quota for non-reserved CUs. Unit: MB.

mem_elastic_quota_min

BIGINT

The minimum memory quota for non-reserved CUs. Unit: MB.

mem_elastic_quota_used

BIGINT

The memory usage for non-reserved CUs in the quota. Unit: MB.

cpu_adhoc_quota

BIGINT

The CPU quota for elastically reserved CUs. Unit: Cores × 100.

cpu_adhoc_quota_used

BIGINT

The CPU utilization for elastically reserved CUs in the quota. Unit: Cores × 100.

mem_adhoc_quota

BIGINT

The memory quota for elastically reserved CUs. Unit: MB.

mem_adhoc_quota_used

BIGINT

The memory usage for elastically reserved CUs in the quota. Unit: MB.

cpu_quota_max

BIGINT

The maximum CPU quota for reserved CUs. Unit: Cores × 100.

cpu_quota_min

BIGINT

The minimum CPU quota for reserved CUs. Unit: Cores × 100.

cpu_quota_used

BIGINT

The CPU utilization for reserved CUs in the quota. Unit: Cores × 100.

mem_quota_max

BIGINT

The maximum memory usage for reserved CUs in the quota. Unit: MB.

mem_quota_min

BIGINT

The minimum memory usage for reserved CUs in the quota. Unit: MB.

mem_quota_used

BIGINT

The memory usage for reserved CUs in the quota. Unit: MB.

region

STRING

The region in which the resource resides.

VOLUMES

Lists the volumes of MaxCompute. The latency is about 3 hours.

Field

Data type

Description

volume_catalog

STRING

The name of the project to which the volume belongs.

volume_name

STRING

The name of the volume.

volume_type

STRING

The type of the volume. Valid values:

  • INTERNAL

  • EXTERNAL

owner_id

STRING

The ID of the volume owner.

owner_name

STRING

The Alibaba Cloud account name of the volume owner.

create_time

DATETIME

The time when the volume was created.

last_modified_time

DATETIME

The time when the data of the volume was last updated.

location

STRING

The storage path of the volume.

comment

STRING

The comments on the volume.

storage_provider

STRING

The storage engine of the volume.

role_arn

STRING

The Alibaba Cloud Resource Name (ARN) of the storage access role of the volume.

lifecycle

BIGINT

The lifecycle of the volume. Unit: days.

options

STRING

The option parameter of the volume.

FOREIGN_SERVERS

Lists the foreign servers of MaxCompute. The latency is about 3 hours.

Field

Data type

Description

server_name

STRING

The name of the server.

server_type

STRING

The type of the server.

owner_id

STRING

The ID of the server owner.

owner_name

STRING

The Alibaba Cloud account name of the server owner.

create_time

DATETIME

The time when the server was created.

last_modified_time

DATETIME

The time when the data was last updated.

options

STRING

The option parameter of the server.