All Products
Search
Document Center

Dataphin:MaxCompute/Hadoop/Lindorm (compute engine)/GaussDB (DWS)/Databricks Physical View and Field Details

Last Updated:Mar 05, 2025

This topic explains how to access the physical view and field asset details for compute engines such as MaxCompute, Hadoop, Lindorm (compute engine), GaussDB (DWS), and Databricks.

Physical view details entry

  1. On the Dataphin home page, navigate to the top menu bar and select Administration > Asset Checklist.

  2. Click the Table tab. Here, you can filter target assets by owner, my responsibility, asset tag, project, environment, data section, subject area, table type, and storage format.

  3. To view a physical view, click on the desired view name or the Actions column image icon to open the object details page.

Physical view details

The display information for physical views in MaxCompute, Hadoop, Lindorm (compute engine), GaussDB (DWS), and Databricks is largely consistent. The image below shows an example of the MaxCompute Physical View.

image

Area

Description

Summary Information

Displays the type, environment, name, tag, description, and other information of the table. You can also perform the following operations:

  • Search Other Asset Objects: Quickly search and switch to view the details of other assets.

  • View Asset Details: If the current object is listed in the Asset Directory, you can quickly jump to the directory details page to view the listed information.

  • View Production/development Objects: Quickly switch the current object to the corresponding production/development environment object details.

  • Tag: Displays the tag values configured for the current asset. To modify the tag, you can click Edit:

    • The length of each tag value does not exceed 128 characters.

    • Each asset object can be configured with up to 20 tag values.

    • The super administrator can modify the asset tags of all table types. The current table owner can modify the asset tags of the tables they are responsible for. The project administrator can modify the asset tags of the physical views under their responsible project.

  • Favorite: Click to add to or remove from favorites. After adding to favorites, you can view the last 30 favorite assets in the Asset Checklist - My Footprints for easy subsequent queries. You can also view all favorite assets in the Personal Data Center. For more information, see the referenced document.

  • Go Analysis: Click to jump to the Notebook page to automatically create the corresponding Notebook task. For more information, see the referenced document.

  • Request Permission: Click to quickly jump to the permission request page of the current table. For more information, see the referenced document.

  • Generate Select Statement: Click to generate the query statement for the current table. You can choose whether to add escape characters. You can copy the query statement to the ad hoc query or analysis page to query data.

    image

  • View DDL Statement: Click More in the upper right corner, select View DDL Statement, and click to view the DDL statement corresponding to the current data table in the tenant compute engine. In addition, you can select Data Source Type, click Generate DDL Statement, and the system will generate a DDL statement to create a table with the same structure as the current table in the specified type of data source system. If you select Automatically Add Escape Characters, the generated DDL statement will automatically add the corresponding escape characters according to the selected source type to reduce issues such as system keyword misinterpretation.

    image

  • Export Fields: Click More in the upper right corner, select Export Fields, and export the field information in the table in CSV format for quick analysis and use by other developers or business personnel.

  • View Transfer Records: Click More in the upper right corner, select View Transfer Records, and view the latest 100 transfer records of the current data table owner.

  • View Permission List: Click More in the upper right corner, select View Permission List, and view the data table permission information.

  • Refresh Metadata: Click More in the upper right corner, select Refresh Metadata. If the data table is not created through the Dataphin platform or the system metadata retrieval delay causes no results when querying the newly created table, you can click Refresh Metadata to obtain the latest metadata information and refresh the specified data table metadata into the Dataphin system.

Note

The analysis platform table does not support operations such as Go Analysis, Request Permission, View Transfer Records, and View Permission List.

Detail Information

Displays the detailed information of the table and fields.

  • Detail: Displays the technical attribute information of the table, including data section, subject area, project, highest sensitivity level, whether it is a manually created table on the analysis platform, storage type, and location.

    • Project: The project information to which the current table belongs. Click the project name to jump to the asset details page of the project.

    • Highest Sensitivity Level: The highest sensitivity level of the current table fields, which helps to quickly understand the data confidentiality of the current table. The Data Classification levels range from low to high as L1, L2, L3, L4 (public to top secret), and custom data classification.

    • Storage Type: The storage type of the current table, including internal table and external table.

      Note

      When the compute engine is GaussDB (DWS), the storage type is not displayed.

  • Field Information: Includes field details, description, data type, associated standard (requires purchasing the data standard module), data classification (requires purchasing the security module), data classification (requires purchasing the security module), and popularity information. You can also click the data lineage Actionsimage icon under the column to view the field lineage centered on the specified field.

Lineage & Impact

  • Lineage displays the data lineage between tables and fields.

    • Table-level Lineage sources include integration sync tasks, custom lineage compute tasks, and system-automatically parsed lineage SQL compute tasks and logical table tasks. For more information, see the referenced document.

    • Field Lineage sources include custom lineage compute tasks and system-automatically parsed lineage SQL compute tasks and logical table tasks, excluding integration sync tasks. For more information, see the referenced document.

      Note

      The system parses the table and field lineage relationships in the development environment when the task is submitted. When published, it parses the table and field lineage relationships in the production environment. A single task submission or publication supports parsing up to 100,000 lineage relationships. If exceeded, it will not be recorded and cannot be displayed in the asset directory.

  • Impact is divided into data table impact and integration sync impact.

    • Data Table Impact: Displays the direct downstream tables that reference the current table and the indirect downstream tables that reference the direct downstream tables. Supports exporting data and displaying only direct downstream tables.

      • Export Data: Supports exporting to Excel for business personnel to browse.

      • Display Only Direct Downstream Tables: When selected, only the downstream tables directly affected by the current table are displayed by default. When deselected, all downstream impact tables are displayed, with a maximum of 15 levels (starting from the direct downstream of the current table as the first level).

    • Integration Sync Impact: Displays the integration sync tasks where the current table and downstream tables are used as source tables. Supports exporting data and displaying only the current table impact operations.

      • Export Data: Supports exporting to Excel for business personnel to browse.

      • Display Only Current Table Impact: When selected, only the integration tasks where the current table is used as the input table are displayed by default. When deselected, the integration tasks where the current and all downstream impact tables are used as input tables are displayed, with a maximum of 15 levels (starting from the direct downstream of the current table as the first level).

Data Exploration

If you have enabled the data quality feature, you can configure data exploration tasks for the data table to quickly understand the data overview and assess the data availability and potential risks in advance. If you need to enable automatic exploration, you can enable the corresponding configuration in Administration > Metadata Center > Exploration Configuration. For more information, see the referenced document.

Note

When the compute engine is Databricks or GaussDB (DWS), the data exploration feature is not supported.

Data Preview

If you have the data permission to query the current table, you can use the data preview feature to query only the results corresponding to the fields for which you have select permission. You can preview the first 50 data entries. For information on how to apply for permission, see the referenced document.

You can search or filter the filtered data based on fields, search, view single-row data details, perform automatic column width adjustment and row-column transformation operations. You can also click the sort icon after the field to perform No Sort, Ascending, Descending operations. Double-click the field value to copy the field value with one click.

Output Information

The output tasks include the data write tasks of the object, lineage automatic parsing or custom configuration tasks with the current table as the output table, and tasks with node output name = project name.table name.

The output task list is updated in near real-time, and the output details are updated on a T+1 basis.

image.png

  • ① View Output Details: Only supports viewing the output details of periodic tasks. For more information, see the referenced document.

  • ② Go To Operation: Click the Go To Operation button to jump to the task list page of the Operation Center and filter out the current task for more information.

Usage Instructions

You can add usage instructions for the data table to provide information references for data browsers and consumers. You can click Add Usage Instructions, fill in the usage instructions title and content to complete the addition. image

Asset Information

Displays detailed information such as Basic Information, Change Information, and Usage Information of the physical view.

  • Basic Information: Includes environment, table type, creation time, creator, owner, and output tasks.

    • Owner: The owner of the current table. Supports transferring the owner of the current table to other users. In the Transfer Owner dialog box, you can choose whether to transfer the development/production environment table synchronously. After selecting the Recipient, click Confirm to transfer immediately. It is recommended to synchronize the recipient promptly after the transfer. You can view the transfer information on the transfer records page. For more information, see the referenced document.

      Note
      • The super administrator can transfer the owner of all table types. The current table owner can transfer the tables they are responsible for.

      • The project administrator can transfer the owner of the physical tables under their responsible project.

    • Output Task: You can view the output tasks of the current table, including the data write tasks of the object, lineage parsing or configuration tasks with the current table as the output table, and tasks with node output name = project name.table name. Click the name of the output task to jump to the operation details page of the data table.

      Note

      Only supports viewing the output details of periodic tasks.

  • Change Information: Includes last accessed, DDL changes.

    • Last Accessed At: The last select time (corresponding to DQL operation) parsed by Dataphin based on SQL. Access triggered by external systems is not counted and is updated in real-time.

    • Last Ddl Time: The last table structure change time (corresponding to DDL operation) parsed by Dataphin based on SQL. Changes triggered by external systems are not counted and are updated in real-time.

  • Usage Information: Includes number of favorites, page views, and visits.

    • Number Of Favorites: Displays the number of users who have favorited the current table, updated in real-time.

    • Page Views: Displays the number of page views (PV) of the current data table. Each refresh increases by one, updated in real-time.

    • Visits: Based on SQL parsing, when the table is selected in the Dataphin task (corresponding to DQL operation), it is calculated as one visit, updated on a T+1 basis, and displays the total number of visits in the last 30 days.

      Note

      When the compute engine is Databricks, the visit information is not displayed.

Field details

This section displays the details of the data table associated with the current field. For more information, see the referenced document.