DataWorks:MaxCompute data management

1. To the right of the schema, click > Create Table to go to the Create Table page.

2. You can create a table in one of the following ways.

   • Create a table using Copilot:

     1. In the toolbar, click Use Copilot to Create Table to open the Copilot Chat interface.

     2. Enter an instruction to create a table. For example, Create a daily aggregate table for product sales.

     3. Click Generate and Replace. The system generates a table name and field information based on your instruction.

     4. If the table name and fields meet your expectations, click Accept.

        Note

        You can click Accept and then manually edit the generated table information.

   • Create a table manually:

     Create a table using the following parameters.

     Parameter	Description
     Basic Information	Specify a custom Table Name, Lifecycle, and other information.
     Field Information	Edit the field and annotation information. Manual editing: Click Insert above the field list. Specify the number of rows, then edit field and annotation information. Intelligent editing with Copilot: Click Generate Fields or Generate Field Descriptions above the field list. The system generates fields and comments based on the table name and description.
     Advanced Settings	The Table Type is set to Internal Table by default. You can configure the Cluster Properties.

3. After the configuration is complete, click Publish in the top toolbar and complete the publishing process to create the table.

1. View a table.

   After creating a table, click the icon to the left of the project and click Table to view basic information. Click a table name to view details such as Fields and DDL.

2. Perform table operations.

   1. Right-click an internal table. You can select Generate SQL Query Statement, Import Data, Request Permissions, Metadata Mapping to Hologres, or Data Synchronization to Hologres.

   2. Double-click an internal table to open its details page. Click Edit in the upper-right corner. On the editing page, modify the Lifecycle and Table Description, or add, modify, or delete fields.

      Important

      • Before modifying a field name, deleting a field, or changing a field type, run the following command in a MaxCompute SQL node to enable schema evolution: setproject odps.schema.evolution.enable=true.

      • To delete a field, select the corresponding row, right-click, and select Delete.

      • After updating the table, click Publish again for the changes to take effect.

3. Delete a table.

   Right-click the table you want to delete and select Delete.

   Important

   This operation cannot be undone. Proceed with caution.

1. To the right of the schema, click > Create External Table to go to the Create External Table page.

2. Create a foreign table using one of the following methods.

   • Create a table using Copilot:

     1. In the toolbar, click Use Copilot to Create Table to open the Copilot Chat interface.

     2. Enter an instruction to create a table. For example, Create a daily aggregate table for product sales.

     3. Click Generate And Replace. The system generates a table name and field information based on your instruction.

     4. If the table name and fields meet your expectations, click Accept.

        Note

        You can click Accept and then manually edit the generated table information.

   • Create a table manually:

     Create a foreign table using the following parameters.

     Parameter	Description
     Basic Information	Specify a custom Table Name, Lifecycle, and other information.
     Field Information	Edit the field and annotation information. Manual editing: Click Insert above the field list. Specify the number of rows, then edit field and annotation information. Intelligent editing with Copilot: Click Generate Fields or Generate Field Descriptions above the field list. The system generates fields and comments based on the table name and description.
     Advanced Settings	The Table Type is set to Externa Table by default. Configure the OSS Storage Location and Storage Format. Storage Location: oss://<OSS_Bucket_Name>/ Note You can obtain the OSS bucket name from Bucket overview. Storage Format: Multiple formats are supported, such as CSV, ORC, and TEXTFILE.

3. Click Publish in the toolbar to create the table.

1. View a foreign table.

   After creating a foreign table, click the icon to the left of the project and click Externa Table to view its basic information. Click a table name to view details such as Fields and DDL.

2. Operations on external tables.

   Double-click the foreign table to open its details page. Click Edit in the upper-right corner. On the editing page, modify the Lifecycle and Table Description, or add, modify, or delete fields.

   Important

   • Before modifying a field name, deleting a field, or changing a field type, run the following command in a MaxCompute SQL node to enable schema evolution: setproject odps.schema.evolution.enable=true.

   • To delete a field, select the corresponding row, right-click, and select Delete.

   • After updating the table, click Publish again for the changes to take effect.

3. Delete a foreign table.

   Right-click the foreign table you want to delete and select Delete.

1. View an object table.

   After you create an OBJECT TABLE in a MaxCompute project, click the icon to the left of the project and click Object Table to view basic information. Click a table name for details such as Fields and DDL.

2. Operate on an object table.

   Right-click an object table. You can select Generate SQL Query Statement, Request Permissions, map MaxCompute metadata to a Hologres foreign table, or sync MaxCompute data to a Hologres internal table.

3. Delete an object table.

   Right-click the object table you want to delete and select Delete.

   Important

   This operation cannot be undone. Proceed with caution.

1. To the right of the schema, click > Create View to open the Create View page.

2. Modify the command as described in Create or update a view. Change view_name to the name of the view that you want to create. After the AS keyword, add the query statement for the view's data source.

3. Click Publish at the top of the page to create the view.

1. View the details of a view

   After creating a view, click the icon to the left of the project and click View to display basic information. Click a view name for details such as Fields and DDL.

2. Operations view

   Double-click the view to open its details page. Click Edit in the upper-right corner. Modify the view by changing the data source query statement after the AS keyword.

3. Delete a view

   Right-click the view you want to delete and select Delete.

1. To the right of the schema, click > Create Materialized View to open the Create Materialized View page.

2. Modify the command as described in Create a materialized view. Replace view_name with the name of the materialized view that you want to create. After the AS statement, add the query statement for the data source of the materialized view.

3. Click Publish at the top of the page to create the materialized view.

1. View a materialized view.

   After creating a materialized view, click the icon to the left of the project, and click Materialized View. Click a materialized view name for details such as Fields and DDL.

2. Delete a materialized view.

   Right-click the materialized view you want to delete and select Delete.

1. To the right of the schema, click > Create Delta Live Vaterialized View to open the Create Delta Live Vaterialized View page. Key configuration parameters:

   Parameter	Description
   Data Generation SQL	Enter the Data Generation SQL based on the command in Dynamic materialized view. Click Precompile to check the SQL syntax. Important A non-partitioned table must have a primary key.
   Field Details	Field details parsed after a successful precompilation.
   Primary Key Field Information	After precompilation, the system reads eligible primary key fields and displays them in the drop-down list. Select one or more primary key fields.
   Partition Field Information	After precompilation, the system reads eligible partition fields and displays them in the drop-down list. Select partition fields to partition the dynamic materialized view. Multiple partition fields are supported.
   Tuning Parameters	Configure parameter key-value pairs to generate into the TBLPROPERTIES of the DDL.
   Data Refresh Policy	Non-partitioned Delta Live Materialized View Refresh Configuration: A non-partitioned dynamic materialized view is created if you do not specify a partition field. For dynamic materialized views in MaxCompute, the refresh mode is set to incremental refresh by default. The table property is TBLPROPERTIES("refresh_mode"="incremental"). The supported refresh scheduling methods are MaxCompute Auto Refresh and DataWorks Scheduled Refresh. Partitioned Delta Live Materialized View Refresh Configuration: A partitioned dynamic materialized view is created if you specify a partition field. Partition refresh: Configure settings such as the refresh scheduling method, whether to auto-refresh data, the scheduling epoch, and the refresh duration. Refresh historical partition data: Configure whether to refresh data in partitions that have completed their refresh cycle.

2. Click Publish at the top of the page to create the dynamic materialized view.

1. Publish to a development or production environment. In a standard mode workspace, publish objects to different environments.

2. View a dynamic materialized view.

   After creating a dynamic materialized view, click the icon to the left of the project and click Delta Live Materialized View to view basic information. Click a view name for details such as Fields and DDL statement.

3. Delete a dynamic materialized view.

   Right-click the dynamic materialized view that you want to delete and select Delete.

After you create a resource in DataWorks Resource Management, click the icon to the left of the MaxCompute project and click Resource to view basic information. Click a resource name for details such as storage size.

After you create a function in DataWorks Resource Management, click the icon to the left of the MaxCompute project and click Function to view basic information. Click a function name for details such as storage size.