Dataphin:Computing Tasks

Area

Description

①Computing Tasks Folder

The computing tasks folder centrally manages created tasks. It supports the following management operations:

• Folder Toolbar: Offers features such as filtering, refreshing, creating new folders, and locating tasks.

• Create Computing Tasks: Click the button to initiate the creation of computing tasks. The available tasks vary depending on the compute engine used; refer to the page display for details.

• Computing Tasks: Supports operations such as locking, editing, cloning, renaming, shifting, deleting, unpublishing, and unpublishing and deleting.

  Important

  • For Basic mode projects, task deletions are immediately updated in the production environment upon successful submission. Exercise caution when deleting tasks.

  • For Dev-Prod mode projects, after task deletion submission, proceed to the pending publication list to publish the changes to the production environment.

• Computing Tasks List: Manage your computing tasks by clicking on the list format.

②Toolbar

The toolbar enables actions such as saving, precompiling, executing, parameterized execution, submitting, unpublishing, formatting, refreshing, locking, locating, unpublishing, and unpublishing and deleting.

• Switch Version: For Python tasks, switch between Python 2.7, Python 3.7, and Python 3.11 execution versions.

• Switch Data Source: For database SQL tasks, change the data source of the task.

• Schema: For database SQL tasks with AnalyticDB for PostgreSQL, Oracle, or Presto databases, switch the Schema of the data source.

• Catalog: For database SQL tasks with Presto databases, switch the Catalog of the data source.

• Save: Save the current computing task in development.

• Precompile: Precompile the current computing task.

• Execute: Run the current computing task. Parameters set during the initial execution are retained for subsequent runs.

• Parameterized Execution: Execute the task without using saved parameters, requiring re-entry each time.

• Submit: Submit the task to the publication center or operation center.

• Unpublish: To unpublish computing tasks, navigate to the publication center and execute the unpublishing operations. For more information, see Deployment center.

• Go to operation: For computing tasks submitted to the operation center, you can go to the operation center to perform operation tasks. For more information, see Operation Center.

• Format: For SQL tasks, format the task code.

• Refresh: Refresh the current computing task.

• Lock: Acquire the editing lock for the task.

• Locate: Find the current computing task in the tasks folder.

• Delete, Unpublish and Delete: Remove or unpublish and delete the current computing task.

  Important

  • For Basic mode projects, task deletions are immediately updated in the production environment upon successful submission. Exercise caution when deleting tasks.

  • For Dev-Prod mode projects, after task deletion submission, proceed to the pending publication list to publish the changes to the production environment.

③Editor

Develop computing tasks using the code editor, which supports various shortcuts and efficiency-enhancing features. For more information, see:

• List of editor shortcut keys.

• For enhanced code efficiency in the Editor, see this guide.

④Configuration and management

Configure and manage the properties, relationships, historical data, and lineage of computing tasks.

• Property configuration: Set up the properties for computing tasks, which vary depending on the type of computation.

  • For offline computing task property configuration, see Overview of offline task property configuration.

  • For real-time computing task properties, see:

    • For an overview of real-time mode configuration, see this document.

    • For an overview of offline mode configuration, see the referenced document.

• Related: Offline computing tasks support viewing related objects of computing tasks, which are the tables that the current computing task references and reads, the tables that reference and read the current task, and the tasks that use the current task as an upstream dependency. For more information, see i.e.Compute,. For more information, see View and manage related objects of tasks.

• History: This feature allows you to view and manage the historical versions of tasks. For more information, see View and manage historical versions of real-time tasks.

• Lineage: Custom lineage is available for Python, Shell, and VIRTUAL computing tasks. For more information, see Custom lineage configuration.

Console

The console displays execution logs and results when tasks are executed or precompiled.

For SQL query computing tasks, it includes the execution results, logs, and code sections. For more information, see SQL query computing tasks query result console.

Block

Description

①Overall Console Operations

• View Execution Results: Access the execution results of the current computing task by clicking the icon on the console's left side.

• View Logs: Click the icon on the console's left side to review the log details of the task's execution.

• View Code: Inspect the code of the current computing task by clicking the icon on the console's left side.

• Manage Multiple Execution Results: View various execution outcomes after multiple runs by clicking the icon in the console's upper right corner.

• Full Screen Console: Expand the console to full screen by clicking the icon in the upper right corner.

• Pull up console/Pull down console: Click the or icon in the upper right corner of the console to pull up or pull down the console. You can also move the mouse to the upper edge of the console to freely pull up or pull down the console.

• Collapse console/View console: To collapse the console, click Collapse Console located at the bottom. To expand it again, click View Console.

②Execution Result Operations

• Column Search and Filter: Use Column Search And Filter to access a dropdown list of all column names. Highlight or filter columns by clicking the icon next to the column name.

• Single Row Details: Display each row's content as fields and values by selecting Single Row Details. Navigate through rows using the provided controls, or switch back to the table view with List View.

• Automatic Column Width: Automatically adjust column widths to fit content by selecting Automatic Column Width.

• Content Search: Search for specific content within the table by clicking the icon.

• Download data: To download, click the icon and choose either Download Sample Data or Download All Data.

• Row and Column Transformation: Transpose the table by clicking the icon.

• Single Column Data Filtering and Sorting: Filter and sort data within a column by clicking the icon next to the column name.

• Select All Table: Select the entire table, including headers, by clicking the cell in the top-left corner. Right-click to copy the selection.