A virtual node is an optional dependency that you can select when you configure scheduling parameters for a tenant. This topic describes how to create a virtual node in Dataphin.
Background information
Before you start building a data model, you can create a virtual node based on the data model to facilitate the configuration of scheduling parameters for other tasks in the data model.
Procedure
In the top menu bar of the Dataphin home page, select Development > Data Development.
On the Development page, select Project from the top menu bar (Dev-Prod mode requires environment selection).
In the navigation pane on the left, choose Data Processing > Script Task. In the Script Task list, click the
icon and select Virtual.In the Create Virtual Task dialog box, configure the following parameters.
Parameter
Description
Task Name
Enter a name for the compute job.
The length must not exceed 256 characters and must exclude vertical lines (|), forward slashes (/), backslashes (\), colons (:), question marks (?), angle brackets (<>), asterisks (*), and quotation marks (").
Schedule Type
Select the scheduling type of the task:
Recurring Task: Automatically participates in the system's periodic scheduling.
Manual Task: You must manually trigger the task.
Select Directory
Select the folder that contains the Job.
If no directory exists, you can Create Folder using the following steps:
Single click the
icon above the computing task list on the left to open the Create Folder dialog box.In the New Folder dialog box, enter the folder Name and Select Directory location as needed.
Single click Confirm.
Description
Enter a brief description of the task, limited to 1000 characters.
Single click Confirm.
In the code editor on the Virtual task tab, write the code for the virtual offline computing task. After you finish writing the code, click Run above the code editor.
Click Property in the right-side pane. In the Property panel, configure properties for the task, such as Basic Information, Runtime Parameter, Scheduling Properties (for recurring tasks), Schedule Dependency (for recurring tasks), Runtime Configuration, and Resource Configuration.
Basic Information
This section is dedicated to defining the name, responsible individual, description, and other fundamental details of the scheduling task. For guidance on configuration, see Configure Basic Task Information.
Runtime Parameter
If your task involves calling parameter variables, you can set values for these parameters in the properties section. This ensures that during node scheduling, the parameter variables are automatically substituted with their respective values. For guidance on configuration, see Configure and Use Node Parameters.
Scheduling Properties (recurring tasks)
For offline computing tasks set as Recurring Task, you must configure the scheduling properties in addition to the Basic Information. For guidance on configuration, see Configure Scheduling Properties.
Schedule Dependency (recurring tasks)
For offline computing tasks set as Recurring Task, you must not only provide Basic Information but also set up the task's scheduling dependencies. For guidance on configuration, see Configure Scheduling Dependencies.
Runtime Configuration
You can set the task-level runtime timeout and rerun policies for offline computing tasks to suit your business needs. If these are not specified, they will default to the values established at the tenant level. For guidance on how to configure these settings, see Configure Computing Task Runtime.
Resource Configuration
You can configure the scheduling resource group for this computing task. The task uses the resource quota of the specified resource group when it runs. For more information, see Configure Computing Task Resources.
On the Virtual task tab, save and submit the task.
Single click the
icon above the code editing area to save the code.Single click the
icon above the code editing area to submit the code.
In the Submitting Log page, you need to confirm the Submission Content and the results of the Pre-check, and fill in the remarks. For more information, see Offline Computing Task Submission Instructions.
After confirmation, single click Confirm And Submit.
What to do next
In Dev-Prod mode, once the task is successfully submitted, navigate to the release list to publish the task to the production environment. For more information, see Manage Release Tasks.
If you use Basic mode, the submitted virtual task is scheduled in the production environment. You can go to the Operation Center to view your published tasks. For more information, see View and manage script tasks, View and manage manual tasks.