DataWorks:Create a CDH Impala node

Prerequisites

Before you begin, ensure that you have:

• Registered a CDH cluster with your DataWorks workspace. See DataStudio (old version): Associate a CDH computing resource.

Limitations

CDH Impala tasks run on serverless resource groups or old-version exclusive resource groups for scheduling. We recommend that you run tasks on serverless resource groups.

Step 1: Create a CDH Impala node

1. Go to the DataStudio page. Log on to the DataWorks console. In the top navigation bar, select the region you want. In the left-side navigation pane, choose Data Development and O&M > Data Development. Select your workspace from the drop-down list and click Go to Data Development.

2. In the Scheduled Workflow pane, right-click the workflow you want, then choose Create Node > CDH > CDH Impala.

   Alternatively, hover over the Create icon at the top of the Scheduled Workflow pane and create a CDH Impala node from there.

3. In the Create Node dialog box, enter a Name and click Confirm.

Step 2: Develop an Impala task

Double-click the node name to open its configuration tab.

Select a CDH cluster (optional)

If multiple CDH clusters are registered to your workspace, select one from the Engine Instance CDH drop-down list. If only one cluster is registered, skip this step.

SHOW tables;

SELECT * FROM userinfo;

SELECT '${var}'; -- Replace var with a scheduling parameter value at runtime.

Step 3: Configure scheduling properties

To run the task on a periodic schedule, click Properties in the right-side navigation pane and configure the following:

• Basic properties — configure basic properties for the task. See Configure basic properties.

• Time properties and dependencies — scheduling cycle, rerun behavior, and upstream node dependencies. See Configure time properties and Configure same-cycle scheduling dependencies.

  Important

  Configure the Rerun and Parent Nodes parameters before committing the task.

• Resource properties — the resource group that runs the task. If the task needs to access the internet or a virtual private cloud (VPC), select a resource group that has the required network connectivity. See Configure the resource property and Network connectivity solutions.

Step 4: Debug the task

1. (Optional) Select a resource group and assign values to scheduling parameters. Click the icon in the top toolbar to open the Parameters dialog box. Select the resource group to use for debugging. If your SQL uses scheduling parameters, assign concrete values to each variable for this debug run. For details on how values are assigned in different run modes, see What are the differences in the value assignment logic of scheduling parameters among the Run, Run with Parameters, and Perform Smoke Testing in Development Environment modes?

2. Save and run the SQL. Click the icon to save, then click the icon to execute the SQL.

3. (Optional) Run smoke testing. Smoke testing validates the task logic in the development environment before or after committing. See Perform smoke testing.

What's next