E-MapReduce:Workflow quick start

Prerequisites

• You have completed system role authorization. For more information, see EMR Workflow role authorization.

• You have created a cluster or a cluster template in EMR on ECS. For more information, see Create a cluster or Create a cluster template.

  Supported cluster types include data lake, Hadoop, and custom.

Step 1: Bind cluster and associate workspace

1. Log on to the EMR console with your Alibaba Cloud account (main account) or a RAM user.

2. In the left-side navigation pane, choose EMR Studio > workflow.

3. On the workflow page, click Resource Groups for Scheduling.

4. Bind a cluster or cluster template.

   1. On the Resource Groups for Scheduling page, find the target execution cluster and click Associate Cluster in the Actions column.

   2. In the Associate EMR Cluster or Cluster Template dialog box, find the target cluster or cluster template and click Associate in the Actions column.

   3. In the dialog box, select a vSwitch and a security group, and then click OK.

      Note

      Binding a cluster takes 5 to 10 minutes to complete.

5. (Optional) Associate a workspace.

   Note

   When you first activate EMR Workflow, you get a free default execution cluster. This default cluster is automatically associated with the default workspace upon creation. If the default execution cluster does not meet your needs, you can purchase a paid execution cluster. For more information about the specifications and billing of paid execution clusters, see Billing of execution clusters. A paid execution cluster must be manually associated with a workspace.

   1. On the Resource Groups for Scheduling page, click Associate Workspace.

   2. In the Associate Workspace dialog box, find the workspace you want to use and click Associate in the Actions column.

   3. In the confirmation dialog box, click OK.

Step 2: Create a project

1. On the Workspace tab of the workflow page, find the target workspace and click Console in the Actions column.

2. On the Project Management page, click Create Project.

3. In the dialog box, enter a Project Name and click OK.

Step 3: Create a workflow

1. On the Project Management page, click the name of your new project.

2. In the left-side navigation pane, choose Data Development > Workflow Definition.

3. On the Workflow Definition page, click Create Workflow.

4. On the Create Workflow page, drag a SHELL node to the canvas.

   This topic uses the SHELL node type as an example. For more information about node types, see Node types.

5. In the dialog box, configure the parameters and click OK.

   The following table lists example settings. You can keep the default values for other parameters. For more information about the parameters, see SHELL. To associate a manual task, turn on the Associate Manual Task switch and select an existing manual task.

   Parameter	Description
   Node Name	A custom name for the node. For example, shell.
   Script	Your custom Shell program.

6. Save the workflow.

   1. In the upper-right corner of the canvas, click Save.

   2. In the dialog box, enter a Workflow Name and click OK.

Step 4: Run the workflow

1. On the Workflow Definition page, find the target workflow definition and click Run in the Actions column.

2. In the dialog box, select an execution cluster from the Resource Groups for Scheduling drop-down list, and click OK.

Step 5: View task instance logs

1. In the left-side navigation pane, choose Instance O&M > Workflow Instance to view the status of your workflow instances.

2. In the left navigation bar, select Instance O&M > Task Instance.

3. On the Task Instance page, find the target task instance and click View Logs in the Actions column.

(Optional) Step 6: Schedule the workflow

1. On the Workflow Definition page, find the target workflow definition and click Configure Scheduling Time in the Actions column.

2. In the dialog box, configure the parameters and click OK.

   • Time Period: The workflow runs on schedule only within this time range. The schedule does not generate new workflow instances outside this range.

   • Configure Scheduling Time: Select when to run the workflow.

3. In the Schedule Status column for the target workflow, turn on the switch.

Related documentation

• For more information about node types, see node types.

• For more information about parameters, see Parameter description.

• For more information about workflow operations, see Manage workflows.