This topic describes how to use Alink to schedule jobs in the E-MapReduce (EMR) console.
Prerequisites
- An EMR Data Science cluster is created. For more information, see Create a cluster.
- A project is created. For more information, see Manage projects.
- Alink is configured. For more information, see PAI-Alink.
- PuTTY and SSH Secure File Transfer Client are installed on your computer.
Obtain the task script
Configure the deployment script
Configure a scheduling task
- Log on to the EMR console.
- In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
- Click the Data Platform tab.
- Create a task execution cluster.
- Find the project where you want to configure a scheduling task, and click Edit Job in the Actions column.
- Click the Projects tab.
- In the left-side navigation pane, click Cluster Settings.
- In the upper-right corner, click Add Cluster.
- In the Add Cluster dialog box, select the created Data Science cluster from the Select Cluster drop-down list and click OK.
- Create a job.
- Configure the job.
- Click Job Settings in the upper-right corner.
- In the Job Settings pane, click the Advanced Settings tab.
- In the Mode section, select Header/Gateway Node from the Job Submission drop-down list.
- Run the job.
- Click Save in the upper-right corner.
- Click Run in the upper-right corner.
- In the Run Job dialog box, set the execution cluster to the created Data Science cluster and click OK.