Create an EMR Hive node

This topic describes how to create an E-MapReduce (EMR) Hive node. EMR Hive nodes allow you to use SQL-like statements to read data from and write data to data warehouses with large volumes of data stored in a distributed storage system and manage these data warehouses. You can use EMR Hive nodes to efficiently analyze large amounts of log data.

1. Go to the DataStudio page.
   1. Log on to the DataWorks console.
   2. In the left-side navigation pane, click Workspaces.
   3. In the top navigation bar, select the region where your workspace resides, find the workspace, and then click Data Analytics in the Actions column.
2. On the DataStudio page, move the pointer over the icon and choose EMR > EMR Hive.
   Alternatively, you can find the required workflow, right-click the workflow name, and then choose Create > EMR > EMR Hive.
3. In the Create Node dialog box, set the Node Name and Location parameters.
   Note The node name must be 1 to 128 characters in length and can contain letters, digits, underscores (_), and periods (.).
4. Click Commit.
5. On the node configuration tab, write code for the node.

   -- SQL statement example 
   -- The size of SQL statements cannot exceed 64 KB. 
   show tables;
   -- Scheduling parameters are supported. 
   CREATE TABLE IF NOT EXISTS userinfo (
   ip STRING COMMENT'IP address',
   uid STRING COMMENT'User ID'
   )PARTITIONED BY(
   dt STRING
   );
   ALTER TABLE userinfo ADD IF NOT EXISTS PARTITION(dt=${bizdate});
   -- LIMIT 2000 is automatically used for the SELECT statement. 
   select * from userinfo ;

   For more information about scheduling parameters, see Configure scheduling parameters.

   If you want to change the values that are assigned to the parameters in the code, click Run with Arguments in the top toolbar. For more information about value assignment for the scheduling parameters, see In which modes can nodes be run in DataWorks?.

   For more information about how to configure a Hive SQL job, see Configure a Hive SQL job.

   Note If multiple EMR compute engine instances are associated with the current workspace, you must select one EMR compute engine instance. If only one EMR compute engine instance is associated with the current workspace, you do not need to select one.
6. Save and commit the node.
   Notice You must set the Rerun and Parent Nodes parameters before you can commit the node.
   1. Click the icon in the toolbar to save the node.
   2. Click the icon in the toolbar.
   3. In the Commit Node dialog box, enter your comments in the Change description field.
   4. Click OK.
   In a workspace in standard mode, you must click Deploy in the upper-right corner after you commit the node. For more information, see Deploy nodes.
7. Test the node. For more information, see View auto triggered nodes.