E-MapReduce:DLF-Auth

Prerequisites

Limits

• DLF allows only RAM users to manage permissions. Therefore, you must use the user management feature to add a RAM user in the EMR console.

• For more information about the regions in which you can use the data permission management feature of DLF, see Supported regions and endpoints.

• If you enable Hive or Spark for DLF-Auth, you cannot enable or disable Hive or Spark for Ranger. If you enable Hive or Spark for Ranger, you cannot enable or disable Hive or Spark for DLF-Auth.

• The following table describes the EMR versions and compute engines that are supported by DLF-Auth.

  EMR version		Hive	Spark	Presto	Impala
  EMR V3.X	EMR V3.39.0 and earlier	Not supported	Not supported	Not supported	Not supported
  	EMR V3.40.0	Supported	Supported	Supported	Not supported
  	EMR V3.41.0 to EMR V3.43.1	Supported	Supported	Not supported	Not supported
  	EMR V3.44.0 and later	Supported	Supported	Supported	Supported
  EMR V5.X	EMR V5.5.0 and earlier	Not supported	Not supported	Not supported	Not supported
  	EMR V5.6.0	Supported	Supported	Supported	Not supported
  	EMR V5.7.0 to EMR V5.9.1	Supported	Supported	Not supported	Not supported
  	EMR V5.10.0 and later	Supported	Supported	Supported	Supported

Procedure

This section describes how to enable DLF-Auth to implement fully managed and centralized permission management on data lakes.

1. Step 1: Enable Hive in DLF-Auth

2. Step 2: Add a RAM user

3. Step 3: Verify the permissions of the RAM user

4. Step 4: Optional. Enable LDAP authentication for Hive

   After you enable DLF-Auth to manage permissions, we recommend that you enable Lightweight Directory Access Protocol (LDAP) authentication for Hive. This way, all users who connect to Hive can run related scripts after they pass LDAP authentication.

Step 1: Enable Hive in DLF-Auth

1. Go to the DLF-Auth service page.

   1. Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.

   2. In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.

   3. On the EMR on ECS page, find the desired cluster and click Services in the Actions column.

   4. On the Services tab, find DLF-Auth and click Status.

2. Enable Hive in DLF-Auth.

   1. In the Service Overview section of the Status tab, turn on enableHive.

   2. In the message that appears, click OK.

3. Restart HiveServer.

   1. On the Services tab, find Hive and click Status.

   2. In the Components section of the Status tab, find HiveServer and click Restart in the Actions column.

   3. In the dialog box that appears, configure the Execution Reason parameter and click OK.

   4. In the Confirm message, click OK.

Step 2: Add a RAM user

You can add a RAM user by using the user management feature.

1. Go to the Users tab.

   1. Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.

   2. In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.

   3. On the EMR on ECS page, find the desired cluster and click Services in the Actions column.

   4. Click the Users tab.

2. On the Users tab, click Add User.

3. In the Add User dialog box, select an existing RAM user as an EMR user account from the Username drop-down list and specify Password and Confirm Password.

4. Click OK.

Step 3: Verify the permissions of the RAM user

1. Verify the permissions of the RAM user before you grant permissions to the RAM user.

   1. Log on to your cluster in SSH mode. For more information, see Log on to a cluster.

   2. Run the following command to access HiveServer2:

      beeline -u jdbc:hive2://master-1-1:10000 -n <user> -p <password>

      Note

      Replace <user> and <password> with the username and password that you set in Step 2: Add a RAM user.

   3. Query the information about an existing table.

      For example, run the following command to query the test table. Replace testdb.test with the actual name of the table.

      select * from testdb.test;

      If the RAM user does not have permissions on the table, an error message indicating that the query fails due to the lack of permissions is returned.

2. Grant permissions to the RAM user.

   1. Log on to the DLF console.

   2. In the left-side navigation pane, choose Data Permission > Data Permissions.

   3. On the Data Permissions page, click Add Permission.

   4. On the Add Permission page, configure the parameters. The following table describes the parameters.

      Parameter		Description
      Principal	Principal Type	The type of the principal. Default value: RAM User/Role.
      	Choose Principal	The RAM user to which you want to grant permissions. Select the user that you added in Step 2: Add a RAM user from the Choose Principal drop-down list.
      Resources	Authorization Method	The authorization method. Default value: Resource Authorization.
      	Resource Type	The type of resources. Select a type based on your business requirements. In this example, a metadata table is used.
      Permissions	Data Permission	In this example, Select is used.
      	Granted Permission

   5. Click OK.

3. Verify the permissions that are granted to the RAM user.

   Query data in the table again by referring to Step 1. The query is successful because the RAM user is granted the Select permission.

Step 4: Optional. Enable LDAP authentication for Hive

1. Go to the Services tab.

   1. Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.

   2. In the top navigation bar, select the region in which your cluster resides and select a resource group based on your business requirements.

   3. On the EMR on ECS page, find the desired cluster and click Services in the Actions column.

2. Enable LDAP authentication.

   1. On the Services tab, click Status in the Hive section.

   2. Turn on enableLDAP.

      • Clusters of EMR V5.11.1 or a later minor version and clusters of EMR V3.45.1 or a later minor version

        1. In the Service Overview section, turn on enableLDAP.

        2. In the Confirm message, click OK.

      • Clusters of EMR V5.11.0 or an earlier minor version and clusters of EMR V3.45.0 or an earlier minor version

        1. In the Components section, find HiveServer, click the > enableLDAP.

        2. In the dialog box that appears, enter an execution reason in the Execution Reason field and click OK.

        3. In the Confirm dialog box, click OK.

   3. Restart HiveServer.

      1. In the Components section of the Status tab, find HiveServer and click Restart in the Actions column.

      2. In the dialog box that appears, enter an execution reason in the Execution Reason field and click OK.

      3. In the Confirm dialog box, click OK.