This topic describes how to integrate Kafka with Ranger and how to configure related permissions.

Integrate Kafka with Ranger

  1. Enable Kafka in Ranger.
    1. Log on to the EMR console.
    2. In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.
    3. Click the Cluster Management tab.
    4. On the Cluster Management page, find your cluster and click Details in the Actions column.
    5. Select EnabledKafka from the Actions drop-down list in the upper-right corner.
      Enable Kafka PLUGIN
    6. In the Cluster Activities dialog box that appears, set related parameters and click OK.
      Click History in the upper-right corner to view the task progress.
  2. Add the Kafka service on the web UI of Ranger.
    1. Log on to Ranger. For more information, see Overview.
    2. Add the Kafka service.
      Ranger WebUI
    3. Configure the Kafka service.
      add_service
      Parameter Description
      Service Name Set the value to emr-kafka.
      Username Set the value to kafka.
      Password Enter a custom value.
      Zookeeper Connect String Enter a value in the format of emr-header-1:2181/kafka-x.xx.
      Note Set kafka-x.xx based on the actual Kafka version.
    4. Click Add.
  3. Restart the Kafka broker.
    1. In the left-side navigation pane, click Cluster Service and then Kafka.
    2. Select Restart Kafka Broker from the Actions drop-down list in the upper-right corner.
    3. In the Cluster Activities dialog box that appears, set related parameters and click OK.
      Click History in the upper-right corner to view the task progress.

Permission configuration example

After Kafka is integrated with Ranger, you can configure Kafka permissions in Ranger.
Notice In a standard cluster, Ranger generates the all - topic policy by default after the Kafka service is added. This policy does not limit the permissions of users. It allows all users to perform all operations. In this case, Ranger cannot control permissions of users.

Take user test as an example. To grant the Publish permission to user test, follow these steps:

  1. Click emr-kafka.
    click_emr_kafka
  2. Click Add New Policy in the upper-right corner.
  3. Configure required parameters.
    add_Policy
    Parameter Description
    Policy Name The name of the policy. You can customize a name.
    topic The topic on which permissions are configured. You can specify multiple topics. Press Enter after you specify each topic.
    Select Group The user group to which you want to add this policy.
    Select User The user to whom you want to add this policy.
    Permissions The permissions to be granted. Click add_permissions and select Publish.

    Click add_permissions below Select Group to authorize multiple groups.

  4. Click Add.
    After the policy is created, authorization is completed. User test can write data to the test topic.
    Note After you add, remove, or modify a policy, it can take up to one minute for the configuration to take effect.