All Products
Search
Document Center

E-MapReduce:Enable high availability for JindoFSx

Last Updated:Oct 31, 2024

This topic describes how to enable high availability for JindoFSx.

Prerequisites

A cluster of E-MapReduce (EMR) V3.42.0 or a later minor version, or a cluster of EMR V5.6.0 or a later minor version is created in the EMR console. JindoData is selected and High Service Availability is turned on when you create the cluster. For more information, see Create a cluster. In this example, a cluster of EMR V3.42.0 is used.

If the data source is Object Storage Service (OSS), OSS-HDFS, Apache Hadoop Distributed File System (HDFS), or File Storage NAS, you must make sure that the following operations are complete:

Limits

The version of the EMR cluster must be V3.42.0 or a later minor version, or V5.6.0 or a later minor version.

Procedure

  1. Step 1: Configure JindoData

  2. Step 2: Configure JindoSDK

Step 1: Configure JindoData

  1. Go to the namespace tab of the JindoData service.

    1. Log on to the EMR console. In the left-side navigation pane, click EMR on ECS.

    2. In the top navigation bar, select the region where your cluster resides and select a resource group based on your business requirements.

    3. On the EMR on ECS page, find the desired cluster and click Services in the Actions column.

    4. On the Services tab, find the JindoData service and click Configure.

    5. On the Configure tab, click the namespace tab.

  2. Add configuration items.

    1. Click Add Configuration Item.

    2. In the Add Configuration Item dialog box, add the configuration items that are described in the following table.

      For more information about how to add a configuration item, see Add configuration items..

      Parameter

      Description

      namespace.backend.type

      Enables high availability for the three master nodes. Set the value to raft.

      namespace.backend.raft.initial-conf

      Specifies the initialization address of the Raft service. The address is in the {hostname-1}:{port}:0,{hostname-2}:{port}:0,{hostname-3}:{port}:0 format. Example: master-1-1:8103:0,master-1-2:8103:0,master-1-3:8103:0.

    3. Click OK. In the dialog box that appears, configure the Execution Reason parameter and click Save.

  3. Restart the JindoData service.

    1. On the Services tab of the JindoData service, choose More > Restart.

    2. In the dialog box that appears, configure the Execution Reason parameter and click OK.

    3. In the Confirm message, click OK.

Step 2: Configure JindoSDK

Note

In this step, you configure JindoSDK on the client. The configurations take effect without the need to restart JindoData.

  1. Go to the core-site.xml tab of the Hadoop-Common service.

    1. On the Services tab of the cluster, find the Hadoop-Common service and click Configure.

    2. On the Configure tab, click the core-site-xml tab.

  2. Modify the configuration item that is described in the following table.

    For more information about how to modify a configuration item, see Modify configuration items.

    Item

    Parameter

    Description

    Configure the address of JindoFSx Namespace Service.

    fs.jindofsx.namespace.rpc.address

    Set this parameter to a value in the {headerhost-1}:8101,{headerhost-2}:8101,{headerhost-3}:8101 format. Example: master-1-1:8101,master-1-2:8101,master-1-3:8101.

  3. Save the configuration.

    1. Click Save on the Configure tab.

    2. In the dialog box that appears, configure the Execution Reason parameter, turn on Automatically Update Configurations, and then click Save.