E-MapReduce:HBase-HDFS

HBase-HDFS service

HDFS is a core component of the Hadoop ecosystem that provides reliable distributed file storage. The HBase-HDFS service uses HDFS as its underlying storage, inheriting the native features of HDFS without modifying its base architecture. For more information about HDFS, see HDFS overview.

The HBase-HDFS service is automatically created in the following scenarios:

• Create a cluster

  • On the console: When you select the OSS-HDFS and HBase services and the HBase Log Storage option, the HBase-HDFS service is created automatically after cluster creation.

  • Using OpenAPI: Call the CreateCluster or RunCluster operation to create a cluster. Add the required configurations to the Application and ApplicationConfig parameters.

    Adjust the parameter values for your specific environment.

    Application = ["HBASE", "OSS-HDFS", "HBASE-HDFS"]
    ApplicationConfigs = [
        {
            "ConfigFileName": "hbase-site.xml",
            "ApplicationName": "HBASE",
            "ConfigItemKey": "hbase.wal.mode",
            "ConfigScope": "CLUSTER",
            "ConfigItemValue": "HDFS"
        },
        {
            "ConfigFileName": "common.conf",
            "ApplicationName": "OSS-HDFS",
            "ConfigItemKey": "OSS_ROOT_URI",
            "ConfigScope": "CLUSTER",
            "ConfigItemValue": "oss://examplebucket.oss-cn-hangzhou-internal.aliyuncs.com/"
        },
        {
            "ConfigFileName": "hdfs-site.xml",
            "ApplicationName": "HBASE-HDFS",
            "ConfigItemKey": "dfs.balancer.block-move.timeout",
            "ConfigScope": "CLUSTER",
            "ConfigItemValue": "600000"
        }
    ]

• Add a service

  If you create a cluster with the OSS-HDFS service and later add the HBase service, the HBase-HDFS service is also created automatically.

References

• For information about component deployment, see View the deployment information of service components.

• To decommission an HBase-HDFS DataNode, see Scale in a node group.