HBase is a real-time database in the Hadoop ecosystem that offers high write performance. OSS-HDFS, also known as the JindoFS service, is an Alibaba Cloud storage service that is compatible with the HDFS API. Alibaba Cloud E-MapReduce (EMR) allows HBase to use OSS-HDFS as its underlying storage and supports storing write-ahead log (WAL) files. This configuration achieves storage-compute separation.
Prerequisites
-
You have created an EMR cluster of version EMR-3.42.0 or later, or EMR-5.8.0 or later, and selected the HBase component during cluster creation. For more information, see Create a cluster.
-
You have enabled OSS-HDFS and granted the required permissions. For more information, see Enable OSS-HDFS.
Procedure
-
Connect to the EMR cluster.
-
Log on to the EMR on ECS console.
-
Click the target EMR cluster.
-
Click the Nodes tab, and then click the
icon to the left of the node group. -
Click the ECS ID. On the ECS instance page, click Connect to the right of the ECS ID.
To connect to the cluster from a Windows or Linux environment using an SSH key pair or password, see Log on to a cluster.
-
Specify the storage path for HBase.
To specify the storage path for HBase and its WAL files, change the value of the hbase.rootdir parameter in the hbase-site configuration file to an OSS path. The path must use the
oss://bucket.endpoint/hbase-root-dirformat.ImportantIf you want to release the cluster, you must first disable the tables to ensure that all data in the WAL files is flushed to HFile storage.