Upgrade JindoData in EMR clusters - E-MapReduce - Alibaba Cloud Documentation Center

For clusters of E-MapReduce (EMR) V3.40.0 or a later minor version, or clusters of EMR V5.6.0 or a later minor version, you can upgrade JindoData in the clusters if you encounter known version-specific issues or you want to use new features in the clusters. This topic describes how to upgrade JindoData in an EMR cluster.

Background information

For more information about known version-specific issues, see Known issues in JindoData 4.X.
For more information about JindoData versions, see Release notes.

Procedure

Step 1: Prepare software packages

Log on to the master node of your cluster. For more information, see Log on to a cluster.

Store the downloaded patch package in the HOME directory of the emr-user user and decompress the package.

su - emr-user
cd /home/emr-user/
wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/resources/emr-taihao/jindodata-patches.tar.gz
tar zxf jindodata-patches.tar.gz

Download the software package jindofsx-{VERSION}.tar.gz of JindoData and store the package in the jindodata-patches directory that you obtained in the previous step.

cd jindodata-patches

wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/4.6.11/jindofsx-4.6.11-linux.tar.gz

ls -l

Sample content of the jindodata-patches directory:

-rwxr-xr-x 1 emr-user emr-user       580 May 30 20:28 apply_all.sh
-rwxr-xr-x 1 emr-user emr-user       677 May 30 20:32 apply.sh
-rw-r--r-- 1 emr-user emr-user        40 May 14 12:38 hosts
-rw-r----- 1 emr-user emr-user xxxxxxxxx May 01 00:00 jindofsx-4.6.11.tar.gz

Step 2: Configure node information

Run the following command to open the hosts file in the jindodata-patches directory:
```
vim hosts
```
Add the hostnames of all nodes in the cluster, such as master-1-1 and core-1-1, to the hosts file. Enter one hostname in each line. Sample file content:
```
master-1-1
core-1-1
core-1-2
```

Step 3: Upgrade JindoData

Run the apply_all.sh script to upgrade JindoData.

./apply_all.sh $JINDODATA_VERSION

For example, you can run the following script to upgrade JindoData to 4.6.11:

./apply_all.sh 4.6.11

If the returned information contains ### DONE, the script is successfully run.

Step 4: Restart JindoData

After the upgrade is complete, restart all components of JindoData in the EMR console.