E-MapReduce:Upgrade JindoData on an EMR cluster

Prerequisites

Before you begin, make sure that you have:

• An EMR cluster running EMR V3.40.0 or later, or EMR V5.6.0 or later

Step 1: Prepare software packages

1. Log on to the master node of your cluster. For more information, see Log on to a cluster.

2. Switch to the emr-user account, download the patch package to the home directory, and decompress it.

   su - emr-user
   cd /home/emr-user/
   wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/resources/emr-taihao/jindodata-patches.tar.gz
   tar zxf jindodata-patches.tar.gz

3. Download the JindoData software package jindofsx-{VERSION}.tar.gz into the jindodata-patches directory.

   cd jindodata-patches
   wget https://jindodata-binary.oss-cn-shanghai.aliyuncs.com/release/4.6.11/jindofsx-4.6.11-linux.tar.gz
   ls -l

   Before continuing, verify that the directory contains the following files:

   -rwxr-xr-x 1 emr-user emr-user       580 May 30 20:28 apply_all.sh
   -rwxr-xr-x 1 emr-user emr-user       677 May 30 20:32 apply.sh
   -rw-r--r-- 1 emr-user emr-user        40 May 14 12:38 hosts
   -rw-r----- 1 emr-user emr-user xxxxxxxxx May 01 00:00 jindofsx-4.6.11.tar.gz

Step 2: Configure node information

1. Open the hosts file in the jindodata-patches directory.

   vim hosts

2. Add the hostnames of all nodes in the cluster, one hostname per line.

   master-1-1
   core-1-1
   core-1-2

Step 3: Upgrade JindoData

Run apply_all.sh with the target version number.

./apply_all.sh $JINDODATA_VERSION

For example, to upgrade to version 4.6.11:

./apply_all.sh 4.6.11

If the output contains ### DONE, the upgrade completed successfully.

Step 4: Restart JindoData

After the upgrade, restart all JindoData components from the EMR console.