[Hadoop] Local Mode

[Hadoop] Local Mode

Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop

[Hadoop] Local Mode.JDK basic configuration


Configure IP address, close network firewall selinux , configure host address

the jdk package to the folder, and add two new lines to configure the environment variables after profie
[root@server1 ~]# tar - zxvf jdk-8u161-linux-x64.tar.gz -C /opt/java/
[root@server 1 jdk 1.8.0_161]# vim / etc /profile
export JAVA _HOME='/opt/java/jdk1.8.0_161'
export PATH =$JAVA_HOME/bin:$PATH
[root@server 1 jdk 1.8.0_161]# source / etc /profile


#Enter java -version to test whether the environment variable takes effect


local mode deployment
Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop
a storage folder for hadoop , decompress hadoop, and use it in single-machine local mode
[root@server1 ~]# mkdir /opt/ hadoopstandalone
[root@server1 ~]# tar - zxf hadoop-2.7.3.tar.gz -C /opt/ hadoopstandalone /
with hadoop to test and run mapreduce in local mode
#Prepare mapreduce input file wc.input
[root@server 1 test ]# cat wc.input
hadoop mapreduce hive
hbase spark storm
sqoop hadoop hive
spark hadoop


#Run, there is the word local after Running job in the output result, indicating that it is running in local mode
[root@server 1 hadoop -2.7.3]# bin/ hadoop jar share/ hadoop / mapreduce /hadoop-mapreduce -examples-2.7.3.jar wordcount test/ wc.input output2

local mode, the output of mapreduce is output to the local, and checking the output file has SUCCESS indicating that the job is running successfully

Related Articles

Explore More Special Offers

  1. Short Message Service(SMS) & Mail Service

    50,000 email package starts as low as USD 1.99, 120 short messages start at only USD 1.00