[Hadoop] Local Mode

[Hadoop] Local Mode

Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop

[Hadoop] Local Mode.JDK basic configuration

Configure IP address, close network firewall selinux , configure host address

the jdk package to the folder, and add two new lines to configure the environment variables after profie
[root@server1 ~]# tar - zxvf jdk-8u161-linux-x64.tar.gz -C /opt/java/
[root@server 1 jdk 1.8.0_161]# vim / etc /profile
export JAVA _HOME='/opt/java/jdk1.8.0_161'
export PATH =$JAVA_HOME/bin:$PATH
[root@server 1 jdk 1.8.0_161]# source / etc /profile


#Enter java -version to test whether the environment variable takes effect


local mode deployment
Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop
a storage folder for hadoop , decompress hadoop, and use it in single-machine local mode
[root@server1 ~]# mkdir /opt/ hadoopstandalone
[root@server1 ~]# tar - zxf hadoop-2.7.3.tar.gz -C /opt/ hadoopstandalone /
with hadoop to test and run mapreduce in local mode
#Prepare mapreduce input file wc.input
[root@server 1 test ]# cat wc.input
hadoop mapreduce hive
hbase spark storm
sqoop hadoop hive
spark hadoop


#Run, there is the word local after Running job in the output result, indicating that it is running in local mode
[root@server 1 hadoop -2.7.3]# bin/ hadoop jar share/ hadoop / mapreduce /hadoop-mapreduce -examples-2.7.3.jar wordcount test/ wc.input output2

local mode, the output of mapreduce is output to the local, and checking the output file has SUCCESS indicating that the job is running successfully