[Hadoop] Local Mode
[Hadoop] Local Mode
Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop
Configure IP address, close network firewall selinux , configure host address
the jdk package to the folder, and add two new lines to configure the environment variables after profie
[root@server1 ~]# tar - zxvf jdk-8u161-linux-x64.tar.gz -C /opt/java/
[root@server 1 jdk 1.8.0_161]# vim / etc /profile
export JAVA _HOME='/opt/java/jdk1.8.0_161'
export PATH =$JAVA_HOME/bin:$PATH
[root@server 1 jdk 1.8.0_161]# source / etc /profile
#Enter java -version to test whether the environment variable takes effect
local mode deployment
Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop
a storage folder for hadoop , decompress hadoop, and use it in single-machine local mode
[root@server1 ~]# mkdir /opt/ hadoopstandalone
[root@server1 ~]# tar - zxf hadoop-2.7.3.tar.gz -C /opt/ hadoopstandalone /
with hadoop to test and run mapreduce in local mode
#Prepare mapreduce input file wc.input
[root@server 1 test ]# cat wc.input
hadoop mapreduce hive
hbase spark storm
sqoop hadoop hive
spark hadoop
#Run, there is the word local after Running job in the output result, indicating that it is running in local mode
[root@server 1 hadoop -2.7.3]# bin/ hadoop jar share/ hadoop / mapreduce /hadoop-mapreduce -examples-2.7.3.jar wordcount test/ wc.input output2
local mode, the output of mapreduce is output to the local, and checking the output file has SUCCESS indicating that the job is running successfully
Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop
[Hadoop] Local Mode.JDK basic configuration
Configure IP address, close network firewall selinux , configure host address
the jdk package to the folder, and add two new lines to configure the environment variables after profie
[root@server1 ~]# tar - zxvf jdk-8u161-linux-x64.tar.gz -C /opt/java/
[root@server 1 jdk 1.8.0_161]# vim / etc /profile
export JAVA _HOME='/opt/java/jdk1.8.0_161'
export PATH =$JAVA_HOME/bin:$PATH
[root@server 1 jdk 1.8.0_161]# source / etc /profile
#Enter java -version to test whether the environment variable takes effect
local mode deployment
Hadoop local mode is only used for local development and debugging, or to quickly install and experience Hadoop
a storage folder for hadoop , decompress hadoop, and use it in single-machine local mode
[root@server1 ~]# mkdir /opt/ hadoopstandalone
[root@server1 ~]# tar - zxf hadoop-2.7.3.tar.gz -C /opt/ hadoopstandalone /
with hadoop to test and run mapreduce in local mode
#Prepare mapreduce input file wc.input
[root@server 1 test ]# cat wc.input
hadoop mapreduce hive
hbase spark storm
sqoop hadoop hive
spark hadoop
#Run, there is the word local after Running job in the output result, indicating that it is running in local mode
[root@server 1 hadoop -2.7.3]# bin/ hadoop jar share/ hadoop / mapreduce /hadoop-mapreduce -examples-2.7.3.jar wordcount test/ wc.input output2
local mode, the output of mapreduce is output to the local, and checking the output file has SUCCESS indicating that the job is running successfully
Related Articles
-
A detailed explanation of Hadoop core architecture HDFS
Knowledge Base Team
-
What Does IOT Mean
Knowledge Base Team
-
6 Optional Technologies for Data Storage
Knowledge Base Team
-
What Is Blockchain Technology
Knowledge Base Team
Explore More Special Offers
-
Short Message Service(SMS) & Mail Service
50,000 email package starts as low as USD 1.99, 120 short messages start at only USD 1.00