在为分布式情况下测试MapReduce时一直卡在INFO mapreduce.Job: Running job: job_1539195694237_0014
我用的是hadoop2.7.4 Ubuntu16.04
详情错误我我的配置如下图:
在学习hadoop,这个问题困扰了我两周了,希望能有大咖帮忙解决一下。
运行情况:
hadoop@xun2-virtual-machine:/usr/local/hadoop/share/hadoop/mapreduce$ hadoop jar hadoop-mapreduce-examples-2.7.4.jar pi 4 4
Number of Maps = 4
Samples per Map = 4
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Starting Job
18/10/11 16:51:39 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
18/10/11 16:51:43 INFO input.FileInputFormat: Total input paths to process : 4
18/10/11 16:51:44 INFO mapreduce.JobSubmitter: number of splits:4
18/10/11 16:51:45 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1539195694237_0014
18/10/11 16:51:50 INFO impl.YarnClientImpl: Submitted application application_1539195694237_0014
18/10/11 16:51:51 INFO mapreduce.Job: The url to track the job: http://xun2-virtual-machine:8088/proxy/application_1539195694237_0014/
18/10/11 16:51:51 INFO mapreduce.Job: Running job: job_1539195694237_0014
配置如下:
core-site.xml配置;
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>file:/usr/local/hadoop/tmp</value>
<description>Abase for other temporary directories.</description>
</property>
</configuration>
hdfs-site.xml 配置
-->
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/usr/local/hadoop/tmp/dfs/name</value>
</property>
<property>
<name>dfs.datanode.data.dir</name
<value>file:/usr/local/hadoop/tmp/dfs/data</value>
</property>
</configuration>
yarn-site.xml 配置
<configuration>
<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.resourcemanager.hostname</name>
<value>localhost</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>
mapred-site.xml配置:
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>