首页 新闻 会员 周边

测试MapReduce时报错: WARN hdfs.DFSClient: Caught exception java.lang.InterruptedException

0
悬赏园豆:20 [待解决问题]

在为分布式情况下测试MapReduce时一直卡在INFO mapreduce.Job: Running job: job_1539195694237_0014
我用的是hadoop2.7.4 Ubuntu16.04
详情错误我我的配置如下图:
在学习hadoop,这个问题困扰了我两周了,希望能有大咖帮忙解决一下。
运行情况:
hadoop@xun2-virtual-machine:/usr/local/hadoop/share/hadoop/mapreduce$ hadoop jar hadoop-mapreduce-examples-2.7.4.jar pi 4 4
Number of Maps = 4
Samples per Map = 4
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Starting Job
18/10/11 16:51:39 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
18/10/11 16:51:43 INFO input.FileInputFormat: Total input paths to process : 4
18/10/11 16:51:44 INFO mapreduce.JobSubmitter: number of splits:4
18/10/11 16:51:45 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1539195694237_0014
18/10/11 16:51:50 INFO impl.YarnClientImpl: Submitted application application_1539195694237_0014
18/10/11 16:51:51 INFO mapreduce.Job: The url to track the job: http://xun2-virtual-machine:8088/proxy/application_1539195694237_0014/
18/10/11 16:51:51 INFO mapreduce.Job: Running job: job_1539195694237_0014

配置如下:
core-site.xml配置;

<!-- Put site-specific property overrides in this file. -->

<configuration>

    <property>
            <name>fs.defaultFS</name>
            <value>hdfs://localhost:9000</value>
    </property>
    <property>
            <name>hadoop.tmp.dir</name> 
            <value>file:/usr/local/hadoop/tmp</value>
            <description>Abase for other temporary directories.</description>
    </property> 
       

</configuration>

hdfs-site.xml 配置

-->

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/usr/local/hadoop/tmp/dfs/name</value>
</property>
<property>
<name>dfs.datanode.data.dir</name
<value>file:/usr/local/hadoop/tmp/dfs/data</value>
</property>

</configuration>

yarn-site.xml 配置

<configuration>

<!-- Site specific YARN configuration properties -->

    <property>
            <name>yarn.resourcemanager.hostname</name>
            <value>localhost</value>
    </property>
    <property>
            <name>yarn.nodemanager.aux-services</name>
            <value>mapreduce_shuffle</value>
    </property>

</configuration>

mapred-site.xml配置:

<!-- Put site-specific property overrides in this file. -->

<configuration>

     <property>
            <name>mapreduce.framework.name</name>
            <value>yarn</value>
    </property>

</configuration>

pzxun的主页 pzxun | 初学一级 | 园豆:182
提问于:2018-10-11 17:23
< >
分享
清除回答草稿
   您需要登录以后才能回答,未注册用户请先注册