首页 新闻 会员 周边

Hadoop Error: org.apache.hadoop.hdfs.BlockMissingException

0
[已关闭问题] 关闭于 2020-10-13 11:19

20/02/12 01:06:42 INFO mapreduce.Job: Task Id : attempt_1581440082012_0003_m_000002_1, Status : FAILED
Error: org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-710677444-192.168.1.200-1581431472787:blk_1073742237_1413 file=/tmp/hadoop-yarn/staging/renguanyu/.staging/job_1581440082012_0003/job.split
        at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:930)
        at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:609)
        at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:841)
        at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:889)
        at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:696)
        at java.io.DataInputStream.readByte(DataInputStream.java:265)
        at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:308)
        at org.apache.hadoop.io.WritableUtils.readVIntInRange(WritableUtils.java:348)
        at org.apache.hadoop.io.Text.readString(Text.java:471)
        at org.apache.hadoop.io.Text.readString(Text.java:464)
        at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:358)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:751)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

 

只要在etc/hadoop/slaves中加上master,就会报错

master
slave1
slave2

如果把master去掉就不会报错

slave1
slave2

 

这是为什么?

 

renguanyu的主页 renguanyu | 小虾三级 | 园豆:838
提问于:2020-02-12 01:08
< >
分享
清除回答草稿
   您需要登录以后才能回答,未注册用户请先注册