首页 新闻 会员 周边

hadoop 下wordcount运行问题

0
悬赏园豆:50 [已关闭问题] 关闭于 2011-04-20 21:39

输出内容如下,找了好多地方了也没找到是为什么

11/03/02 16:49:03 INFO input.FileInputFormat: Total input paths to process : 111
11/03/02 16:49:03 INFO mapred.JobClient: Running job: job_201103021524_0007
11/03/02 16:49:05 INFO mapred.JobClient:  map 0% reduce 0%
11/03/02 16:49:13 INFO mapred.JobClient:  map 1% reduce 0%
11/03/02 16:49:16 INFO mapred.JobClient:  map 3% reduce 0%
11/03/02 16:49:18 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000003_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:49:18 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:18 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:21 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000002_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:49:21 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:21 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:22 INFO mapred.JobClient:  map 5% reduce 0%
11/03/02 16:49:28 INFO mapred.JobClient:  map 7% reduce 0%
11/03/02 16:49:30 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000006_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:49:30 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:30 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:31 INFO mapred.JobClient:  map 9% reduce 2%
11/03/02 16:49:33 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000002_1, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:49:33 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:33 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:34 INFO mapred.JobClient:  map 10% reduce 2%
11/03/02 16:49:37 INFO mapred.JobClient:  map 12% reduce 2%
11/03/02 16:49:40 INFO mapred.JobClient:  map 14% reduce 3%
11/03/02 16:49:42 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000006_1, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:49:42 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:42 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:43 INFO mapred.JobClient:  map 16% reduce 3%
11/03/02 16:49:45 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000002_2, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:49:45 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:45 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:46 INFO mapred.JobClient:  map 18% reduce 5%
11/03/02 16:49:49 INFO mapred.JobClient:  map 19% reduce 5%
11/03/02 16:49:52 INFO mapred.JobClient:  map 21% reduce 5%
11/03/02 16:49:54 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000006_2, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:49:54 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:54 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:55 INFO mapred.JobClient:  map 23% reduce 6%
11/03/02 16:49:58 INFO mapred.JobClient:  map 25% reduce 6%
11/03/02 16:50:03 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000111_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:50:03 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:50:03 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:50:09 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000111_1, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:50:09 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:50:09 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:50:15 INFO mapred.JobClient: Task Id : attempt_201103021524_0007_m_000111_2, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)

11/03/02 16:50:15 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:50:15 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:50:21 INFO mapred.JobClient: Job complete: job_201103021524_0007
11/03/02 16:50:21 INFO mapred.JobClient: Counters: 12
11/03/02 16:50:21 INFO mapred.JobClient:   Job Counters
11/03/02 16:50:21 INFO mapred.JobClient:     Launched reduce tasks=1
11/03/02 16:50:21 INFO mapred.JobClient:     Launched map tasks=37
11/03/02 16:50:21 INFO mapred.JobClient:     Data-local map tasks=37
11/03/02 16:50:21 INFO mapred.JobClient:     Failed map tasks=1
11/03/02 16:50:21 INFO mapred.JobClient:   FileSystemCounters
11/03/02 16:50:21 INFO mapred.JobClient:     HDFS_BYTES_READ=2520
11/03/02 16:50:21 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=3780
11/03/02 16:50:21 INFO mapred.JobClient:   Map-Reduce Framework
11/03/02 16:50:21 INFO mapred.JobClient:     Combine output records=28
11/03/02 16:50:21 INFO mapred.JobClient:     Map input records=28
11/03/02 16:50:21 INFO mapred.JobClient:     Spilled Records=28
11/03/02 16:50:21 INFO mapred.JobClient:     Map output bytes=2660
11/03/02 16:50:21 INFO mapred.JobClient:     Combine input records=28
11/03/02 16:50:21 INFO mapred.JobClient:     Map output records=28

飞云的主页 飞云 | 初学一级 | 园豆:200
提问于:2011-03-02 16:52
< >
分享
所有回答(2)
0

我也遇到过该问题,谁能回答一下啊

Renwen0524 | 园豆:205 (菜鸟二级) | 2011-03-18 16:03
0


11/03/02 16:49:18 WARN mapred.JobClient: Error reading task outputConnection refused
11/03/02 16:49:18 WARN mapred.JobClient: Error reading task outputConnection refused

输出连接 拒绝,你运行时前有创建output文件吗?

lyeoswu | 园豆:202 (菜鸟二级) | 2013-07-16 19:31
清除回答草稿
   您需要登录以后才能回答,未注册用户请先注册