首页 新闻 会员 周边 捐助

map 100% reduce 100%后卡很长时间才job completed successfully

-1
悬赏园豆:10 [待解决问题]

最近碰到个棘手的问题,hive to hbase时,mr 100%后要卡2个小时才往下运行。请教各位大佬怎么解决,日志如下:
19/12/07 09:26:00 INFO mapreduce.Job: map 100% reduce 99%
19/12/07 09:28:58 INFO mapreduce.Job: map 100% reduce 100%
19/12/07 11:23:41 INFO mapreduce.Job: Job job_1573578492079_77195 completed successfully
19/12/07 11:23:41 INFO mapreduce.Job: Counters: 55
File System Counters
FILE: Number of bytes read=1683812280367
FILE: Number of bytes written=2435423697907
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=493062881348
HDFS: Number of bytes written=506907302538
HDFS: Number of read operations=23296
HDFS: Number of large read operations=0
HDFS: Number of write operations=1024
Job Counters
Launched map tasks=4173
Launched reduce tasks=201
Other local map tasks=16
Data-local map tasks=3582
Rack-local map tasks=575
Total time spent by all maps in occupied slots (ms)=7379197245
Total time spent by all reduces in occupied slots (ms)=3682136626
Total time spent by all map tasks (ms)=1475839449
Total time spent by all reduce tasks (ms)=263009759
Total vcore-milliseconds taken by all map tasks=1475839449
Total vcore-milliseconds taken by all reduce tasks=263009759
Total megabyte-milliseconds taken by all map tasks=7556297978880
Total megabyte-milliseconds taken by all reduce tasks=3770507905024
Map-Reduce Framework
Map input records=4169870821
Map output records=50038449852
Map output bytes=5020813018224
Map output materialized bytes=853752811214
Input split bytes=680199
Combine input records=0
Combine output records=0
Reduce input groups=4169870821
Reduce shuffle bytes=853752811214
Reduce input records=50038449852
Reduce output records=50038449852
Spilled Records=142600501308
Shuffled Maps =838773
Failed Shuffles=0
Merged Map outputs=838773
GC time elapsed (ms)=65935140
CPU time spent (ms)=1524125840
Physical memory (bytes) snapshot=14092438933504
Virtual memory (bytes) snapshot=37445243592704
Total committed heap usage (bytes)=15693646921728
Peak Map Physical memory (bytes)=3101376512
Peak Map Virtual memory (bytes)=8300838912
Peak Reduce Physical memory (bytes)=12616282112
Peak Reduce Virtual memory (bytes)=14701731840
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=493041949580
File Output Format Counters
Bytes Written=506907302538

悯言的主页 悯言 | 初学一级 | 园豆:194
提问于:2019-12-07 13:47
< >
分享
所有回答(3)
-1

有可能是数据倾斜了

二十六键 | 园豆:223 (菜鸟二级) | 2019-12-07 14:06
-1

老哥,最后怎么解决的?我也碰到同样的问题了。

LeonLee1015 | 园豆:202 (菜鸟二级) | 2020-07-08 23:31
0

优化hfileMRLast.jar
加大队列资源

悯言 | 园豆:194 (初学一级) | 2022-03-30 16:25
清除回答草稿
   您需要登录以后才能回答,未注册用户请先注册