首页新闻找找看学习计划

使用Java的lambda表达式循环插入(mybtais)数据库,发现只保存了部分数据,漏掉了一部分数据的问题

0
悬赏园豆:200 [待解决问题]

出现问题的环境:Java的web框架,Spring和mybatis,使用Java8。

描述:在使用Java8的lambda表达式进行循环插入(mybtais)数据库的时候发现,只有部分数据被插入了,还漏掉了一部分,通过输出的日志判断总共插入了119条,但实际保存了69条。我的问题是日志中已经输出了SQL,为什么没有全部保存到数据库中?

下面给出代码和日志,望各位大佬帮忙详细分析下是怎么回事,小白在此感谢!

说明:日志中所有输出的SQL都是正确的的,所有SQL可以分为两类,

一类是ForkJoinPool.commonPool-worker操作的;

另一类是org.springframework.jms.listener.DefaultMessageListenerContainer

ForkJoinPool操作的SQL都在数据库中保存了,但是DefaultMessageListenerContainer操作的SQL全都没有保存到数据库中。

 

Java代

 1 public Integer saveCheckinData(String openCheckinDataType, String startTime, String endTime, List<String> useridList) throws Exception {
 2         List<WcCheckin> list = getCheckinData(openCheckinDataType, startTime, endTime, useridList);
 3 
 4         list.parallelStream()
 5                 .filter(wcCheckin -> StringUtils.isNotBlank(wcCheckin.getExceptionType()))
 6                 .filter(wcCheckin -> StringUtils.isNotBlank(wcCheckin.getGroupname()))
 7                 .forEach(wcCheckin -> insertSelective(wcCheckin));
 8 
 9         return list.size();
10     }

 

日志截图

复制代码
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==>  Preparing: select WC_CHECKIN_SEQ.nextval as id from dual 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==> Parameters: 
[ForkJoinPool.commonPool-worker-6] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==>  Preparing: select WC_CHECKIN_SEQ.nextval as id from dual 
[ForkJoinPool.commonPool-worker-6] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==> Parameters: 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - <==      Total: 1
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==>  Preparing: insert into WC_CHECKIN ( ID, USERID, GROUPNAME, CHECKIN_TYPE, EXCEPTION_TYPE, CHECKIN_TIME, LOCATION_TITLE, LOCATION_DETAIL, WIFINAME, NOTES, WIFIMAC, MEDIAIDS, CREATE_TIME ) values ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==> Parameters: 30221(Long), 10004666(String), 华中打卡(String), 0(Short), 0(String), 1554768020(Long), 集团有限公司(String), 湖南省长沙市天心区新姚南路200(String), Stark_晃_5G(String), (String), (String), ["WWCISP_0zBvIdaurkAx2a6bmUUvzunkwph3LgygxJ3ZNDeWotDBHh7ffgAYmjIh6fosuIC4ox8Qeg0uKfEcdD_qpJBcfQ"](String), 2019-04-10 03:13:12.072(Timestamp)
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - <==    Updates: 1
=======插入完成30221==========
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==>  Preparing: select WC_CHECKIN_SEQ.nextval as id from dual 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==> Parameters: 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - <==      Total: 1
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==>  Preparing: insert into WC_CHECKIN ( ID, USERID, GROUPNAME, CHECKIN_TYPE, EXCEPTION_TYPE, CHECKIN_TIME, LOCATION_TITLE, LOCATION_DETAIL, WIFINAME, NOTES, WIFIMAC, MEDIAIDS, CREATE_TIME ) values ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==> Parameters: 30222(Long), 10004404(String), 上海库房(String), 0(Short), 未打卡(String), 1554771600(Long), (String), (String), (String), (String), (String), [](String), 2019-04-10 03:13:12.08(Timestamp)
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - <==    Updates: 1
=======插入完成30222==========
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==>  Preparing: select WC_CHECKIN_SEQ.nextval as id from dual 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==> Parameters: 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - <==      Total: 1
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==>  Preparing: insert into WC_CHECKIN ( ID, USERID, GROUPNAME, CHECKIN_TYPE, EXCEPTION_TYPE, CHECKIN_TIME, LOCATION_TITLE, LOCATION_DETAIL, WIFINAME, NOTES, WIFIMAC, MEDIAIDS, CREATE_TIME ) values ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==> Parameters: 30223(Long), 10004404(String), 上海库房(String), 1(Short), 未打卡(String), 1554804000(Long), (String), (String), (String), (String), (String), [](String), 2019-04-10 03:13:12.082(Timestamp)
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - <==    Updates: 1
=======插入完成30223==========
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==>  Preparing: select WC_CHECKIN_SEQ.nextval as id from dual 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==> Parameters: 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - <==      Total: 1
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==>  Preparing: insert into WC_CHECKIN ( ID, USERID, GROUPNAME, CHECKIN_TYPE, EXCEPTION_TYPE, CHECKIN_TIME, LOCATION_TITLE, LOCATION_DETAIL, WIFINAME, NOTES, WIFIMAC, MEDIAIDS, CREATE_TIME ) values ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==> Parameters: 30224(Long), 10004767(String), 济宁办事处725(String), 0(Short), 0(String), 1554770410(Long), 集团有限公司(String), 山东省济宁市任城区京杭路(String), 6666666666(String), (String), b8:3a:08:e1:ed:e0(String), ["WWCISP_16udLcJNc8EiVyC5eXTopxtXWd19oTxN3ER_qlnPp90bVgCJxIcgJr75N_1XIb6YU364DIOsZFTaK8rKOxdKRQ"](String), 2019-04-10 03:13:12.083(Timestamp)
[ForkJoinPool.commonPool-worker-6] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - <==      Total: 1
=======插入完成30224==========
[ForkJoinPool.commonPool-worker-6] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==>  Preparing: insert into WC_CHECKIN ( ID, USERID, GROUPNAME, CHECKIN_TYPE, EXCEPTION_TYPE, CHECKIN_TIME, LOCATION_TITLE, LOCATION_DETAIL, WIFINAME, NOTES, WIFIMAC, MEDIAIDS, CREATE_TIME ) values ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) 
[ForkJoinPool.commonPool-worker-6] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==> Parameters: 30225(Long), 10002534(String), 西安平台(String), 0(Short), 0(String), 1554769620(Long), 集团有限公司(String), 甘肃省兰州市城关区兰新市场万国港C座906室(String), ◊œπ‚ ˝¬Î(String), (String), (String), ["WWCISP_Cct6BgZU9I3I35T1n3sbBlittUbLwSk3SbUGyhCIHBwWKATETXcxVaE51lHK_RsmBog9pfJEHTu6aVUS2HW9Jw"](String), 2019-04-10 03:13:12.073(Timestamp)
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - <==    Updates: 1
=======插入完成30225==========
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==>  Preparing: select WC_CHECKIN_SEQ.nextval as id from dual 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==> Parameters: 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - <==      Total: 1
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==>  Preparing: insert into WC_CHECKIN ( ID, USERID, GROUPNAME, CHECKIN_TYPE, EXCEPTION_TYPE, CHECKIN_TIME, LOCATION_TITLE, LOCATION_DETAIL, WIFINAME, NOTES, WIFIMAC, MEDIAIDS, CREATE_TIME ) values ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) 
[org.springframework.jms.listener.DefaultMessageListenerContainer#3-1] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==> Parameters: 30226(Long), 10004650(String), 北京办事处(String), 0(Short), 0(String), 1554770910(Long), 集团有限公司(String), 北京市海淀区中关村东路1号院10号(String), (String), (String), (String), ["WWCISP_jP_c-yfvFcZ1G2e1L2HlNI4cdJEdXGWUoZzcD4wxCNW629_n53gB2euHaBmZDxrEXq3vIpCQaMcnbsl3aoH24A"](String), 2019-04-10 03:13:12.086(Timestamp)
[ForkJoinPool.commonPool-worker-6] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - <==    Updates: 1
=======插入完成30226==========
[ForkJoinPool.commonPool-worker-3] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==>  Preparing: select WC_CHECKIN_SEQ.nextval as id from dual 
[ForkJoinPool.commonPool-worker-3] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - ==> Parameters: 
[ForkJoinPool.commonPool-worker-3] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective!selectKey] - <==      Total: 1
[ForkJoinPool.commonPool-worker-3] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==>  Preparing: insert into WC_CHECKIN ( ID, USERID, GROUPNAME, CHECKIN_TYPE, EXCEPTION_TYPE, CHECKIN_TIME, LOCATION_TITLE, LOCATION_DETAIL, WIFINAME, NOTES, WIFIMAC, MEDIAIDS, CREATE_TIME ) values ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? ) 
[ForkJoinPool.commonPool-worker-3] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - ==> Parameters: 30227(Long), 10004831(String), 物流-杭州(String), 1(Short), 未打卡(String), 1554804000(Long), (String), (String), (String), (String), (String), [](String), 2019-04-10 03:13:12.073(Timestamp)
[ForkJoinPool.commonPool-worker-3] DEBUG [com.thunis.wecorp.dao.inf.WcCheckinMapper.insertSelective] - <==    Updates: 1
=======插入完成30227==========
复制代码

mesen的主页 mesen | 初学一级 | 园豆:4
提问于:2019-04-16 17:10
< >
分享
所有回答(1)
0

你先执行

list.parallelStream()

.filter(wcCheckin -> StringUtils.isNotBlank(wcCheckin.getExceptionType()))

.filter(wcCheckin -> StringUtils.isNotBlank(wcCheckin.getGroupname())).count();

看一下结果

狼爷 | 园豆:1192 (小虾三级) | 2019-04-17 01:01

你好,我把生产上的代码改一下,观察今天再来回复你,希望能继续帮忙分析下。我还问了另外一个朋友,他也让我把filter去掉再试试。

这是生产环境发现的问题,这段代码每天执行一次,发生这个问题是在某一天发生,不是每天;而且我本地环境,不会发生此问题。

支持(0) 反对(0) mesen | 园豆:4 (初学一级) | 2019-04-17 09:38
清除回答草稿
   您需要登录以后才能回答,未注册用户请先注册