在阅读本篇文章之前,先阅读我之前写的文章: Mysql,FIND_IN_SET() 函数 与 Mybatis框架中 foreach 标签联用,解决批量数据查询问题。  ,在这篇文章中我提到  标签中的入参参数超过1000时,可能会出问题。在之后的工作中,我果然遇到了对应的Bug。

在使用Mybatis进行批量查询时,由于入参参数数量大于1000导致报错,下列的报错是:栈溢出错误

org.springframework.web.util.NestedServletException: Handler dispatch failed; nested exception is java.lang.StackOverflowError

at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1055) ~[spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:943) ~[spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at javax.servlet.http.HttpServlet.service(HttpServlet.java:660) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) [spring-webmvc-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at javax.servlet.http.HttpServlet.service(HttpServlet.java:741) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) [tomcat-embed-websocket-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at com.daikin.filter.SystemAuthorityFilter.doFilter(SystemAuthorityFilter.java:94) [classes!/:na]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:124) [druid-1.1.16.jar!/:1.1.16]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:320) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:126) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:90) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:118) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:158) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:154) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.oauth2.provider.authentication.OAuth2AuthenticationProcessingFilter.doFilter(OAuth2AuthenticationProcessingFilter.java:176) [spring-security-oauth2-2.3.4.RELEASE.jar!/:na]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:92) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:92) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:77) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:215) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:178) [spring-security-web-5.2.1.RELEASE.jar!/:5.2.1.RELEASE]

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:108) [spring-boot-actuator-2.2.2.RELEASE.jar!/:2.2.2.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.2.RELEASE.jar!/:5.2.2.RELEASE]

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:526) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:367) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:860) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1591) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_231]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_231]

at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-embed-core-9.0.29.jar!/:9.0.29]

at java.lang.Thread.run(Thread.java:748) [na:1.8.0_231]

Caused by: java.lang.StackOverflowError: null

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

at java.lang.String.valueOf(String.java:2994) ~[na:1.8.0_231]

at java.lang.StringBuilder.append(StringBuilder.java:131) ~[na:1.8.0_231]

at net.sf.jsqlparser.expression.BinaryExpression.toString(BinaryExpression.java:63) ~[jsqlparser-1.0.jar!/:na]

..............................................................

..............................................................

..............................................................

..............................................................

解决的办法是:将入参参数分批,进行分批查询。在这里我分享一点核心代码来进行讲解,具体代码我会在文章末尾分享我Gitee中 Demo 案例。

在下方的代码中,入参 List nameList 数据量太大时,就会引起:java.lang.StackOverflowError 的异常报错,因此我将其分批处理,以每800条数据进行一次批量查询,这样就解决了 栈溢出 的Bug。

/**

* 批量查询 UserVO 信息.

*

* @param paramDTO user入参DTO

* @param pageNum 页码

* @param pageSize 页尺寸

*

* @return

* @author moon 2023/5/19 15:27

*/

@Override

public PageInfo selectUserByParamDTO(UserParamDTO paramDTO, Integer pageNum, Integer pageSize) {

List resultList = new ArrayList<>();

PageInfo pageInfo = new PageInfo<>();

List nameList = paramDTO.getNameList();

if (CollectionUtils.isEmpty(nameList)) {

PageHelper.startPage(pageNum, pageSize);

resultList = userMapper.selectUserByParamDTO(paramDTO);

pageInfo = new PageInfo<>(resultList);

} else {

// 考虑到性能问题,在这里我不采取入参参数为 1000的边界值,我选择使用 800 作为边界值.

for (int i = 0; i < nameList.size(); i += Constant.Digital.EIGHT_HUNDRED) {

List tempNameList = nameList.subList(i, Math.min(i + Constant.Digital.EIGHT_HUNDRED, nameList.size()));

// 设置 '姓名集合'

paramDTO.setNameList(tempNameList);

// 分批查询

List tempUserVOList = userMapper.selectUserByParamDTO(paramDTO);

resultList.addAll(tempUserVOList);

}

if (CollectionUtils.isNotEmpty(resultList)) {

// 对 resultList 进行排序:创建时间 + ID 倒叙排序.

Comparator comparator = Comparator.comparing(UserVO::getCreateDate, Comparator.reverseOrder()).thenComparing(UserVO::getId, Comparator.reverseOrder());

resultList = resultList.stream().distinct().sorted(comparator).collect(Collectors.toList());

}

// 手动分页处理

pageInfo = PageUtils.handlePaging(resultList, pageInfo, pageNum, pageSize);

}

log.info("批量查询 UserVO 信息,返回值resultList为:{}", JSON.toJSONString(resultList));

return pageInfo;

}

在 knife4j 中运行测试接口,运行正常。

入参参数:

{

"age": null,

"createDate": "",

"id": null,

"isDeleted": "",

"name": "",

"nameLike": "",

"nameList": ["张三", "李四", "柳乐儿"],

"errorMsg": ""

}

图一

 图二

图三

Demo案例:  明月的Gitee,SpringBoot实战--Myself/springboot-demo 。   

Controller层入口函数: com.moon.controller.UserController2#listUserByParamDTO(...)   

精彩链接

评论可见,请评论后查看内容,谢谢!!!评论后请刷新页面。