Error Processing request tomcat errors in JSS

[wstewart3]

We recently upgraded to Casper 9.52 and have been having some issues (Although I am not convinced the update is what caused the issues).

Casper seems to have trouble pushing out software and kicking off processes to the client machines. We have had several packages that go through the motions in self service but never seem to actually do anything.

We checked out logs and we see this group of tomcat errors repeating themselves:

2014-10-16 08:05:19,693 [ERROR] [Tomcat-1582] [MDMController            ] - Error processing request action:TokenUpdate, CmdUUID:null, SigVerified: false. Returning 500.
2014-10-16 08:09:40,142 [ERROR] [Tomcat-1616] [MDMController            ] - Error processing request action:TokenUpdate, CmdUUID:null, SigVerified: false. Returning 500.
2014-10-16 08:11:55,038 [ERROR] [Tomcat-1614] [lientCommunicationServlet] - Communication device is null
2014-10-16 08:15:22,876 [ERROR] [Tomcat-1617] [MDMController            ] - Error processing request action:TokenUpdate, CmdUUID:null, SigVerified: false. Returning 500.
2014-10-16 08:19:47,685 [ERROR] [Tomcat-1614] [MDMController            ] - Error processing request action:TokenUpdate, CmdUUID:null, SigVerified: false. Returning 500.
2014-10-16 08:25:26,278 [ERROR] [Tomcat-1620] [MDMController            ] - Error processing request action:TokenUpdate, CmdUUID:null, SigVerified: false. Returning 500.
2014-10-16 08:26:40,344 [ERROR] [Tomcat-1621] [lientCommunicationServlet] - Communication device is null
2014-10-16 08:28:24,598 [WARN ] [Tomcat-1614] [ComputerHelper           ] - POSSIBLE DUPLICATES: computer=60, report=135884, services=1500

I checked both PKI and Push certificates and neither have expired. Any ideas?

[McClure]

I;m getting the same error, generally it looks like it happens around a push notification

[lashomb]

Getting a similar error:

2015-02-12 10:02:09,163 [ERROR] [omcat-18950] [MDMController            ] - Error processing request action:StatusUpdatePlist, CmdUUID:null, SigVerified: false. Returning 500.

[charliwest]

Anyone ever get to the bottom of this, I get a lot of them too

[Simmo]

Bumping this up, since I see no resolution was reached.
I'm seeing several of these notifications every minute and it makes me worry if that many push notifications are failing.

[WUSLS]

Second bump, I am seeing quite a few of these as well.

[mrben]

We're experiencing a similar issue (v9.81 clustered)

2015-10-09 17:56:38,667 [ERROR] [8080-exec-6] [MDMController            ] - Error processing request action:StatusUpdatePlist, CmdUUID:null, SigVerified: false. Returning 500.
2015-10-09 17:56:38,692 [ERROR] [080-exec-17] [JAXBPlistParser          ] - Error unmarshalling
2015-10-09 17:56:38,692 [WARN ] [080-exec-17] [MDMActionFactory         ] - Unable to find device from plist
2015-10-09 17:56:38,692 [ERROR] [080-exec-17] [JSSAccessFilter          ] - Error displaying page
java.lang.NullPointerException
    at com.jamfsoftware.jss.mdm.enrollment.MDMController.process(MDMController.java:204)
    at com.jamfsoftware.jss.mdm.enrollment.MDMController.doGet(MDMController.java:67)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
    at com.jamfsoftware.jss.frontend.JSSAccessFilter.doFilter(JSSAccessFilter.java:59)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
    at com.jamfsoftware.jss.frontend.JSSLoadingFilter.doFilter(JSSLoadingFilter.java:180)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
    at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:680)
    at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)
    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
    at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)
    at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
    at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:701)
2015-10-09 17:56:38,693 [ERROR] [080-exec-17] [JSSAccessFilter          ] - Exception with error page: 
org.apache.jasper.JasperException: org.apache.jasper.JasperException: java.lang.NullPointerException
    at org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServletWrapper.java:549)
    at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:455)
    at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:390)
    at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
    at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:684)
    at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:593)
    at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:530)
    at com.jamfsoftware.jss.frontend.JSSAccessFilter.doFilter(JSSAccessFilter.java:81)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
    at com.jamfsoftware.jss.frontend.JSSLoadingFilter.doFilter(JSSLoadingFilter.java:180)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
    at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
    at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:680)
    at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)
    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
    at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)
    at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)
    at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:701)
Caused by: org.apache.jasper.JasperException: java.lang.NullPointerException
    at org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServletWrapper.java:549)
    at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:470)
    at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:390)
    at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
    at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:684)
    at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:593)
    at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:530)
    at org.apache.jasper.runtime.JspRuntimeLibrary.include(JspRuntimeLibrary.java:954)
    at org.apache.jsp.WEB_002dINF.frontend.frontEndWrapper_jsp._jspService(frontEndWrapper_jsp.java:183)
    at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
    at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432)
    ... 29 more
Caused by: java.lang.NullPointerException
    at org.apache.jsp.WEB_002dINF.frontend.frontEndTopNavigation_jsp._jspService(frontEndTopNavigation_jsp.java:171)
    at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
    at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432)
    ... 42 more

[BenDenham]

@mrben I am receiving the same errors on v 9.81.
Did you find out what the problem is?
My JSS eventually crashes and i have to reload tomcat..

[mrben]

No resolution yet, though support is looking into it. Just got this from our rep:

Thanks for your time on the phone today Ben! Do we happen to know if port 2195 is blocked? That was a quick suggestion that someone throw out at me and figured it would be worth a shot to ask. Let me know, thanks!

We're experiencing intermittent crashes as well. Bumping up the heap size of Tomcat solved some earlier issues.

@BenDenham Do you experience any page loads in the JSS where you see CSS but no content? That's another issue we're experiencing :/

[BenDenham]

@mrben I do occasionally have the page either take a long time to load or not load at all as far as the content goes. Generally a restart of tomcat clears things up and the JSS will run smoothly again, for a while.

I have checked my server and that port is not blocked.
I have had to occasionally restart tomcat in the past but since the last upgrade my JSS has been very intermittent :(

[BenDenham]

@mrben This error is sitting in the tomcat catalina logs, not sure if this could have something to do with the performance side of things

Oct 15, 2015 11:39:56 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /var/empty/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.

[jcompton]

Same errors. And anecdotally - sometimes we have config profiles that never deploy unless you remove the MDM profile, then run "jamf manage" and "jamf policy" on the Mac.

[brobbins]

We are seeing the same errors as well. This has been going on for about 8 months now for us. All we have been able to do is restart Tomcat like others have as well. Sure enough it comes right back eventually.

I have had tech support look into this for the last 8 months and no solution has been given. Has anyone else found anything?