SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

sakibsoayle — Wed, 11 Sep 2019 14:40:26 GMT

Hi,

Hope you are fine.

I was getting blank screen while accessing SASCIStudio on browser. I checked the logs and found these error in SASCustIntelStudio.log file

2019-09-11 11:35:05,878 ERROR [Timer-26] [] [] org.jasig.cas.client.util.CommonUtils - Server returned HTTP response code: 503 for URL: http://a0310pnbisasr10.tnbss.com.pk:7980/SASLogon/proxy?pgt=TGT-19-aa2zteRe063bbIpoo00B1KTCNJcXOf6HoOwU2gswXoiDzJtBFU-cas&targetService=http%3A%2F%2Fa0310pnbisasr10.tnbss.com.pk%3A7980%2FSASCIStudio
java.io.IOException: Server returned HTTP response code: 503 for URL: http://a0310pnbisasr10.tnbss.com.pk:7980/SASLogon/proxy?pgt=TGT-19-aa2zteRe063bbIpoo00B1KTCNJcXOf6HoOwU2gswXoiDzJtBFU-cas&targetService=http%3A%2F%2Fa0310pnbisasr10.tnbss.com.pk%3A7980%2FSASCIStudio
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1694)
at org.jasig.cas.client.util.CommonUtils.getResponseFromServer(CommonUtils.java:311)
at org.jasig.cas.client.util.CommonUtils.getResponseFromServer(CommonUtils.java:291)
at org.jasig.cas.client.util.CommonUtils.getResponseFromServer(CommonUtils.java:344)
at org.jasig.cas.client.proxy.Cas20ProxyRetriever.getProxyTicketIdFor(Cas20ProxyRetriever.java:65)
at org.jasig.cas.client.authentication.AttributePrincipalImpl.getProxyTicketFor(AttributePrincipalImpl.java:87)
at com.sas.ci.services.common.util.SessionUtil.touchContext(SessionUtil.java:88)
at com.sas.ci.services.common.session.SessionCacheAdmin$TouchSessions.run(SessionCacheAdmin.java:207)
at java.util.TimerThread.mainLoop(Timer.java:555)
at java.util.TimerThread.run(Timer.java:505)
2019-09-11 11:35:21,292 ERROR [tomcat-http--125] [] [] talina].[localhost].[/SASCIStudio].[jsp] - Servlet.service() for servlet [jsp] in context with path [/SASCIStudio] threw exception
java.lang.IllegalStateException: No services are available for: com.sas.svcs.validation.client.SystemValidationServiceInterface. Is a required process not started?
at com.sas.svcs.cluster.httpinvoker.AutoDiscoveredHttpService.invoke(AutoDiscoveredHttpService.java:486)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy201.check(Unknown Source)
at com.sas.svcs.webapp.servlet.filters.SecurityFilter.onDoFilter(SecurityFilter.java:67)
at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.svcs.security.authentication.web.filters.TgtKeepAliveFilter.doFilterInternal(TgtKeepAliveFilter.java:59)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:106)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.svcs.security.authentication.web.filters.SessionIdentifierFilter.doFilterInternal(SessionIdentifierFilter.java:38)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:106)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:182)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.svcs.security.authentication.session.jasig.SingleSignOutFilter.doFilterInternal(SingleSignOutFilter.java:60)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:106)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.svcs.security.authentication.web.filters.RevokableTokenLogoutFilter.doFilter(RevokableTokenLogoutFilter.java:38)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.svcs.security.authentication.web.filters.CsrfRefererCheckerFilter.doFilterInternal(CsrfRefererCheckerFilter.java:909)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:106)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.framework.webapp.servlet.ApplicationNameFilter.onDoFilter(ApplicationNameFilter.java:55)
at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.ci.services.common.spring.filters.SecurityContextCleanupFilter.onDoFilter(SecurityContextCleanupFilter.java:32)
at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at com.sas.framework.webapp.servlet.SanitizingRequestFilter.onDoFilter(SanitizingRequestFilter.java:119)
at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:343)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:260)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
at com.sas.servlet.filters.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:62)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:478)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:80)
at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:624)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:677)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:341)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:799)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:861)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1455)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)

Then I tried to restart SASserver6_1 service, every time the service stuck at Initializing Spring FrameworkServlet 'springExporter'
below are the server.log for SASServer6_1

2019-09-11 12:56:28,472 INFO  (WrapperSimpleAppMain) [org.apache.catalina.core.StandardService] Starting service Catalina
2019-09-11 12:56:28,473 INFO  (WrapperSimpleAppMain) [org.apache.catalina.core.StandardEngine] Starting Servlet Engine: Pivotal tc Runtime 3.2.5.RELEASE/8.5.13.B.RELEASE
2019-09-11 12:56:28,523 INFO  (localhost-startStop-4) [org.apache.catalina.startup.HostConfig] Deploying configuration descriptor D:\sas\sasconfig\Lev1\Web\WebAppServer\SASServer6_1\conf\Catalina\localhost\SASCIStudio.xml
2019-09-11 12:56:28,523 INFO  (localhost-startStop-1) [org.apache.catalina.startup.HostConfig] Deploying configuration descriptor D:\sas\sasconfig\Lev1\Web\WebAppServer\SASServer6_1\conf\Catalina\localhost\ccs.xml
2019-09-11 12:56:28,523 INFO  (localhost-startStop-2) [org.apache.catalina.startup.HostConfig] Deploying configuration descriptor D:\sas\sasconfig\Lev1\Web\WebAppServer\SASServer6_1\conf\Catalina\localhost\ci65.xml
2019-09-11 12:56:28,523 INFO  (localhost-startStop-5) [org.apache.catalina.startup.HostConfig] Deploying configuration descriptor D:\sas\sasconfig\Lev1\Web\WebAppServer\SASServer6_1\conf\Catalina\localhost\sdm.xml
2019-09-11 12:56:28,523 INFO  (localhost-startStop-3) [org.apache.catalina.startup.HostConfig] Deploying configuration descriptor D:\sas\sasconfig\Lev1\Web\WebAppServer\SASServer6_1\conf\Catalina\localhost\mamomintegration.xml
2019-09-11 12:57:02,422 INFO  (localhost-startStop-5) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/sdm]] No Spring WebApplicationInitializer types detected on classpath
2019-09-11 12:57:02,422 INFO  (localhost-startStop-3) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/mamomintegration]] No Spring WebApplicationInitializer types detected on classpath
2019-09-11 12:57:02,482 INFO  (localhost-startStop-3) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/mamomintegration]] Config path: file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/
2019-09-11 12:57:02,482 INFO  (localhost-startStop-3) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/mamomintegration]] Context path: SASMAIntegration
2019-09-11 12:57:02,482 INFO  (localhost-startStop-5) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/sdm]] Config path: file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/
2019-09-11 12:57:02,482 INFO  (localhost-startStop-5) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/sdm]] Context path: SASDigitalMarketingServer
2019-09-11 12:57:02,483 INFO  (localhost-startStop-3) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/mamomintegration]] Configuring Log4j from URL at path: /file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/SASMAIntegration-log4j.xml
2019-09-11 12:57:02,483 INFO  (localhost-startStop-3) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/mamomintegration]] isXMLConfigFile: true
2019-09-11 12:57:02,483 INFO  (localhost-startStop-5) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/sdm]] Configuring Log4j from URL at path: /file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/SASDigitalMarketingServer-log4j.xml
2019-09-11 12:57:02,484 INFO  (localhost-startStop-5) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/sdm]] isXMLConfigFile: true
2019-09-11 12:57:02,489 INFO  (localhost-startStop-1) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ccs]] No Spring WebApplicationInitializer types detected on classpath
2019-09-11 12:57:02,535 INFO  (localhost-startStop-1) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ccs]] Config path: file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/
2019-09-11 12:57:02,536 INFO  (localhost-startStop-1) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ccs]] Context path: SASCustIntelReporting
2019-09-11 12:57:02,536 INFO  (localhost-startStop-1) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ccs]] Configuring Log4j from URL at path: /file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/SASCustIntelReporting-log4j.xml
2019-09-11 12:57:02,536 INFO  (localhost-startStop-1) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ccs]] isXMLConfigFile: true
2019-09-11 12:57:02,545 INFO  (localhost-startStop-5) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/sdm]] Initializing Spring root WebApplicationContext
2019-09-11 12:57:02,545 INFO  (localhost-startStop-3) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/mamomintegration]] Initializing Spring root WebApplicationContext
2019-09-11 12:57:02,594 INFO  (localhost-startStop-1) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ccs]] Initializing Spring root WebApplicationContext
2019-09-11 12:57:02,850 INFO  (localhost-startStop-2) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ci65]] No Spring WebApplicationInitializer types detected on classpath
2019-09-11 12:57:02,897 INFO  (localhost-startStop-2) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ci65]] Config path: file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/
2019-09-11 12:57:02,897 INFO  (localhost-startStop-2) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ci65]] Context path: SASCustIntelCore
2019-09-11 12:57:02,898 INFO  (localhost-startStop-2) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ci65]] Configuring Log4j from URL at path: /file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/SASCustIntelCore-log4j.xml
2019-09-11 12:57:02,898 INFO  (localhost-startStop-2) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ci65]] isXMLConfigFile: true
2019-09-11 12:57:02,942 INFO  (localhost-startStop-2) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/ci65]] Initializing Spring root WebApplicationContext
2019-09-11 12:57:13,636 INFO  (localhost-startStop-4) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASCIStudio]] No Spring WebApplicationInitializer types detected on classpath
2019-09-11 12:57:13,706 INFO  (localhost-startStop-4) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASCIStudio]] Config path: file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/
2019-09-11 12:57:13,707 INFO  (localhost-startStop-4) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASCIStudio]] Context path: SASCustIntelStudio
2019-09-11 12:57:13,707 INFO  (localhost-startStop-4) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASCIStudio]] Configuring Log4j from URL at path: /file:///D:/sas/sasconfig/Lev1/Web/Common/LogConfig/SASCustIntelStudio-log4j.xml
2019-09-11 12:57:13,707 INFO  (localhost-startStop-4) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASCIStudio]] isXMLConfigFile: true
2019-09-11 12:57:13,909 INFO  (localhost-startStop-4) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASCIStudio]] Initializing Spring root WebApplicationContext
2019-09-11 12:58:04,625 INFO  (localhost-startStop-4) [org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASCIStudio]] Initializing Spring FrameworkServlet 'springExporter'

Please let us know why above mentioned error is coming, what is the root cause of this and SASServer6_1 is not starting up. Pelase guide.

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

JosvanderVelden — Thu, 12 Sep 2019 14:23:05 GMT

I suggest opening a track with technical support: https://support.sas.com/en/technical-support/contact-sas.html

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

JamesAnderson — Thu, 12 Sep 2019 22:11:40 GMT

HI,

SASServer6 is failing when it tries to communicate with SASServer1 (SASLogon). I suggest you restart all your mid-tier services in the correct order. If that fails then definitely get in touch with SAS Technical Support..

Regards

James

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

SushantC — Tue, 24 Sep 2019 01:26:02 GMT

Hi,

Maybe you have resolved it by now but this happens mostly when the memory allocated to JVM is not enough to let the server instance to finish starting! It will not give any error but just waits there. Increase the memory(-Xmx -Xms) allocated to SASServer6_1 instance and it should finish starting!

Regards,

Sushant

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

sakibsoayle — Tue, 29 Oct 2019 06:10:03 GMT

Hi Sushant,

yes you are right, there was an issue with the memory allocation to the process I have increased the memory and it resolved the issue.

Thanks

topic Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter' in SAS Customer Intelligence

SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'

Re: SASServer6_1 Stuck on Startup at Initializing Spring FremeworkServlet 'springExporter'