BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
nagaraj1991
Obsidian | Level 7

One of our Application enterprise case management depends on SASServer8_1 service and this is not coming up and soon stalls after too many waiting .

 

 

Starting SAS Web App Server: SASServer8_1
(this can take a while)
waiting 30 ...
waiting 30 ...
waiting 30 ...
waiting 30 ...
waiting 60 ...

 

 

[acoe_sasdev@auirsfcts002 logs]$
[acoe_sasdev@auirsfcts002 logs]$ cat server.log | egrep "WARN|ERROR"
2019-12-30 14:41:19,121 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2019-12-30 15:09:13,968 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2019-12-30 17:24:18,964 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2019-12-30 21:26:05,688 ERROR (localhost-startStop-1) [org.apache.catalina.core.StandardContext] Error listenerStart
2019-12-30 21:26:05,688 ERROR (localhost-startStop-1) [org.apache.catalina.core.StandardContext] Context [/SASEntCaseManagement] startup failed due to previous errors
2019-12-30 21:26:05,738 ERROR (localhost-startStop-1) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASEntCaseManagement] created a ThreadLocal with key of type [org.apache.log4j.helpers.ThreadLocalMap] (value [org.apache.log4j.helpers.ThreadLocalMap@348fc2ef]) and a value of type [java.util.Hashtable] (value [{}]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
2019-12-30 21:26:05,738 ERROR (localhost-startStop-1) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASEntCaseManagement] created a ThreadLocal with key of type [java.lang.InheritableThreadLocal] (value [java.lang.InheritableThreadLocal@4a46f3de]) and a value of type [org.springframework.security.core.context.SecurityContextImpl] (value [org.springframework.security.core.context.SecurityContextImpl@ffffffff: Null authentication]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
2020-01-02 12:34:12,214 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [vfabric-license-heartbeat] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,214 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Timer-0] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,215 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [TimeScheduler.Thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,215 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Timer-1] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,215 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Timer-2] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,215 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [UDP Incoming Message Handler] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,215 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Distributed system shutdown hook] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,216 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [SystemFailure WatchDog] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,216 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [SystemFailure Proctor] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,216 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P-Handshaker auirsfcts002/10.248.68.5:0 Thread 3] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,216 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P Listener Thread tcp:///10.248.68.5:39364] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,216 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [UDP ucast receiver] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,216 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [FD_SOCK listener thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,217 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [FD_SOCK Ping thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,217 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [FD_SOCK ClientConnectionHandler] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,217 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(20593)<v2>:60705/34440 SHARED=true ORDERED=false UID=10] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,217 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(23492)<v3>:23055/45907 SHARED=true ORDERED=false UID=17] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,217 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(20800:admin)<v0>:14262/42437 SHARED=true ORDERED=false UID=6] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,218 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(23889)<v4>:21958/41053 SHARED=true ORDERED=false UID=11] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,218 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(21490)<v1>:58219/40759 SHARED=true ORDERED=false UID=16] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,218 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [State Logger Consumer Thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,218 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Thread-8 StatSampler] but has failed to stop it. This is very likely to create a memory leak.
2020-01-02 12:34:12,302 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASFINCRM] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@84fa323]) and a value of type [flex.messaging.io.SerializationContext] (value [flex.messaging.io.SerializationContext@245f5318]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
2020-01-02 13:12:32,730 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-02 17:14:19,039 ERROR (localhost-startStop-1) [org.apache.catalina.core.StandardContext] Error listenerStart
2020-01-02 17:14:19,039 ERROR (localhost-startStop-1) [org.apache.catalina.core.StandardContext] Context [/SASEntCaseManagement] startup failed due to previous errors
2020-01-02 17:14:19,091 ERROR (localhost-startStop-1) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASEntCaseManagement] created a ThreadLocal with key of type [org.apache.log4j.helpers.ThreadLocalMap] (value [org.apache.log4j.helpers.ThreadLocalMap@16b8ef5b]) and a value of type [java.util.Hashtable] (value [{}]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
2020-01-02 17:14:19,091 ERROR (localhost-startStop-1) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASEntCaseManagement] created a ThreadLocal with key of type [java.lang.InheritableThreadLocal] (value [java.lang.InheritableThreadLocal@476a4b04]) and a value of type [org.springframework.security.core.context.SecurityContextImpl] (value [org.springframework.security.core.context.SecurityContextImpl@ffffffff: Null authentication]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
2020-01-06 11:25:47,857 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [vfabric-license-heartbeat] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,857 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Timer-0] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,857 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [TimeScheduler.Thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,857 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Timer-1] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,858 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Timer-2] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,858 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [UDP Incoming Message Handler] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,858 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Distributed system shutdown hook] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,858 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [SystemFailure WatchDog] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,858 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [SystemFailure Proctor] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,859 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P-Handshaker auirsfcts002/10.248.68.5:0 Thread 4] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,859 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P Listener Thread tcp:///10.248.68.5:35239] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,860 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [UDP ucast receiver] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,860 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [FD_SOCK listener thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,860 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [FD_SOCK Ping thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,860 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [FD_SOCK ClientConnectionHandler] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,860 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(14345)<v3>:12257/38112 SHARED=true ORDERED=false UID=13] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,860 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(11456:admin)<v0>:64505/43753 SHARED=true ORDERED=false UID=5] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,861 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(11260)<v1>:11378/34667 SHARED=true ORDERED=false UID=6] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,861 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(12404)<v2>:9917/45653 SHARED=true ORDERED=false UID=18] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,861 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(14816)<v4>:54938/45767 SHARED=true ORDERED=false UID=8] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,861 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [State Logger Consumer Thread] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,861 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [Thread-8 StatSampler] but has failed to stop it. This is very likely to create a memory leak.
2020-01-06 11:25:47,941 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASFINCRM] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@25b3d7c5]) and a value of type [flex.messaging.io.SerializationContext] (value [flex.messaging.io.SerializationContext@421ad9d9]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak.
2020-01-06 11:51:01,543 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 12:28:12,262 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 13:32:57,337 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 13:34:07,775 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 14:38:00,394 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 16:02:08,043 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 16:33:46,375 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 17:17:00,081 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-06 17:49:17,651 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
2020-01-07 10:50:17,545 WARN (main) [com.springsource.tcserver.serviceability.rmi.JmxSocketListener] Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.

 

 

 

 

 

 

 

14:38:00,394 | WARN | [JmxSocketListener] | Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
WARN [localhost-startStop-1] - Have received 20 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 40 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 60 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 80 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 100 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 120 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 140 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 160 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 180 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 200 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 220 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 240 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
ERROR [localhost-startStop-1] - #############################################################################################
WARN [localhost-startStop-1] - Have received 260 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
16:02:08,043 | WARN | [JmxSocketListener] | Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
WARN [localhost-startStop-1] - Have received 20 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 40 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 60 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 80 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
16:33:46,375 | WARN | [JmxSocketListener] | Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
WARN [localhost-startStop-1] - Have received 20 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 40 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 60 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 80 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 100 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 120 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
17:17:00,081 | WARN | [JmxSocketListener] | Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
WARN [localhost-startStop-1] - Have received 20 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 40 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 60 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 80 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
17:49:17,651 | WARN | [JmxSocketListener] | Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
WARN [localhost-startStop-1] - Have received 20 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
10:50:17,545 | WARN | [JmxSocketListener] | Detected LDAP configuration '/app/sas/metamid/Lev1/Web/WebAppServer/SASServer8_1/conf/jaas.config', but there is no ldap configuration entry specified.
WARN [localhost-startStop-1] - Have received 20 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 40 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 60 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 80 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 100 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
WARN [localhost-startStop-1] - Have received 120 failures while trying to access an auto-discoverable service to satisfy request for 'com.sas.svcs.config.client.ConfigurationServiceInterface'. Please ensure that the application and/or process surfacing this interface is still in the process of starting.
[acoe_sasdev@auirsfcts002 logs]$

 

 

There is no error or warning in any other log file ,,It would be really helpful if anyone able to point out something  .

1 ACCEPTED SOLUTION

Accepted Solutions
nagaraj1991
Obsidian | Level 7


Thanks a lot @Andy547 

 

That helped .

 

it was some some port already in use so sasserver1_1 not able to start .

 

11:34:15,878 | INFO  | [HostConfig] | Deployment of configuration descriptor /app/sas/metamid/Lev1/Web/WebAppServer/SASServer1_1/conf/Catalina/localhost/SASWIPServices.xml has finished in 195,723 ms

11:34:15,880 | INFO  | [HostConfig] | Deploying web application directory /app/sas/metamid/Lev1/Web/WebAppServer/SASServer1_1/webapps/ROOT

11:34:16,168 | INFO  | [HostConfig] | Deployment of web application directory /app/sas/metamid/Lev1/Web/WebAppServer/SASServer1_1/webapps/ROOT has finished in 288 ms

11:34:16,179 | ERROR | [Http11Protocol] | Failed to start end point associated with ProtocolHandler ["http-bio-8080"]

java.net.BindException: Address already in use <null>:8080

 

View solution in original post

6 REPLIES 6
nagaraj1991
Obsidian | Level 7

It was working fine until December 30th and there were no changes done to any config.

AnandVyas
Ammonite | Level 13

Hi @nagaraj1991 

 

Can you check if all the other web application servers before SASServer8_1 have started properly? You will have to check server.log for any errors. From the errors you have listed Server 8 is looking for a service that isn't up and that's the reason its failing.

nagaraj1991
Obsidian | Level 7

Thanks Anand for the reply .

 


I am doing full restart .It is showing up in status But there are Errors in SASServer1_1  server.log .I have attached the error log.

 

Will you be able to check .

 

 

Starting SAS servers
SAS Metadata Server 1 is UP
[acoe_sasdev@auirsfcts002 Lev1]$ ./sas.servers.mid start
Starting SAS JMS Broker
Starting SAS Web Server
Starting SAS Web App Server: SASServer1_1
(this can take a while)
waiting 30 ...
waiting 30 ...
waiting 30 ...
waiting 30 ...
waiting 60 ...
waiting 60 ...
Starting SAS Web App Server: SASServer11_1
(this can take a while)
waiting 30 ...
Starting SAS Web App Server: SASServer12_1
(this can take a while)
waiting 30 ...
Starting SAS Web App Server: SASServer13_1
(this can take a while)
Starting SAS Web App Server: SASServer2_1
(this can take a while)
waiting 30 ...
waiting 30 ...
Starting SAS Web App Server: SASServer7_1
(this can take a while)
waiting 30 ...
waiting 30 ...
Starting SAS Web App Server: SASServer8_1
(this can take a while)
waiting 30 ...
waiting 30 ...
waiting 30 ...
waiting 30 ...
waiting 60 ...
waiting 60 ...
waiting 60 ...
waiting 60 ...
waiting 60 ...
waiting 60 ...
waiting 60 ...

nagaraj1991
Obsidian | Level 7
Please check the Errors from 2020-01-07 10:45:43,162 that is today error log
Andy547
SAS Employee

I see two main types of error in the partial log you posted:

2020-01-06 11:25:47,861 ERROR (localhost-startStop-2) [org.apache.catalina.loader.WebappClassLoader] The web application [/SASSNA] appears to have started a thread named [P2P message reader for auirsfcts002(12404)<v2>:9917/45653 SHARED=true ORDERED=false UID=18] but has failed to stop it. This is very likely to create a memory leak. 

 

All of these messages can be ignored.  They mean the server stopped while a thread had not stopped.  This happens all the time and is harmless. 

 

2020-01-02 17:14:19,039 ERROR (localhost-startStop-1) [org.apache.catalina.core.StandardContext] Error listenerStart
2020-01-02 17:14:19,039 ERROR (localhost-startStop-1) [org.apache.catalina.core.StandardContext] Context [/SASEntCaseManagement] startup failed due to previous errors

 

This type of error means one of the application contexts failed to start for some reason.  This is always bad.  Around this message in the log will be a java traceback with a 'caused by...' clause.  One of the causes will be something like 'connection refused' or 'failed to load' or 'timed out' or 'Host not found' This will get you one step closer to the root cause for the server not starting all the way.  

nagaraj1991
Obsidian | Level 7


Thanks a lot @Andy547 

 

That helped .

 

it was some some port already in use so sasserver1_1 not able to start .

 

11:34:15,878 | INFO  | [HostConfig] | Deployment of configuration descriptor /app/sas/metamid/Lev1/Web/WebAppServer/SASServer1_1/conf/Catalina/localhost/SASWIPServices.xml has finished in 195,723 ms

11:34:15,880 | INFO  | [HostConfig] | Deploying web application directory /app/sas/metamid/Lev1/Web/WebAppServer/SASServer1_1/webapps/ROOT

11:34:16,168 | INFO  | [HostConfig] | Deployment of web application directory /app/sas/metamid/Lev1/Web/WebAppServer/SASServer1_1/webapps/ROOT has finished in 288 ms

11:34:16,179 | ERROR | [Http11Protocol] | Failed to start end point associated with ProtocolHandler ["http-bio-8080"]

java.net.BindException: Address already in use <null>:8080

 

suga badge.PNGThe SAS Users Group for Administrators (SUGA) is open to all SAS administrators and architects who install, update, manage or maintain a SAS deployment. 

Join SUGA 

Get Started with SAS Information Catalog in SAS Viya

SAS technical trainer Erin Winters shows you how to explore assets, create new data discovery agents, schedule data discovery agents, and much more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 6 replies
  • 3985 views
  • 0 likes
  • 3 in conversation