SASSERVER2_1 Redeploy ERROR

[sathya66]

All,

We installed latest hot fixes & latest security patch on Mid-tier machine.

We installed all hot fixes successfully, rebuilt them successfully but when we try to redeploy them it is failed at SASSERVER2_1 modules configuration

•   folderModule
• SASServerModule
• SASUsermodule,etc

Stopped SASServer2_1 and I tried to backup the war folders from <config>Web/WebAppServer/SASServer2_1/sas_webapps/Backups but it didn't help me

what else do I need to backup to get SASServer2_1 to work or what steps do I need to take now to resolve this issue.

Thanks in advance.

[Anand_V]

Hi @sathya66 

Can you share the complete error details? If you are thinking of reverting it back it should be from the cold backup you might have taken before applying the hot-fix not the files inside the sas_webapps directory.

[sathya66]

Thanks,

see the screenshot below. It looks like connection refused multiple times but server2 started but modules are not started properly. and also see the log below. 

[appserverTarget] 2020-09-29 16:11:03,992 [main] INFO com.sas.appserver.vfabrictcsvr.Server - testServer() >>>
[appserverTarget] 2020-09-29 16:11:03,992 [main] INFO com.sas.appserver.vfabrictcsvr.Server - getFailedApps() >>>
[appserverTarget] 2020-09-29 16:11:09,129 [main] INFO com.sas.appserver.vfabrictcsvr.Server - getFailedApps() >>>
[appserverTarget] 2020-09-29 16:11:09,129 [main] INFO com.sas.appserver.vfabrictcsvr.Server - testServer() <<<
[appserverTarget] 2020-09-29 16:11:09,130 [main] INFO com.sas.appserver.vfabrictcsvr.Server - cloneName=SASServer2_1
[appserverTarget] 2020-09-29 16:11:09,130 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable(test.com,8181) >>>
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.PortUtils - Connection refused (Connection refused)
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.PortUtils - isAvailable=true
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable() <<<
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.AntProcessInvoker - Environment Variables:
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.AntProcessInvoker - Working Directory: /Web/WebAppServer/SASServer2_1/bin
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.AntProcessInvoker - Executable: /Web/WebAppServer/SASServer2_1/bin/tcruntime-ctl.sh
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.AntProcessInvoker - Arguments:
[appserverTarget] 2020-09-29 16:11:09,131 [main] INFO com.sas.appserver.utils.AntProcessInvoker - start
[appserverTarget] 2020-09-29 16:11:09,132 [main] INFO com.sas.appserver.utils.AntProcessInvoker - spawning process
[appserverTarget] 2020-09-29 16:11:09,133 [main] INFO com.sas.appserver.vfabrictcsvr.Server - test.com SASServer2 using http on port 8181
[appserverTarget] 2020-09-29 16:11:19,134 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable(test.com,8181) >>>
[appserverTarget] 2020-09-29 16:11:19,136 [main] INFO com.sas.appserver.utils.PortUtils - Connection refused (Connection refused)
[appserverTarget] 2020-09-29 16:11:19,136 [main] INFO com.sas.appserver.utils.PortUtils - isAvailable=true
[appserverTarget] 2020-09-29 16:11:19,136 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable() <<<
[appserverTarget] 2020-09-29 16:11:19,350 [main] INFO com.sas.appserver.vfabrictcsvr.Server - Waiting for port (8181) to open on address (test.com).
[appserverTarget] 2020-09-29 16:11:29,353 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable(test.com,8181) >>>
[appserverTarget] 2020-09-29 16:11:29,354 [main] INFO com.sas.appserver.utils.PortUtils - Connection refused (Connection refused)
[appserverTarget] 2020-09-29 16:11:29,354 [main] INFO com.sas.appserver.utils.PortUtils - isAvailable=true
[appserverTarget] 2020-09-29 16:11:29,354 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable() <<<
[appserverTarget] 2020-09-29 16:11:29,624 [main] INFO com.sas.appserver.vfabrictcsvr.Server - Waiting for port (8181) to open on address (test.com).
[appserverTarget] 2020-09-29 16:11:39,630 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable(test.com,8181) >>>
[appserverTarget] 2020-09-29 16:11:39,631 [main] INFO com.sas.appserver.utils.PortUtils - Connection refused (Connection refused)
[appserverTarget] 2020-09-29 16:11:39,631 [main] INFO com.sas.appserver.utils.PortUtils - isAvailable=true
[appserverTarget] 2020-09-29 16:11:39,631 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable() <<<
[appserverTarget] 2020-09-29 16:11:39,938 [main] INFO com.sas.appserver.vfabrictcsvr.Server - Waiting for port (8181) to open on address (test.com).
[appserverTarget] 2020-09-29 16:11:49,938 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable(test.com,8181) >>>
[appserverTarget] 2020-09-29 16:11:49,939 [main] INFO com.sas.appserver.utils.PortUtils - Connection refused (Connection refused)
[appserverTarget] 2020-09-29 16:11:49,939 [main] INFO com.sas.appserver.utils.PortUtils - isAvailable=true
[appserverTarget] 2020-09-29 16:11:49,939 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable() <<<
[appserverTarget] 2020-09-29 16:11:50,288 [main] INFO com.sas.appserver.vfabrictcsvr.Server - Waiting for port (8181) to open on address (test.com).
[appserverTarget] 2020-09-29 16:12:00,289 [main] INFO com.sas.appserver.utils.PortUtils - isPortAvailable(test.com,8181) >>>
[appserverTarget] 2020-09-29 16:12:00,289 [main] INFO com.sas.appserver.utils.PortUtils - isAvailable=false
[appserverTarget] 2020-09-29 16:12:00,549 [main] INFO com.sas.appserver.vfabrictcsvr.Server - Server SASServer2_1 started successfully.
[appserverTarget] 2020-09-29 16:12:00,549 [main] INFO com.sas.appserver.vfabrictcsvr.Server - testServer() >>>
[appserverTarget] 2020-09-29 16:12:00,549 [main] INFO com.sas.appserver.vfabrictcsvr.Server - getFailedApps() >>>
[appserverTarget] 2020-09-29 16:12:05,706 [main] ERROR com.sas.appserver.vfabrictcsvr.Server - Webapp with FolderModule context failed to start
[appserverTarget] 2020-09-29 16:12:05,718 [main] ERROR com.sas.appserver.vfabrictcsvr.Server - Webapp with SASServerModule context failed to start
[appserverTarget] 2020-09-29 16:12:05,718 [main] ERROR com.sas.appserver.vfabrictcsvr.Server - Webapp with SASSecurityAdminModule context failed to start
[appserverTarget] 2020-09-29 16:12:05,742 [main] ERROR com.sas.appserver.vfabrictcsvr.Server - Webapp with SASEnvironmentMgrLibraryMod context failed to start
[appserverTarget] 2020-09-29 16:12:05,743 [main] ERROR com.sas.appserver.vfabrictcsvr.Server - Webapp with SASEnvironmentMgrMidTier context failed to start
[appserverTarget] 2020-09-29 16:12:05,754 [main] ERROR com.sas.appserver.vfabrictcsvr.Server - Webapp with SASUserModule context failed to start
[appserverTarget] 2020-09-29 16:12:05,770 [main] INFO com.sas.appserver.vfabrictcsvr.Server - getFailedApps() >>>
[appserverTarget] 2020-09-29 16:12:05,786 [main] INFO com.sas.appserver.utils.AppServerException - /en_US/AppServerMessages.properties does not exist.
[appserverTarget] 2020-09-29 16:12:05,786 [main] INFO com.sas.appserver.vfabrictcsvr.Server - testServer() - Throwing AppServerException
[appserverTarget] 2020-09-29 16:12:05,786 [main] INFO com.sas.appserver.vfabrictcsvr.Server - testServer() <<<
[appserverTarget] 2020-09-29 16:12:05,790 [main] INFO com.sas.sdw.SDWExceptionHandler - handle() >>>
[appserverTarget] 2020-09-29 16:12:05,790 [main] INFO com.sas.sdw.SDWExceptionHandler - handleSDWException() >>>
[appserverTarget] 2020-09-29 16:12:05,790 [main] INFO com.sas.sdw.SDWExceptionHandler - target=startAppServers, task=com.sas.sdw.SDWExceptionHandler
[appserverTarget] 2020-09-29 16:12:05,790 [main] INFO com.sas.sdw.SDWExceptionHandler - message=Application Server has started, however web applications with the following contexts failed to start. Please refer to Application Server logs for more details.</br><ul><li>FolderModule</li><li>SASServerModule</li><li>SASSecurityAdminModule</li><li>SASEnvironmentMgrLibraryMod</li><li>SASEnvironmentMgrMidTier</li><li>SASUserModule</li></ul>
[propertyfile] Updating property file: /Logs/Configure/vfabrictcsvr_config_status.properties
[propertyfile] Updating property file: /Logs/Configure/vfabrictcsvr_config_status.properties
2020-09-29 16:12:05,803 [main] INFO com.sas.sdw.SDWExceptionHandler - configStatusFile set.
2020-09-29 16:12:05,807 [main] ERROR com.sas.sdw.SDWExceptionHandler - com.sas.appserver.utils.AppServerException: Application Server has started, however web applications with the following contexts failed to start. Please refer to Application Server logs for more details.</br><ul><li>FolderModule</li><li>SASServerModule</li><li>SASSecurityAdminModule</li><li>SASEnvironmentMgrLibraryMod</li><li>SASEnvironmentMgrMidTier</li><li>SASUserModule</li></ul>
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.codehaus.groovy.runtime.MetaClassHelper.doConstructorInvoke(MetaClassHelper.java:526)
at groovy.lang.MetaClassImpl.doConstructorInvoke(MetaClassImpl.java:2331)
at groovy.lang.MetaClassImpl.invokeConstructor(MetaClassImpl.java:1227)
at groovy.lang.MetaClassImpl.invokeConstructor(MetaClassImpl.java:1157)
at org.codehaus.groovy.runtime.InvokerHelper.invokeConstructorOf(InvokerHelper.java:801)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeNewN(ScriptBytecodeAdapter.java:227)
at com.sas.appserver.vfabrictcsvr.Server.testServer(Server.groovy:342)
at com.sas.appserver.vfabrictcsvr.Server.this$4$testServer(Server.groovy)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnCurrentN(ScriptBytecodeAdapter.java:77)
at com.sas.appserver.vfabrictcsvr.Server.startResource(Server.groovy:517)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnCurrentN(ScriptBytecodeAdapter.java:77)
at com.sas.appserver.impl.AbstractServer.start(AbstractServer.groovy:144)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:740)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:773)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:753)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodN(ScriptBytecodeAdapter.java:167)
at com.sas.appserver.vfabrictcsvr.AppServer$_doStartAppServers_closure4.doCall(AppServer.groovy:323)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:252)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:740)
at groovy.lang.Closure.call(Closure.java:292)
at groovy.lang.Closure.call(Closure.java:305)
at org.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:990)
at org.codehaus.groovy.runtime.DefaultGroovyMethods.each(DefaultGroovyMethods.java:967)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.runtime.metaclass.ReflectionMetaMethod.invoke(ReflectionMetaMethod.java:51)
at org.codehaus.groovy.runtime.metaclass.NewInstanceMetaMethod.invoke(NewInstanceMetaMethod.java:54)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:740)
at org.codehaus.groovy.runtime.InvokerHelper.invokePojoMethod(InvokerHelper.java:761)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:749)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodN(ScriptBytecodeAdapter.java:167)
at com.sas.appserver.vfabrictcsvr.AppServer.doStartAppServers(AppServer.groovy:321)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnCurrentN(ScriptBytecodeAdapter.java:77)
at com.sas.appserver.impl.AbstractAppServer.startAppServers(AbstractAppServer.groovy:411)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:740)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:773)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:753)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodN(ScriptBytecodeAdapter.java:167)
at com.sas.appserver.impl.AbstractAppServer.invoke(AbstractAppServer.groovy:1166)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:740)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:773)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:753)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodN(ScriptBytecodeAdapter.java:167)
at com.sas.appserver.ant.AppServerDispatch.invoke(AppServerDispatch.groovy:147)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:740)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:773)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:753)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodN(ScriptBytecodeAdapter.java:167)
at com.sas.sdw.ant.DispatchTask.doExecute(DispatchTask.groovy:81)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:95)
at org.codehaus.groovy.runtime.MetaClassHelper.doMethodInvoke(MetaClassHelper.java:599)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:904)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnCurrentN(ScriptBytecodeAdapter.java:77)
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.invokeMethodOnCurrent0(ScriptBytecodeAdapter.java:109)
at com.sas.sdw.ant.SDWTask.execute(SDWTask.groovy:44)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:105)
at org.apache.tools.ant.Task.perform(Task.java:348)
at org.apache.tools.ant.Target.execute(Target.java:357)
at org.apache.tools.ant.Target.performTasks(Target.java:385)
at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1329)
at org.apache.tools.ant.Project.executeTarget(Project.java:1298)
at org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
at org.apache.tools.ant.Project.executeTargets(Project.java:1181)
at org.apache.tools.ant.Main.runBuild(Main.java:698)
at org.apache.tools.ant.Main.startAnt(Main.java:199)
at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
at org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)

2020-09-29 16:12:05,809 [main] INFO com.sas.sdw.SDWExceptionHandler - Forcing failure.

BUILD FAILED

[MarcoGhiglieri]

In config/Lev1/Web/Logs/SASServer2 , there's no file updating, right?

I can see a "isPortAvailable(test.com,8181)" - that's your hostname, test.com?

[sathya66]

Yes, thats correct, there is no file updating means empty (ex:SASSecurityAdminModule2.3.log,etc)
Yes ,test.com is our hostname ( I removed our original hostnames here and added test.com 🙂 )

[MarcoGhiglieriO]

Sorry, same me but old account. I misunderstood the moment you'r getting the errors, since it's during redeploy the webapps wouldn't log for sure. I should have guessed the hostname was redacted.
I can remember some hotfixes required manual intervention or some other prerequisites. I think I'd re-check them.

[Anand_V]

Hi @sathya66 

Can you please share application logs for these apps located under <sas-config>/Lev1/Web/Logs/SASServer2_1? 

[sathya66]

see the log below for SASUserModule.
same error for SASEnvironmentMgrMidTier2.5.log
SASSecurityAdminModule2.3.log and SASServerModule2.1.logs are empty.


2020-09-29 15:59:57,514 [localhost-startStop-8] ERROR [unknownunknown] org.apache.catalina.core.ContainerBase.[Catalina].[localhost].[/SASUserModule] - Exception sending context initialized ev
ent to listener instance of class [org.springframework.web.context.ContextLoaderListener]
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'registration': Invocation of init method failed; nested exception is org.springframework.jms.IllegalStat
eException: javax.jms.JMSException: Cannot send, channel has already failed: tcp://30.22.55.55:61617; nested exception is javax.jms.IllegalStateException: javax.jms.JMSException: Cannot send,
channel has already failed: tcp://30.22.55.55:61617
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:133)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:396)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1507)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:191)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:638)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:942)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:482)
at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:410)
at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:306)
at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:112)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4792)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5256)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:754)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:730)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:734)
at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:629)
at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1839)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

[Anand_V]

Error looks related to JMS connection. Is the activemq services up and running? Can you check activemq logs and verify if there are any errors in it? I would advise a clean restart and try again. Also validate if compute tier services are running without any error.

[sathya66]

Thanks @Anand_V , Yes activemq is running. Other SASServerX_Y servcies are UP and working, only isssue is with SASServer2_1.

there are warning in the activemq. see the log below.

No issues/ERRORs in Compute tier logs.

2020-10-08 14:05:19,711 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@610aa285{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16851
2020-10-08 14:05:19,730 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@241bf809{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16836
2020-10-08 14:05:19,728 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@5a4ad09a{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16867
2020-10-08 14:05:19,727 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@5bb14392{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16864
2020-10-08 14:05:19,725 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@2fa036cf{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16840
2020-10-08 14:05:19,724 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@5431425a{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16874
2020-10-08 14:05:19,718 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@36ebdf86{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16870
2020-10-08 14:05:21,570 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@2a7cb5fe[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16825
2020-10-08 14:05:21,572 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@560698c9{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16825
2020-10-08 14:05:21,724 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@3960ff1f[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16855
2020-10-08 14:05:21,726 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@78af8204[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16864
2020-10-08 14:05:21,725 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@77a8ac98[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16868
2020-10-08 14:05:21,725 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@4563b68c[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16867
2020-10-08 14:05:21,734 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@71b366e6{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16868
2020-10-08 14:05:21,732 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@711aa246{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16864
2020-10-08 14:05:21,731 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@34e44fe3[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16874
2020-10-08 14:05:21,727 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@ca7bd49[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16875
2020-10-08 14:05:21,727 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@11254a60[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16840
2020-10-08 14:05:21,743 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@3fdc57fa{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16840
2020-10-08 14:05:21,726 | WARN | Illegal character 0x0 in state=START for buffer HeapByteBuffer@14f07591[p=1,l=366,c=16384,r=365]={\x00<<<\x00\x01j\x01ActiveMQ\x00\x00\x00\x0c\x01...ersion\t\x00\x065.15.5>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16861
2020-10-08 14:05:21,726 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@677b9164{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16855
2020-10-08 14:05:21,746 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@6ec4b26f{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16861
2020-10-08 14:05:21,742 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@479fbe4b{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16875
2020-10-08 14:05:21,740 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@1d5dad3b{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16874
2020-10-08 14:05:21,735 | WARN | badMessage: 400 Illegal character 0x0 for HttpChannelOverHttp@7c573129{r=0,c=false,a=IDLE,uri=} | org.eclipse.jetty.http.HttpParser | qtp1305935114-16867

[Anand_V]

Hi @sathya66 

Thanks for the log and update. Don't see much help from the logs.

I hope you have already raised a support track with SAS TS. If not I would suggest you to raise it so they can advise more steps on troubleshooting this issue. Please update the outcome once resolved.

Thanks!