Traditional web-based reporting with SAS BI tools

SAS Portal went Down-The web applications server in Weblogic server console status shows warning

Reply
Frequent Contributor
Posts: 141

SAS Portal went Down-The web applications server in Weblogic server console status shows warning

 

Hello everyone,

 

on weekend we have some batch jobs runs after server restart occurs

we have some issues with the portals not working

 

when I tried to login to our sas portals today they are not opening and keep on loading and shows Page can’t be displayed.

 

When I checked the status of the Servers on WebLogic console the status of SASServer 1 showing running but Health status  shows warning and rest of servers sasserver 2 and sasserver 8 showing running and health status shows OK.

 

so I have issue with sasserver 1 only with status showing Warning,

 

I checked the sasserver1 log on Midtier and it showing at the end of the log below error,how can i resolve this issue please help me.

am in big troube.

 

 

 

SASServer 1 log file

 

 

####<Sep 26, 2015 4:47:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300469284> <BEA-000337> <[STUCK] ExecuteThread: '21' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "688" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@3276b390[
####<Sep 26, 2015 4:48:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300529354> <BEA-000337> <[STUCK] ExecuteThread: '109' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "616" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@7d090fbe[
####<Sep 26, 2015 4:48:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300529370> <BEA-000337> <[STUCK] ExecuteThread: '25' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "686" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@37040577[
####<Sep 26, 2015 4:48:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300529386> <BEA-000337> <[STUCK] ExecuteThread: '29' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "608" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@3aafdd67[
####<Sep 26, 2015 4:49:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300589452> <BEA-000337> <[STUCK] ExecuteThread: '109' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "676" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@7d090fbe[
####<Sep 26, 2015 4:49:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300589467> <BEA-000337> <[STUCK] ExecuteThread: '36' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "638" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@6ff0b34a[
####<Sep 26, 2015 4:49:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300589484> <BEA-000337> <[STUCK] ExecuteThread: '29' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "668" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@3aafdd67[
####<Sep 26, 2015 4:50:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[STANDBY] ExecuteThread: '141' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300649679> <BEA-000337> <[STUCK] ExecuteThread: '36' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "698" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@6ff0b34a[
####<Sep 26, 2015 4:51:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300709820> <BEA-000337> <[STUCK] ExecuteThread: '32' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "626" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@22e4e322[
####<Sep 26, 2015 4:52:49 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '140' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443300769896> <BEA-000337> <[STUCK] ExecuteThread: '32' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "686" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@22e4e322[
####<Sep 26, 2015 5:18:51 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443302331378> <BEA-000337> <[STUCK] ExecuteThread: '142' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "658" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@72e8bc96[
####<Sep 26, 2015 5:19:51 PM EDT> <Error> <WebLogicServer> <ap1snx132> <SASServer1> <[ACTIVE] ExecuteThread: '112' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1443302391457> <BEA-000337> <[STUCK] ExecuteThread: '142' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "718" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@72e8bc96[

 

 

SASPortal log file

 

 

2015-09-15 08:09:41,349 [[ACTIVE] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] com.sas.portal.metadataOperations.TransactionHelper - Rolling back the transaction for object [name=null entitykey=User+omi://Foundation/reposname=Foundation/null;id=null]
2015-09-15 14:47:34,553 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [ded8b4607314dca2:-3e71c84e:14fd10d79c7:-a24Gonzalo Ocano] com.sas.portal.metadata.omr.PortalMetadataFactory - Refresh for id A5ITO1KX.AR00288Z failed.
com.sas.services.ServiceException: Refresh for id A5ITO1KX.AR00288Z failed. [ com.sas.metadata.remote.MdException: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. [ com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. ] ]
Caused by: com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository.
at com.sas.iom.SASIOMDefs.GenericErrorHelper.read(GenericErrorHelper.java:21)
at com.sas.iom.SASIOMDefs.GenericErrorHelper.extract(GenericErrorHelper.java:46)
2015-09-15 14:47:34,565 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [ded8b4607314dca2:-3e71c84e:14fd10d79c7:-a24Gonzalo Ocano] com.sas.portal.actions.GeneralExceptionHandler - Refresh for id A5ITO1KX.AR00288Z failed.; nested exception is:
com.sas.services.ServiceException: Refresh for id A5ITO1KX.AR00288Z failed. [ com.sas.metadata.remote.MdException: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. [ com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. ] ]
com.sas.services.ServiceException: Refresh for id A5ITO1KX.AR00288Z failed. [ com.sas.metadata.remote.MdException: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. [ com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. ] ]
Caused by: com.sas.services.ServiceException: Refresh for id A5ITO1KX.AR00288Z failed. [ com.sas.metadata.remote.MdException: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. [ com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository. ] ]
Caused by: com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AR00288Z is not found in the person container in the Foundation repository.
at com.sas.iom.SASIOMDefs.GenericErrorHelper.read(GenericErrorHelper.java:21)
at com.sas.iom.SASIOMDefs.GenericErrorHelper.extract(GenericErrorHelper.java:46)
2015-09-15 14:56:01,773 [[ACTIVE] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [ded8b4607314dca2:-3e71c84e:14fd10d79c7:-a24Gonzalo Ocano] com.sas.portal.delegates.preferences.ChangeNavDelegate - Unable to obtain property sets for root entity.; nested exception is:
com.sas.services.ServiceException: Unable to obtain property sets for root entity. [ com.sas.metadata.remote.MdException: The object A5ITO1KX.AN0056UN is not found in the prprtyst container in the Foundation repository. [ com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AN0056UN is not found in the prprtyst container in the Foundation repository. ] ]
com.sas.services.ServiceException: Unable to obtain property sets for root entity. [ com.sas.metadata.remote.MdException: The object A5ITO1KX.AN0056UN is not found in the prprtyst container in the Foundation repository. [ com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AN0056UN is not found in the prprtyst container in the Foundation repository. ] ]
Caused by: com.sas.services.ServiceException: Unable to obtain property sets for root entity. [ com.sas.metadata.remote.MdException: The object A5ITO1KX.AN0056UN is not found in the prprtyst container in the Foundation repository. [ com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AN0056UN is not found in the prprtyst container in the Foundation repository. ] ]
Caused by: com.sas.iom.SASIOMDefs.GenericError: The object A5ITO1KX.AN0056UN is not found in the prprtyst container in the Foundation repository.
at com.sas.iom.SASIOMDefs.GenericErrorHelper.read(GenericErrorHelper.java:21)
at com.sas.iom.SASIOMDefs.GenericErrorHelper.extract(GenericErrorHelper.java:46)
2015-09-16 15:42:11,596 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] org.apache.struts.tiles.taglib.InsertTag - Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null
2015-09-16 15:42:11,624 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] Navigation.jsp - javax.servlet.jsp.JspException: Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null
2015-09-16 16:48:38,735 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] com.sas.portal.actions.GeneralExceptionHandler -
2015-09-16 16:48:38,756 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] org.apache.struts.tiles.taglib.InsertTag - Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null
2015-09-16 16:48:38,770 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] Navigation.jsp - javax.servlet.jsp.JspException: Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null
2015-09-16 16:48:49,967 [[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] com.sas.portal.actions.GeneralExceptionHandler -
2015-09-16 16:48:49,991 [[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] org.apache.struts.tiles.taglib.InsertTag - Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null
2015-09-16 16:48:50,009 [[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] Navigation.jsp - javax.servlet.jsp.JspException: Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null
2015-09-17 09:51:50,012 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] com.sas.portal.actions.GeneralExceptionHandler -
2015-09-17 09:51:50,037 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] org.apache.struts.tiles.taglib.InsertTag - Can't insert page '/sas/portlets/wrtyanl_MessagesPortlet/GetMessagesAction.do' : null
2015-09-17 09:51:50,054 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] Navigation.jsp - javax.servlet.jsp.JspException: Can't insert page '/sas/portlets/wrtyanl_MessagesPortlet/GetMessagesAction.do' : null
2015-09-22 14:29:38,795 [[ACTIVE] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] com.sas.portal.actions.GeneralExceptionHandler -
2015-09-22 14:29:38,824 [[ACTIVE] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] org.apache.struts.tiles.taglib.InsertTag - Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null
2015-09-22 14:29:38,851 [[ACTIVE] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'] ERROR [] Navigation.jsp - javax.servlet.jsp.JspException: Can't insert page '/sas/portlets/wrtyanl_LaunchSWAPortlet/DefaultAction.do' : null

 

 

 

Please help me how can I trouble shoot this error now and how can i overcome this problem next time

 

Thanks alot all of you in advance

 

Swathi

Post a Question
Discussion Stats
  • 0 replies
  • 289 views
  • 0 likes
  • 1 in conversation