topic Re: Stored Process Error in SAS Visual Analytics

Stored Process Error

balraj — Thu, 07 Apr 2016 13:22:14 GMT

Hi Community,

When I'm trying to Access/Run Stored Process in the WebApplication I'm getting the following error. I've logged in with sasadm@saspw i.e. SAS Administrator

StoreProcess Error

Unable to Execute Stored Process

Unable to Connect to SAS Server

Even when I'm trying to access the sample StoredProcesses also i'm getting the same error.

Reffered to this link but couldn't solve

Kind Regards,

Balraj

Re: Stored Process Error

Kurt_Bremser — Thu, 07 Apr 2016 13:35:17 GMT

@ saspw users are internal users; they exist only in the metadata repository and cannot start a workspace server. Use a user with a valid system account instead.

DO NOT use sasadm@saspw for work; it is only to be used for administrative purposes.

Re: Stored Process Error

Kurt_Bremser — Thu, 07 Apr 2016 13:38:04 GMT

I also suspect that there's a misconfiguration of your stored processes. Verify that your stored processes are bound to the Logical Stored Process Server and not the Logical Workspace Server

Re: Stored Process Error

balraj — Thu, 07 Apr 2016 13:43:49 GMT

Hi @Kurt_Bremser,

I've logged in with the System User and executed the Stored Process i got the same error.

I Validated the Workspace server from SMC with System User that also didn't work.

Any other approaches to solve this error.

Kind Regards,

Balraj

Re: Stored Process Error

balraj — Thu, 07 Apr 2016 13:47:49 GMT

wow @Kurt_Bremser spot on. I got this error.

[4/7/16 1:44 PM] INFO: Starting simple validation for Stored Process server (level 1) - ping
[4/7/16 1:44 PM] SEVERE: Connection refused: connect
[4/7/16 1:44 PM] SEVERE: java.net.ConnectException: Connection refused: connect

how to resolve this? I'm new to SAS VA, can you please guide me.

Kind Regards,

Balraj

Re: Stored Process Error

Kurt_Bremser — Thu, 07 Apr 2016 13:55:53 GMT

Several options.

- The Object Spawner is not running. The Object Spawner needs to be started by the operating system at startup; in UNIX this means it has an entry in /etc/inittab or a similar file (if the UNIX in question does not use SysV init)

- The Workspace Servers and Stored Process Server are not correctly configured into the the Object Spawner (open Properties of the Object Spawner in SAS MC and look at the Server tab)

- The UserIDs used to start the Servers (your personal account for a Workspace Server, sassrv for the Stored Process Server) have problems starting a SAS process

Also keep in mind that the Stored Process Server and Workspace Server are not part of SAS VA, but part of the standard Business Intelligence Server package

Re: Stored Process Error

balraj — Thu, 07 Apr 2016 14:28:02 GMT

Hi @Kurt_Bremser

- ObjectSpawner is running on Start-up

-Inside ObjectSpawner both the Workspace Servers and Stored Process Server are configured

- I've Logged into SMC with sasadm@saspw and did this steps, "ObjectSpawner"->rightclick->"connect"

still same error.

Gist of the Logs:

Unable to connect to a SAS server.

Unable to Connect to a SAS server
com.sas.services.storedprocess.ExecutionException: A connection could not be obtained.

Caused by: com.sas.services.connection.FatalConnectionFactoryException: The application could not log on to the server "defteam.sas.com:8601". No server is available at that port on that machine.

Caused by: org.omg.CORBA.COMM_FAILURE: The application could not log on to the server "defteam.sas.com:8601". No server is available at that port on that machine.  vmcid: 0x0  minor code: 1  completed: No

Caused by: java.net.ConnectException: Connection refused: connect

Kind Regards,

Balraj

Re: Stored Process Error

Kurt_Bremser — Thu, 07 Apr 2016 16:15:21 GMT

Please verify that the spawner is actually up. Log on to the server and do ps -ef|grep Spaw. This should show the process. You also check that user ID and password are valid.

Re: Stored Process Error

balraj — Mon, 11 Apr 2016 10:09:14 GMT

Hi @Kurt_Bremser

When I connect the Object Spawner from SMC, I'm getting the following in the "Log" tab.

Current message level: Off
Current threshold level: Error
Either there's no log available, you may need to enable logging at a higher message/threshold level or the server appender is not defined in the log configuration file.

And in ObjectSpawner log file and MetaDataServer log file there are no errors specified. I'm facing this issue after running "importad.sas" script, Is it impacting anywhere?

Can you guide me here.

Kind Regards,

Balraj.P

Re: Stored Process Error

Kurt_Bremser — Mon, 11 Apr 2016 10:42:33 GMT

According to the messages that you posted, the Spawner does not listen on the Stored Process Server port (8601). Since you could open a connection to the spawner, this lets me think that the Stored Process Server is not properly configured into the spawner.

In SASMC, expand Server Manager, right-click on the Object Spawner, select Properties and then the Server tab. The Stored Process Server should be in the right-hand list.

Re: Stored Process Error

balraj — Mon, 11 Apr 2016 10:56:44 GMT

Hi @Kurt_Bremser,

I've done what you've said and I can see "Stored Process Server" in that list.

PFA and guide me whether i'm missing anything.

By the way I'm facing the same error when I'm validating the "Pooled Workspace Server" as well.

Kind Regards,

Balraj.P

Re: Stored Process Error

Kurt_Bremser — Mon, 11 Apr 2016 11:34:54 GMT

Then it's time for the log files. You find the object spawner logs in your configuration tree in Lev1/ObjectSpawner/Logs.

The filenames look like ObjectSpawner_YYYY-MM-DD_NNNNNN.log, where YYYY-MM-DD is the date and NNNNNN is the process number of the spawner. Try a connection to the Stored Process or Workspace Server and then do (immediately) tail ObjectSpawner_YYYY-MM-DD_NNNNNN.log to see the latest messages.

Re: Stored Process Error

balraj — Mon, 11 Apr 2016 13:19:33 GMT

Hi @Kurt_Bremser

I've done as you said, this what the log file returns, no errors

2016-04-11T13:11:06,371 INFO  [00000374] :SYSTEM@WIN-16NDD1VN0L5 - New out call client connection (39) for user sasadm@saspw.  Encryption level is Credentials using encryption algorithm SASPROPRIETARY.  Peer IP address and port are [192.168.2.241]:8561.
2016-04-11T13:11:06,372 INFO  [00000374] :sasadm@saspw - New client connection (38) accepted from server port 8581 for SAS token user sasadm@saspw.  Encryption level is Credentials using encryption algorithm SASPROPRIETARY.  Peer IP address and port are [::ffff:192.168.2.241]:6150 for APPNAME=ConnectionService 904201.
2016-04-11T13:11:51,680 INFO  [00000422] :SYSTEM@WIN-16NDD1VN0L5 - New out call client connection (41) for user sasadm@saspw.  Encryption level is Credentials using encryption algorithm SASPROPRIETARY.  Peer IP address and port are [192.168.2.241]:8561.

I've a question, does executing "importad.sas" code will have any impact on "Pooled Workspace server"?

Kind Regards,

Balraj.P

Re: Stored Process Error

Kurt_Bremser — Mon, 11 Apr 2016 13:51:19 GMT

What you see is your access from the MC to the operator port of the spawner.

A successful connection for the start of a workspace server instance would look like this:

2016-04-11T15:03:29,770 INFO  [00017498] UUUUU - New client connection (4892) accepted from server port 8591 for user UUUUU.  Encryption level is Credentials using encryption algorithm SASProprietary.  Peer Address .....

where UUUUU represents the UserID with which the connection is made.

A failed attempt would look like this:

2016-01-04T16:52:24,686 INFO  [00350751] sas - Access denied.
2016-01-04T16:52:24,690 WARN  [00350751] sas - New client connection (50614) rejected from server port 8591 for user UUUUU.

Connection attempts to the Stored Process Server would use port 8601, respectively.

If you do not find any messages with these port numbers in your spawner log file, then I think you have problems connecting to the ports as such. Maybe a firewall is interfering that allows 8561 (Metadata) and 8581 (spawner operator port) but not the other SAS ports.

importad.sas seems to be the program that is used to synchronize Active Directory with the users and groups in SAS metadata. I don't think that could cause problems with the server configuration, as it uses macros that only deal with users/groups.

Re: Stored Process Error

balraj — Mon, 11 Apr 2016 16:29:20 GMT

Hi @Kurt_Bremser

Thanks alot for your time, will check about it tomorrow in office.

Have a Great time and I'm very grateful for your support and assistance.

Kind Regards,

Balraj.P

Re: Stored Process Error

avinashginjupal — Wed, 22 Nov 2017 09:42:15 GMT

Hello Balraj - Did you fixed the issue which was discussed here? we do have same problem with our STP and seeing same points discussed in thread, any help would be appreciated

Thanks

Avinash G

Re: Stored Process Error

Kurt_Bremser — Wed, 22 Nov 2017 09:59:43 GMT

What exactly have you tried so far? Describe your tries, and post results. If you have already followed the suggestions I gave, post the relevant log parts.

Re: Stored Process Error

avinashginjupal — Wed, 22 Nov 2017 10:20:06 GMT

We have verified whether Objectspawner is configured correctly or not - yes both Stored process server and Pooled Workspace Server are on the right hand side in Object Spawner Server Tab properties.

Under Content Server log and many other places I can see this error:

ERROR 2017-11-22 04:07:15,467 [RMI TCP Connection(158)-162.102.151.62] - failed to read bundle: f002de7c-b7f0-414d-8d8c-a6acee653dfa: java.io.EOFException
ERROR 2017-11-22 04:07:15,870 [RMI TCP Connection(158)-162.102.151.62] - failed to read bundle: 299fa6af-dbc2-444e-ae4b-90a47d17c5af: java.io.EOFException
ERROR 2017-11-22 04:07:16,434 [RMI TCP Connection(158)-162.102.151.62] - failed to read bundle: 423f6256-92e0-45ab-a455-c034c16c5405: java.io.EOFException

Under Stored Process Log :

2017-11-22 01:02:43,623 [JBoss Shutdown Hook] ERROR [] com.sas.svcs.authentication.helper.UserContextFactoryBean - An error occurred destroying user, sastrust@saspw. The Platform Services VM should be restarted.
2017-11-22 02:58:00,508 [http-0.0.0.0-8080-7] WARN [] com.sas.svcs.webapp.servlet.filters.SecurityFilter - The current HttpSession level entityKey does not match the value presented as a request parameter. The HttpSession will be invalidated and this request processed as a new HttpSession / User.

Ran STP Hello World with &_debug=2305

SASStoredProcess

>>> Stored Process Web Application Version 9.3 (Build 477) November 22, 2017 2:54:00 AM CST

>>> Using user name u431739 in domain DefaultAuth

>>> Parameter file /Params.config

>>> User context u431739

>>> Locale en_US

>>> Stored Process Input Parameters:

_debug = 2305
_grafloc = /sasweb/graph
_htcook = s_cc=true; s_sq=%5B%5BB%5D%5D; CSILL=1511252153462; JSESSIONID.SASServer1=64628F4BDF4C1624BE7AA0EBDE907FB8
_htua = Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko
_program = /Products/SAS Intelligence Platform/Samples/Sample: Hello World
_reqmeth = GET
_rmtaddr = 10.92.227.201
_rmthost = 10.92.227.201
_srvname = crpra00a0021.wellsfargo.com
_srvport = 8080
_url = /SASStoredProcess/do
_userlocale = en_US
_username = u431739
_version = Version 9.3 (Build 477)
debug_action = form,properties,execute

>>> Servlet Session Data:

Servlet Session ID: 64628F4BDF4C1624BE7AA0EBDE907FB8
Counter: 16
Creation Time: Wed Nov 22 02:46:05 CST 2017
Last Accessed Time: Wed Nov 22 02:52:23 CST 2017 
Servlet Session Timeout: 30

>>> Using Pathurl SBIP://METASERVER/Products/SAS Intelligence Platform/Samples/Sample: Hello World(StoredProcess)

>>> Creating Stored Process Object

>>> Got Stored Process /Products/SAS Intelligence Platform/Samples/Sample: Hello World

Name: Sample: Hello World
Directory: /opt/sas/93tfcm/SASFoundation/9.3/samples/inttech
Source File: stphello.sas
Description: DATA Step-generated output using PUT statements.

>>> Setting stored process parameters

>>> Executing stored process object
Stored Process Error Unable to execute stored process.

Unable to connect to a SAS server.

com.sas.services.storedprocess.ExecutionException: A connection could not be obtained.
	at com.sas.services.storedprocess.Execution2.makeConnection(Execution2.java:337)
	at com.sas.services.storedprocess.Execution2.(Execution2.java:296)
	at com.sas.services.storedprocess.StoredProcess2.execute(StoredProcess2.java:1200)
	at com.sas.services.storedprocess.webapp.StoredProcessServlet.doRequest(StoredProcessServlet.java:1478)
	at com.sas.services.storedprocess.webapp.StoredProcessServlet.doGet(StoredProcessServlet.java:265)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at com.sas.svcs.webapp.servlet.filters.ThemeSupportFilter.onDoFilter(ThemeSupportFilter.java:177)
	at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:66)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at com.sas.svcs.webapp.servlet.filters.PlatformServicesFilter.onDoFilter(PlatformServicesFilter.java:148)
	at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:66)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at com.sas.svcs.webapp.servlet.filters.SecurityFilter.onDoFilter(SecurityFilter.java:212)
	at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:66)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at com.sas.services.storedprocess.webapp.SPFilter.onDoFilter(SPFilter.java:228)
	at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:66)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at com.sas.servlet.filters.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:62)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at com.sas.framework.webapp.servlet.SanitizingRequestFilter.onDoFilter(SanitizingRequestFilter.java:83)
	at com.sas.framework.webapp.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:66)
	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:237)
	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:167)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:235)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
	at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:190)
	at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:92)
	at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.process(SecurityContextEstablishmentValve.java:126)
	at org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:70)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
	at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:158)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:330)
	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:829)
	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:598)
	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
	at java.lang.Thread.run(Thread.java:662)
Caused by: com.sas.services.connection.FatalConnectionFactoryException: The application could not log on to the server "crpra00a0021.wellsfargo.com:8601". No server is available at that port on that machine.
	at com.sas.services.connection.ClusterEnvelope.getConnection(ClusterEnvelope.java:235)
	at com.sas.services.connection.AggregationKernel.doGetConnection(AggregationKernel.java:241)
	at com.sas.services.connection.ConnectionFactoryKernel.getConnection(ConnectionFactoryKernel.java:325)
	at com.sas.services.connection.ConnectionFactoryShell.getConnection(ConnectionFactoryShell.java:75)
	at com.sas.services.connection.platform.PlatformConnectionFactory.getConnectionMetadata(PlatformConnectionFactory.java:571)
	at com.sas.services.connection.platform.PlatformConnectionFactory.getConnection(PlatformConnectionFactory.java:116)
	at com.sas.services.connection.platform.PlatformConnectionFactory.getConnection(PlatformConnectionFactory.java:94)
	at com.sas.services.storedprocess.ConnectionMaker.doMakeConnection(ConnectionMaker.java:117)
	at com.sas.services.storedprocess.ConnectionMaker.makeConnection(ConnectionMaker.java:61)
	at com.sas.services.storedprocess.Execution2.makeConnection(Execution2.java:330)
	... 57 more
Caused by: org.omg.CORBA.COMM_FAILURE: The application could not log on to the server "crpra00a0021.wellsfargo.com:8601". No server is available at that port on that machine.  vmcid: 0x0  minor code: 1  completed: No
	at com.sas.iom.orb.brg.Engine$5.run(Engine.java:3416)
	at java.security.AccessController.doPrivileged(Native Method)
	at com.sas.iom.orb.brg.Engine.flowConnect(Engine.java:3490)
	at com.sas.iom.orb.brg.Engine.flow(Engine.java:658)
	at com.sas.iom.orb.brg.Engine.initClient(Engine.java:622)
	at com.sas.iom.orb.brg.ORBImpl.uri_to_object(ORBImpl.java:119)
	at com.sas.services.connection.ClusterEnvelope.createObject(ClusterEnvelope.java:278)
	at com.sas.services.connection.ClusterEnvelope.getConnection(ClusterEnvelope.java:73)
	... 66 more
Caused by: java.net.ConnectException: Connection refused
	at sun.nio.ch.Net.connect(Native Method)
	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:500)
	at com.sas.iom.orb.brg.Engine$5.run(Engine.java:3399)
	... 73 more

Re: Stored Process Error

JuanS_OCS — Wed, 22 Nov 2017 10:24:20 GMT

Hello @avinashginjupal,

I would definitely check it the SAS metadata's sastrust@saspw or the OS' sassrv account are ok on the password, or just locked out.

Also, I think perhaps it would be an idea to involve SAS Technical Support, since they can see/touch your system safely.

Re: Stored Process Error

avinashginjupal — Wed, 22 Nov 2017 10:29:12 GMT

I feel passwords are not causing the issue here, something in the background that makes connections to required services is not working properly.

I feel the ports we are trying to call are not listening to application