topic Submit Code/Job to Specific Node under SAS GRID Environment in SAS Enterprise Guide

Submit Code/Job to Specific Node under SAS GRID Environment

Ravikishore — Thu, 02 Jan 2020 10:02:15 GMT

Hello All,

I would like to run piece of code using SAS Enterprise Guide and code should be run on specific node. Could some one help me with code?

Re: Submit Code/Job to Specific Node under SAS GRID Environment

tomrvincent — Thu, 02 Jan 2020 18:17:26 GMT

Why would you want to do that?

Re: Submit Code/Job to Specific Node under SAS GRID Environment

Patrick — Fri, 03 Jan 2020 18:51:33 GMT

@Ravikishore wrote:

Hello All,

I would like to run piece of code using SAS Enterprise Guide and code should be run on specific node. Could some one help me with code?

I believe that's only possible in batch so you would need to start a SAS program in batch out of a SAS EG session (i.e. by using an X command).

SASGSUB as documented here is what you need to start the SAS batch job against the Grid. You will need to ask your SAS admin what you're allowed to do and which queu to use.

@tomrvincent

The one use case I know of is in an environment where a small percentage of jobs require a lot of memory. For cost reasons only one of the grid nodes has been set-up with such an amount of memory.

Re: Submit Code/Job to Specific Node under SAS GRID Environment

tomrvincent — Fri, 03 Jan 2020 20:07:32 GMT

Since it's a grid it's going to use that node anyway.

Re: Submit Code/Job to Specific Node under SAS GRID Environment

Patrick — Fri, 03 Jan 2020 20:22:47 GMT

@tomrvincent wrote:
Since it's a grid it's going to use that node anyway.

Not necessarily. Only because this node has more CPU's and memory doesn't mean it got always more available resources.

These are multi-threaded processes so a few jobs only can keep the whole node already rather busy.

Re: Submit Code/Job to Specific Node under SAS GRID Environment

tomrvincent — Mon, 06 Jan 2020 12:52:40 GMT

Then it's a poorly designed grid. Having the bulk of CPUs or memory in one node defeats the entire purpose of distributed processing.

Re: Submit Code/Job to Specific Node under SAS GRID Environment

Patrick — Mon, 06 Jan 2020 13:32:04 GMT

@tomrvincent wrote:
Then it's a poorly designed grid. Having the bulk of CPUs or memory in one node defeats the entire purpose of distributed processing.

@tomrvincent

Sorry but you're really missing the point:

This is AWS and you pay for the size of an instance (a node) per time you use it. There is a small percentage of jobs which need an "excessive" amount of memory during month end processing. These jobs get submitted using a lsf queue which only points to this one node with more memory. Other jobs use the full grid. Once month end processing is done the grid node with the "excessive" memory gets replaced with a cheaper AWS instance.

Re: Submit Code/Job to Specific Node under SAS GRID Environment

tomrvincent — Mon, 06 Jan 2020 17:20:40 GMT

Nobody can 'miss a point' that was never even mentioned. This has nothing to do with AWS at all. If it is, that's a different matter. This is about running EG grid. I've been doing that for years on Linux.

Re: Submit Code/Job to Specific Node under SAS GRID Environment

ErikLund_Jensen — Mon, 06 Jan 2020 18:06:19 GMT

Hi @Ravikishore

It can be done, but you need an extra server-context which bypasses the grid manager /LSF. You could then connect to that server-context from EG using the designated port number.

Setting up an extra server context isn't among the daily routines for a local SAS administrator, so it is a good idea to leave it to your SAS technical consultant or whoever was responsible for your SAS Grid installation in the first place.