topic Re: Parallel processing and variables in SAS Programming

Parallel processing and variables

JeffM — Sat, 03 Aug 2019 12:58:19 GMT

Hi,

I have setup a process that parallel processes 8 programs to pull a lot of data. However, I have to maintain all of the variables in each one going forward (this is a monthly thing).

Is there a way to create 1 master program with all of the variables and share them across programs when running? I understand each program uses its own instance of SAS so I am thinking no.

Thanks

Jeff

Re: Parallel processing and variables

Astounding — Sat, 03 Aug 2019 14:34:06 GMT

Save the variable names in a permanent SAS data set. It should be quick and easy for each program to extract the list of variable names, and it makes for easy maintenance if you decide to add a variable name to the list.

Re: Parallel processing and variables

JeffM — Sat, 03 Aug 2019 14:39:27 GMT

Thanks! I'll look into that

Re: Parallel processing and variables

JeffM — Wed, 07 Aug 2019 11:58:06 GMT

The SAS guru at my company finally got back to me with the hookup! She said to use an "environment" node to handle everything.

In the environment program:

options presenv

filename env "filepath"

lib statements

Let statements

etc

proc presenv permdir=mylib (assuming you created this earlier) sascode=env;

run;

In each subsequent node you just need to put:

filename myenv "filepath for env file above";

%include myenv;

the filename in the child nodes need to be different than the master one (myenv vs env)

Cheers!

Jeff