BookmarkSubscribeRSS Feed
rsb7678
Calcite | Level 5
Hi

Have little knowledge on Submitting background jobs in Unix.
We have a script that run automatically as soon as the data gets updated.
I parallel process a job into three parallel process, see below. Each is independent of the other, uses different input files but follows the same logic in generating the output datasets.

script_file:

nohup sas9 /pgms_rx/process1_v2.sas &
nohup sas9 /pgms_rx/process2_v2.sas &
nohup sas9 /pgms_rx/process3_v2.sas &

I would like to run another sas program that convers the output of all these three processes into a single pipe delimited zipped file. I did wrtie a program to do this .
but how can i automate it, i.e., include it in the script file. Once all the above three process generate output datasets successfully run the pipe_delimited.sas program that generated the desired output.

Let me know if you have further questions.
Thank you.
RB
1 REPLY 1
sbb
Lapis Lazuli | Level 10 sbb
Lapis Lazuli | Level 10
A few techniques come to mind, however I found a technical conference paper at the SAS support http://support.sas.com/ website which discusses parallel processing. And for your successor SAS program, you can use a technique that detects the presence (or lack) of "gate" file(s), such that when all are present you proceed with your follow-on SAS program execution.

Or, maybe your enterprise already has a job scheduler specifically for this purpose - maybe ask around.

Regardless, I'm sure you can find a suitable tool/technique with SAS - take advantage of the support website and its resources.

Scott Barry
SBBWorks, Inc.

Parallel Processing on the Cheap: Using Unix Pipes to Run SAS® Programs in Parallel
Ted Conway, Ted Conway Consulting, Inc., Chicago, IL
http://www2.sas.com/proceedings/sugi28/114-28.pdf

SAS Innovate 2025: Register Now

Registration is now open for SAS Innovate 2025 , our biggest and most exciting global event of the year! Join us in Orlando, FL, May 6-9.
Sign up by Dec. 31 to get the 2024 rate of just $495.
Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 1 reply
  • 874 views
  • 0 likes
  • 2 in conversation