topic Re: Parallel Processing in SAS in SAS Programming

Parallel Processing in SAS

Aexor — Wed, 19 May 2021 10:44:34 GMT

Few Question in optimization :-

1. how can we achieve Parallel Processing in SAS.?

2. How can be solve space issue after executing a program in sas

3. how can we optimize a process involves in reading sas data set ?

Already tried compress, keep,drop, data _null_

4. Latency in SAS.

these are few questions i came across, i am looking for any suggestion or documentation which talks about these topics.

Thanks!

Re: Parallel Processing in SAS

Kurt_Bremser — Wed, 19 May 2021 11:38:15 GMT

Enterprise Guide allows the use of parallel SAS sessions within a project. And a lot of SAS procedures support multithreading out of the box, especially SQL

On the storage side, using SPDE libraries can speed up I/O massively.

Space issues are dependent on the data you have to use. Some rules of thumb:

Reduce data early. Only keep variables and observations that are needed later.
Summarize data early, where appropriate.
Use compression (selectively).
Remove intermediate tables when they are no longer needed.

To optimize a process, the good doctor has to get to know it. So we need to see a code piece that eats lots of time and space to make suggestions for improvement. Also do not forget to add information about the data involved (variable sizes, observation numbers).

Define "latency". Latencies are found in network connections, storage, and a gazillion of other things.

Re: Parallel Processing in SAS

Aexor — Wed, 19 May 2021 12:04:33 GMT

Thanks much!! It's very helpful

Re: Parallel Processing in SAS

yabwon — Wed, 19 May 2021 12:24:08 GMT

About: "1. how can we achieve Parallel Processing in SAS.?"

If you have XCMD turned-on on your SAS you can check out my little tutorial about running code in parallel in SAS:

https://pages.mini.pw.edu.pl/~jablonskib/SASpublic/Parallel-processing-in-BASE-SAS.sas

If you have any questions on that material let me know.

All the best

Bart

Re: Parallel Processing in SAS

Aexor — Wed, 19 May 2021 13:19:01 GMT

Thanks much!

Re: Parallel Processing in SAS

SASKiwi — Wed, 19 May 2021 20:41:19 GMT

Parallel processing is also possible using SAS/CONNECT. Refer to the SAS/CONNECT documentation for more details.