In traditional SAS/Connect
I need to copy a dataset from a client to a remote server using a remote libname
is slow, so is Proc SQL
Ihe datastep only runs on one core (out of 40 available) - right? But PROC SQL should be able to run on eg 4 cores. But the elapse time in the saslog is almost the same. THREADS is enabled and CPUCOUNT=4 in config.
Why is SQL not faster than Data?
Bandwith is about 10Gb/s
According to this, it looks like the PROC SQL only uses multi-threading for group by and order by clauses:
Another issue could be the bandwidth not being 10Gb/s all the way between the two servers, but as the cpu time in the log is significant compared to real time in both cases, I guess it has to do with single-threading.
Not sure how to overcome the issue apart from hardcode the input into chunks, and transfer them seperately in parallel.
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.