topic Re: What is the fastest way to download sas data to local desktop? in SAS Programming

What is the fastest way to download sas data to local desktop?

afiqcjohari — Tue, 14 Mar 2017 03:55:22 GMT

I have this routine whereby I need to analyze data from the server.

However, I find that doing the analysis locally is much more pleasant than using the server.

What's the best way to download the a sas data to a local folder?

*connection to server;
rsubmit;
 proc sql;
   create table tolocal as 
   select * from servertable
   where <conditions>
 ;quit;
endrsubmit;
* tolocal is now in Rwork;

*define local folder on desktop;
libname mylocal "C:\Users\Working folder";

*download data to mylocal;
data mylocal.tolocal; set rwork.tolocal;run;

Is it possible to do everything within rsubmit?

It seems that I can't define the local folder within rsubmit..

Re: What is the fastest way to download sas data to local desktop?

Reeza — Tue, 14 Mar 2017 04:04:24 GMT

It depends. Sometimes the desktop and server have different modules licensed. For example we had SAS IML on desktops but not server... not sure why. Most things should be able to run on the server and should be faster since they're typically much faster machines. Sometimes network speed can mess that up though. It does require a small shift in how you work but once you figure it out it's significantly faster.

No you can't define a local folder on the server, you need to give it a location the server has access to, somewhere on the server or a shared drive.

Re: What is the fastest way to download sas data to local desktop?

afiqcjohari — Tue, 14 Mar 2017 04:06:47 GMT

I concur about the different modules. Though for this exercise, I've no need to worry about it... Yet.

Anyways, is proc download a better alternative to data;set;run?

Re: What is the fastest way to download sas data to local desktop?

Reeza — Tue, 14 Mar 2017 04:14:01 GMT

Yes, because data steps read each line and proc download or even proc copy can move the data in blocks.

A datastep could create new variables or change the dataset somehow. If none of this is occurring a different method is more efficient.

Re: What is the fastest way to download sas data to local desktop?

SASKiwi — Tue, 14 Mar 2017 06:54:34 GMT

Since you have both PC SAS and server SAS you could download your SAS data using PROC DOWNLOAD which has the smarts to know about your local LIBNAMEs:

rsubmit;

proc download data = tolocal
              out = mylocal.tolocal;
run;

endrsubmit;

Re: What is the fastest way to download sas data to local desktop?

afiqcjohari — Tue, 14 Mar 2017 07:38:28 GMT

Thanks for the PROC DOWNLOAD tips.
Save me a bunch of time 🙂

Re: What is the fastest way to download sas data to local desktop?

afiqcjohari — Tue, 14 Mar 2017 07:38:43 GMT

Good explanation. Will bear in mind.

Re: What is the fastest way to download sas data to local desktop?

Oligolas — Tue, 14 Mar 2017 14:08:37 GMT

Hi,

on SAS/CONNECT non licensed Windows machines, one could use robocopy to perform the task.

Robocopy has the big advantage that it creates the output folder by its own and can also copy subdirectory files without further specifying them.

Consult robocopy /? in the command line for more details.

libname inLib "C:\TEMP\input Lib Folder";
libname outLib "C:\TEMP\output Lib Folder";
x "robocopy ""%sysfunc(pathname(inLib))"" ""%sysfunc(pathname(outLib))"" *.sas7bdat *.png /MIR";
/*
   interesting parameters:
   /PURGE
   /XF
   /XD
   /LOG:
*/

I would advise to use the compress option on SAS datasets whenever possible if you intend to regularly transfer a big amount of files over your network.

Re: What is the fastest way to download sas data to local desktop?

rogerjdeangelis — Tue, 14 Mar 2017 16:42:16 GMT

I always zip on the server and I like to use
Bruno Mueller's (binary copy with a large chunksize (ie32k)

Re: What is the fastest way to download sas data to local desktop?

afiqcjohari — Wed, 15 Mar 2017 01:26:56 GMT

I'm transferring file from the server to my local desktop. I don't think I can automate using robocopy as I need to open the cmd line.