topic Re: how to copy files from sub directory.. in SAS Procedures

how to copy files from sub directory..

nikhilwagh — Sat, 21 Nov 2015 09:52:29 GMT

Hello friends,

Recently I'm working on a task where I need to take backup of all files which are generated as output from the main program to a new folder like Backup_2015 etc.

my folder structure is like below -

E:\TEST DATA\2015

folder 2015 contains following files in it -
1. adomsg.sas7bdat
2. ADOMSG.XPT
3. Report_2015.rtf
4. DOMAIN_XPT.LOG and
5. QC folder which again contains 3 files -
a. notes.txt
b. QC_report.xlsx
c. Report.pdf

now my task is to take a backup these files by making a new folder in 2015 folder naming like Backup_2015(current year) and copy the contents of 2015 folder to it.

I have achieved the half milestone by below program however I'm not able to create "QC" folder and copy it's contents to newly created folder i.e. Backup_2015.

/* SET THE OPTIONS */
OPTIONS MLOGIC MPRINT SYMBOLGEN;


%macro copyit(in=,out=);
filename in "&in";
filename out "&out";

/* copy the file byte-for-byte  */
data _null_;
  length filein 8 fileid 8;
  filein = fopen('in','I',1,'B');
  fileid = fopen('out','O',1,'B');
  rec = '20'x;
  do while(fread(filein)=0);
     rc = fget(filein,rec,1);
     rc = fput(fileid, rec);
     rc =fwrite(fileid);
  end;
  rc = fclose(filein);
  rc = fclose(fileid);
run;
 
filename in clear;
filename out clear;
%mend copyit;
/* Path for the source folder */
%let infolder=E:\TEST DATA\2015;
%let prot=backup; 
data dnam; 
rc=filename("mydir","&infolder"); /* create fileref */ 
did =dopen("mydir"); /* open folder */ 
f_name1=catx("_","&prot",(put(year(today()),best.)));
outfolder=dcreate(f_name1,"&infolder");/* create backup_<year> folder */
if did > 0 then
do i=1 to dnum(did);
file_name= dread(did,i);
infolder=catx("\","&infolder",dread(did,i)); /* read item name */
outfolder=catx("\","&infolder",f_name1,file_name) ;
output;
end;
rc=dclose(did); /* close folder */  
run;

/* create macro variable for input and out folder */
data _null_(drop=rc did f_name1 i);
	set dnam
	(where=(upcase(compress(f_name1))^=upcase(compress(file_name)))) end=eof;
	cnt+1;
	call symputx('infile'||LEFT(PUT(_N_,8.)),infolder);
	call symputx('outfile'||LEFT(PUT(_N_,8.)),outfolder);
	IF EOF THEN CALL SYMPUTX('CNT',PUT(_N_,8.));
run;

/* copy file one by one */
%macro doit;
	%do i=1 %to &cnt;
	%copyit(in=&&infile&i,out=&&outfile&i);
	%end;
%mend doit;

%doit

Please help me to get this rigth.

Thanks in Advance!

- Nikhil

Re: how to copy files from sub directory..

kannand — Sat, 21 Nov 2015 12:52:17 GMT

Is the directory structure you have mapped as "E-drive" a NAS mount with an underlying Unix environment or is this a pure windows environment? If it is Unix, a simple shell script could accomplish the task without a need for a lengthy and complex coding.

Re: how to copy files from sub directory..

nikhilwagh — Sun, 22 Nov 2015 07:45:49 GMT

Hi Kannad,
thanks for you quick response. I'm testing these codes on Windows only however I need to release final SAS program to work on Unix environment. I will be very grateful if you explain me how to achive it with simple shell scripting.
Thanks.
- Nikhil

Re: how to copy files from sub directory..

kannand — Sun, 22 Nov 2015 10:00:49 GMT

I'm not an expert on Unix but this should work... The following would be the contents of your .sh file

echo "starting backup process"
mkdir ./2015bk
mv ./2015/* ./2015bk
echo "Backup complete. The files have been copied. Please verify !"

Note: This just creates a directory called 2015bk and copies the originals. The original copies remain in the source as well. If you need the original files or folders removed, you need to modify this to include a line performing the "rm" command to clear the files.

Hope this helps... Good Luck...!!!

Re: how to copy files from sub directory..

kannand — Sun, 22 Nov 2015 10:09:16 GMT

forgot to mention....The script assumes that the folder 2015 is available in the directory where the script is located and running... It will create a 2015bk folder in the same location where you have 2015 folder. If you need to run the copy from a different location, you need to specify the entire path in place of the "."

Re: how to copy files from sub directory..

nikhilwagh — Sun, 22 Nov 2015 13:37:50 GMT

Hey Kannad,
Your help is really appreciated, but I want to ask that can we added these codes in SAS program instead running it in Unix script or run manually?

I want SAS to do this work for me as we are running single SAS program like
cd dmenv/dmwork/abc/ sas myprogram.sas

Also I'm not much familiar with UNIX and scripting etc.

I hope you understand it :).

Thanks again!
- Nikhil

Re: how to copy files from sub directory..

kannand — Sun, 22 Nov 2015 14:35:22 GMT

Nikhil - refer to the URL below, you'll get a better idea as it gives some theoritical background on how to do the same...

http://support.sas.com/documentation/cdl/en/hostunx/61879/HTML/default/viewer.htm#xcomm.htm

Focus on this example in the document specifically that calls the macro pwdls: You can clone this to your requirement with the commands I gave you in the sh script earlier...

%macro pwdls;
%sysexec %str(pwd;ls -l);
%mend pwdls;
%pwdls;

Replace this line

%sysexec %str(pwd;ls -l);

to show something like

%sysexec %str(mkdir ./2015bk;mv ./2015/* ./2015bk);

Hope this helps... Good Luck...!!!

Re: how to copy files from sub directory..

kannand — Sun, 22 Nov 2015 14:50:09 GMT

As mentioned yesterday for the script, this code will work if you have and run the sas program in the same directory as the folder named 2015. If not, you need to code the entire path in the %str() instead of referring to the current directory using a "."

Hope this makes sense. You may also need to refer to Unix help online just to get an idea of the Unix commands and the parameters used. This may help getting started...

https://kb.iu.edu/d/afsk

There are plenty of online resources that can help learning Unix commands.

Good Luck...!!!

Re: how to copy files from sub directory..

RW9 — Mon, 23 Nov 2015 09:50:58 GMT

Alternatively, use version control software - which is what its created for. After each run commit the folder to the repository and it is there for good. Why go through all the effort of creating code to create multiple back up folders (which may or may not work depending on how robust your code is), then have to faff about with lots of folders/files including duplicates etc. when there is pre-built software to do it for you? At worst case scenario your IT group should have a backup setup already.