topic Re: Compile file names into a single batch file in SAS Programming

Compile file names into a single batch file

KateM — Thu, 14 May 2015 20:13:14 GMT

I used SAS to create 60,000 flexMIRT syntax files for a simulation study. Now I need to compile those file names into a single csv batch file. I've created the batch macro below but I keep overwriting the batch file instead of amending it as I try and loop through the file names. I think I need to create a DO loop within the batch macro. The batch file should look like:

C:\Users\KMarino\300_10_0.11_10_1.flexmirt

C:\Users\KMarino\300_10_0.11_10_2.flexmirt

C:\Users\KMarino\300_10_0.11_10_3.flexmirt

......

C:\Users\KMarino\300_10_0.11_10_250.flexmirt

.....

C:\Users\KMarino\1000_10_0.11_10_1.flexmirt

.....

C:\Users\KMarino\300_10_0.11_10_250.flexmirt

How can I modify the macro below to appropriately compile all the files?

%MACRO batch(I=, ss=, cl=, bv=, it=, rep=);

DATA _NULL_;

FILE "C:\Users\KMarino\Dropbox\Dissertation\Data Generation\For Dissertation\SAS Control Files\flexMIRTsim.BATRUN.csv";

PUT #&I @1 "C:\Users\KMarino\&ss._&cl._&bv._&it._&rep..flexMIRT"

;

RUN;

%mend batch;

data _null_;

DO ss=300, 1000, 5000;

DO cl=10, 60, 100, 150;

DO it=10, 20, 50, 70;

DO BV=0.053, 0.11, 0.25, 0.43, 1.00

DO it=10, 20, 50, 70;

Do rep=1 to 250;

_N_+1;

call execute (catt('%batch (I='|| put(_N_+1,2.)||', ss=', ss ,', cl=', cl ,', bv=',bv,', it=',it,', rep=',rep,')')) ;

end;

run;

Re: Compile file names into a single batch file

ballardw — Thu, 14 May 2015 21:40:58 GMT

If this a program that will run under SAS it may be easier to use something like:

%include "C:\Users\KMarino\*.flexmirt";

Re: Compile file names into a single batch file

sbb — Thu, 14 May 2015 22:59:58 GMT

Add the operand "MOD" to your FILE statement - it will be ignored by SAS on the first execution of the invoked DATA _NULL_ step.

Scott Barry
SBBWorks, Inc.

Re: Compile file names into a single batch file

dkb — Fri, 15 May 2015 01:02:57 GMT

Alternatively it could be done in a single data step without using a macro, something like this :

data _null_;

FILE "C:\Users\KMarino\Dropbox\Dissertation\Data Generation\For Dissertation\SAS Control Files\flexMIRTsim.BATRUN.csv";

DO ss='300', '1000', '5000';

DO cl='10', '60', '100', '150';

DO it='10', '20', '50', '70';

DO BV='0.053', '0.11', '0.25', '0.43', '1.00';

DO it='10', '20', '50', '70';

Do rep=1 to 250;

string= compress('C:\Users\KMarino\' !! ss !! '_' !! cl !! '_' !! bv !! '_' !! it !! '_' !! put(rep, 3.) !! '.flexMIRT', ' ');

PUT @1 string;

end;

run;

Re: Compile file names into a single batch file

KateM — Fri, 15 May 2015 12:43:22 GMT

This worked perfectly except it compressed the file name and deleted the spaces. The true path is C:\Users\KMarino\Dropbox\Dissertation\Data Generation\For Dissertation\Simulation Syntax\filename.flexMIRT.

It deleted the space between "Data Generation", "For Dissertation" and "Simulation Syntax". Is there a way to avoid that?

Re: Compile file names into a single batch file

data_null__ — Fri, 15 May 2015 13:10:16 GMT

You might thing about what is happening when you COMPRESS.

Re: Compile file names into a single batch file

Tom — Fri, 15 May 2015 16:16:21 GMT

1) Why not make the list while you make the files? Either as a data set or into the text file.

2) Since you already have the files why not just use DIR command to get the list? Does the order matter? And if so is it different than the order that DIR will return.

data _null_;

file

"C:\Users\KMarino\Dropbox\Dissertation\Data Generation\For Dissertation\SAS Control Files\flexMIRTsim.BATRUN.csv";

infile 'dir /b C:\Users\KMarino\*.flexmirt' pipe;

input;

put _infile_;

run;

Re: Compile file names into a single batch file

jakarman — Fri, 15 May 2015 17:04:12 GMT

Use the mod option with the file-statement when you do not want to overwrite but append the csv file SAS(R) 9.4 Statements: Reference, Third Edition

Re: Compile file names into a single batch file

KateM — Mon, 18 May 2015 14:53:42 GMT

Thanks for all the suggestions! The MOD statement worked after some further modification of the original syntax but now I've also learned some new commands from the other suggestions. Thanks so much for the help!