topic Re: macro to create data sets from txt files in multiple folders. in SAS Programming

macro to create data sets from txt files in multiple folders.

MUABer — Thu, 01 Feb 2018 02:57:08 GMT

I am using the macro at the link below.

http://support.sas.com/kb/45/805.html

It runs fine as-is, but I need to put an infile statement in it to output SAS data sets for each txt file found.

I do not seem to be able to get that to run. Below is macro with my infile. I have tried many ways, but must be making some basic mistake. Please help. Thanks.

%macro drive(dir,ext);
%local filrf rc did memcnt name i;

/* Assigns a fileref to the directory and opens the directory */
%let rc=%sysfunc(filename(filrf,&dir));
%let did=%sysfunc(dopen(&filrf));

/* Make sure directory can be open */
%if &did eq 0 %then %do;
   %put Directory &dir cannot be open or does not exist;
   %return;
%end;

   /* Loops through entire directory */
   %do i = 1 %to %sysfunc(dnum(&did));

     /* Retrieve name of each file */
     %let name=%qsysfunc(dread(&did,&i));

%let x = %sysfunc(tranwrd(&name,.,_));
%let dt = %sysfunc(compress(%superQ(x),%str(%(%))));

     /* Checks to see if the extension matches the parameter value */
     /* If condition is true print the full name to the log        */
      %if %qupcase(%qscan(&name,-1,.)) = %upcase(&ext) %then %do;
      %put &dir\&name;
%put &dt;
*%put &x;
%put &i;

data &dt.&i;
           *set &name;*(keep=path filename txtcount txtc ID);
   *if line ^= "" then do;* change these numbers as needed with do loop;
   *fulldt=trim(left(path))||"\"||trim(left(filename));
   *length line $ 100;
      *informat line $char100.;* change to longer line if needed (was $char155.) *;
infile "&dir\&name" truncover;
    *infile in filevar=fulldt end=done truncover firstobs = 28;
    *do until(done);
    *input line & 1-100;
input line $ 1-100;
   *output;
    *end;
   *end;
*proc print data=&dt.&i(obs=4);title2 "&dt.&i";
run; title2;

      %end;
     /* If directory name call macro again */
     %else %if %qscan(&name,2,.) = %then %do;
        %drive(&dir\%unquote(&name),&ext)
      %end;

   %end;

/* Closes the directory and clear the fileref */
%let rc=%sysfunc(dclose(&did));
%let rc=%sysfunc(filename(filrf));
%mend drive;
/* First parameter is the directory of where your files are stored. */
/* Second parameter is the extension you are looking for.           */
%drive(C:\folder,txt) ;

Re: macro to create data sets from txt files in multiple folders.

Astounding — Thu, 01 Feb 2018 06:25:30 GMT

You're looking at vital information that you didn't share. For example ...

Did the %PUT statements write out anything at all?

If so, was it correct?

Did you get an error message?

If so, what was it? Was it a macro error vs. a SAS error?

Did you make any changes to the code before the %DO loop begins?

Do you have a log where you turned on key debugging options:

options symbolgen mprint mlogic;

Re: macro to create data sets from txt files in multiple folders.

MUABer — Thu, 01 Feb 2018 15:33:17 GMT

The %Put does correctly write all the path/files to the log. No ERRORs were generated.

If I use %Include all the files data is written to the output window, but the format is not usable. Sometimes data lines are one line per row and some times it may be multiple lines of data per row.

The data has some header lines and then the data itself is rows of comma delimited numbers.

Maybe a %symput can be used to write all the path/files to a data set?

Re: macro to create data sets from txt files in multiple folders.

Reeza — Thu, 01 Feb 2018 16:00:59 GMT

Try this one instead:

https://github.com/statgeek/SAS-Tutorials/blob/master/Import_all_files_one_type

Re: macro to create data sets from txt files in multiple folders.

ballardw — Fri, 02 Feb 2018 00:03:10 GMT

Did you run your code with

Options mprint symbolgen mlogic;

which are basic debugging tools for code involving macros to show you in detail what the macro language is doing?

Second:

Do not use the inline comment style such as on this line

*set &name;*(keep=path filename txtcount txtc ID);

inside macros.

Single line comments in the macro language are

%*set &name; %*(keep=path filename txtcount txtc ID);

/*set &name; */ /*(keep=path filename txtcount txtc ID);*/

Personally I only use /* */ style comments so I don't have to worry about the differences

AND the editor will comment / uncomment entire lines with the ctrl-/ and shift-ctrl-/ key strokes.

Re: macro to create data sets from txt files in multiple folders.

MUABer — Thu, 01 Feb 2018 20:13:53 GMT

That was a great help!

Thank you!