topic Re: read multiple txt files automatically in SAS Data Management

read multiple txt files automatically

wutao9999 — Fri, 08 Jan 2016 18:37:30 GMT

I have a data file as attached. The below is the code to revise the data.

data want;

infile 'C:\Users\AAB006.txt' lrecl=30000;

input;

x=countw(_infile_);

do i=1 to x;

Num=scan(_infile_, i, " ");

output;

end;

drop i x;

run;

My next challenge is that: There are thousands of such files in a folder. Is there way that the SAS code can automatically get the files' names, and process each of them automatically, rather than manually do it one by one. Appreciate your help.

Re: read multiple txt files automatically

LinusH — Fri, 08 Jan 2016 18:42:33 GMT

One alternative is to use an aggregate file location for you filename.

Re: read multiple txt files automatically

Reeza — Fri, 08 Jan 2016 18:53:11 GMT

Yes, search on here. The method is typically:

Get list of file names into data set. This can be done via OS commands typically, ie dir on windows and ls on Unix.
Use the filevar option on the infile statement to specify that the input data set will provide variable names.

If you need one output file per text file you can use the method here.

https://communities.sas.com/t5/General-SAS-Programming/Importing-several-files-into-SAS/m-p/242170#M35014

There are other solutions listed on the forum as well.

https://communities.sas.com/t5/SAS-Communities-Library/How-do-I-write-a-macro-to-import-multiple-text-files-that-have/ta-p/223627

Re: read multiple txt files automatically

Tom — Fri, 08 Jan 2016 19:07:52 GMT

Use the FILENAME option on the INFILE statement.

Here is an example that will keep the name and also number the files, the rows and column location within the row.

data want ;
  length filename fn $200 ;
  infile '*.txt' filename=fn eov=eov length=ll column=cc truncover ;
  fileno+1;
  do row=1 by 1 until (eov) ;
    do col=1 by 1 until (cc>ll);
       input num @ ;
       filename=fn ;
       output;
    end;
    input;
   end;
run;

Re: read multiple txt files automatically

wutao9999 — Fri, 08 Jan 2016 19:23:05 GMT

I really love Tom's answer. So simple, but perfectly match my needs.