topic Re: import multiple .dat files in one step in New SAS User

import multiple .dat files in one step

dht115 — Wed, 12 Jan 2022 21:57:02 GMT

Hello,

I have two separate .dat files. I need to import files by using DATA and INFILE statements.

Both files have same variables different values.

Is there a way for me to import two files so I can use same length, format options (reduce program size).

Re: import multiple .dat files in one step

Tom — Wed, 12 Jan 2022 22:08:58 GMT

Yes.

If the names are similar (and unique) just use a wildcard in the filename.

infile 'myfiles*.dat' ....

Define a fileref that points to both files and use the fileref in the INFILE statement.

filename mydata ('file1.dat','file2.dat') ;
...
infile mydata ...

Or create a dataset with the list of files and use the FILEVAR= option on the INFILE statement. So if you have a dataset name FILELIST with a variable named FILENAME then use code like:

data want;
  set filelist ;
  infile dummy filevar=filename end=eof;
  do while (not eof);
     input .... ;
     ...
     output;
  end;
run;

Re: import multiple .dat files in one step

Reeza — Wed, 12 Jan 2022 22:09:25 GMT

For sure!

However there are some things to consider:

Headers in each file?
How do you know which record a file comes from - do you need this information?
Do you need separate files for each file or a single file?

Rough outline is here:

https://communities.sas.com/t5/SAS-Communities-Library/How-do-I-write-a-macro-to-import-multiple-text-files-that-have/ta-p/223627

@dht115 wrote:

Hello,

I have two separate .dat files. I need to import files by using DATA and INFILE statements.

Both files have same variables different values.

Is there a way for me to import two files so I can use same length, format options (reduce program size).

Re: import multiple .dat files in one step

dht115 — Wed, 12 Jan 2022 22:13:32 GMT

I have two separate .dat files and need to create two separate dataset.

both .dat files have different name

both dataset needs to have different name.

Re: import multiple .dat files in one step

Reeza — Wed, 12 Jan 2022 22:20:27 GMT

Then wrap the code into a macro? You can write a data step that handles this but a macro would be easier.

Tutorial on converting a working program to a macro

This method is pretty robust and helps prevent errors and makes it much easier to debug your code. Obviously biased, because I wrote it 🙂 https://github.com/statgeek/SAS-Tutorials/blob/master/Turning%20a%20program%20into%20a%20macro.md

Replace the inner code with working code for one data set and then it generalizes. Honestly, for just two files I'd probably copy and paste (rough guideline is if you repeat it 3 times or more, then generalize).

%macro import_dat_file(path=, out=);

data &out;
infile "&path" dsd truncover;
input ........;


run;


%mend;

%import_dat_file(path=/pathtofile1/myfile1.dat, out=data1);
%import_dat_file(path=/pathtofile1/myfile2.dat, out=data1);