Hi, I am using SAS University Edition and trying to get names of all the file available in a Folder (Folder inside Shared Folder). So that, I can prepared a Macro to import and append all the data sets in one. I need help to get names for all the CSV files available in my Folder.
data filenames;
length fref $8 fname $200;
did = filename(fref,'/folders/myfolders');
did = dopen(fref);
do i = 1 to dnum(did);
fname = dread(did,i);
output;
end;
did = dclose(did);
did = filename(fref);
keep fname;
run;
Please post your question as a self-contained data step in the form of "have" (source) and "want" (desired results). I won't contribute to your post if I can't cut-and-paste your syntactically correct code into SAS.
I do this enough to have a macro for it. There are some dependencies on other macros I've written. You can try it yourslef :
/* Get the necessary macro files */
filename getmacro url "https://raw.githubusercontent.com/SASJedi/sas-macros/master/exist.sas";
%include getmacro;
filename getmacro url "https://raw.githubusercontent.com/SASJedi/sas-macros/master/fileattribs.sas";
%include getmacro;
filename getmacro url "https://raw.githubusercontent.com/SASJedi/sas-macros/master/translate.sas";
%include getmacro;
filename getmacro url "https://raw.githubusercontent.com/SASJedi/sas-macros/master/findfiles.sas";
%include getmacro;
/* Get syntax help in the log */
%FindFiles(?)
/* List files in the s:/workshop and all sub-folders, save as a SAS data set */
%FindFiles(s:/workshop,,work.myFiles)
data filenames;
length fref $8 fname $200;
did = filename(fref,'/folders/myfolders');
did = dopen(fref);
do i = 1 to dnum(did);
fname = dread(did,i);
output;
end;
did = dclose(did);
did = filename(fref);
keep fname;
run;
It first creates a file reference for the directory (FILENAME), opens the directory and creates a handle (DOPEN), and then loops over all (DNUM) entries in the directory and reads each (DREAD). At the end, it deassigns the handle and the file reference.
I recommend studying the documentation of all these functions.
I wrote a macro that allows recursive functionality and adds FINFO data. This works on both Windows and Linux, even when the X statement cannot be used. On LSAF, the datetime stamps are moot since the file is copied to the transient directory.
No doubt and I did not search, but it might make a suitable SUG paper if one does not already exist or does not have some functionalities. I use it quite frequently. I have read entire directories in minutes, which is fast given the structure and volume, but I am sure it could be faster.
%macro list_files(dir,ext);
%local filrf rc did memcnt name i;
%let rc=%sysfunc(filename(filrf,&dir));
%let did=%sysfunc(dopen(&filrf));
%if &did eq 0 %then %do;
%put Directory &dir cannot be open or does not exist;
%return;
%end;
%do i = 1 %to %sysfunc(dnum(&did));
%let name=%qsysfunc(dread(&did,&i));
%if %qupcase(%qscan(&name,-1,.)) = %upcase(&ext) %then %do;
%put &dir\&name;
%end;
%else %if %qscan(&name,2,.) = %then %do;
%list_files(&dir\&name,&ext)
%end;
%end;
%let rc=%sysfunc(dclose(&did));
%let rc=%sysfunc(filename(filrf));
%mend list_files;
%list_files(c:\temp,sas)
This macro looping would be orders of magnitude slower than using corresponding functions in a data step, although it does have the benefit of being recursive.
Please post your question as a self-contained data step in the form of "have" (source) and "want" (desired results). I won't contribute to your post if I can't cut-and-paste your syntactically correct code into SAS.
I know It's been done (to death😎) But for such a simple request it's nice to provide the simple solution: Read all csv files in one folder into one dataset..... Data resultDS( compress= yes) ; Length file filename col1-col100 $300 ; INFILE "yourfolder/?*.csv" lrecl= 32000 dsd filename= file truncover ; Input col1-col100 ; Filename=file ; Run ;
That is a simple approach if the number of files is small and the file sizes are also small. It is a good demonstration. For a single level, i.e. not recursive, Kurt snippet is a great approach. Have you tried this with other file formats, life PDF? I suspect it would still work. I also wonder about using *.*?
