Thanks for your response.   I successfully used the copy files task in SAS EG to copy *.csv  from  a shared folder on our network. So I can see all the CSV files have been loaded into my home directory in SAS EG,  which is visible to the to the SAS Server. Also our SAS runs on UNIX so the INFILE generated by File-->Import Data looks a bit different but it loads one .csv  all right. Also to add, I would not like the files to keep on loading all the files in the folder everyday. I want it to load the new ones that have been added and append to the one big SAS dataset having all the daily files loaded.     ... View more

Thank you novinosrin. I'm trying to read .CSV files  from my folder:  /home/username/ I'm unable to modify your code to read that.  New .csv files are added daily but I would not like to read all of the same files everyday. I want it to import only the newly added .csv files and append to the one BigFile.sas.   Thanks   ... View more

Thanks Tom,   I'm using SAS EG, so I'm able to import one .CSV into SAS successfully, which generates its own LENGTH, FORMAT & INFORMAT statements. After that I added your code below and replace  " input var1-var20" with the INPUT from the SAS EG generated code. I also replaced the first inpath with the correct path. When I run this code, it creates an empty dataset instead of the combined dataset that I'm looking for. I appreciate your assistance.  Thanks   %let inpath=C:\MyDataFolder; data bigfile;   length fname $256 ;   infile "&inpath\*.csv" filename=fname truncover;   input @;   if fname ne lag(fname) then delete;   input var1-var20; run; ... View more

Hi Tom, I run the code below but it returned no data. Actually the variables in the data are 20. Do I need to list all of them in place of Var1, Var2 & Var3? Also what does fname represent?   %let inpath=C:\MyDataFolder\ ; data bigfile;   length fname $256 ;   infile "&inpath\*.csv" filename=fname truncover;   input @;   if _n_=1 or (fname=lag(fname) ) then delete;   input var1 var2 var3; run;     ... View more

Thanks for your response. I want to actually combine all the .CSV files into one sas dataset for further manipulation. The new data set would be written into a library. My goal is to recopy the new files (for efficiency). So YES I'd not want to recopy and combine all the files everyday. Also, the filesnames are timestamped and unique.   So for example the files are: C:\MyDataFolder\File.10.1.2019.csv C:\MyDataFolder\File.10.2.2019.csv C:\MyDataFolder\File.10.3.2019.csv ...etc   And the final should be WORK.bigfile.sas7bdat       ... View more

I was trying to avoid the row limitation in excel and that's why I decided to keep my file in SAS and build the pivot table off of it.   Thanks ... View more

If I do the Append in SAS, how do I replace the first appended file with the new data the following day? It will not replace the first BASE file because it is already in use. ... View more

Thanks. I'll give it a try. ... View more