04-30-2015 12:54 PM
We have multiple sas7bdat files saved on a network drive and a reference file which lists the file names that need to be combined.
How can I do put them together using data steps?
Thank you for your time.
04-30-2015 01:17 PM
Read the list of files from the reference file into a macro variable, if it's less than 64K characters and include that in your set statement.
proc sql noprint;
select name into :ref_list separated by " " from reference_list;
set & ref_list;
05-05-2015 03:44 PM
And we need this job to run on weekly basis to check for new files.can you please list out the software that is required and the process. I 'm pretty new with SAS tool.
Thanks a lot for your help
05-05-2015 07:02 PM
"Check on a weekly basis" sounds like you need to schedule your job. If it's just "run weekly" then any scheduler will do (Cron, Task Scheduler,....).
"check for new files": What identifies a new file? Safest would be you maintain a list of already processed files and then compare this list with your control file.
You seem to have a process where you add some weekly snapshots to a "analytical base table". Assuming this table is a SAS data set and if the structure of the weekly files is stable (same columns with same attributes) then you should eventually consider to use Proc Append instead of a data step. This would avoid processing ALL the data every single week.
An alternative approach: You could also create a view over the individual SAS files. This way you would only need to re-create the view once a week including all files available.