I Am trying to read all the log files of a user to a dataset having incremental number version .
Please check below example.
I am SAS 9.4 , trying to extract all the log files of user1 having 17 versions into dataset chkmain.
I tried below code, the iterations are working but not getting observations into dataset. Pease suggest.
%do i= 1 %to &ver ;
lrecl=900 termstr=CRLF delimiter=' ' truncover;
Usual advice is to try getting the code working first without macros. It will be easier to debug. Then after it's working without macros (reading says 3 log files), then go back to working on a macro solution.
You can make a single fileref that points to multiple files, and use a single INFILE statement in your DATA step to read data from all the files, like:
filename mylogs ("Q:\junk\log1.log" "Q:\junk\log2.log") ; data _null_ ; infile mylogs ; input ; put _infile_ ; run ;
If you can get a step like that working, then your macro is simpler to write, because it only needs to generate the list of file names.
Did you consider using a wildcard?
%let log_path=c:\temp; %let log_rootname=mylog; data work.want; length _fname $400 log_name $80 line_num 8; infile "&log_path\&log_rootname.*.log" truncover filename=_fname; input logline $char256.; log_name=scan(_fname,-1,'\/'); if lag(log_name) ne log_name then line_num=1; else line_num+1; run;
You use slashes for the path, indicating a UNIX file system. UNIX uses LF as TERMSTR.
Since you create this code
data ...; infile ...; input ...; output; infile ...; input ...; output; /* and so on */ run;
any input trying to read past the end of any one file will terminate the step, even if the other files still have data.
To read multiple external files in a single DATA step, you must use only one INFILE statement which opens all the files in succession, either by supplying a list of names and using the FILEVAR= option, or by using wildcards.
The macro is not generating the right code.
But you don't need macro logic to read 17 different files in a data step. Just data step logic.
%let pathname=some direcotry/; %let file=some prefix; %let ver=17; data chk_lst; length ver 8 fname $50 filename $256 lineno 8 line $900; do ver=1 to &ver ; fname=cats("&file",ver); filename=cats("&pathname",fname); infile logfile filevar=filename end=eof truncover; do lineno=1 by 1 while (not eof); input line $char900.; output; end; end; run;
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.