topic Re: How to set a variable filename (INFILE-statement)? in SAS Programming

How to set a variable filename (INFILE-statement)?

jurlis — Wed, 13 Sep 2017 08:28:07 GMT

Hi,

I'm new to SAS Programming (9.3) and I'm struggling with setting a variable filename for the INFILE-statement.

Goal :

I want to treat a list of SAS logfiles. The full path name of the file is retrieved from a newly created dataset (SASLOGS. LOGFILES). This dataset was created by a 'ls' on a UNIX-directory where SAS logs are stored (see step 1 in code snippet).

Problem:

In the INFILE-statement, I don't succeed in retrieving the correct value of the file -> ERROR: Invalid physical name.

Eventhough, the variable 'saslogfile_fullpath' contains the correct path (with ""). See code snippet.

Code snippet :

/*1. Fill SASLOGS.LOGFILES with all filenames listed in directory*/
filename dirlist pipe "ls /sas/prd/common/SASApp_IAM_WorkspaceServer_*.log";
LIBNAME SASLOGS "/sas/prd/data/IAM/SASLOGS";

data SASLOGS.LOGFILES;
infile dirlist lrecl=200 truncover;
input file_name $200.;
run;

/* 2. Use SASLOGS.LOGFILES and handle each file (see value "file_name") seperately*/
LIBNAME SASLOGS "/sas/prd/data/IAM/SASLOGS";

%let saslogfile_fullpath=' ';

data work.ONE_LOGFILE;
set SASLOGS.LOGFILES;
saslogfile_fullpath=trim(file_name);
saslogfile_fullpath='"' || strip(saslogfile_fullpath) || '"';
putlog saslogfile_fullpath;/* correct value in saslogfile_fullpath*/

infile &saslogfile_fullpath firstobs=2 length=linelength;

input @1 date YYMMDD10.
+1 time TIME8.
@24 level $5. @;

lengthSASInfo=linelength-52;
input @53 SAS_info $VARYING500. lengthSASInfo;

/* call macro to treat logfile*/
RUN;

What I'm I doing wrong?

Thanks for your assistance.

Jurgen

Re: How to set a variable filename (INFILE-statement)?

ShiroAmada — Wed, 13 Sep 2017 08:53:23 GMT

Please share your log, thanks.

Your first data step based in your code (which i did too) is working fine. I am not sure about the 2nd data step. I don't know how different the contents of ls command in unix versus dir command in Windows.

Re: How to set a variable filename (INFILE-statement)?

Kurt_Bremser — Wed, 13 Sep 2017 08:52:38 GMT

When you do this:

infile &saslogfile_fullpath firstobs=2 length=linelength;

you reference a macro variable; this reference is resolved once while the datastep is compiled, and requires the macro variable to be present at that time.

A code snippet that reads all lines from a bunch of textfiles into a dataset would look like this:

filename dirlist pipe "ls /sas/prd/common/SASApp_IAM_WorkspaceServer_*.log";

data dirlist;
infile dirlist truncover;
input logfile $200.;
run;

data logtext;
set dirlist;
infilename = logfile;
infile xxx filevar=infilename end=eof truncover;
do until (eof);
  input textline $200.;
  output;
end;
run;

Re: How to set a variable filename (INFILE-statement)?

jurlis — Wed, 13 Sep 2017 09:52:54 GMT

Thanks for pointing me to this option "filevar"! This solved my issue.