I wrote code that reads in fixed-width text files then looks for specific lines and writes them to a dataset.  Then I export lines from that dataset into a new text file that combines all of the lines I was looking for into one file.  My goal was to keep the lines exactly as they were in the text files from which they originate such that the import code will import the new text file exactly as it would the original files.  When I try to import the text file I get a "Lost Card" note (see log text below).  Also it only imports half of the records. There should be 1445 imported and it only imports 722.  Otherwise the lines import correctly.   I think I'm not exporting the file correctly.  I used some code from a similar project I worked on to create a csv file and that seemed to work great.  I tried changing the "mod=" option to different numbers without success.  I looked at other "Lost Card" posts and there have been suggestions such as using truncover on the import. However, because this file is going to passed to someone else and imported into a non-SAS system, I need the new text file to be exactly like the original text files.  The purpose of importing the new text file into SAS is only a test to see if it the formats are the same.  'The import code works fine for the originals leading me to think there are differences.   1)  Am I not exporting my file correctly? 2)  Is there a way to edit text files without importing them into SAS and storing them in a SAS dataset?  Even though I tried to minimize the possibility of unforeseen changes, it seems the act of importing and storing the lines in SAS modifies them to some extent.   Thanks, Ryan     52015 /* Import TRX file*/ 52016 %let filename_1=temp.TRX; 52017 %import_TRX_TRP(C:\Users\Public\&filename_1,test); NOTE: The infile IMPORT is: Filename=C:\Users\Public\temp.TRX, RECFM=V,LRECL=32767,File Size (bytes)=566440, Last Modified=17May2017:15:42:55, Create Time=17May2017:15:24:42 NOTE: LOST CARD. t_death_year=2017 ...<DELETED SENSITIVE INFORMATION HERE> priority=. _ERROR_=1 _N_=723 NOTE: 1445 records were read from the infile IMPORT. The minimum record length was 390. The maximum record length was 390. NOTE: SAS went to a new line when INPUT statement reached past the end of a line. NOTE: The data set WORK.TEST has 722 observations and 108 variables. NOTE: DATA statement used (Total process time): real time 0.02 seconds cpu time 0.01 seconds     /***************************************************************************************************** Collect all records that need to be imported *****************************************************************************************************/ proc sql noprint; /* Create macro variables holding directories, filenames, and extensions of all trp and trx files */ select distinct(final_path) into :path separated by '@' from CCDF_TRX_TRP where final_path ne ''; quit; %let path_obs=&sqlobs; %put &path_obs &path; %macro catch_up(); %do i = 1 %to &path_obs; /* iterate through the list of full_paths */ %let path_itr= %scan(&path, &i, '@'); /* scans through the list of files */ proc sql noprint; /* Create list of SFNs needed for each of the files */ select distinct catt("'", SFN_1, "'") into :SFN_list separated by ' ' from CCDF_TRX_TRP where final_path eq "&path_itr"; quit; data comprehensive_temp; missing; infile "&path_itr" lrecl=2000 truncover; length lines $2000; input lines $1-2000; keep lines ; if '305'||substr(lines,1,4)||substr(lines,7,6) in (&SFN_list); run; data comprehensive; %if &i = 1 %then %do; set comprehensive_temp; %end; %else %do; set comprehensive comprehensive_temp; %end; if lines ne ''; run; %end; %mend catch_up; %catch_up(); /***************************************************************************************************** Export cath_up file to I drive *****************************************************************************************************/ Options noQuoteLenMax; /* Supresses the warning "WARNING: The quoted string currently being processed has become more than 262 characters long" */ data _null_; set comprehensive; file "C:\Users\Public\temp.TRX" lrecl=2000 n=/*4*/1 MOD; * Export file to temporary location; put lines; run; /* Import TRX file*/ %let filename_1=temp.TRX; %import_TRX_TRP(C:\Users\Public\&filename_1,test);   ... View more

I found the code below (originally without any of the macro code) that inventories directories and it's lightning quick.  I want to turn it into a macro so I can call it when I need it, but when I put the &path in place of the literal path it resolves as &path rather than inserting the path I called in the macro.  I tried switching the single and double quotes and it looks like &path resolves to the correct path but now the coding doesn't work (Stderr output: The specified path is invalid.).  It works perfectly when I just paste the path into the code.  What can I do to turn this into a macro?   Thanks.      %macro get_file_info(path); /* http://support.sas.com/resources/papers/proceedings12/058-2012.pdf */ filename pipedir pipe ' dir "I:\VRBIS\TransaxAchieve-UCD" /S' lrecl=5000; /* filename pipedir pipe ' dir "&path" /S' lrecl=5000;*/ data indata; infile pipedir truncover; input line $char1000.; length directory $1000; retain directory; if line =' ' or index(upcase(line),'<DIR>') or left(upcase(line))=:'VOLUME' then delete; if left(upcase(line))=:'DIRECTORY OF' then directory=left(substr(line,index(upcase(line),'DIRECTORY OF')+12)); if left(upcase(line))=:'DIRECTORY OF' then delete; if input(substr(line,1,10),?? mmddyy10.) = . then substr(line,1,10)='12/31/2999'; date=input(substr(line,1,10),?? mmddyy10.); format date mmddyy10.; run; proc sort data=indata; by directory descending date; run; data Directory_Summary(drop=i line); set indata; by directory; length filename $75; retain number_of_files_in_directory directory_size; if first.directory then do; number_of_files_in_directory=input(scan(line,2,' '),32.); directory_size=input(scan(line,4,' '),comma32.); end; file_size=input(scan(line,4,' '),comma32.); filename=' '; do i=5 to 100; filename=trim(left(filename))||' '||scan(line,i,' '); if scan(line,i,' ')=' ' then leave; end; if index(upcase(line),'FILE(S)') then delete; if date ge '30DEC2999'd then delete; run; %mend get_file_info; /*%include 'H:\SAS code\Directory_summary.sas';*/ %get_file_info(I:\VRBIS\TransaxAchieve-UCD); ... View more

In the past I've been able to read in a csv file to process it line-by-line, but for some reason the file I'm working on now only imports every other line.  Any information you can provide is appreciated.  Here's my code:   data cleaned; missing; infile "C:\temp\test.csv" lrecl=2000; length lines $2000; input lines $1-2000; keep lines tag ; if _N_ eq 1 then do; find_CR_re=prxparse('/\n/'); /* Find carriage returns */ end; retain find_CR_re; if prxmatch(find_CR_re,lines) then tag=1; /* Looking for embedded carriage returns in line*/ run; ... View more