topic pickup latest available file in SAS Programming

pickup latest available file

sampsas — Fri, 17 May 2019 18:30:21 GMT

Hi Friends, i developed below process and just want to make sure have correct logic in place.

Goal here is to make sure empty touch file got out ONLY WHEN previous process gets completed and "full/complete" file is available

step1:

/*different sas process runs and end of the process one large .dat file out there on sas server */

step2:

/*logic which create touch file only once large .dat file is done writing and fully available*/

%let datfile="/dir-where-dat-file-is/test.dat

%if %sysfunc(fileexist(&datfile)) %then
%do;

data _null_;
infile "cd /dir-where-touch-file-needs-to-go; touch MarketingDataFileReady.txt;" pipe;
run;

Re: pickup latest available file

noling — Fri, 17 May 2019 19:08:04 GMT

Seems correct. Other questions:

1. Do you remove the .dat file after your touch file is created? It's possible that you may look at the same .dat file multiple times if you don't check timestamps or move the file out.

2. Do you have another process that deletes the touch file later? Same potential issues as question #1.

Re: pickup latest available file

sampsas — Fri, 17 May 2019 20:06:13 GMT

Thanks.

1. Do you remove the .dat file after your touch file is created? No. this will be replaced/overwritten by my same process next day (process runs on daily bases) It's possible that you may look at the same .dat file multiple times if you don't check timestamps or move the file out.

2. Do you have another process that deletes the touch file later? No, this will be replaced/overwritten as well. i am assuming Same potential issues as question #1.

- another technology (non-sas) will pickup touch file