topic proc s3 help in SAS Programming

proc s3 help

sathya66 — Thu, 11 Jun 2020 10:38:47 GMT

All,

I have file on s3 bucket(static file name ex:test.txt ) and that file over writes everyday.

So I need to read that file based on modified date.

ex:If test.txt modified date is today then run Proc s3 otherwise file is not modified today.

proc s3 config="/u/marti/.tks3.conf";
   create "/myBucket";
   put "/u/marti/project/test.txt" "/myBucket/test.txt";
run;

Thanks,

Re: proc s3 help

ChrisNZ — Thu, 11 Jun 2020 11:11:29 GMT

What do you get when you run the INFO statement?

Re: proc s3 help

smantha — Thu, 11 Jun 2020 11:49:00 GMT

Doesn't list give you the information you need

Re: proc s3 help

sathya66 — Thu, 11 Jun 2020 12:39:26 GMT


proc s3 config="/u/marti/.tks3.conf";
   create "/myBucket";
   get "/u/marti/project/test.txt" "/myBucket/test.txt";
list "/myBucket";
run;

Sorry to get a file from S3 onto SAS (now used get statement). If I do the list. It is giving the info(modified date )in the log. How can I read that into sas to work with my logic.

ex: if modified date is today then get the file onto sas otherwise no.

Re: proc s3 help

smantha — Thu, 11 Jun 2020 12:42:46 GMT

you can add the following lines

proc printto log="homeopath/status.txt";

run;

proc s3 step;

proc printto;

run;

read the status from the status.txt

Re: proc s3 help

sathya66 — Thu, 11 Jun 2020 15:27:28 GMT

This will not work as I need to read a file in S3 bucket.
I can list all the files and modified date from S3 bucket into a dateset but how can I apply this logic in proc s3?

Re: proc s3 help

smantha — Thu, 11 Jun 2020 15:30:04 GMT

As far as I know one cannot write an if then logic inside a proc step. You have to use two separate steps one to get status and one to read the file itself based on what you find.

Re: proc s3 help

ChrisNZ — Thu, 11 Jun 2020 22:39:28 GMT

Try:

Step 1: Momentarily redirect the log with proc PRINTTO

Step 2: Run proc S3 with INFO statement (or LIST? which one gives you the date?)

Step 3: Stop the redirection: run proc PRINTTO again

Step 4: Run a data steps that analyses the log file.

This data steps triggers a new proc S3 run if the date is as expected.

Re: proc s3 help

sathya66 — Fri, 12 Jun 2020 13:48:43 GMT

yes, thanks
It worked.
In Step4.
I have written a macro to read the dates and files from the log dateset (call symput) and if file and date matches then do proc S3 otherwise "file is not todays file".
Thanks for your Help .