topic Not able to get or to list the files on S3 from SAS by using proc S3 in Administration and Deployment

Not able to get or to list the files on S3 from SAS by using proc S3

sathya66 — Wed, 12 Mar 2025 12:00:09 GMT

One of our job is running for years without issues but since a week, job is failing due to "list" issue. hasn't changed anything from sas bucket permissions side or from the server.

28 proc s3
29 awsconfig="/data/config"
30 awscredentials="/data/credentials" ;
31 /* get "/data_bucket/S3Test/Test.txt" "/data/test/Test.txt" ; */
32 list "/data_bucket/Test/";
33 run;

ERROR: Could not list bucket contents.
ERROR: Invalid argument

Re: Not able to get or to list the files on S3 from SAS by using proc S3

soominchae — Thu, 13 Mar 2025 02:35:15 GMT

Try installing this hot fix https://support.sas.com/kb/69/457.html

Re: Not able to get or to list the files on S3 from SAS by using proc S3

dshahvx — Thu, 20 Mar 2025 13:28:10 GMT

Do you have a hot fix for 9.4 M5. We need it!

Re: Not able to get or to list the files on S3 from SAS by using proc S3

sathya66 — Fri, 21 Mar 2025 09:03:19 GMT

Think there is no fix for this on M5 and M6 . We have to upgrade SAS to either M7 or M8.

I have sorted this by adding the bucket policy to instance role but you have to list the files by using x command (if enabled ) . something like below.

I have enabled x commands for s3 users group.

x  aws s3 ls "s3://data_bucket/Test/" > "/tmp/log.txt" ;

Re: Not able to get or to list the files on S3 from SAS by using proc S3

dshahvx — Fri, 21 Mar 2025 14:22:27 GMT

Many thanks.

It is very strange in our case. Because there are several other buckets that are created using AWS console and on which we can use the list command but just one is on which we cant since few days. It had been working for almost a year but just stopped working until last week. However we are able to delete/copy the contents.

Was there anything changed within 9.4M5 which could impact only the list statement within PROC s3?

Many thanks

Re: Not able to get or to list the files on S3 from SAS by using proc S3

sathya66 — Tue, 01 Apr 2025 11:08:48 GMT

this issue might have occurred due to certain changes in AWS. Please refer to the following documentation:
Ref:- https://docs.aws.amazon.com/sdkref/latest/guide/feature-dataintegrity.html