Not able to get or to list the files on S3 from SAS by using proc S3

[sathya66]

One of our job is running for years without issues but since a week, job is failing due to "list" issue. hasn't changed anything from sas bucket permissions side or from the server.

28 proc s3
29 awsconfig="/data/config"
30 awscredentials="/data/credentials" ;
31 /* get "/data_bucket/S3Test/Test.txt" "/data/test/Test.txt" ; */
32 list "/data_bucket/Test/";
33 run;

ERROR: Could not list bucket contents.
ERROR: Invalid argument

[soominchae]

Try installing this hot fix https://support.sas.com/kb/69/457.html

[dshahvx]

Do you have  a hot fix for 9.4 M5. We need it!

[sathya66]

Hi 

Think there is no fix for this on M5 and M6 . We have to upgrade SAS to either M7 or M8.

I have sorted this by adding the bucket  policy to instance role but you have to list the files by using x command (if enabled ) . something like below.

I have enabled x commands for s3  users group.

x  aws s3 ls "s3://data_bucket/Test/" > "/tmp/log.txt" ;

[dshahvx]

Many thanks.

It is very strange in our case. Because there are several other buckets that are created using AWS console and on which we can use the list command but just one is on which we cant since few days. It had been working for almost a year but just stopped working until last week.  However we are able to delete/copy the contents. 

Was there anything changed within  9.4M5 which could impact only the list statement within PROC s3?

Many thanks

[sathya66]

this issue might have occurred due to certain changes in AWS. Please refer to the following documentation:
Ref:- https://docs.aws.amazon.com/sdkref/latest/guide/feature-dataintegrity.html