topic Re: Proc S3 Connectivity Issue in SAS Procedures

Proc S3 Connectivity Issue

ankitd — Mon, 08 Jun 2020 10:28:18 GMT

Hello Experts,

I have a cloud based SAS 9.4M4 environment and have deployed SAS on RHEL OS.

We are trying to connect to S3 bucket from SAS using Proc S3.

AWS CLI has been installed and tested from the server and it is working absolutely fine however while trying to use the Proc S3 code I get the below error message.

This error arises whether I use any of the functions i.e. LIST, PUT or GET etc.

ERROR: Could not list bucket contents.
ERROR: Encryption run-time execution error

Thanks in advance for your help.

Regards,

Ankit

Re: Proc S3 Connectivity Issue

hhhhh — Mon, 08 Jun 2020 12:29:40 GMT

Can you put the code? I think the region which you specified would have some issue.

Re: Proc S3 Connectivity Issue

ankitd — Mon, 08 Jun 2020 12:46:37 GMT

Below is the sample code

proc s3 KEYID="key-id" SECRET="secret-access" REGION=USEAST;
LIST "/s3_bucket_name/test.txt";
run;

The S3 bucket is hosted in US-EAST-1 region.

Re: Proc S3 Connectivity Issue

hhhhh — Mon, 08 Jun 2020 13:25:27 GMT

use this in list

LIST "/s3_bucket_name"

Re: Proc S3 Connectivity Issue

ankitd — Mon, 08 Jun 2020 14:24:59 GMT

Its the same thing, whether you mention a file or just the bucket.

Additionally, we have tried the PUT and GET options as well same error message is being received.

Re: Proc S3 Connectivity Issue

hhhhh — Mon, 08 Jun 2020 14:29:38 GMT

I would suggest try connecting to bucket on winscp and verify that you have access to bucket using given credentials, if you are able to connect manually on s3 bucket then you should be able by Proc s3 also.

Re: Proc S3 Connectivity Issue

ankitd — Fri, 12 Jun 2020 08:38:52 GMT

Basis investigation found that S3 uses AES encryption which is only supported from SAS 9.4M6. Got it vetted from SAS Technical Support as well.

Given that we are using SAS 9.4M4 there are possible 2 options only:

1. Use AWS CLI for data upload and download from S3 and then leverage it in SAS.

2. Upgrade to SAS 9.4M6

Hope this helps anyone else facing similar issue.

Re: Proc S3 Connectivity Issue

Ramprakash — Wed, 19 Aug 2020 19:59:24 GMT

Use AWS CLI for data upload and download from S3 and then leverage it in SAS.

how do we do this ? any examples would be very useful. I am trying to do this on a s3 bucket with multi-part parquet files?

Re: Proc S3 Connectivity Issue

ankitd — Thu, 20 Aug 2020 06:15:00 GMT

You will need to install the CLI on the SAS compute node and then initialize the AWS config post which using the normal PUT and GET statements of AWS you can upload and download the objects from the bucket/s.