topic Re: how to connect to AWS with SAS in SAS Enterprise Guide

how to connect to AWS with SAS

alepage — Wed, 17 Apr 2024 13:38:34 GMT

Hello,

We are starting a new project and I will need to read a csv file on Amazon Web Services. I do not have a lot of information up to now but I wonder if it could be possible to get a SAS snippet showing how to connect on AWS and how to read a csv file.

Regards,

Re: how to connect to AWS with SAS

colingray83 — Wed, 17 Apr 2024 14:10:43 GMT

Hi,

It sounds like you need PROC S3, this reads / lists / creates files in S3 buckets. It has a variety of statements so check in support.sas.com for more details, but you will need something like:

/* read data in and import excel file*/
filename _s3file temp;
%let _locals3file = %sysfunc(pathname(_s3file));
/* connect to S3 */

proc s3 config="/home/sas/Documents/tks3.conf";
get "/XXXXsasdata/fakenames100.csv" "&_locals3file"; /* XXXXsasdata is your bucket name */
run;

/* this bit hopefully works - i was using xlsx spreadsheet so haven't tested with csv */
proc import datafile =_s3file replace
dbms=csv
out=work.fake1;
getnames=yes;

run;

you will also need a file called tks3.conf (or you can put the details in code, but this contains something like the following)

ssl=yes
keyID=XXXXXXXX
secret=YYYYYYYYYYYYYYYYYYYYYYYY
region=euireland

Let me know how you get on - good luck.

Colin

Re: how to connect to AWS with SAS

Sajid01 — Wed, 17 Apr 2024 14:13:00 GMT

Hello @alepage
Have a look at this https://www.sas.com/en_us/webinars/ate-viya-architecture-data-movement.html

Re: how to connect to AWS with SAS

alepage — Wed, 17 Apr 2024 18:58:36 GMT

This more related to SAS Viya. I don't see nothing related to proc s3

Re: how to connect to AWS with SAS

alepage — Wed, 17 Apr 2024 19:00:42 GMT

As I can see from your SAS code, we cannot read the file directly, we need to import it to read it.

Is that correct ?

Also, is there some options we can use to help in troubleshoothing proc s3? Ex: could not list bucket contents and so on

Re: how to connect to AWS with SAS

Patrick — Thu, 18 Apr 2024 03:30:05 GMT

@alepage wrote:

As I can see from your SAS code, we cannot read the file directly, we need to import it to read it.

Depending on your SAS version you can use FILENAME Statement: S3 Access Method

To read the file "directly" refer to: Example 1: Reading a File by Using the S3 Access Method

Re: how to connect to AWS with SAS

colingray83 — Thu, 18 Apr 2024 08:00:02 GMT

Hi,

Not sure there is a debug option, though the following will list files to the log,

proc s3 config="c:/temp/aws/tks3.conf";
list "XXXsasdata"; /* will list files to the log */
run;

I've also used with Viya a libname statement that points directly to the folder and you can then read directly in the usual way. I'm not sure how AWS transfer charges apply, so i always disconnect afterwards !

caslib mys3 datasource=(srctype="s3"
accesskeyid="AAAAAAAAAAAA"
secretaccesskey="BBBBBBBBBBBBBBBB"
region="EU_Ireland"
bucket="XXXXsasdata"
/* objectpath="/asr/projB" */
usessl=true);

Re: how to connect to AWS with SAS

alepage — Fri, 19 Apr 2024 13:26:51 GMT

Up to now, I have made some tests but it is like SAS EG is running, running and nothing appends.

Is there some options we can use to check if the connection is granted and to check the grant for my key and secret

Any sample test we can do ?

Re: how to connect to AWS with SAS

Sajid01 — Sat, 20 Apr 2024 23:44:05 GMT

I think the best option is to create a ticket with SAS Tech Support.

Re: how to connect to AWS with SAS

alepage — Wed, 24 Apr 2024 14:27:01 GMT

How do we create a ticket with sas tech support

Re: how to connect to AWS with SAS

Patrick — Thu, 25 Apr 2024 01:10:48 GMT

@alepage wrote:
How do we create a ticket with sas tech support

Contact SAS Technical Support

Re: how to connect to AWS with SAS

colingray83 — Thu, 25 Apr 2024 09:09:48 GMT

Hi,

It might be that your organisation doesn't permit connections out to s3, as if its timing out, this sounds like it might be a connection issue. You could try using curl from a command line prompt to your s3 bucket, this would at least check if your getting a connection.

Have a look at this website and check it meets your requirements

https://www.googlinux.com/retrieving-s3-objects-using-curl/

regards,

Colin