topic Re: SAS and AWS S3 in SAS Programming

SAS and AWS S3

gra_in_aus — Wed, 17 Aug 2016 08:49:32 GMT

Would like to know if there is a way to libname directly to AWS S3 in the same way that you can in LINUX, UNIX or Windows?

Re: SAS and AWS S3

LinusH — Wed, 17 Aug 2016 10:12:06 GMT

Like what from where?
Please have your requirement more detailed...

Re: SAS and AWS S3

gra_in_aus — Wed, 17 Aug 2016 10:31:31 GMT

Libnaming from a AWS EC2 hosted SAS Server directly to an AWS S3 Bucket, e.g. libname s3buck "s3://mybucket/";

Re: SAS and AWS S3

LinusH — Wed, 17 Aug 2016 13:11:34 GMT

If that location is available to you in the SAS server instance it should probably work.
But I think that this question should be directed to your service provider (unless you can test it yourself).

Re: SAS and AWS S3

Cynthia_sas — Wed, 17 Aug 2016 14:34:05 GMT

Hi:
If you are using the AMAZON AWS and SAS University Edition in the free tier, then to work with SAS University Edition, you need to upload your files and/or SAS datasets to your /myfolders location on the AMAZON AWS and assuming you put your files in the /myfolders location and not under a new folder in that location, your libname statement would generally be:
libname mystuff '/folders/myfolders';

For any other questions about using data on the AMAZON AWS, with SAS University Edition, you might want to post your question on the SAS Analytics U forum.

Otherwise, if you are using the AMAZON AWS, but not the SAS University Edition on the free tier, then you might be better off working with your service provide or working with Tech Support for this question.

cynthia

Re: SAS and AWS S3

gra_in_aus — Wed, 17 Aug 2016 22:35:48 GMT

The question is not related to SAS University. The question is related to whether SAS can directly interface via libnames to S3 as a file server, or if there is another way of connecting with ease.

Thanks

Re: SAS and AWS S3

SASPhile — Sun, 22 Jan 2017 15:44:49 GMT

Hi gra_in_aus,

I'm also trying to find out if there any in-built procedures or process in SAS to upload files to AWS S3? and how to establish connectvity between SAS and AWS?f you have answers can you please share them?

Thanks,

Re: SAS and AWS S3

gra_in_aus — Mon, 23 Jan 2017 08:36:41 GMT

Hi SASPhile,

Apparently in SAS 9.4m4 maintenance release there is a new PROC S3 procedure. I am lead to believe that it has basic functionality for data movement to S3.

Many Thanks

Re: SAS and AWS S3

SASPhile — Mon, 23 Jan 2017 19:34:23 GMT

I'm using 9.4 M3. Cant find it.

but how to set up S3 on machine? Is there a free version to test it out how SAS and S3 works?

Re: SAS and AWS S3

gra_in_aus — Tue, 24 Jan 2017 07:53:20 GMT

Apologies for the confusing you need to have the 4th maintenance release installed.

https://communities.sas.com/t5/tkb/articleprintpage/tkb-id/library/article-id/1696

Re: SAS and AWS S3

ankitd — Thu, 13 Apr 2017 11:12:18 GMT

Found the below SAS Note useful, libnames will not work for earlier releases hence this is the best way

http://support.sas.com/kb/57/091.html

Also I have heard S3 can mounted as driver on Linux Servers but does the permission/authentication to connect to the bucket remain as is has not been tested by me.

Re: SAS and AWS S3

sachaanu0 — Fri, 08 Sep 2017 21:22:07 GMT

Hello,

I am using SAS University Edition Enterprise Miner, SAS Studio on AWS.

Trying to load a file to the SAS environment from my Macbook.

Could you please highlight steps/video on how to upload data to /myfolders location on the AMAZON AWS? -- Such that it is available in SAS environment.

Thanks

Re: SAS and AWS S3

ankitd — Wed, 13 Sep 2017 11:25:07 GMT

S3 is Amazon's data storage system and can be used for saving files and utilizing when requried.

If you are going with S3 you can either use the AWS CLI (by installing it on the server) to establish connection with S3 and use files.

You can mount S3 buckets on the server (this will then work as any other mount point).

Proc S3 can be used for accessing data.

If you are using S3 then you will have to create buckets in it and restrict the access of each bucket.

Regards,

Ankit

Re: SAS and AWS S3

gauravp1993 — Mon, 18 Sep 2017 12:26:19 GMT

Hello,

I was trying to use Proc S3 to connect to S3 folders by following steps mentioned by SAS documentation(http://support.sas.com/documentation/cdl/en/proc/70377/HTML/default/viewer.htm#n1volodm4xnj3xn1s99poiemcha2.htm) like creating configuration file.

After running commands like listing folder, i get a timed out error after few minutes of running Proc S3.

Couold you please help me with this?

Thanks in advance.

Re: SAS and AWS S3

ankitd — Mon, 18 Sep 2017 13:07:51 GMT

Gaurav, you will need to check on the S3 front and also enable workspace server logs and check the reason for the time out.

This could be a long running code or a heavy amount of data being fetched.

Network level checks would also need to be performed to ensure that no such timeout time has been set.

Hope the above checks help in narrowing down the issue.

Regards,

Ankit.

Re: SAS and AWS S3

gauravp1993 — Mon, 18 Sep 2017 15:57:59 GMT

Hello Ankit,
Thank you for sorting me out.
Should we check connectivity between my unix box and S3 to ensure Proc S3
works?
In that case,what can we do??

Re: SAS and AWS S3

ankitd — Thu, 21 Sep 2017 18:16:30 GMT

Hi Gaurav,

You can test the connectivity between the two by downloading the Amazon S3 CLI on the SAS unix box and trying to connect to S3 since I am not sure whether a ping or telnet test would work since S3 is a web application.

If the CLI connection works then your proc s3 should work as well as long as other network and timeouts have been sorted.

Hope this should work for you.

Regards,

Ankit.

Re: SAS and AWS S3

ssajop — Tue, 23 Aug 2022 14:44:39 GMT

Did you get a correct answer to your question?

Is it possible to create a SAS library to a aws s3 storage location.

Do nto want to use Proc s3.

Want to use a sas library in a data step or proc sql to create or read sas dataset on the aws s3 storage.

Re: SAS and AWS S3

SASKiwi — Tue, 23 Aug 2022 22:36:19 GMT

My understanding is that you can't use S3 for "normal" SAS libraries / storage, that is, SAS7BDAT files. S3 is for other file types like text and delimited files. If you are using SAS Viya, then SASHDAT-format files can be stored on S3.