topic Re: Downloading S3 files from AWS in SAS Programming

Downloading S3 files from AWS

juanvg1972 — Wed, 27 Sep 2017 12:25:13 GMT

Hi,

I am trying to dowload or directly read S3 files from AWS in a SAS BASE program. Is that possible?

I have found in documentation the procedure 'proc S3', but it's not avalilable in my SAS version.

Is there any other way to read or download S3 files to SAS??

I am working with SAS EG 6.1

Thanks in advance

Re: Downloading S3 files from AWS

Reeza — Wed, 27 Sep 2017 14:17:12 GMT

What's your SAS version, not EG version?

%put &sysvlong;

Re: Downloading S3 files from AWS

LinusH — Wed, 27 Sep 2017 14:31:59 GMT

6.1 would be 9.4, but perhaps an earlier maintenance level.

Upgrading within a major SAS release is usually not a very big task (depending on the nature of the installation of course).

Re: Downloading S3 files from AWS

juanvg1972 — Wed, 27 Sep 2017 14:53:41 GMT

I am sorry, my SAS EG is 7.11

and SAS: 9.04.01M4P110916

Re: Downloading S3 files from AWS

juanvg1972 — Wed, 27 Sep 2017 14:56:25 GMT

SAS admins don't plan any upgrading coming soon...

If you can give a possible solution to download S3 files not with 'proc S3' I will be very gratefuk

Sorry for my english and thanks!!

Re: Downloading S3 files from AWS

LinusH — Wed, 27 Sep 2017 15:16:21 GMT

PROC S3 should be available in the M4 release...?

Re: Downloading S3 files from AWS

juanvg1972 — Wed, 27 Sep 2017 17:17:22 GMT

I have read that is: 9.04M5, but I am not sure.....

I can't upgrade, becasuse admins don't plan do it....until.....I don't know....

Is there any other solution to connect SAS to AWS S3 and download files?

Thanks in advance

Re: Downloading S3 files from AWS

AlanC — Wed, 27 Sep 2017 20:34:52 GMT

I think your version of SAS even predates PROC HTTP which would allow you to go against S3 REST APIs.

Consider doing it outside of SAS and bringing it in a delimited file or something else.

Re: Downloading S3 files from AWS

Reeza — Thu, 28 Sep 2017 03:40:34 GMT

If the version is correct it should have PROC S3 Included as part of the Base Procedure which is most SAS installations.

What makes you think you don't have PROC S3?

If you're getting an error message post your code and log.

Re: Downloading S3 files from AWS

juanvg1972 — Thu, 28 Sep 2017 09:45:42 GMT

This is my log:

27         proc s3 ;
ERROR: Procedure S3 not found.
28            create "/xxxxxxxx";
29         run;

NOTE: The SAS System stopped processing this step because of errors.
NOTE: PROCEDURE S3 used (Total process time):
      real time           0.00 seconds
      cpu time            0.00 seconds

Re: Downloading S3 files from AWS

Reeza — Fri, 29 Sep 2017 02:27:16 GMT

What's your output from a PROC SETINIT?

Are you sure your version is correct? Perhaps they didn't install it correctly?

I would consider contacting SAS tech support and talking to your IT area. If they've explicitly locked down access to S3 that's something you would need to be aware of before proceeding in my opinion.

Re: Downloading S3 files from AWS

AlanC — Fri, 29 Sep 2017 04:07:24 GMT

Reeza,

He mentioned that he is using SAS 9.04. I don't think it existed at that time.

Re: Downloading S3 files from AWS

Reeza — Fri, 29 Sep 2017 14:46:35 GMT

@AlanC The SAS version posted is 9.4 TS1M4 which does support PROC S3.

Re: Downloading S3 files from AWS

AlanC — Fri, 29 Sep 2017 15:06:46 GMT

Correct. I didn't see that SAS posts the version that way. Thanks.

Re: Downloading S3 files from AWS

JBailey — Tue, 01 May 2018 13:07:18 GMT

Hi @juanvg1972,

PROC S3 was added in SAS 9.4M4. Let's make certain there is no weirdness regarding the version of SAS you are actually running on. Can you run the following code in a single SAS session and post the results from the log?

proc s3;
   create "/xxxxxx"; 
run;

%put &sysvlong;

Best wishes,

Jeff

Re: Downloading S3 files from AWS

Tom — Tue, 01 May 2018 16:57:04 GMT

You can install the AWS command line tools on the SAS server and then call the copy command using %SYSEXEC() or other methods available in SAS to run operating system commands.