What's the pipe command to download a csv file from a aws s3 bucket , to the specific location

alepage — Wed, 13 Nov 2024 21:59:35 GMT

Up to now, I have been using a proc s3 procedure to download file.

But now, I would prefer to use a aws s3 command to download a csv file by specifying the profile I want to use.

How do we do that ?

Re: What's the pipe command to download a csv file from a aws s3 bucket , to the specific location

Patrick — Thu, 14 Nov 2024 00:04:15 GMT

Based on documentation and starting with SAS 9.4M5 you can specify the profile with both Proc S3 and the Filename S3 access method. There shouldn't be a need for explicitly calling the aws cli.
Optional Arguments

The aws cli command for downloading a file will look similar to below.

aws s3 cp s3://your-bucket-name/your-file.csv /path/to/destination/ --profile your_profile_name

You need of course the aws cli installed from the environment where SAS executes.

To use a filename pipe with reading the .csv directly via a SAS data step I assume you would need to write directly to standard out. Copilot returned syntax as below for such a scenario.

aws s3 cp s3://your-bucket-name/your-file.csv - --profile your_profile_name --output text

In this command:

The - after the S3 path tells the AWS CLI to write the output to stdout.
--output text specifies the format of the output. You can also use --output json if you prefer JSON format.

topic Re: What's the pipe command to download a csv file from a aws s3 bucket , to the specific location in SAS Enterprise Guide

What's the pipe command to download a csv file from a aws s3 bucket , to the specific location

Re: What's the pipe command to download a csv file from a aws s3 bucket , to the specific location