ORC and Parquet file format

Gweeks — Wed, 20 Jan 2021 13:52:22 GMT

Hello everyone,

I'm trying to push out data from SAS DI Studio, into an amazon s3 bucket using either one of the following file formats: orc/ parquet.

I have no experience in using both orc and parquet file formats.

Any help/assistance will be gladly appreciated.

Ps. a job has been created to push data through to an s3 bucket in aws, we've added some code to the data transfer transformation to be able to do. Please also advise where one would apply these file formats.

@Community_Help

Thank you,

Gweek

Re: ORC and Parquet file format

LinusH — Tue, 26 Jan 2021 09:15:14 GMT

Hi,

what version of DI Stiodo do you use?

What other SAS products do you have at hand?

Viya?

As a general note - if you are unsure of the concept, try to make it wotk outside DI Stio first. Then try to adopt it in DI Studio.

https://communities.sas.com/t5/SAS-Communities-Library/Getting-Started-Write-SAS-data-to-a-Parquet-file-on-Amazon-S3/ta-p/613322

topic Re: ORC and Parquet file format in SAS Data Management

ORC and Parquet file format

Re: ORC and Parquet file format