BookmarkSubscribeRSS Feed
a20121248
Obsidian | Level 7

Hi experts:

 

I have SAS Viya 3.5 and I need to export a table to parquet. Using CAS, I'm able to export the table to uncompressed Parquet files. However, we need these Parquet files to be compressed using SNAPPY. This is my current script:

proc cas;
	* Load table to CAS;
	index /
		table={caslib="data" name="scored_202302.sas7bdat" singlepass=true}
		casout={caslib="data" name="scored_202302" blockSize=536870912 compress=true replication=0};
run;
	* Export as .parquet;
	table.save /
		table={caslib="data" name="scored_202302"}
		caslib="parquet" name="scored_202302.parquet" replace=true
		exportOptions={fileType='parquet'};
run;
quit;

Is there a way to generate achieve a parquet with SNAPPY compression?

 

Best regards,

Javier

SAS INNOVATE 2024

Innovate_SAS_Blue.png

Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. 

Register now!

Discussion stats
  • 0 replies
  • 218 views
  • 0 likes
  • 1 in conversation