BookmarkSubscribeRSS Feed
a20121248
Obsidian | Level 7

Hi experts:

 

I have SAS Viya 3.5 and I need to export a table to parquet. Using CAS, I'm able to export the table to uncompressed Parquet files. However, we need these Parquet files to be compressed using SNAPPY. This is my current script:

proc cas;
	* Load table to CAS;
	index /
		table={caslib="data" name="scored_202302.sas7bdat" singlepass=true}
		casout={caslib="data" name="scored_202302" blockSize=536870912 compress=true replication=0};
run;
	* Export as .parquet;
	table.save /
		table={caslib="data" name="scored_202302"}
		caslib="parquet" name="scored_202302.parquet" replace=true
		exportOptions={fileType='parquet'};
run;
quit;

Is there a way to generate achieve a parquet with SNAPPY compression?

 

Best regards,

Javier

sas-innovate-2024.png

 

Time is running out to save with the early bird rate. Register by Friday, March 1 for just $695 - $100 off the standard rate.

 

Check out the agenda and get ready for a jam-packed event featuring workshops, super demos, breakout sessions, roundtables, inspiring keynotes and incredible networking events. 

 

Register now!

Discussion stats
  • 0 replies
  • 274 views
  • 0 likes
  • 1 in conversation