SAS Viya

SAS Viya’s AI-based automation aligns to the needs and talents of your team, keeping both models and progress in motion across the analytics life cycle.
BookmarkSubscribeRSS Feed
a20121248
Obsidian | Level 7

Hi experts:

 

I have SAS Viya 3.5 and I need to export a table to parquet. Using CAS, I'm able to export the table to uncompressed Parquet files. However, we need these Parquet files to be compressed using SNAPPY. This is my current script:

proc cas;
	* Load table to CAS;
	index /
		table={caslib="data" name="scored_202302.sas7bdat" singlepass=true}
		casout={caslib="data" name="scored_202302" blockSize=536870912 compress=true replication=0};
run;
	* Export as .parquet;
	table.save /
		table={caslib="data" name="scored_202302"}
		caslib="parquet" name="scored_202302.parquet" replace=true
		exportOptions={fileType='parquet'};
run;
quit;

Is there a way to generate achieve a parquet with SNAPPY compression?

 

Best regards,

Javier

sas-innovate-white.png

Our biggest data and AI event of the year.

Don’t miss the livestream kicking off May 7. It’s free. It’s easy. And it’s the best seat in the house.

Join us virtually with our complimentary SAS Innovate Digital Pass. Watch live or on-demand in multiple languages, with translations available to help you get the most out of every session.

 

Register now!

Discussion stats
  • 0 replies
  • 1012 views
  • 0 likes
  • 1 in conversation