topic Re: Compress Data Enterprise Guide vs Compress Data SAS VA Data Builder in SAS Enterprise Guide

Compress Data Enterprise Guide vs Compress Data SAS VA Data Builder

cesarssantos — Fri, 10 Aug 2018 12:54:01 GMT

Hello there,

I have a Star schema too heavy, considering my environment. So, I'm looking for options to decrease or compress that data.

What's the difference between compressing my data in Enterprise Guide and compressing my data in SAS VA Data Builder?

I noticed that when I use the task Upload to Lasr after a query that compressed my data, my dataset returns to the size before the compressing. Can I compress the data while uploading to Lasr?

Do I have other options?

Thanks!

Re: Compress Data Enterprise Guide vs Compress Data SAS VA Data Builder

LinusH — Fri, 10 Aug 2018 13:54:15 GMT

Compression is an attribute local to the storage, it's not transferred when you move the data.
There's a COMPRESS statement in PROC IMSTAT you could try.
http://documentation.sas.com/?docsetId=inmsref&docsetTarget=p1vi3iq0kbqmy8n1d3wcwy5mexn7.htm&docsetVersion=2.81&locale=sv

Re: Compress Data Enterprise Guide vs Compress Data SAS VA Data Builder

SASKiwi — Fri, 10 Aug 2018 23:57:46 GMT

I recommend you don't compress data held in SAS VA LASR memory. In my experience VA report performance suffers quite badly, and it would be even worse with a star schema. I find uncompressed single SAS tables give the best performance, even if it means de-normalising your data from a star schema.

Re: Compress Data Enterprise Guide vs Compress Data SAS VA Data Builder

cesarssantos — Mon, 13 Aug 2018 11:06:49 GMT

That is exactly what I was looking for, thank you very much.

Re: Compress Data Enterprise Guide vs Compress Data SAS VA Data Builder

cesarssantos — Mon, 13 Aug 2018 11:07:54 GMT

Nice tip, thank you for your collaboration.