topic Re: Uncompress Data while Loading to LASR from HDFS in SAS Visual Analytics

Uncompress Data while Loading to LASR from HDFS

ShivamKS — Fri, 03 Jul 2015 10:05:40 GMT

I am trying to load data from HDFS to LASR in SAS VA using PROC LASR.

In HDFS we have data in compressed format, however when loading it in LASR I want the data to be in uncompressed format.

Basically I want this is because the I want to have the HDFS as the backup storage, so want to have data in compressed format there but in LASR it should be uncompressed.

Is there a way this can be achieved?

SAS VA version is 7.1 and LASR Analytic Server is 2.4.

Regards

Shivam

Re: Uncompress Data while Loading to LASR from HDFS

I_Kong_SAS — Wed, 08 Jul 2015 14:06:00 GMT

Hi Shivam, the data is memory mapped so if it is compressed on disk, it will be compressed in memory as well. Depending on the lifecycle of your data, you might consider keeping the data uncompressed while it is "fresh" and in use a lot, then later compressing it for backup. For example, you might be using the current year's data frequently now but using the previous year's data less frequently so you could consider compressing the older data.

Hope that helps,

i-kong