Exploring, predicting and reporting with SAS Visual Analytics and SAS Visual Statistics

Uncompress Data while Loading to LASR from HDFS

Reply
Occasional Contributor
Posts: 14

Uncompress Data while Loading to LASR from HDFS


Hi

I am trying to load data from HDFS to LASR in SAS VA using PROC LASR.

In HDFS we have data in compressed format, however when loading it in LASR I want the data to be in uncompressed format.

Basically I want this is because the I want to have the HDFS as the backup storage, so want to have data in compressed format there but in LASR it should be uncompressed.

Is there a way this can be achieved?

SAS VA version is 7.1 and LASR Analytic Server is 2.4.

Regards

Shivam

SAS Employee
Posts: 23

Re: Uncompress Data while Loading to LASR from HDFS

Hi Shivam, the data is memory mapped so if it is compressed on disk, it will be compressed in memory as well. Depending on the lifecycle of your data, you might consider keeping the data uncompressed while it is "fresh" and in use a lot, then later compressing it for backup. For example, you might be using the current year's data frequently now but using the previous year's data less frequently so you could consider compressing the older data.

Hope that helps,

i-kong

Ask a Question
Discussion stats
  • 1 reply
  • 251 views
  • 0 likes
  • 2 in conversation