BookmarkSubscribeRSS Feed
vallsas
Pyrite | Level 9

Hello All,

I have noticed that the table size in LASR is not equal to HDFS library. Is it possible that when we load table first into HDFS and then load into LASR . in my case I did the same thing but size it not same in LASR as compared to HDFS. 

 

I could sense that LASR library is not reading the latest of HDFS library. Any Idea how to get lastest table from HDFS to LASR.

 

example : HDFS 4.30 GB , lasr 4.12 gb . i have not used any compression option(of course there  is not compression option while loading HDFS to Lasr) (we know there will be message the LASR table will have the same compression as the source table).

 

How to check whether HDFS and LASR having same version the table (size or update)..

2 REPLIES 2
JuanS_OCS
Azurite | Level 17

Hello @vallsas,

 

assuming that it is correct the information regarding compression, have you already tried to run something like what is in this document? It helps to understand the memory management in LASR: http://support.sas.com/documentation/cdl/en/inmsref/67629/HTML/default/viewer.htm#p050lknh5xepngn1s2...

alexal
SAS Employee

@vallsas,


I would like to see the output from "proc contents" for this dataset from both HDFS and LASR library.

 

sas-innovate-white.png

Our biggest data and AI event of the year.

Don’t miss the livestream kicking off May 7. It’s free. It’s easy. And it’s the best seat in the house.

Join us virtually with our complimentary SAS Innovate Digital Pass. Watch live or on-demand in multiple languages, with translations available to help you get the most out of every session.

 

Register now!

Tips for filtering data sources in SAS Visual Analytics

See how to use one filter for multiple data sources by mapping your data from SAS’ Alexandria McCall.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 1299 views
  • 1 like
  • 3 in conversation