topic LASR server memory consumption in SAS Visual Analytics

LASR server memory consumption

babai88 — Tue, 07 Aug 2018 08:55:14 GMT

How much byte of memory does LASR server take to store a length 1 character data and lenght 8 numeric data ?

Re: LASR server memory consumption

Kurt_Bremser — Tue, 07 Aug 2018 09:29:11 GMT

The answer is in your question.

Re: LASR server memory consumption

babai88 — Tue, 07 Aug 2018 10:13:35 GMT

Thanks Mr. Bremser,

I tried to estimate total table space considering each character takes 2 bytes and length 8 numeric takes 8 bytes. This gives me a fair estimate but not a exact or almost exact memory consumption value !!

Re: LASR server memory consumption

Kurt_Bremser — Tue, 07 Aug 2018 10:48:33 GMT

There will always be an overhead for metadata, and artifacts of the page-wise organisation of datasets. But a 1-character field needs one byte, and the larger the dataset (in terms of observations), the smaller the overhead.

Re: LASR server memory consumption

alexal — Tue, 07 Aug 2018 10:50:01 GMT

@babai88,

Each column in the LASR server is padded to an 8 byte boundary. If the character variable you are adding is not a multiple of 8 bytes, the variable will be padded to an 8-byte boundary.

Re: LASR server memory consumption

Kurt_Bremser — Tue, 07 Aug 2018 11:07:21 GMT

@alexal wrote:

@babai88,

Each column in the LASR server is padded to an 8 byte boundary. If the character variable you are adding is not a multiple of 8 bytes, the variable will be padded to an 8-byte boundary.

Didn't know that. Now that can blow up a dataset quite nicely (if it contains lots of y/n type variables).

Re: LASR server memory consumption

babai88 — Wed, 08 Aug 2018 06:35:25 GMT

Is there anything like 8 byte padding in case of numeric columns ?

A numeric column of length 8 takes up 8 bytes of memory? Please correct me if I am wrong.

Re: LASR server memory consumption

SASKiwi — Wed, 08 Aug 2018 22:54:46 GMT

Correct. Numeric columns use 8 bytes of storage by default so no padding is done for these. If the LASR load table contains shortened numerical columns I presume padded would be done for these too.