topic Re: Where do I find the size of the datasets loaded to memory in SAS Visual Analytics

Where do I find the size of the datasets loaded to memory

Allan_dk — Tue, 08 Jul 2014 13:11:12 GMT

Where do I find the size of the datasets loaded to memory?

I now have more than 50 tables loaded in the LASR-server.

The Sizing Guideline for Single Machine have a guideline about

largest individual table size (16 GB)
total GB loaded to memory. (180 GB)

I can only find information about number of rows and columns.

Re: Where do I find the size of the datasets loaded to memory

RW9 — Tue, 08 Jul 2014 13:16:15 GMT

Hi,

In base SAS in SASHELP.VTABLE, find your table (where libname=library and dataset=memname), and it will show you FILESIZE variable, I assume its in bytes.

Re: Where do I find the size of the datasets loaded to memory

stat_sas — Tue, 08 Jul 2014 13:31:36 GMT

Hi,

You can use proc datasets to get info for all your loaded tables.

proc datasets library=sashelp;

run;

quit;

Re: Where do I find the size of the datasets loaded to memory

Allan_dk — Tue, 08 Jul 2014 13:44:12 GMT

Just to specify.

It is the datasets loaded to memory in the LASR-server.

There are no physical files, therefore sashelp.vtable.filesize=0

proc datasets don't give me much information.

Re: Where do I find the size of the datasets loaded to memory

stat_sas — Tue, 08 Jul 2014 14:20:22 GMT

Not sure about LASR-server, try to explore SASFILE statement if that works in this situation.

Re: Where do I find the size of the datasets loaded to memory

JasonAllen — Tue, 08 Jul 2014 17:11:55 GMT

Hello Allan_dk,

Because of the way data is loaded into a LASR server, it's difficult to say. For example, if source SAS data is loaded into HDFS, then into a LASR server, a LASR table only consumes memory while it is being used. If not, it consumes memory as long as it is loaded. Also for example, levelization increases memory consumption.

However, you can get a rough estimate of the size of (uncompressed) data using the SASIOLA libname engine and PROC DATASETS CONTENTS by multiplying the number of observations ("Observations") by the observation length ("Observation Length").