Exploring, predicting and reporting with SAS Visual Analytics and SAS Visual Statistics

Where do I find the size of the datasets loaded to memory

Reply
Contributor
Posts: 40

Where do I find the size of the datasets loaded to memory

Where do I find the size of the datasets loaded to memory?

I now have more than 50 tables loaded in the LASR-server.

The Sizing Guideline for Single Machine have a guideline about

  • largest individual table size (16 GB)
  • total GB loaded to memory. (180 GB)

I can only find information about number of rows and columns.

Super User
Super User
Posts: 7,716

Re: Where do I find the size of the datasets loaded to memory

Hi,

In base SAS in SASHELP.VTABLE, find your table (where libname=library and dataset=memname), and it will show you FILESIZE variable, I assume its in bytes.

Trusted Advisor
Posts: 1,228

Re: Where do I find the size of the datasets loaded to memory

Hi,

You can use proc datasets to get info for all your loaded tables.

proc datasets library=sashelp;

run;

quit;

Contributor
Posts: 40

Re: Where do I find the size of the datasets loaded to memory

Just to specify.

It is the datasets loaded to memory in the LASR-server.

There are no physical files, therefore sashelp.vtable.filesize=0

proc datasets don't give me much information.


Trusted Advisor
Posts: 1,228

Re: Where do I find the size of the datasets loaded to memory

Not sure about LASR-server, try to explore SASFILE statement if that works in this situation.

SAS Employee
Posts: 15

Re: Where do I find the size of the datasets loaded to memory

Hello Allan_dk,

Because of the way data is loaded into a LASR server, it's difficult to say.  For example, if source SAS data is loaded into HDFS, then into a LASR server, a LASR table only consumes memory while it is being used.  If not, it consumes memory as long as it is loaded.  Also for example, levelization increases memory consumption.

However, you can get a rough estimate of the size of (uncompressed) data using the SASIOLA libname engine and PROC DATASETS CONTENTS by multiplying the number of observations ("Observations") by the observation length ("Observation Length").

Ask a Question
Discussion stats
  • 5 replies
  • 3102 views
  • 1 like
  • 4 in conversation