Hi I am using the sas option to load SAS tables in memory:
sasfile work.ventas load;
My dataset has 10 million rows is 2Gb and my RAM is 8Gb, but once loaded in memory I haven’t improve the performance of my proc s and data steps comparing with when the dataset is in disk.
I don’t know if this option (sasfile ... load) is oriented to improve some types of steps or data management. My steps are proc freq, proc measn and typical data steps to calculate fields
Also perhaps I need a LASR server to work efficiently in memory with SAS. Can anybody help me?
Any advice will be greatly apreciated.
As a pure test of reading the dataset from memory, run a DATA _NULL_ from disk and again from the same dataset via sasfile:
data _null_;
set work.ventas;
run;
sasfile work.ventas load;
data _null_;
set work.ventas;
run;
and compare the timings of the data _null_ steps,
Have you tried increasing the value of the Bufno system option? http://support.sas.com/documentation/cdl/en/hostwin/69955/HTML/default/viewer.htm#p148jwukxcnmmin0z6...
Proc Means will likely need to sort the data which is done multithreaded but using temporary intermediary data sets on disc (UTILLOC). Having your source table in memory will at best speed up read from source into this process - but depending on the inner workings of Proc Means this read operation isn't the "bottleneck" and though reading from memory won't improve performance at all.
Given above: If and when having data in memory improves performance depends on the processing details.
There are options like BUFNO which influence performance for read/write operations on disk and it can be worth to investigate if the default values are set optimal for your environment.
Here a paper which might be useful:
http://support.sas.com/resources/papers/proceedings09/333-2009.pdf
As a pure test of reading the dataset from memory, run a DATA _NULL_ from disk and again from the same dataset via sasfile:
data _null_;
set work.ventas;
run;
sasfile work.ventas load;
data _null_;
set work.ventas;
run;
and compare the timings of the data _null_ steps,
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.