BookmarkSubscribeRSS Feed
singhashupratap
Fluorite | Level 6

I need help regarding SAS memory management, currently I have 96 GB LASR memory but my production data base size is huge so currently we put only 90 days data (only important table) in SAS LASR, now LASR memory is almost full and due to this SAS server is goes down so many time, due to this all data is truncated from memory, so can you suggest me how manage SAS memory system or save data in disk other than LASR or opimization of data in LASR, any best way optimize data size of table

 

 

proc sql ;
connect to odbc (dsn=inventory user=ashu password='');  
create table libname.test_table as select
c0  format=11.,
c1  format=$30. length=30,
c2  format=11.,
c3  format=11.2
from connection to odbc
(SELECT c0,c1,c2,c3
FROM db_name.test_table
limit 10;);
disconnect from odbc;
quit ;

 

3 REPLIES 3
LinusH
Tourmaline | Level 20

Save data on disk removes the possibility to (immediately) analyze it in VA/VS. So it depends hon your whole analytical environment/process if that's feasible.

 

There a few techniques (not limited to) that can save memory in LASR, what to do depends on your data, requirements and query patterns:

  • Compress
  • Star schema
  • Truncate char cols
  • Use formats
Data never sleeps
Patrick
Opal | Level 21

I don't have practical experience with it but it appears the 2.4 version got a squeeze option which allows for compressed in-memory tables.

http://support.sas.com/documentation/cdl/en/inmsref/67597/HTML/default/viewer.htm#inmsrefwhatsnew24....

 

SASKiwi
PROC Star

Compression is available in the more recent versions of SAS VA, but the down side is it can have a very significant impact on performance and needs to be used with extreme caution. For large tables like the one being discussed it could be a total CPU killer. Have a look at the other options suggested first.

 

Also if you don't need row-level detail in VA consider pre-summarising your data first to reduce the size.

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 940 views
  • 1 like
  • 4 in conversation