Hi,
I would like to know how to modify BUFNO and BUFSIZE to improve the performance of my process.
I know that option is related with size and number of buffers, but I don'y know which is the optimial value.
My process is the typical ETL process, I read from external files, I made filerts, join, aggrs and load to database. My main datasets is about 10 millions rows.
Thanks in advance
There is no such thing as "optimal" once and for all. If performance matters to you, you have to test.
Here is a small excerpt from my book High-Performance SAS Coding
http://www.amazon.com/High-Performance-SAS-Coding-Christian-Graffeuille/dp/1514362317
fyi and to use as your testing framework.
Each case is different and ideally tests should be conducted in order to decide upon the values of BUFSIZE and BUFNO as well as to decide when to use direct I/O. These decisions will depend on the hardware, the data, how the data is used, and what other jobs are running. [..]
The first row uses the default SAS settings. The best times are underlined¸ and the grey zones are where enabling SGIO slowed down the data transfer compared to just using the default.
May the "search for better performance" bug be with you forever!
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.