topic Re: How to increase the SAS DI job runtime ? in SAS Data Management

How to increase the SAS DI job runtime ?

Shakti_Sourav — Thu, 21 Oct 2021 11:51:05 GMT

Hy,

I have one job which is name is Kalia_Job. and its taking 4 hours to execute, in kalia Job 3 datasets are used, per dataset have 50 lakhs record. and also i have used INSERTBUFF=32767 in table loader transformation.

Kindly suggest me how to incraeses the performance ?

Re: How to increase the SAS DI job runtime ?

ErikLund_Jensen — Sun, 24 Oct 2021 21:02:52 GMT

Hi @Shakti_Sourav

In order to help with this question, a lot more information is needed. You have 3 input data sets which are processed in a series of transformations to end with a table loader. The log contains information about the time used for every step in the job, and it is impossible to answer your question without knowing which transformation is slow running. It could be in the data preparation steps or the table loader. So please provide a full log and and a screenshot of the loader settings + information about the output libname. Is it SAS or a DBMS?

Re: How to increase the SAS DI job runtime ?

LinusH — Tue, 23 Nov 2021 14:01:10 GMT

Beside the tips from @ErikLund_Jensen , some bottlenecks can be hidden because the extensive and default use of views in DI Studio.

If you find a branch in your job that takes long time, temporarily change outputs to be tables instead. By doing so, you will in more detail see what step consumes the most resources.

A part from this, you can consider this as optimizing normal SAS code. Use options to further track whats's going on (FULLSTIMER, MSGLEVEL=i, _method PROC SQL option, and SASTRACE options for SAS/ACCESS processing).