topic Re: Use subflow - SAS Management Console optimizing memory use in Administration and Deployment

Use subflow - SAS Management Console optimizing memory use

ANLYNG — Fri, 03 Dec 2021 15:14:08 GMT

Hi Community,

we have large dataset processed via defined subflows in one flow in SAS Management console. We use SAS DI to define the deployed jobs.

Sometimes the batch flow result in an error and stop processing because of memory exhaust.

I was wondering if it would help if I scheduled only one flow at a time instead of one flow contaning 6 subflows? or is there a option where I can reset the memory use in the sas di jobs?

Thanks in advance. I look forward to hear from you and the best practice for minimzing memory use during batch running via SAS SMC.

Regards,

Ann

Re: Use subflow - SAS Management Console optimizing memory use

LinusH — Fri, 03 Dec 2021 15:24:09 GMT

Hi,

Question is if you are constrained by memory in the job, or if the whole server's memory is exhasted.

To increase the memory availbe for a single job - you can add the MEMSIZE option on a deployed job in SMC, use the Advanced... in the Scheduling details tab.
If server memory is constrained, rearrange jobs so they don't run in parallel, or decrease the MEMSIZE for relevant jobs.

You can also change the MEMSIZE for all your jobs, e.g. using the config file under /BatchServer.