topic Re: How to solve memory issue in SAS EM? in SAS Data Science

How to solve memory issue in SAS EM?

Riana — Mon, 30 May 2016 11:55:46 GMT

I work with a model in SAS Enterprise Miner that when I run it I'm getting this message:

'ERROR: The SAS System stopped processing this step because of insufficient memory.'

Physical memory has been added:

From MEMSIZE 8G To MEMSIZE 12G

From SORTSIZE 1G To SORTSIZE 4G

But it didn't help and I'm still getting the same error message. If increasing the memory is the only way?

Is there any other thing that should be consider about this issue?

Re: How to solve memory issue in SAS EM?

LinusH — Mon, 30 May 2016 12:24:35 GMT

You say that physical memory have been added. But how much free physical memory do you have prior to your SAS process? Increasing those options can be contra productive if you don't have the resources.

Also, be sure that you have enough space on disk as well.

Would be interesting to see the log when you get the error, preferably using

options fullstimer;

Re: How to solve memory issue in SAS EM?

Riana — Mon, 30 May 2016 13:47:44 GMT

Thanks LinusH for your reply. The log file is a long file. Could you tell me which part of it you would like to see? There are many time descriptions(cpu, system,..) for PROCEDURE SORT , PROCEDURE FREQ , PROCEDURE PRINT, PROCEDURE DMDB,PROCEDURE ASSOC,..

Actually I'm getting this error when running Association node.

Re: How to solve memory issue in SAS EM?

LinusH — Mon, 30 May 2016 13:56:23 GMT

The step that crashes.

Again, monitor the actual system resources outside SAS as well.

Re: How to solve memory issue in SAS EM?

Riana — Mon, 30 May 2016 14:39:57 GMT

Memory has been increased to 16G. Please see the attached file.

Re: How to solve memory issue in SAS EM?

LinusH — Tue, 31 May 2016 10:32:37 GMT

Still not seeing the SAS code that generates this error.

Still, can you verify that the actual physical memory is 16GB?

If this is the case, you probably shouldn't set 16GB in SAS, since the OS, other users and applications probably uses some of that memory. Look into your OS monitor to see the memory usage prior to your batch.

Also, check how much free space there is where your library ABCD1 resides.

And again, check the amount available space on saswork.

How large is the input table(s) to this step?

If you need help, it's better to give a little more, or at least as much information we ask for - not less.