topic Re: Unable to allocate sufficient memory in proc quantreg in Administration and Deployment

Unable to allocate sufficient memory in proc quantreg

Boriana — Wed, 16 Jan 2019 14:34:58 GMT

I'm running

proc quantreg

with 2 independent variables over 12555029 cases.

The error for insufficient memory is appear:

ERROR: Unable to allocate sufficient memory. At least 1177035K bytes were requested, but only
786430K were available. You must either increase the amount of memory available, or
approach the problem differently.

I have 8GB RAM.

I check memsize and receive the next:

Group=MEMORY
SORTSIZE=268435456
Specifies the amount of memory that is available to the SORT procedure.
SUMSIZE=0 Specifies a limit on the amount of memory that is available for data
summarization procedures when class variables are active.
MAXMEMQUERY=0 Specifies the maximum amount of memory that is allocated for procedures.
MEMBLKSZ=16777216 Specifies the memory block size for Windows memory-based libraries.
MEMMAXSZ=2147483648
Specifies the maximum amount of memory to allocate for using memory-based
libraries.
LOADMEMSIZE=0 Specifies a suggested amount of memory that is needed for executable programs
loaded by SAS.
MEMSIZE=4294967295
Specifies the limit on the amount of virtual memory that can be used during a
SAS session.
REALMEMSIZE=0 Specifies the amount of real memory SAS can expect to allocate.

The option sasv9.cfg in sas is 6GB. But the same error appear with different sises there.

Do you know that if I increase my RAM the problem will be solved.

Re: Unable to allocate sufficient memory in proc quantreg

SASKiwi — Wed, 16 Jan 2019 19:12:55 GMT

The error message says the procedure needs over 11GB of memory to work. So if you have only 8GB of actual memory then it just isn't going to work. I'm not familiar with QUANTREG, but you could experiment with samples of your data rather than the full volume.

Re: Unable to allocate sufficient memory in proc quantreg

Boriana — Thu, 17 Jan 2019 08:14:08 GMT

I put additionally 8GB, but error still persist.

By looking in memory occupation in task manager during running of procedure I notice that it occupied only 2GB. The memory size is changed to 12GB in SAS config. But it is not occupied. It should be set memory size by command or something else. SAS is not allocate dedicated RAM for computing.

Re: Unable to allocate sufficient memory in proc quantreg

SASKiwi — Thu, 17 Jan 2019 08:29:15 GMT

Are you using 32-bit or 64-bit SAS? If you are using 32-bit SAS then 2 GB is about the limit it can use because of memory addressing limitations.

Re: Unable to allocate sufficient memory in proc quantreg

Boriana — Thu, 17 Jan 2019 09:04:10 GMT

I thing this is 32bit version with some emulation of 64bit, but in core it is 32bit.

My version is 9.4. I use SAS Analytics modules.

The print screen of my version is in picture. But it is written that my version is 32bit.

Re: Unable to allocate sufficient memory in proc quantreg

SASKiwi — Thu, 17 Jan 2019 18:58:35 GMT

Yes, Windows is 32-bit so SAS has to be too. On Windows 64-bit you can run either 32 or 64 bit SAS.

Re: Unable to allocate sufficient memory in proc quantreg

MargaretC — Thu, 17 Jan 2019 19:00:47 GMT

Yes, on Windows 64 bit you can run either 32-bit or 64-bit SAS