turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

Find a Community

- Home
- /
- SAS Programming
- /
- SAS Procedures
- /
- PROC CORR gives Out of Memory error

Topic Options

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

05-22-2009 12:23 PM

Hi Everyone,

I'm running a PROC CORR on several thousand variables to do comparisons on product preferences. It works just fine if I keep the number of variables below 4500, but once I tell it to run PROC CORR on 5000 variables I immediately get an "Out of Memory" error.

I have tried changing OPTIONS to increase MEMSIZE with no luck. System memory is 2G, hard drive space has over 100G free, and I'm using Enterprise Guide on XP.

Is this a limitation on PROC CORR, a limitation on my system, or something else? Any advice on what I can do to get it to run? Should I be approaching this problem differently? Thanks for any advice!

-MBI

I'm running a PROC CORR on several thousand variables to do comparisons on product preferences. It works just fine if I keep the number of variables below 4500, but once I tell it to run PROC CORR on 5000 variables I immediately get an "Out of Memory" error.

I have tried changing OPTIONS to increase MEMSIZE with no luck. System memory is 2G, hard drive space has over 100G free, and I'm using Enterprise Guide on XP.

Is this a limitation on PROC CORR, a limitation on my system, or something else? Any advice on what I can do to get it to run? Should I be approaching this problem differently? Thanks for any advice!

-MBI

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

05-22-2009 02:33 PM

Go to the documentation for CORR and you will find this in the section under computer resources: "The only factor limiting the number of variables that you can analyze is the amount of available memory. The computer resources that PROC CORR requires depend on which statements and options you specify." as well as the formulas for computing the resources needed.

As far as work-arounds, you can break the correlations down. Do the 2500, do the other 2500, do the first 2500 WITH the second 2500. Then, you can combine your summary datasets and do the screening.

Doc Muhlbaier

Duke

As far as work-arounds, you can break the correlations down. Do the 2500, do the other 2500, do the first 2500 WITH the second 2500. Then, you can combine your summary datasets and do the screening.

Doc Muhlbaier

Duke

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to Doc_Duke

05-22-2009 04:11 PM

Duke,

Thanks for the quick reply. I was able to find this link ( http://www.sfu.ca/sasdoc/sashtml/proc/zconcept.htm ) which describes the calculations you mentioned. Looks like I need a bigger hard drive!

-MBI

Thanks for the quick reply. I was able to find this link ( http://www.sfu.ca/sasdoc/sashtml/proc/zconcept.htm ) which describes the calculations you mentioned. Looks like I need a bigger hard drive!

-MBI

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

05-22-2009 04:37 PM

If you are doing the non-parametric correlations, then you may need the huge disk space. If you are doing Pearson correlation, then the need is for RAM.