topic Re: proc freq for huge data in SAS Programming

proc freq for huge data

abdullala — Wed, 04 Nov 2009 22:12:00 GMT

I got a huge data of over 100 million records, 2 variables a and b. I need to do
proc freq;
table a*b;
run;

I got:
ERROR: The requested table is too large to process.

any suggestions to beat this beast? many thanks!

Re: proc freq for huge data

LinusH — Thu, 05 Nov 2009 08:07:49 GMT

I think FREQ try to build this in physical memory.
On way of doing this is to use SQL, which will use utility files on disk during sort/summarization.
Or you could try a divide and conquer strategi...

/Linus