DATA Step, Macro, Functions and more

proc freq for huge data

Reply
Contributor
Posts: 74

proc freq for huge data

I got a huge data of over 100 million records, 2 variables a and b. I need to do
proc freq;
table a*b;
run;

I got:
ERROR: The requested table is too large to process.

any suggestions to beat this beast? many thanks!
Super User
Posts: 5,255

Re: proc freq for huge data

I think FREQ try to build this in physical memory.
On way of doing this is to use SQL, which will use utility files on disk during sort/summarization.
Or you could try a divide and conquer strategi...

/Linus
Data never sleeps
Ask a Question
Discussion stats
  • 1 reply
  • 180 views
  • 0 likes
  • 2 in conversation