topic Re: Proc corr in SAS Procedures

Proc corr

shyam — Tue, 18 Sep 2012 19:16:50 GMT

Hi ,

I have to compute correlation of the aproximately 11000 variables. But Proc Corr has restriction of 3000 variables. Could anybody suggest me, if there is any alternative way to accomplish this task. Could you also provide me the possible SAS code(s).

Shyam

Re: Proc corr

Doc_Duke — Tue, 18 Sep 2012 19:57:34 GMT

You could do a series of PROC CORRs with chunks of the variables, output the results and then combine the results to further process them. It is just 16 PROC CORR executions. Che the documentation for how to code it.

I question the wisdom of that many correlations; some of the results will be just spurious noise.

Doc Muhlbaier

Duke

Re: Proc corr

Ksharp — Wed, 19 Sep 2012 03:19:41 GMT

You can use a macro to walk throught every single variable for all of them , then append them all together.

data x;
 array _a{*} a1-a11000;
 do j=1 to 10 ;
 do i=1 to dim(_a);
  _a{i}=ranuni(0);
 end;
 output; 
end;drop i j;
run;
proc corr data=x outp=want1 noprint;
 var _all_;
 with a1;
run;

proc corr data=x outp=want2 noprint ;
 var _all_;
 with a2;
run;

 
.............. and so on

Ksharp

Re: Proc corr

PaigeMiller — Wed, 19 Sep 2012 12:39:00 GMT

Doc@Duke said

I question the wisdom of that many correlations; some of the results will be just spurious noise.

This is wise advice. What are you going to do with 11000*10999/2 > 60 million correlations? What is the real problem you are trying to solve with this data?

Re: Proc corr

shyam — Thu, 27 Dec 2012 16:23:37 GMT

Thanks Ksharp for your coding help. Comments form Doc@Duke and PaigeMiller appreciated.