Hi ,
I have to compute correlation of the aproximately 11000 variables. But Proc Corr has restriction of 3000 variables. Could anybody suggest me, if there is any alternative way to accomplish this task. Could you also provide me the possible SAS code(s).
Shyam
You can use a macro to walk throught every single variable for all of them , then append them all together.
data x; array _a{*} a1-a11000; do j=1 to 10 ; do i=1 to dim(_a); _a{i}=ranuni(0); end; output; end;drop i j; run; proc corr data=x outp=want1 noprint; var _all_; with a1; run; proc corr data=x outp=want2 noprint ; var _all_; with a2; run; .............. and so on
Ksharp
You could do a series of PROC CORRs with chunks of the variables, output the results and then combine the results to further process them. It is just 16 PROC CORR executions. Che the documentation for how to code it.
I question the wisdom of that many correlations; some of the results will be just spurious noise.
Doc Muhlbaier
Duke
You can use a macro to walk throught every single variable for all of them , then append them all together.
data x; array _a{*} a1-a11000; do j=1 to 10 ; do i=1 to dim(_a); _a{i}=ranuni(0); end; output; end;drop i j; run; proc corr data=x outp=want1 noprint; var _all_; with a1; run; proc corr data=x outp=want2 noprint ; var _all_; with a2; run; .............. and so on
Ksharp
Thanks Ksharp for your coding help. Comments form Doc@Duke and PaigeMiller appreciated.
Doc@Duke said
I question the wisdom of that many correlations; some of the results will be just spurious noise.
This is wise advice. What are you going to do with 11000*10999/2 > 60 million correlations? What is the real problem you are trying to solve with this data?
Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.
Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.
Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.
Find more tutorials on the SAS Users YouTube channel.