turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

Find a Community

- Home
- /
- Analytics
- /
- Stat Procs
- /
- Regression: Best Subsets

Topic Options

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

03-15-2012 03:47 PM

Hi,

I need help finding the the most significant, non-correlated, variables in SAS.

The Current Approach:

In the "Analysis" section, I am currently going line by line to find which variables are correlated. I have 187 variables, so that is 2^187 (=1.961e56) combinations I have to go through. I am using the Pearson Correlation Coefficient to find multicolinearity b/t variables. I am eliminating ones that are >.80

I know that SAS can hadle the best subsets, but I would like the best subsets for 187 variables taking into accounf multicolinearity

Ideally I would like to:

1.) Eliminate all of the correlation b/t the 187 variables

2.) With the non correlated variables, I would like to find the most significant, best subset of variables to run in a regression

This is taking too long, and I know there is a more mathematical approach to solve this. That is why I am reaching out to people much smarter than myself

Thanks for any help!

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

03-15-2012 04:04 PM

Have you looked into Principal Compenents Analysis (PCA)?

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

03-15-2012 04:09 PM

This is a vast subject, full of traps. Here is one approach. You should try doing a PCA (proc princomp) to determine roughly how many *true* independent factors are among your variables. Then you should look for best subsets of that size using best subset regression. Last, you should check, starting with the *bestest* subset, that the chosen variables are indeed uncorrelated (it is unlikely that correlated variables will turn out in the same subset). After all that, make sure the model makes sense, that it is meaningful!

My two cents.

PG

PG