topic Re: Regression in Statistical Procedures

Regression

AmrAd — Thu, 27 Jan 2022 14:47:59 GMT

If i have a list of 5 variable and need to derive all possible combinations for these 50 variable where no two variables are highly correlated with one another,given that i have the correlation between every two variables ( every possible pir of variables) from these 5o variables

For example i need output like highest number of combination (i.e 20-30 etc from these variables )

Re: Regression

PaigeMiller — Thu, 27 Jan 2022 14:57:43 GMT

@AmrAd wrote:
If i have a list of 5 variable and need to derive all possible combinations for these 50 variable where no two variables are highly correlated with one another,given that i have the correlation between every two variables ( every possible pir of variables) from these 5o variables

For example i need output like highest number of combination (i.e 20-30 etc from these variables )

So, this is a set of requirements that I haven't seen before. You can do all possible regressions via this code, and then weed out the ones you don't want based upon your correlation restrictions.

I wonder though, if there isn't a better way to handle multicollinearity. Actually, I don't wonder, I know there are better ways to handle multicollinearity, which also involve much less programming. The two that come to mind are PROC GLMSELECT and PROC PLS, both of which give you the ability to fit models (and compare them) in the presence of multicollienarity. If I were you, I would start there and not even bother with the method you stated.

Re: Regression

AmrAd — Thu, 27 Jan 2022 15:00:50 GMT

I am running proc logistic on these variables and the model selects up to 20-30 variables from this list. However, Variance inflation factor breaches the acceptable threshold and shows multi-collinearity in up to 10 of them. So i am looking for a code that could help me in testing out all possible combinations of these 10 with respect to the non-collinear remaining 20 or so.

Re: Regression

PaigeMiller — Thu, 27 Jan 2022 15:09:06 GMT

You can simply modify the code I linked to so that instead of PROC REG, you type in PROC LOGISTIC and the desired options.

You can also find out there on the internet SAS code for stepwise PROC GLIMMIX, which would include logistic regression as a special case.

I still think the best method of handling multicollinearity is not what you are trying to do, but Logistic Partial Least Squares. Unfortunately, this is not a feature of SAS, but it has been programmed in R. There is no logistic counterpart to PROC GLMSELECT.

Re: Regression

AmrAd — Thu, 27 Jan 2022 15:25:30 GMT

Thanks a lot will check this