topic Re: Ordinal Logistic Regression in Statistical Procedures

Ordinal Logistic Regression

DJGS — Tue, 21 Jul 2020 17:27:07 GMT

Hi: I performed an ordinal logistic regression (dependent variable has values of 0,1, and 2) which I was interested in with respect to two predictors (one is a weight variable) and the other an age variable. Before running the regression I checked to see that the two predictors were not highly correlated (they weren't). When I ran the model, I found that it was statistically significant as were the two predictors. I was thrilled.

Then I thought maybe I needed to check for an interaction effect. When I added the interaction effect, neither main effects nor the interaction were significant. Finally, I then checked to see if the interaction alone (without the individual predictors included in the model) was significant-- and it was. I am just wondering how someone with better statistical knowledge than me would make sense of these results. Thank you! Cheers, DJGS

Re: Ordinal Logistic Regression

PaigeMiller — Tue, 21 Jul 2020 18:07:57 GMT

Welcome to the world of correlated predictors. Even though you said the two predictors were not highly correlated, I'm sure the correlation wasn't zero either, and then adding in the interaction later creates a different (and usually more) multi-collinearity to the party. And so, what you expect to happen is reasonable, two predictors are significant, then you add in the interaction and you expect the two predictors to remain significant; but that's not what happens. The multi-collinearity has an impact here and sometimes it is counter-intuitive. But this is a deficiency of most regression methods, that adding terms into the model cause previously significant terms to become insignificant, or vice versa. Isn't that awesome? 🙂

Well, what's the solution? Stepwise is not the solution, it has the same deficiencies. I like to use Partial Least Squares regression (PROC PLS) which is much less susceptible to these problems, but PROC PLS only works for continuous Y. There is a logistic version of the algorithm out there on the internet, and an R-package, but if you are using SAS, there is no such algorithm that I know of (except for the one I wrote, and I doubt my employer would want me to share it).

Re: Ordinal Logistic Regression

DJGS — Tue, 21 Jul 2020 18:18:13 GMT

Thanks-- that is very helpful. Cheers, DJGS