Stepwise Selection: Exclude variables if they are of the unexpected sign

bmm0628 — Thu, 17 Jun 2021 19:41:28 GMT

Hi! I am using the stepwise (and forward) selection criteria just to narrow down the variables that I use in the formal regression analysis that I use. However, a frequent problem that I have been running into is having variables in the final given model from the stepwise selection criteria with the unexpected sign, creating statistically insignificant results. With this, I was wondering if there is a way to code for this, so if the parameter estimate has a variable with the unexpected sign, it can be taken out of the model, and replaced with others.

I am using the "proc reg" procedure for this.

Thank you!

Re: Stepwise Selection: Exclude variables if they are of the unexpected sign

PaigeMiller — Fri, 18 Jun 2021 10:36:01 GMT

This is a known drawback of stepwise (and non-stepwise as well). It is caused by multi-collinearity among your X variables. Many techinques, such as PROC REG, PROC GLM, PROC LOGISTIC and so on can be very sensitive to multi-collinearity and can produce coefficients with the wrong sign.

An alternative is PROC PLS, which is surprisingly robust to multi-collinearity (and doesn't generally produce coefficients with the wrong sign). The lead programmer of PROC PLS wrote this paper, in which he fits a model with 1000 highly correlated x variables, does not bother with the step of variable selection, and still gets a useful model from PLS (Note: the syntax in the paper is very old and doesn't work in the current PROC PLS).

topic Re: Stepwise Selection: Exclude variables if they are of the unexpected sign in SAS Programming

Stepwise Selection: Exclude variables if they are of the unexpected sign

Re: Stepwise Selection: Exclude variables if they are of the unexpected sign