A non-contributing predictor variable whose P value is more than .50 is added to an existing multiple linear regression model. It will increase R2 value. I want to know if the same variable is removed from the regression model what will happen?
R2 value going down or no change in R2 value or will it affect mean square error.
Take an example we remove non significant variables in backward elimination method in SAS.. does this reduce r2 value if we remove non significant predictor variable?
Sameer
As @ballardw said, it is data dependent. Suppose it is highly correlated with a linear combination of two or three other variables, but is not a good predictior in and of itself. Removing it could alleviate multicollinearity, which would result in an increase in R^2. If the nonsignificant variables are completely independent from all other predictor variables, then per the calculation of R^2, it should decrease. But in real data, you DON'T KNOW whether this is the case or not.
Blanket statements rarely apply without examining the data.
Steve Denham
Yes, no or maybe. Insufficient information. Very data and procedure dependent.
In simple wanted to know can removing non significant vaiables reduce R2 or keep it unchanged in regression?
As @ballardw said, it is data dependent. Suppose it is highly correlated with a linear combination of two or three other variables, but is not a good predictior in and of itself. Removing it could alleviate multicollinearity, which would result in an increase in R^2. If the nonsignificant variables are completely independent from all other predictor variables, then per the calculation of R^2, it should decrease. But in real data, you DON'T KNOW whether this is the case or not.
Blanket statements rarely apply without examining the data.
Steve Denham
SAS Innovate 2025 is scheduled for May 6-9 in Orlando, FL. Sign up to be first to learn about the agenda and registration!
ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.
Find more tutorials on the SAS Users YouTube channel.