BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
sameer112217
Quartz | Level 8

A non-contributing predictor variable whose P value is more than .50 is added to an existing multiple linear regression model. It will increase R2 value. I want to know if the same variable is removed from the regression model what will happen?

 

R2 value going down or no change in R2 value or will it affect mean square error.

 

Take an example we remove non significant variables in backward elimination method in SAS.. does this reduce r2 value if we remove non significant predictor variable?

 

Sameer
  

1 ACCEPTED SOLUTION

Accepted Solutions
SteveDenham
Jade | Level 19

As @ballardw said, it is data dependent.  Suppose it is highly correlated with a linear combination of two or three other variables, but is not a good predictior in and of itself.  Removing it could alleviate multicollinearity, which would result in an increase in R^2.  If the nonsignificant variables are completely independent from all other predictor variables, then per the calculation of R^2, it should decrease.  But in real data, you DON'T KNOW whether this is the case or not.

 

Blanket statements rarely apply without examining the data.

 

Steve Denham

View solution in original post

4 REPLIES 4
ballardw
Super User

Yes, no or maybe. Insufficient information. Very data and procedure dependent.

 

 

sameer112217
Quartz | Level 8

In simple  wanted to know can removing non significant vaiables reduce R2 or keep it unchanged in regression?

SteveDenham
Jade | Level 19

As @ballardw said, it is data dependent.  Suppose it is highly correlated with a linear combination of two or three other variables, but is not a good predictior in and of itself.  Removing it could alleviate multicollinearity, which would result in an increase in R^2.  If the nonsignificant variables are completely independent from all other predictor variables, then per the calculation of R^2, it should decrease.  But in real data, you DON'T KNOW whether this is the case or not.

 

Blanket statements rarely apply without examining the data.

 

Steve Denham

DHINESHSHANKAR0
Fluorite | Level 6
In MLR we see the R2 value increases by the increase in the predictor variables , but are we not interested in Adj R2 in case of multiple regression ?. More over few text speaks about the control variables which can have effect on the coefficients.

SAS Innovate 2025: Save the Date

 SAS Innovate 2025 is scheduled for May 6-9 in Orlando, FL. Sign up to be first to learn about the agenda and registration!

Save the date!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 4 replies
  • 2454 views
  • 0 likes
  • 4 in conversation