BookmarkSubscribeRSS Feed
MTM1
Fluorite | Level 6

 

Hi!!

 

Why r squared value reduces when i introducing intervention variables in the model??? However AIC and BIC improves.

 

regards

2 REPLIES 2
udo_sas
SAS Employee

Hello -

One reason might be that using R Square for forecasting models is not a good idea in the first place.

See for example: http://www.forecastingprinciples.com/index.php/2013-01-30-11-08-58/10-practitioner/238-rules-for-che...

Thanks,

Udo

rselukar
SAS Employee

Please see my response (towards the end of a long correspondence) for a question on UCM diagnostics ("Unobserved Components Model Model Diagnostic").  It explains how one-step-residuals are produced by the UCM procedure, including the fact that UCM residuals are different from the usual OLS residuals that are produced by the standard regression procedures such as PROC REG.  Consequently, many common things that are true for standard regression model do not hold for UCM models, e.g., adding a regerssor in the model need not decrease Rsquare, Rsquare can be negative, etc.  

 

In general, for time series models one-step-ahead residuals based Rsquare is not as useful a fit statistic as usual Rsquare is in standard regression modeling.  Diagnostics for time series models is a little more involved and one must rely on a variety fit measures besides one-step-ahead residuals based fit measures.  PROC UCM provides a wide variety of fit/diagnostic measures (both numerical and graphical) including:

1.  one-step-ahead residual based fit measures and plots

2.  information theoretic fit measures based on likelihood

3.  delete-one-measurement based influence statistics

4.  prediction errors based on with-holding last few measurements of the time series (see the BACK= option in the ESTIMATE and FORECAST statements)

5.  see the additional graphical diagnostics explained on http://support.sas.com/documentation/cdl/en/etsug/68148/HTML/default/viewer.htm#etsug_ucm_details31....

 

This is a large topic.  More details some other times.

 

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 996 views
  • 4 likes
  • 3 in conversation