Forecasting using SAS Forecast Server, SAS/ETS, and more

proc ucm intervention variables reduces r squared value

Reply
New Contributor
Posts: 3

proc ucm intervention variables reduces r squared value

 

Hi!!

 

Why r squared value reduces when i introducing intervention variables in the model??? However AIC and BIC improves.

 

regards

SAS Employee
Posts: 416

Re: proc ucm intervention variables reduces r squared value

Hello -

One reason might be that using R Square for forecasting models is not a good idea in the first place.

See for example: http://www.forecastingprinciples.com/index.php/2013-01-30-11-08-58/10-practitioner/238-rules-for-che...

Thanks,

Udo

SAS Employee
Posts: 57

Re: proc ucm intervention variables reduces r squared value

Please see my response (towards the end of a long correspondence) for a question on UCM diagnostics ("Unobserved Components Model Model Diagnostic").  It explains how one-step-residuals are produced by the UCM procedure, including the fact that UCM residuals are different from the usual OLS residuals that are produced by the standard regression procedures such as PROC REG.  Consequently, many common things that are true for standard regression model do not hold for UCM models, e.g., adding a regerssor in the model need not decrease Rsquare, Rsquare can be negative, etc.  

 

In general, for time series models one-step-ahead residuals based Rsquare is not as useful a fit statistic as usual Rsquare is in standard regression modeling.  Diagnostics for time series models is a little more involved and one must rely on a variety fit measures besides one-step-ahead residuals based fit measures.  PROC UCM provides a wide variety of fit/diagnostic measures (both numerical and graphical) including:

1.  one-step-ahead residual based fit measures and plots

2.  information theoretic fit measures based on likelihood

3.  delete-one-measurement based influence statistics

4.  prediction errors based on with-holding last few measurements of the time series (see the BACK= option in the ESTIMATE and FORECAST statements)

5.  see the additional graphical diagnostics explained on http://support.sas.com/documentation/cdl/en/etsug/68148/HTML/default/viewer.htm#etsug_ucm_details31....

 

This is a large topic.  More details some other times.

 

Ask a Question
Discussion stats
  • 2 replies
  • 207 views
  • 4 likes
  • 3 in conversation