proc ucm intervention variables reduces r squared value

MTM1 — Fri, 18 Nov 2016 10:03:32 GMT

Hi!!

Why r squared value reduces when i introducing intervention variables in the model??? However AIC and BIC improves.

regards

Re: proc ucm intervention variables reduces r squared value

udo_sas — Mon, 21 Nov 2016 13:24:58 GMT

Hello -

One reason might be that using R Square for forecasting models is not a good idea in the first place.

See for example: http://www.forecastingprinciples.com/index.php/2013-01-30-11-08-58/10-practitioner/238-rules-for-cheaters-how-to-get-a-high-r2

Thanks,

Udo

Re: proc ucm intervention variables reduces r squared value

rselukar — Mon, 21 Nov 2016 14:35:29 GMT

Please see my response (towards the end of a long correspondence) for a question on UCM diagnostics ("Unobserved Components Model Model Diagnostic"). It explains how one-step-residuals are produced by the UCM procedure, including the fact that UCM residuals are different from the usual OLS residuals that are produced by the standard regression procedures such as PROC REG. Consequently, many common things that are true for standard regression model do not hold for UCM models, e.g., adding a regerssor in the model need not decrease Rsquare, Rsquare can be negative, etc.

In general, for time series models one-step-ahead residuals based Rsquare is not as useful a fit statistic as usual Rsquare is in standard regression modeling. Diagnostics for time series models is a little more involved and one must rely on a variety fit measures besides one-step-ahead residuals based fit measures. PROC UCM provides a wide variety of fit/diagnostic measures (both numerical and graphical) including:

1. one-step-ahead residual based fit measures and plots

2. information theoretic fit measures based on likelihood

3. delete-one-measurement based influence statistics

4. prediction errors based on with-holding last few measurements of the time series (see the BACK= option in the ESTIMATE and FORECAST statements)

5. see the additional graphical diagnostics explained on http://support.sas.com/documentation/cdl/en/etsug/68148/HTML/default/viewer.htm#etsug_ucm_details31.htm

This is a large topic. More details some other times.

topic Re: proc ucm intervention variables reduces r squared value in SAS Forecasting and Econometrics

proc ucm intervention variables reduces r squared value

Re: proc ucm intervention variables reduces r squared value

Re: proc ucm intervention variables reduces r squared value