BookmarkSubscribeRSS Feed
mmyrto
Quartz | Level 8

what can be the reason for having very wide confidence intervals for the predictions? Should one report these predictions, if yes how would he explain the wide C.I?

3 REPLIES 3
ballardw
Super User

How wide is "very wide"?

 

Wider intervals generally come from the variability in the observed data for the number of records used. Generally a small sample will have a larger CI for a given dispersion of data than a larger sample with the same dispersion.

 

And with forecasts, the farther from the observed data in time the wider.

Reeza
Super User
Wider Prediction Intervals (PI) may indicate that your forecast model isn't optimal.

Should you report predictions? That depends on if they're useful in a practical sense, given the PI. If they're too variable to be of use, then they're not, and the criteria for such a definition would vary from field to field. In the medical field, very small PI would be optimal, while in a retail setting wider PI may be perfectly fine.
udo_sas
SAS Employee

Hello -

Confidence limits are based on the prediction standard errors and a chosen confidence limit size. The variance of each forecast is called the prediction error variance, and the square root of the variance is called the prediction standard error. The variance is computed from the forecast model parameter estimates and the model residual variance. Wide CI usually indicate either a poor performing model or lots of noise in your data.

 

Have you considered using forecast combinations, also called ensemble forecasts? They are a known technique for improving forecast accuracy and reducing the variability of the resulting forecasts. See: http://blogs.sas.com/content/subconsciousmusings/2014/06/18/combined-forecasts-what-to-do-when-one-m...

 

Thanks,

Udo

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 956 views
  • 1 like
  • 4 in conversation