Forecasting using SAS Forecast Server, SAS/ETS, and more

Wide Confidence Interval for pedictions SAS forecast studio for desktop

Reply
Contributor
Posts: 60

Wide Confidence Interval for pedictions SAS forecast studio for desktop

what can be the reason for having very wide confidence intervals for the predictions? Should one report these predictions, if yes how would he explain the wide C.I?

Super User
Posts: 11,343

Re: Wide Confidence Interval for pedictions SAS forecast studio for desktop

How wide is "very wide"?

 

Wider intervals generally come from the variability in the observed data for the number of records used. Generally a small sample will have a larger CI for a given dispersion of data than a larger sample with the same dispersion.

 

And with forecasts, the farther from the observed data in time the wider.

Super User
Posts: 19,868

Re: Wide Confidence Interval for pedictions SAS forecast studio for desktop

Wider Prediction Intervals (PI) may indicate that your forecast model isn't optimal.

Should you report predictions? That depends on if they're useful in a practical sense, given the PI. If they're too variable to be of use, then they're not, and the criteria for such a definition would vary from field to field. In the medical field, very small PI would be optimal, while in a retail setting wider PI may be perfectly fine.
SAS Employee
Posts: 416

Re: Wide Confidence Interval for pedictions SAS forecast studio for desktop

Hello -

Confidence limits are based on the prediction standard errors and a chosen confidence limit size. The variance of each forecast is called the prediction error variance, and the square root of the variance is called the prediction standard error. The variance is computed from the forecast model parameter estimates and the model residual variance. Wide CI usually indicate either a poor performing model or lots of noise in your data.

 

Have you considered using forecast combinations, also called ensemble forecasts? They are a known technique for improving forecast accuracy and reducing the variability of the resulting forecasts. See: http://blogs.sas.com/content/subconsciousmusings/2014/06/18/combined-forecasts-what-to-do-when-one-m...

 

Thanks,

Udo

Ask a Question
Discussion stats
  • 3 replies
  • 382 views
  • 1 like
  • 4 in conversation