BookmarkSubscribeRSS Feed
mmyrto
Quartz | Level 8

what can be the reason for having very wide confidence intervals for the predictions? Should one report these predictions, if yes how would he explain the wide C.I?

3 REPLIES 3
ballardw
Super User

How wide is "very wide"?

 

Wider intervals generally come from the variability in the observed data for the number of records used. Generally a small sample will have a larger CI for a given dispersion of data than a larger sample with the same dispersion.

 

And with forecasts, the farther from the observed data in time the wider.

Reeza
Super User
Wider Prediction Intervals (PI) may indicate that your forecast model isn't optimal.

Should you report predictions? That depends on if they're useful in a practical sense, given the PI. If they're too variable to be of use, then they're not, and the criteria for such a definition would vary from field to field. In the medical field, very small PI would be optimal, while in a retail setting wider PI may be perfectly fine.
udo_sas
SAS Employee

Hello -

Confidence limits are based on the prediction standard errors and a chosen confidence limit size. The variance of each forecast is called the prediction error variance, and the square root of the variance is called the prediction standard error. The variance is computed from the forecast model parameter estimates and the model residual variance. Wide CI usually indicate either a poor performing model or lots of noise in your data.

 

Have you considered using forecast combinations, also called ensemble forecasts? They are a known technique for improving forecast accuracy and reducing the variability of the resulting forecasts. See: http://blogs.sas.com/content/subconsciousmusings/2014/06/18/combined-forecasts-what-to-do-when-one-m...

 

Thanks,

Udo

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

Multiple Linear Regression in SAS

Learn how to run multiple linear regression models with and without interactions, presented by SAS user Alex Chaplin.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 935 views
  • 1 like
  • 4 in conversation