BookmarkSubscribeRSS Feed
kcros
Calcite | Level 5

I have a 'black box' model that outputs model predictions, but I don't know what actually goes on inside the model. I also have a bunch of data that I can pass through the model so that I can compare the predictions with actual results. Which interval would I use to bound most of the actual values around the predicted value? I don't think that I would use the prediction interval because that would give me a range that the next prediction is likely to be in, correct? I would like to say that for a single prediction, I am 95% confident that the actual value falls into this interval.

1 REPLY 1
Rick_SAS
SAS Super FREQ

The confidence limits for the mean predicted values account for the variation due to estimating the parameters. The confidence interval for individuals adds in the variability of the error term, so it is wider.

Are you saying that you can bootstrap your data and create new predictions? If so, then check out the example of constructing bootstrap confidence intervals for the TPSPLINE procedure. Maybe you can modify that example for your situation.

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 1168 views
  • 0 likes
  • 2 in conversation