Hey guys,
I have attached an image of my calibration plot.
My interpretation: When probability is about 0.6 and greater, predicted probabilities are close to or on target as it relates to the actual outcome, but below that probability they tend to be inaccurate in terms of predicting event?
You should be asking WPS related questions to the WPS community.
Calling @Rick_SAS . Rick have written several blogs about it .
That looks like a decile calibration plot. You can read about the decile calibration plot and why many researchers do not recommend their use.
I've written other articles about the loess-smoothed calibration plot:
- How to create if you are running SAS/STAT prior to 15.1
- How to create a calibration plot directly in PROC LOGISTIC in SAS?STAT 15.1 or later.
The first two links include a discussion of how to interpret the plots and references to the literature.
Regarding your interpretation: yes, your interpretation seems correct. For low values of the predicted probabilities, the model seems inaccurate. I'd add that the very high predicted probabilities seem to have some issues as well.
Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!
ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.
Find more tutorials on the SAS Users YouTube channel.