BookmarkSubscribeRSS Feed
edasdfasdfasdfa
Quartz | Level 8

cali.jpgHey guys,

 

I have attached an image of my calibration plot. 

 

My interpretation: When probability is about 0.6 and greater, predicted probabilities are close to or on target as it relates to the actual outcome, but below that probability they tend to be inaccurate in terms of predicting event?

 

 

3 REPLIES 3
PGStats
Opal | Level 21

You should be asking WPS related questions to the WPS community.

PG
Ksharp
Super User

Calling @Rick_SAS   . Rick have written several blogs about it .

Rick_SAS
SAS Super FREQ

That looks like a decile calibration plot. You can read about the decile calibration plot and why many researchers do not recommend their use.

 

I've written other articles about the loess-smoothed calibration plot:

- How to create if you are running SAS/STAT prior to 15.1

- How to create a calibration plot directly in PROC LOGISTIC in SAS?STAT 15.1 or later.

 

The first two links include a discussion of how to interpret the plots and references to the literature.

 

Regarding your interpretation: yes, your interpretation seems correct. For low values of the predicted probabilities, the model seems inaccurate. I'd add that the very high predicted probabilities seem to have some issues as well.

sas-innovate-2026-white.png



April 27 – 30 | Gaylord Texan | Grapevine, Texas

Registration is open

Walk in ready to learn. Walk out ready to deliver. This is the data and AI conference you can't afford to miss.
Register now and lock in 2025 pricing—just $495!

Register now

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 3 replies
  • 2703 views
  • 0 likes
  • 4 in conversation