BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
deb193
Fluorite | Level 6

Hi all -

I have run a PROC LOGISTIC with and without my weight variable. The regression seems fine and agrees SPSS and Stata where I specified the same model. More of hte predictors are signifigant for the weighted data, and the overall R2 is higher. (I did have to tell SAS to model event=1 to get the same outputs.) However, the area under the ROC curve gets smaller in SAS weighted model, where it should be increasing. It increases when I produce ROC after weighted logistic in Stata, and when ROC curves are obtained in SPSS.

It almost looks like the ROC plot is not using the weights - except the area under the curve is even smaller than the ROC area form theunweighted analysis.

I am going to try generating a score dataset, and computing the sensitivity and susceptibility to do my own ROC calculations - but I though I would ask if anyone else has seen this.

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions
Rick_SAS
SAS Super FREQ

By default, weights are used to fit the model, but not to compute the ROC. See if the ROCOPTIONS(WEIGHTED) option on the PROC LOGISTIC statement addresses your needs.

Rick

View solution in original post

2 REPLIES 2
Rick_SAS
SAS Super FREQ

By default, weights are used to fit the model, but not to compute the ROC. See if the ROCOPTIONS(WEIGHTED) option on the PROC LOGISTIC statement addresses your needs.

Rick

deb193
Fluorite | Level 6

This worked perfectly. However, it begs the question, "Why is this the default?". In other words, what is the value of ROC and AUC without weights when weights have been used? IS there some downside or bias to the weighted ROC?

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 2417 views
  • 0 likes
  • 2 in conversation