BookmarkSubscribeRSS Feed
SAS_ter
Calcite | Level 5

Hi,

Does anyone know how I can use an existing dataset to output 95% confidence intervals around sensitivity/specificity values? I have created a cross-tab so that I can derive my sens/spec values by hand. However, I'd like SAS to run the 95% CI for me without me having to input the data values each time.

Secondly, what test can I do in SAS to compare two sensitivity values to determine if they are significantly different from each other? i.e. Algorithm vs,Test A gives me a sens. value of 0.87 and Algorithm vs.Test B gives me a sens. value of 0.89, this is done on the same population. What test/code do I use in SAS to determine this?

Thanks in advance.

1 REPLY 1
HWSteinberg
Calcite | Level 5

Hi SAS'ter,

What do you need? Sensitivity and Specificity are polygons running from (low,1) to (high,0) and from (low,0) to (high,1) resp. or vice versa when the measured data values range from low to high, and combined as ROC curve, forgetting the data values, from (0,0) to (1,1) where the x-axis is 1-specificity and the y-axis is sensitivity.

So do you need confidence bands? Then I'm sorry I can't help you. Or do you rely to specific parameters like the AUC (Area Under roc Curve) or to the Youden index, the maximum of all possible (sensitivity + specificity -1) values or, you speaking of sensitivity values, just those sensitivity values from the Youden index? The values you mention, 0.87 and 0.89, could be all 3 of them.

The first, since SAS9.2, can be done with PROC LOGISTIC and the ROC statement, the second and third one only, as far as I know, with bootstrap resamples of your data. Eventually this last task can be done with PROC SURVEYSELECT, but still I didn't apply that. Otherwise it's an easy task to create 1000 or 10000 resamples of your data and take the limits of the inner 95% of the values in question as the confidence limits

Hope that helps a bit.

Hans

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 1459 views
  • 0 likes
  • 2 in conversation