BookmarkSubscribeRSS Feed
shaz1
Calcite | Level 5

Hi all,

 

I have two data sets where multiple raters have rated multiple x-rays into 3 categories.  All raters have rated all x-rays and there is no missing data.

 

I've calculated overall kappas using magree for each of the two data sets.  Is anyone aware of a way to statistically compare these two kappas?  The macro produces a standard error for the overall kappa, which is very tiny (presumably because there are >200 raters in each group).  Would it be proper to use this SE to create confidence intervals?  For some reason the macro doesn't create confidence intervals, which makes me concerned I'm incorrect in doing this. Are there other ways to create these confidence intervals?  I've seen one example of bootstrapping to create CIs in this situation as well - not sure which is most appropriate.

 

Thanks!

2 REPLIES 2
Rick_SAS
SAS Super FREQ

You mention a macro for computing the kappas. Is it the %MAGREE macro that is provided by SAS?  Can you provide a link or reference for the bootstrapping example that you are considering?

 

shaz1
Calcite | Level 5

Yes - the %magree macro from SAS is what I used.  

 

This is what I've read about using bootstrapping to generate CIs for kappas:

http://support.sas.com/resources/papers/proceedings12/323-2012.pdf

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 1331 views
  • 0 likes
  • 2 in conversation