- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
I need to compare 2 agreement coeficients (Gwet's AC1) to know if diagnostic value is better than another.
Does someone know how to compute it with sas ?
Thank you in advance for your help
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
Depending on the framework (e.g., are the same subjects being rated, etc.), here are a couple of resources.
SAS Note and the MAGREE macro for more than 2 raters:
Compute estimates and tests of agreement among multiple raters
Gwet (2016). "Testing the Difference of Correlated Agreement Coefficients for Statistical Significance." Educational and Psychological Measurement 76(4): 609-637.
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
The AGREE(AC1) option in PROC FREQ produces Gwet's AC1 agreement coefficient.
proc freq data=have;
tables rater1 * rater2 / agree(ac1);
run;
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
Thank you very much for your answer but I 'm looking for a method to test the difference between two AC1 : Indeed, I have an AC1 (with 95%CI) (Rater1 *Rater 2) that I would like to compare with another AC1 (with 95%CI) (Rater1 * Rater 3) . I already calculate each AC1 with the proc freq procedure...
Thank you very much for your help
- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content
Depending on the framework (e.g., are the same subjects being rated, etc.), here are a couple of resources.
SAS Note and the MAGREE macro for more than 2 raters:
Compute estimates and tests of agreement among multiple raters
Gwet (2016). "Testing the Difference of Correlated Agreement Coefficients for Statistical Significance." Educational and Psychological Measurement 76(4): 609-637.