Depending on the framework (e.g., are the same subjects being rated, etc.), here are a couple of resources.
SAS Note and the MAGREE macro for more than 2 raters:
Compute estimates and tests of agreement among multiple raters
Gwet (2016). "Testing the Difference of Correlated Agreement Coefficients for Statistical Significance." Educational and Psychological Measurement 76(4): 609-637.
The AGREE(AC1) option in PROC FREQ produces Gwet's AC1 agreement coefficient.
proc freq data=have;
tables rater1 * rater2 / agree(ac1);
run;
Thank you very much for your answer but I 'm looking for a method to test the difference between two AC1 : Indeed, I have an AC1 (with 95%CI) (Rater1 *Rater 2) that I would like to compare with another AC1 (with 95%CI) (Rater1 * Rater 3) . I already calculate each AC1 with the proc freq procedure...
Thank you very much for your help
Depending on the framework (e.g., are the same subjects being rated, etc.), here are a couple of resources.
SAS Note and the MAGREE macro for more than 2 raters:
Compute estimates and tests of agreement among multiple raters
Gwet (2016). "Testing the Difference of Correlated Agreement Coefficients for Statistical Significance." Educational and Psychological Measurement 76(4): 609-637.
Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!
ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.
Find more tutorials on the SAS Users YouTube channel.