Dear All:
I want to calculate the following measures for multiple raters (or observers) from the data given below.
- How to calculate the Cohen's Kappa "K" for multiple raters.
- The measure of agreement; I am not sure if this measure is the same as "the interobserver agreement"
- Spearman's "rho"
I know how to get the Cohen's Kappa for two raters; using the PROC FREQ, TABLES statement with the option agree, BUT do not know how to calculate it for multiple raters.
Thank you very much
abou
===========================
data have;
input Rater1 Rater2 Rater3;
datalines;
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 2.00
0.00 1.00 1.00
0.00 . 0.00
. . .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 0.00
0.00 1.00 1.00
0.00 . .
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 1.00 .
0.00 1.00 2.00
0.00 1.00 1.00
0.00 0.00 .
0.00 . 1.00
0.00 1.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
1.00 1.00 1.00
. . .
0.00 1.00 .
0.00 1.00 1.00
0.00 . .
0.00 0.00 1.00
0.00 1.00 1.00
0.00 . .
0.00 0.00 1.00
0.00 0.00 2.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
. . .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 2.00
0.00 . 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 .
0.00 1.00 1.00
0.00 1.00 1.00
. . .
0.00 . .
0.00 0.00 0.00
0.00 1.00 2.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 1.00 .
0.00 0.00 1.00
. . .
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
. . .
0.00 1.00 2.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 1.00 .
0.00 1.00 1.00
0.00 0.00 1.00
0.00 1.00 .
. . 1.00
. 0.00 2.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 3.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 .
0.00 2.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 . .
0.00 1.00 1.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
. . .
0.00 1.00 2.00
;
run;
proc print data = have;
run;
