Cohen's Kappa for multiple raters

Occasional Learner
Posts: 1

Cohen's Kappa for multiple raters

[ Edited ]

Dear All:

I want to calculate the following measures for multiple raters (or observers) from the data given below.

- How to calculate the Cohen's Kappa "K" for multiple raters.

- The measure of agreement; I am not sure if this measure is the same as "the interobserver agreement"

- Spearman's "rho"

I know how to get the Cohen's Kappa for two raters; using the PROC FREQ, TABLES statement with the option agree, BUT do not know how to calculate it for multiple raters.

Thank you very much
abou

===========================

data have;
input Rater1 Rater2 Rater3;
datalines;
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 2.00
0.00 1.00 1.00
0.00 . 0.00
. . .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 0.00
0.00 1.00 1.00
0.00 . .
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 1.00 .
0.00 1.00 2.00
0.00 1.00 1.00
0.00 0.00 .
0.00 . 1.00
0.00 1.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
1.00 1.00 1.00
. . .
0.00 1.00 .
0.00 1.00 1.00
0.00 . .
0.00 0.00 1.00
0.00 1.00 1.00
0.00 . .
0.00 0.00 1.00
0.00 0.00 2.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
. . .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 2.00
0.00 . 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 .
0.00 1.00 1.00
0.00 1.00 1.00
. . .
0.00 . .
0.00 0.00 0.00
0.00 1.00 2.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 1.00 .
0.00 0.00 1.00
. . .
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
. . .
0.00 1.00 2.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 1.00 .
0.00 1.00 1.00
0.00 0.00 1.00
0.00 1.00 .
. . 1.00
. 0.00 2.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 3.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 .
0.00 2.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 . .
0.00 1.00 1.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
. . .
0.00 1.00 2.00
;
run;

proc print data = have;
run;

Discussion stats
• 0 replies
• 414 views
• 0 likes
• 1 in conversation