Help using Base SAS procedures

Cohen's Kappa for multiple raters

Reply
Occasional Learner
Posts: 1

Cohen's Kappa for multiple raters

[ Edited ]

Dear All:

 

I want to calculate the following measures for multiple raters (or observers) from the data given below.

 
- How to calculate the Cohen's Kappa "K" for multiple raters.
 
- The measure of agreement; I am not sure if this measure is the same as "the interobserver agreement"
 
- Spearman's "rho"
 
 
I know how to get the Cohen's Kappa for two raters; using the PROC FREQ, TABLES statement with the option agree, BUT do not know how to calculate it for multiple raters.
 
 
Thank you very much
abou
 
=========================== 
 
data have;
input Rater1 Rater2 Rater3;
datalines;
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 2.00
0.00 1.00 1.00
0.00 . 0.00
. . .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 0.00
0.00 1.00 1.00
0.00 . .
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 1.00 .
0.00 1.00 2.00
0.00 1.00 1.00
0.00 0.00 .
0.00 . 1.00
0.00 1.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
1.00 1.00 1.00
. . .
0.00 1.00 .
0.00 1.00 1.00
0.00 . .
0.00 0.00 1.00
0.00 1.00 1.00
0.00 . .
0.00 0.00 1.00
0.00 0.00 2.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
. . .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 2.00
0.00 . 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 .
0.00 1.00 1.00
0.00 1.00 1.00
. . .
0.00 . .
0.00 0.00 0.00
0.00 1.00 2.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 0.00
0.00 1.00 .
0.00 0.00 1.00
. . .
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 0.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 1.00
. . .
0.00 1.00 2.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 1.00 .
0.00 1.00 1.00
0.00 0.00 1.00
0.00 1.00 .
. . 1.00
. 0.00 2.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 3.00
0.00 0.00 0.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 1.00 1.00
0.00 0.00 1.00
0.00 0.00 .
0.00 0.00 1.00
0.00 1.00 2.00
0.00 0.00 .
0.00 2.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 . .
0.00 1.00 1.00
0.00 1.00 .
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
0.00 0.00 1.00
. . .
0.00 1.00 2.00
;
run;
 
 
proc print data = have;
run;
 
 

 

Ask a Question
Discussion stats
  • 0 replies
  • 263 views
  • 0 likes
  • 1 in conversation