Dear All: I want to calculate the following measures for multiple raters (or observers) from the data given below. - How to calculate the Cohen's Kappa "K" for multiple raters. - The measure of agreement; I am not sure if this measure is the same as "the interobserver agreement" - Spearman's "rho" I know how to get the Cohen's Kappa for two raters; using the PROC FREQ, TABLES statement with the option agree, BUT do not know how to calculate it for multiple raters. Thank you very much abou =========================== data have; input Rater1 Rater2 Rater3; datalines; 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 2.00 0.00 1.00 1.00 0.00 . 0.00 . . . 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 . 0.00 0.00 0.00 0.00 1.00 1.00 0.00 . . 0.00 0.00 . 0.00 0.00 1.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.00 0.00 1.00 . 0.00 1.00 2.00 0.00 1.00 1.00 0.00 0.00 . 0.00 . 1.00 0.00 1.00 1.00 0.00 1.00 1.00 0.00 0.00 1.00 0.00 1.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 1.00 1.00 1.00 . . . 0.00 1.00 . 0.00 1.00 1.00 0.00 . . 0.00 0.00 1.00 0.00 1.00 1.00 0.00 . . 0.00 0.00 1.00 0.00 0.00 2.00 0.00 1.00 . 0.00 0.00 1.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 1.00 . 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 0.00 0.00 0.00 1.00 0.00 1.00 1.00 0.00 0.00 2.00 0.00 0.00 1.00 0.00 0.00 1.00 . . . 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 1.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 1.00 2.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 2.00 0.00 . 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 1.00 2.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 1.00 . 0.00 1.00 1.00 0.00 1.00 1.00 . . . 0.00 . . 0.00 0.00 0.00 0.00 1.00 2.00 0.00 0.00 0.00 0.00 0.00 1.00 0.00 0.00 . 0.00 0.00 1.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.00 . 0.00 0.00 1.00 . . . 0.00 1.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 0.00 0.00 0.00 1.00 0.00 0.00 . 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 1.00 2.00 0.00 0.00 1.00 . . . 0.00 1.00 2.00 0.00 0.00 1.00 0.00 1.00 1.00 0.00 1.00 . 0.00 1.00 1.00 0.00 0.00 1.00 0.00 1.00 . . . 1.00 . 0.00 2.00 0.00 1.00 1.00 0.00 0.00 1.00 0.00 0.00 3.00 0.00 0.00 0.00 0.00 1.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 1.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 1.00 1.00 0.00 0.00 1.00 0.00 0.00 . 0.00 0.00 1.00 0.00 1.00 2.00 0.00 0.00 . 0.00 2.00 . 0.00 0.00 1.00 0.00 0.00 1.00 0.00 . . 0.00 1.00 1.00 0.00 1.00 . 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 0.00 0.00 1.00 . . . 0.00 1.00 2.00 ; run; proc print data = have; run;
... View more