https://communities.sas.com/t5/Statistical-Procedures/How-to-adjust-for-Inter-Rater-Reliability/m-p/979324#M49078 <P>I have a 5-level ordinal measure taken on each patient at three different times.&nbsp; A second rater scored a small subset of this data and we can compute inter-rater reliability/ies (IRR)--kappa--on this small subset of this data.&nbsp;</P> <P>&nbsp;</P> <P>Seeking input on how to incorporate the IRR data in the final analysis understanding that only a small number of measurements will have two sets of ratings?&nbsp; Initial thought is to weight different segments of the scale and different time-points by their respective reliabilities--e.g., low end of the scale is more reliable than high end.</P> <P>&nbsp;</P> <P>Any and all thoughts and refernces are apreciated.&nbsp; Thanks.</P> Fri, 21 Nov 2025 17:17:20 GMT Haris 2025-11-21T17:17:20Z https://communities.sas.com/t5/Statistical-Procedures/How-to-adjust-for-Inter-Rater-Reliability/m-p/979324#M49078 <P>I have a 5-level ordinal measure taken on each patient at three different times.&nbsp; A second rater scored a small subset of this data and we can compute inter-rater reliability/ies (IRR)--kappa--on this small subset of this data.&nbsp;</P> <P>&nbsp;</P> <P>Seeking input on how to incorporate the IRR data in the final analysis understanding that only a small number of measurements will have two sets of ratings?&nbsp; Initial thought is to weight different segments of the scale and different time-points by their respective reliabilities--e.g., low end of the scale is more reliable than high end.</P> <P>&nbsp;</P> <P>Any and all thoughts and refernces are apreciated.&nbsp; Thanks.</P> Fri, 21 Nov 2025 17:17:20 GMT https://communities.sas.com/t5/Statistical-Procedures/How-to-adjust-for-Inter-Rater-Reliability/m-p/979324#M49078 Haris 2025-11-21T17:17:20Z