https://communities.sas.com/t5/Statistical-Procedures/compare-difference-across-groups/m-p/250978#M13238 <P>This is my experiment:<BR />Each product were examed by a group of inspectors(identified by inspector ID) and assigned to a grade (1,2,3,4,5) initially. Then these products go to different store and were assigned another grade(1,2,3,4,5) by store manager.</P><P>My task is to answer if the grade at first stage by inspector is statistically different from the grade store managers assigned? If different, which inspector has the greatest difference?</P><P>I was able to answer the first question but am wondering how to do the second one.</P><P>Anyone can help?</P> Thu, 18 Feb 2016 22:45:00 GMT sasuser2014 2016-02-18T22:45:00Z https://communities.sas.com/t5/Statistical-Procedures/compare-difference-across-groups/m-p/250978#M13238 <P>This is my experiment:<BR />Each product were examed by a group of inspectors(identified by inspector ID) and assigned to a grade (1,2,3,4,5) initially. Then these products go to different store and were assigned another grade(1,2,3,4,5) by store manager.</P><P>My task is to answer if the grade at first stage by inspector is statistically different from the grade store managers assigned? If different, which inspector has the greatest difference?</P><P>I was able to answer the first question but am wondering how to do the second one.</P><P>Anyone can help?</P> Thu, 18 Feb 2016 22:45:00 GMT https://communities.sas.com/t5/Statistical-Procedures/compare-difference-across-groups/m-p/250978#M13238 sasuser2014 2016-02-18T22:45:00Z https://communities.sas.com/t5/Statistical-Procedures/compare-difference-across-groups/m-p/250999#M13240 <P>It looks like you are looking for KAPPA of proc freq.</P> Fri, 19 Feb 2016 01:03:16 GMT https://communities.sas.com/t5/Statistical-Procedures/compare-difference-across-groups/m-p/250999#M13240 Ksharp 2016-02-19T01:03:16Z https://communities.sas.com/t5/Statistical-Procedures/compare-difference-across-groups/m-p/251002#M13241 <P>The topic is known as interrater reliability.</P> <P>&nbsp;</P> <P>Wikipedia has some of the standard methods outlined.</P> <P><A href="https://en.wikipedia.org/wiki/Inter-rater_reliability" target="_blank">https://en.wikipedia.org/wiki/Inter-rater_reliability</A></P> <P>&nbsp;</P> <P>There are several papers on lexjansen.com that illustrate ways to analyze this type of data in SAS.</P> <P>&nbsp;</P> Fri, 19 Feb 2016 01:31:13 GMT https://communities.sas.com/t5/Statistical-Procedures/compare-difference-across-groups/m-p/251002#M13241 Reeza 2016-02-19T01:31:13Z