Actually, it is possible to obtain within-subjects measures if your data represent the ratings from a set of raters on a set of subjects (or items) and your interest is the agreement between raters or within subjects. The generalized linear mixed models (GLMM) approach available with the MAGREE macro can provide estimates of the random effects for subjects as well as raters. For each subject or rater, the macro can provide measures of the departure from agreement. Example 2 in the Results tab of the macro documentation illustrates how rater- and subject-specific agreement statistics can be obtained and interpreted. If your PTID variable represents the subjects and your _NAME_ variable represents the raters, then the following macro call requests the GLMM-based statistics. However, to avoid problems in fitting the model required for this method, you will probably need more than three subjects. But more subjects does not guarantee that model fitting problems won't occur.
%magree(data=trans, items=ptid, raters=_name_, response=col1,
stat=glmm, options=ratereffects itemeffects )
... View more