BookmarkSubscribeRSS Feed
FredXu
Calcite | Level 5

Hi all,

Recently I was working on a project to perform a Simulation on Correlated Ordinal Data with Random effect. I need to generate two groups of ordinal variables which were correlated with each other, and each pair of values should come from one subject which is a random effect.

According to Rick Wicklin's book,Simulating Data with SAS, I used the method in chapter 9.3.2 to create correlated ordinal variables, but not sure how to add in random effect into the proc iml functions (especially the RandMVOrdinal function).

You could find the original code on Rick's blog.

/*code in Chapter 9.3.2*/

/***********************************************************************

Programs for

Wicklin, Rick, 2013, Simulating Data with SAS, SAS Institute Inc., Cary NC.

Appendix B: Generating Multivariate Ordinal Variables

This program saves functions to the SAS/IML storage library.

To use these functions in a SAS/IML program, run this program

and then load the functions, as follows:

***********************************************************************/

proc iml;

    /* P1   P2    P3  */

/* example matrix of PMFs */

/*

P = {0.25  0.50  0.20 ,

     0.75  0.20  0.15 ,

      .    0.30  0.25 ,

      .     .    0.40 };

*/

/* OrdN: number of values for each variable */

start OrdN(P);

   return( countn(P, "col") );

finish;

/* OrdMean: Expected value for each variable is Sigma_i (i*p)    */

start OrdMean(P);

   x = T(1:nrow(P));                 /* values of ordinal vars      */

   return( (x#P)[+,] );              /* expected values E(X)        */

finish;

/* OrdVar: variance for each variable */

start OrdVar(P);

   d = ncol(P);   m = OrdMean(P);

   x = T(1:nrow(P));                 /* values of ordinal vars      */

   var = j(1, d, 0);

   do i = 1 to d;

      var = sum( (x - m)##2 # P[,i] );    /* defn of variance */

   end;

   return( var );

finish;

/* OrdCDF: Given PMF, compute CDF = cusum(PDF) */

start OrdCDF(P);

   cdf = j(nrow(P), ncol(P));        /* cumulative probabilities    */

   do i = 1 to ncol(P);

      cdf[,i] = cusum(P[,i]);

   end;

   return( choose(P=., ., cdf) );    /* missing vals for short cols */

finish;

/* Function that returns ordered pairs on a uniform grid of points.

   Return value is an (Nx*Ny x 2) matrix */

start Expand2DGrid( _x, _y );

   x  = colvec(_x); y  = colvec(_y);

   Nx = nrow(x);    Ny = nrow(y);

   x = repeat(x, Ny);

   y = shape( repeat(y, 1, Nx), 0, 1 );

   return ( x || y );

finish;

/* OrdQuant: Compute normal quantiles for CDF(P) */

start OrdQuant(P);

   N = OrdN(P);

   CDF = OrdCDF(P);

   /* QUANTILE function in SAS/IML 12.1 does not accept 1 as parameter */

   /* Replace 1 with missing value to prevent error */

   CDF = choose(CDF > 1 - 2e-6, ., CDF);

   quant = quantile( "Normal", cdf );

   do j = 1 to ncol(P);      /* set upper quantile to .I = infinity */

      quant[N,j] = .I;    /* .I has special meaning to BIN func  */

   end;                     

   return( quant );

finish;

/* OrdFindRoot: Use bisection to find the MV normal correlation that

   produces a specified MV ordinal correlation. */

start OrdFindRoot(P1, P2,  target);

   N1 = countn(P1);   N2 = countn(P2);

   q1 = OrdQuant(P1); q2 = OrdQuant(P2);

   v1 = q1[1:N1-1];   v2 = q2[1:N2-1];

   g = Expand2DGrid(v1, v2);

   /* find value of rho so that sum(probbnrm(g[,1], g[,2], rho))=target */

   /* Bisection: find root on bracketing interval [a,b] */

   a = -1; b = 1;                 /* look for correlation in [-1,1] */

   dx = 1e-8; dy = 1e-5;

   do i = 1 to 100;               /* iterate until convergence      */

      c = (a+b)/2;

      Fc = sum( probbnrm(g[,1], g[,2], c) ) - target;

      if (abs(Fc) < dy) | (b-a)/2 < dx then

         return(c);

      Fa = sum( probbnrm(g[,1], g[,2], a) ) - target;

      if Fa#Fc > 0 then a = c;

      else b = c;

   end;

   return (.);                    /* no convergence                 */

finish;

/* alternative root-finding algorithm that uses FROOT (SAS 12.1) */

/*

start MMRoot(x) global(_grid, _target);

   return( sum( probbnrm(_grid[,1], _grid[,2], x) ) - _target );

finish;

start AltOrdFindRoot(P1, P2,  target) global(_grid, _target);

   N1 = countn(P1);   N2 = countn(P2);

   q1 = OrdQuant(P1); q2 = OrdQuant(P2);

   v1 = q1[1:N1-1];   v2 = q2[1:N2-1];

   _grid = Expand2DGrid(v1, v2);

   _target = target;

   return( froot("MMRoot", {-1 1}) );

finish;

*/

/* OrdMVCorr: Compute a MVN correlation matrix from the PMF and

   the target correlation matrix for the ordinal variables. */

start OrdMVCorr(P, Corr);

   d = ncol(P);

   N = OrdN(P);

   mean = OrdMean(P);

   var  = OrdVar(P);

   cdf  = OrdCDF(P);

   R = I(d);

   do i = 1 to d-1;

      sumCDFi = sum(cdf[1:N-1, i]);

      do j = i+1 to d;

         sumCDFj = sum(cdf[1:N-1, j]);

         hStar = Corr[i,j] * sqrt(var*var) + mean*mean

                 - N*N + N*sumCDFj + N*sumCDFi;

         R[i,j] = OrdFindRoot(P[,i], P[,j], hStar);

         R[j,i] = R[i,j];

      end;

   end;

   return(R);

finish;

/* RandMVOrdinal:

   N     Number of desired observations from MV ordinal distribution,

   P     Matrix of PMF for ordinal vars. The j_th col is the j_th PMF.

         Use missing vals if some vars have fewer values than others.

   Corr  Desired correlation matrix for ordinal variables. Not every

         matrix is a valid as the correlation of ordinal variables. */

start RandMVOrdinal(N, P, Corr);

   d = ncol(P);

   C = OrdMVCorr(P, Corr);     /* 1. compute correlation matrix, C  */

   mu = j(1, d, 0);

   X = RandNormal(N, mu, C);   /* 2. simulate X ~ MVN(0,C)          */

   N = OrdN(P);

   quant = OrdQuant(P);        /* compute normal quantiles for PMFs */

   do j = 1 to d;              /* 3. convert to ordinal             */

      X[,j] = bin(X[,j], .M // quant[1:N,j]);

   end;

   return(X);

finish;

store module=_all_;

quit;

proc iml;

load module=_all_;

p={0.16 0.16,

   0.28 0.28,

   0.2  0.2 ,

   0.15 0.15,

   0.12 0.12,

   0.06 0.06,

   0.03 0.03 };

delta={1.0 0.5,

          0.5 1.0};

call randseed(1234);

x=RandMVOrdinal(60,p,delta);

create mn from x;append from x; close mn;

*****************************************************************************************************************************************;

Chapter 12.3.1 provided an example of adding random effect for a continuous variable. I am not sure if I could just use the same method. Do you guys have any code already for Ordinal Variables? If not, could you please provide any guidance on this? How would you control the random components?

*****************************************************************************************************************************************;

/*code in Chapter 12.3.1*/

/*simple random effect model with repeated measurements*/

%let var_A=4;      /*variance of random effect (intercept)  */

%let sigma2=2;      /*variance of residual, N(0, sqrt(sigma2))  */

%let L=3;      /*num levels in random effect A*/

%let K=5;      /*num repeated measurements in each level of A */

data randomeffects(12345);

call streaminit(12345);

mu=5;

do a=1 to &L;

    rndA=rand("Normal", 0, sqrt(&var_A));

    do rep=1 to &k;

        y= mu +rndA+rand("Normal", 0, sqrt(&sigma2));

        output;

    end;

end;

run;

*****************************************************************************************************************************************;

Look forward to your guidance,

Thanks,

Fred

1 REPLY 1
Rick_SAS
SAS Super FREQ

I think you need to carefully specify the statistical model from which you are trying to simulate. Presumably the random effect is changing some aspect of the model that varies between subjects.  You need to specify what changes between subjects and how it changes.  For each subject, you can draw a pair of observations. Then generate new parameters for the next subject, and repeat.  If that process sounds like what you are trying to acheive, then you do not need to change any functions.  You would loop over subjects and generate the PMF (P) and correlation for that subject, simulate from those parameters, and move on to the next subject.

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 888 views
  • 0 likes
  • 2 in conversation