BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
Excelsius
Obsidian | Level 7

I have spent so much time trying to find out how to calculate an effect size for linear mixed models, but still success evades me. I am an avid SPSS user. Given the mixed model limitation in SPSS and lack of my success, I finally decided to transition to SAS in hopes of possibly overcoming this problem with the effect size. Is there anyone who has any clue how to calculate an effect size for lognitudinal linear mixed models with complex covariance structures like ARH1, ante(1), AR(1), etc?

 

Here is a sample code:

proc mixed data = sas.aLTP covtest scoring=5;
class dose Mouse Time;
model ln_aLTP = dose cTime cTime*cTime / solution ddfm=sat influence;
repeated Time /type=ante(1) subject=mouse;
random int cTime / subject = mouse type = arh(1) solution g v; 
lsmeans dose /adjust=dunnett pdiff=control('4') CL;
run;

I am aware of this thread for Cohen's d in proc mixed, which did not generate a solid resolution.

 

I'm also aware of this paper: A practical guide to calculating Cohen’s f2, a measure of local effect size, from PROC MIXED, but that covers only the simplest covariance structures. I have emailed various authors and  still have not found a practical solution. So I'm wondering if any SAS users have somehow overcome this issue, since the community is large.

 

Some more specific questions to guide the discussion:

 

  1. If I want to at least report Cohen's d for the difference between two means in lsmeans, does it sound resonable to run a t-test for those two means of interesy using the predicted values from proc mixed and then calculate Cohen's d?
  2. As far as converting SE to SD, are there actual sources that validate such an approach? The thread referenced above mentions SD=SE*SQRT(DF+1). Is this a justifyable approach?
  3. One of the authors who didn't have much time to explain his solution to me, said that he would compute the effect size as the ratio of the estimated fixed effect parameter to the sqrt of total marginal outcome (at a given timepoint if marginal variance isn't constant). It seems that SAS can produce the marginal variance output. Can anyone elaborate on this and perhaps give some tips about syntax? Do I need to add "marginal" or "var" somewhere in the syntax to get that output? I am not sure what would such an effect size be called in terms of the standardized variants, like Cohen's f sq, pseudo-r sq, or something else.

 

1 ACCEPTED SOLUTION

Accepted Solutions
Damien_Mather
Lapis Lazuli | Level 10

The reference to marginal variance likely refers to proc glimmix not proc mixed, but that's ok, both will estimate your models.

 

See

 

http://support.sas.com/resources/papers/proceedings16/11663-2016.pdf

 

for an example of specifying, exporting and calculating other statistics from proc glimmix covariance estimate output.

View solution in original post

2 REPLIES 2
Damien_Mather
Lapis Lazuli | Level 10

The reference to marginal variance likely refers to proc glimmix not proc mixed, but that's ok, both will estimate your models.

 

See

 

http://support.sas.com/resources/papers/proceedings16/11663-2016.pdf

 

for an example of specifying, exporting and calculating other statistics from proc glimmix covariance estimate output.

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 10436 views
  • 0 likes
  • 2 in conversation