Turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- Home
- /
- Programming
- /
- SAS Procedures
- /
- Different degree of freedom and P-value from SAS proc mixed and SPSS m...

Options

- RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Posted 10-02-2015 02:54 PM
(1747 views)

Hello, I am doing a repeated measure analysis using mixed model. However, SAS (9.4) and SPSS (23.0) have some difference:

1. They have different degree of freedom

2. P-values are slightly different

3. In some cases, SAS cannot converge for some covariance structure types but SPSS does not report such warning.

4. Even SAS 9.1.3 and 9.4, in some cases, have difference: sas 9.4 reports warning but sas 9.1.3 ran smoothly. Such warning is like " Convergence criteria met but final hessian is not positive definite. " Not sure why.

can anyone give some hints? Thank you!

7 REPLIES 7

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

At the least you'd need to post your SAS code.

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Here is the code I used in SAS:

proc mixed data=repeated.longform method=reml;

class time clientID;

model measure = time /s;

repeated /type = arh(1) subject=ClientID r rcorr;

lsmeans time/ alpha=0.05;

estimate "Time2 vs Time1" time -1 1 0 0/cl;

estimate " Time3 vs Time1" time -1 0 1 0/cl;

estimate " Time4 vs Time1" time -1 0 0 1/cl;

estimate "Time3 vs Time2" time 0 -1 1 0/cl;

estimate " Time4 vs Time2" time 0 -1 0 1/cl;

estimate " Time4 vs Time3" time 0 0 -1 1/cl;

run;

And Here is the syntax I used for SPSS:

MIXED measure BY Time

/CRITERIA=CIN(95) MXITER(100) MXSTEP(10) SCORING(1) SINGULAR(0.000000000001) HCONVERGE(0,

ABSOLUTE) LCONVERGE(0, ABSOLUTE) PCONVERGE(0.000001, ABSOLUTE)

/FIXED=Time | SSTYPE(3)

/METHOD=REML

/REPEATED=Time | SUBJECT(ClientID) COVTYPE(ARH1)

/EMMEANS=TABLES(Time) COMPARE ADJ(LSD).

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

I admit I don't know SPSS, but I'm not convinced you should expect to get the exact same answers. It's possible that the two different softwares use different algorithms, or possibly that they have different default options, but whatever it is they are clearly using different degrees of freedom. So if I were you, I'd try to track down the choices of algorithms, and the default options in each software.

--

Paige Miller

Paige Miller

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

I am using SPSS is because when I chose some covariance structure SAS produce "Convergence criteria met but final hessian is not positive definite" but SPSS does not. In some cases SPSS also have the converge warning, but less than in SAS. Then I found the difference. Otherwise I may use only one software and may not notice they have difference.

Clearly they handle the degree of freedom in different ways. But they produce the same estimates which suggest the mixed model is fitted the same.

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

As a starting point on the SAS side, look at option DDFM= in **proc mixed**. I bet the default method (BETWITHIN for a REPEATED analysis without a RANDOM effect) isn't the same in SPSS.

PG

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

I found one answer online, for the difference in degree of freedom:

http://www-01.ibm.com/support/docview.wss?uid=swg21477296

I've found that a mixed linear model run in the SPSS procedure MIXED reports denominator degrees of freedom (df) for the fixed effects in the model that differ from those reported by the SAS procedure Proc Mixed. Will you explain the difference in results between the two programs?

SPSS MIXED uses the Satterthwaite approximation to calculate df. This method is valid for both balanced and unbalanced designs. By default, SAS uses the CONTAINment method when there is a RANDOM statement, and the BETWITHIN method when a REPEATED statement is used without a RANDOM statement (unless the R matrix is specified as unstructured). These methods do not adjust for lack of balance in the data. Neither does the RESIDUAL, method available in SAS. SAS does offer two methods that adjust for lack of balance: These are the SATTERTHwaite and the KENWARDROGER methods. While the CONTAIN, BETWITHIN, and RESIDUAL methods always yield integer values for the denominator df, the SATTERTHwaite and KENWARDROGER do not.

If you want to compare SAS results for mixed linear models to those from SPSS, be sure you have employed the Satterthwaite method for computing denominator degrees of freedom in SAS.

Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

**If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. **

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.