BookmarkSubscribeRSS Feed
Pyrite | Level 9

Hello, I am doing a repeated measure analysis using mixed model. However, SAS (9.4) and SPSS (23.0) have some difference:

1. They have different degree of freedom
2. P-values are slightly different
3. In some cases, SAS cannot converge for some covariance structure types but SPSS does not report such warning.
4. Even SAS 9.1.3 and 9.4, in some cases, have difference: sas 9.4 reports warning but sas 9.1.3 ran smoothly. Such warning is like " Convergence criteria met but final hessian is not positive definite. " Not sure why.


can anyone give some hints? Thank you!





Super User

At the least you'd need to post your SAS code.

Pyrite | Level 9

Here is the code I used in SAS:


proc mixed data=repeated.longform method=reml;
class time clientID;
model measure = time /s;
repeated  /type = arh(1) subject=ClientID r rcorr;
lsmeans time/ alpha=0.05;

estimate "Time2 vs Time1" time -1 1 0 0/cl;
estimate " Time3 vs Time1" time  -1 0 1 0/cl;
estimate " Time4 vs Time1" time  -1 0 0 1/cl;
estimate "Time3 vs Time2" time 0 -1 1 0/cl;
estimate " Time4 vs Time2" time  0 -1 0 1/cl;
estimate " Time4 vs Time3" time  0 0 -1 1/cl;



And Here is the syntax I used for SPSS:


MIXED measure BY Time
  /FIXED=Time | SSTYPE(3)

Diamond | Level 26

I admit I don't know SPSS, but I'm not convinced you should expect to get the exact same answers. It's possible that the two different softwares use different algorithms, or possibly that they have different default options, but whatever it is they are clearly using different degrees of freedom. So if I were you, I'd try to track down the choices of algorithms, and the default options in each software.

Paige Miller
Pyrite | Level 9

I am using SPSS is because when I chose some covariance structure SAS produce "Convergence criteria met but final hessian is not positive definite" but SPSS does not. In some cases SPSS also have the converge warning, but less than in SAS. Then I found the difference. Otherwise I may use only one software and may not notice they have difference.

Clearly they handle the degree of freedom in different ways. But they produce the same estimates which suggest the mixed model is fitted the same.

Opal | Level 21

As a starting point on the SAS side, look at option DDFM= in proc mixed. I bet the default method (BETWITHIN for a REPEATED analysis without a RANDOM effect) isn't the same in SPSS.

Super User

I would not be surprised to find out that different settings related to convergence or number of interations between packages you would get slightly different results.

Pyrite | Level 9

I found one answer online, for the difference in degree of freedom:



I've found that a mixed linear model run in the SPSS procedure MIXED reports denominator degrees of freedom (df) for the fixed effects in the model that differ from those reported by the SAS procedure Proc Mixed. Will you explain the difference in results between the two programs?

Resolving the problem

SPSS MIXED uses the Satterthwaite approximation to calculate df. This method is valid for both balanced and unbalanced designs. By default, SAS uses the CONTAINment method when there is a RANDOM statement, and the BETWITHIN method when a REPEATED statement is used without a RANDOM statement (unless the R matrix is specified as unstructured). These methods do not adjust for lack of balance in the data. Neither does the RESIDUAL, method available in SAS. SAS does offer two methods that adjust for lack of balance: These are the SATTERTHwaite and the KENWARDROGER methods. While the CONTAIN, BETWITHIN, and RESIDUAL methods always yield integer values for the denominator df, the SATTERTHwaite and KENWARDROGER do not.

If you want to compare SAS results for mixed linear models to those from SPSS, be sure you have employed the Satterthwaite method for computing denominator degrees of freedom in SAS.



Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.

If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website. 

Register now!

What is Bayesian Analysis?

Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.

Find more tutorials on the SAS Users YouTube channel.

Get the $99 certification deal.jpg



Back in the Classroom!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 7 replies
  • 5 in conversation