Turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- Home
- /
- Analytics
- /
- Stat Procs
- /
- Huge difference between Likelihood ratio test and t value in proc glim...

Options

- RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Posted 11-13-2018 11:19 AM
(2407 views)

Hi,

I am using a log-likelihood ratio test and the t value, in proc glimmix, to compare the fit of two nested models – one random intercept model and one full model, by adding a continuous explanatory variable to the model.

I obtained hugely contrasting results between the LL ratio test and the reported t value!

While the LL ratio test was highly significant, the t value was highly non-significant.

Does anyone know what may be causing this, and how I should interpret the direction of the trend for the logistic regression (i.e. positive or negative effect of the predictor variable on the probability of the event occurring)?

Thank you in advance,

Boban

8 REPLIES 8

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Are these testing the same hypotheses in the same model? Or are they from different models? Can you show us the relevant parts of the SAS code? Can you show us the relevant parts of the SAS output?

--

Paige Miller

Paige Miller

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Thank you for your reply!

I am testing only one hypothesis, the effect of jsh on the outcome surv, shown in the full model bellow:

**proc** **glimmix** method = laplace data=finale_updated;

class year;

model surv (event = '1')= jsh /S dist = binary link = logit ddfm =bw;

random int/ subject = year;

covtest 'var (year)= 0' **0** / est parms ;

**run**;

Here is the output for the full model:

Solutions for Fixed EffectsEffect Estimate StandardError DF t Value Pr > |t|InterceptJSH

-2.7900 | 0.5244 | 8 | -5.32 | 0.0007 |

-0.6452 | 0.4951 | 2789 | -1.30 | 0.1926 |

Fit Statistics-2 Log LikelihoodAIC (smaller is better)AICC (smaller is better)BIC (smaller is better)CAIC (smaller is better)HQIC (smaller is better)

846.75 |

852.75 |

852.76 |

853.34 |

856.34 |

851.48 |

And for the empty model, without the variable jsh

Fit Statistics-2 Log LikelihoodAIC (smaller is better)AICC (smaller is better)BIC (smaller is better)CAIC (smaller is better)HQIC (smaller is better)

2170.83 |

2174.83 |

2174.84 |

2175.23 |

2177.23 |

2173.98 |

By comparing the two outputs, you see that the p value for t is very high. However, the difference in -2 Log Likelihood is just as important, and all information criteria!

I am wondering what may be causing this?

What shall I conclude?

How do I interpret the odds ratio, not shown here, but there is a negative relationship.

Best,

Boban

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Sorry, but it looks as if the formating ot the tables didn't work.

Anyway, the p value for t is 0.1926, shown in the first table.

In the other two tables, the -2 log likelihood is the value at the top.

Boban

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

It seems like you are comparing a t-test about whether or not a term in the model is significant, to a model fit statistic. Is that what you are doing? These are not the same and don't have to be close to one another.

--

Paige Miller

Paige Miller

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

Did you include the RANDOM statement in the reduced model?

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

I am testing the significance of a fixed effect, using both the t statitic and the LL ratio test (model fit estimation). They are not always supposed to yield simmilar results, but the difference is very important here!

I am wondering how to interpret this. Thank you for spending time on this!

Yes, the random effect is included in both.

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

@boban wrote:

I am testing the significance of a fixed effect, using both the t statitic and the LL ratio test (model fit estimation). They are not always supposed to yield simmilar results, but the difference is very important here!

I am wondering how to interpret this. Thank you for spending time on this!

These are not the same test. They are not testing the same hypothesis. They are not on the same scale. There is no reason to expect similar results. They are interpreted as individual tests, not related to one another.

--

Paige Miller

Paige Miller

- Mark as New
- Bookmark
- Subscribe
- Mute
- RSS Feed
- Permalink
- Report Inappropriate Content

**Available on demand!**

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.