BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
joesmama
Obsidian | Level 7

Hello,

 

I am running proc logistic on my dataset and have come across a quasi-complete separation error. I've managed to figure out which variable is causing the issue: a cross tabulation of two variables (dependent x independent) showed that one of the cells in the 2x2 is 0. My original logistic regression model yielded a enormous odds ratio for this variable and  CIs that are essentially +-infinity. Using Paul Allison's suggestions on dealing with the quasi-complete separation, I narrowed it down to adjusting the model to use the Firth method. Now my results look much more reasonable, although the CIs (using profile likelihood CIs) are still quite wide (n=220). My question is: Do I now report these "modified" ORs and CIs as I normally would and just mention that the Firth method was used or do I need to go into additional detail.   

 

Any input is appreciated. 

1 ACCEPTED SOLUTION

Accepted Solutions
Rick_SAS
SAS Super FREQ

I'd tell the readers just what you told us. A classical logistic regression results in a quasi-separation, so Firth’s penalized likelihood method (the FIRTH option) is used as suggested by Allison (2012). Then report likelihood-based confidence limits and likelihood ratio tests.

 

BTW, if your sample is small, you can also try exact logistic regression.

View solution in original post

4 REPLIES 4
Rick_SAS
SAS Super FREQ

I'd tell the readers just what you told us. A classical logistic regression results in a quasi-separation, so Firth’s penalized likelihood method (the FIRTH option) is used as suggested by Allison (2012). Then report likelihood-based confidence limits and likelihood ratio tests.

 

BTW, if your sample is small, you can also try exact logistic regression.

joesmama
Obsidian | Level 7

Thank you for the response. That clarifies things.

 

One question: do we still report the estimates from the Firth analysis or just the confidence limits and likelihood tests?

joesmama
Obsidian | Level 7

Thank you very much Rick. 

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!

Submit your idea!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 4 replies
  • 1324 views
  • 3 likes
  • 2 in conversation