Programming the statistical procedures from SAS

Can i change the Maximum Likelihood Estimates in logistic regression to least squares ?

Reply
New Contributor
Posts: 4

Can i change the Maximum Likelihood Estimates in logistic regression to least squares ?

In my solution after the logit-regression the Maximum Likelihood Estimate is the standardmethod. Is it  possible to change to least-squares estimate and compare the difference between the two methods in the results?

Super User
Posts: 11,797

Re: Can i change the Maximum Likelihood Estimates in logistic regression to least squares ?

[ Edited ]
Posted in reply to smadlindl0

You may need to specify which procedure you are using. Proc Logistic supports least squares using the LSMEANS and LSMESTIMATE statements.

SAS Employee
Posts: 307

Re: Can i change the Maximum Likelihood Estimates in logistic regression to least squares ?

The LSMEANS and LSMESTIMATE statements compute marginal (least squares) means and compares them using the maximum likelihood estimates.  They do NOT involve estimation using least squares.  Logistic models are one in the class of generalized linear models which are all estimated using maximum likelihood estimation.  

SAS Super FREQ
Posts: 3,839

Re: Can i change the Maximum Likelihood Estimates in logistic regression to least squares ?

Posted in reply to smadlindl0

I'm not certain what you intend, but PROC LOGISTIC support iteratively reweighted least square solutions, and in fact that is the default solution technique. You can read about the numerical solution algorithms in PROC LOGISTIC in the doc.  To compare you would need to run the procedure twice, once with each method.

 

But as far as I know there is no direct method for using least squares to compute a logistic regression, only iterative methods. The problem is that the conditional probability of the response p_i = E(Y_i | X_i) is not observed. So you have to use some iterative technique to optimize the likelihood function.

Ask a Question
Discussion stats
  • 3 replies
  • 228 views
  • 2 likes
  • 4 in conversation