Building models with SAS Enterprise Miner, SAS Factory Miner, SAS Visual Data Mining and Machine Learning or just with programming

Lasso Logistic Regression

Reply
Occasional Contributor
Posts: 11

Lasso Logistic Regression

Hello,
I am trying to develop a regularized(LASSO) logistic regression model in SAS EM 14.1 but as far as I understand LASSO is available only for linear regression in SAS EM. I consider selecting variables with LASSO then put the resulting non zero variables as inputs into logistic regression. Does this approach work? Or are there any ways to come up with this issue?

Thanks for your help

Engin
Super User
Posts: 10,028

Re: Lasso Logistic Regression

Posted in reply to fuatengin
The LASSO method is in PROC GLMSELECT, Check whether it could be applied in logistic regression. And actually proc logistic have an option OFFSET= which can constraint parameter sum to one due to the fact that offset variable's parameter is always fixed as 1. E.X. if you want var1 has 0.2, var2 has 0.8 then put 0.2*var1+0.8*var2 into OFFSET= . More info check documentation of proc logistic.
Occasional Contributor
Posts: 11

Re: Lasso Logistic Regression

Posted in reply to fuatengin
Hello, thanks for your reply but I plan to use SAS Miner Nodes not SAS STAT. Can I select inputs with LARS Node and use the nonzero features in Logistic Regression model?
SAS Employee
Posts: 106

Re: Lasso Logistic Regression

Posted in reply to fuatengin

Hi, check out the HP Regression Node. I think it will do what you want. 

 

Another option ion is to preselect variables using the HP Variable Selection node.

 

Hope this helps. 

 

Ray 

Ask a Question
Discussion stats
  • 3 replies
  • 510 views
  • 0 likes
  • 3 in conversation