BookmarkSubscribeRSS Feed
Dcicantab5
Obsidian | Level 7
I was running GLMSELECT adaptive LASSO and obtained the following:
 
WARNING: The adaptive weights for the LASSO method are not uniquely determined because the full least squares model is singular.
 
Been searching but it seems no one has posted anything on this. I imagine this is due to formation of singular matrix problem (struggling to understand what that is..).
 
Does this mean adaptive LASSO is not 'valid'? Would appreciate if anyone can guide me through this. 
 
Thank you in advance.
 
Saiful.
 
code:
 
proc glmselect data=WORK.SD outdesign(addinputvars)=Work.Glmselect_Design
plots=(ASEplot criterionpanel coefficientpanel) seed=123456;
partition fraction(validate=0.3);
class Phase_at_admission Phase_at_SD Lethargy Bleed Multiple_comorbids /
param=glm;
model Outcome=Age_yr_ PR Plt Sr_Creat AST ALT HCO3 Lactate Phase_at_admission
Phase_at_SD Lethargy Bleed Multiple_comorbids AST*ALT HCO3*Lactate
Phase_at_admission*Phase_at_SD Age_yr_*Multiple_comorbids / stb
selection=lasso
(adaptive stop=none choose=sbc) stats=all;
run;

 

2 REPLIES 2
PGStats
Opal | Level 21

Collinearity will more likely occur between CLASS variables when some class combinations are empty (i.e. if all males are right-handed in your data there is no way to estimate the left-handed male effect). If you can't find where the problem is, you can get collinearity diagnosis with proc reg after expanding your design matrix (create dummy variables for class effects) with proc glmmod.

PG
Ksharp
Super User

Not sure, but you could try SELECTION option:

 

 

L1=

L1CHOICE= 

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 1571 views
  • 0 likes
  • 3 in conversation