BookmarkSubscribeRSS Feed
Dcicantab5
Obsidian | Level 7
I was running GLMSELECT adaptive LASSO and obtained the following:
 
WARNING: The adaptive weights for the LASSO method are not uniquely determined because the full least squares model is singular.
 
Been searching but it seems no one has posted anything on this. I imagine this is due to formation of singular matrix problem (struggling to understand what that is..).
 
Does this mean adaptive LASSO is not 'valid'? Would appreciate if anyone can guide me through this. 
 
Thank you in advance.
 
Saiful.
 
code:
 
proc glmselect data=WORK.SD outdesign(addinputvars)=Work.Glmselect_Design
plots=(ASEplot criterionpanel coefficientpanel) seed=123456;
partition fraction(validate=0.3);
class Phase_at_admission Phase_at_SD Lethargy Bleed Multiple_comorbids /
param=glm;
model Outcome=Age_yr_ PR Plt Sr_Creat AST ALT HCO3 Lactate Phase_at_admission
Phase_at_SD Lethargy Bleed Multiple_comorbids AST*ALT HCO3*Lactate
Phase_at_admission*Phase_at_SD Age_yr_*Multiple_comorbids / stb
selection=lasso
(adaptive stop=none choose=sbc) stats=all;
run;

 

2 REPLIES 2
PGStats
Opal | Level 21

Collinearity will more likely occur between CLASS variables when some class combinations are empty (i.e. if all males are right-handed in your data there is no way to estimate the left-handed male effect). If you can't find where the problem is, you can get collinearity diagnosis with proc reg after expanding your design matrix (create dummy variables for class effects) with proc glmmod.

PG
Ksharp
Super User

Not sure, but you could try SELECTION option:

 

 

L1=

L1CHOICE= 

Ready to join fellow brilliant minds for the SAS Hackathon?

Build your skills. Make connections. Enjoy creative freedom. Maybe change the world. Registration is now open through August 30th. Visit the SAS Hackathon homepage.

Register today!
What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 1669 views
  • 0 likes
  • 3 in conversation