BookmarkSubscribeRSS Feed
DavyJones
Obsidian | Level 7

Hello,

I use the following script for model averaging:

proc glmselect data=&infile plots=(EffectSelectPct ParmDistribution);
model depvar=indepvar1 indepvar2 indepvar3
/selection=LASSO(adaptive stop=none choose=SBC) ;
modelAverage nsamples=100tables=(EffectSelectPct(all) ParmEst(all) );
run;

According to the SAS manual (page 4290 of GLMSelect procedure, SAS/STAT 15.1), the parameter estimates and standard deviation printed in the output are simple unweighted (equally weighted) averages. I wonder if there is any way to specify a weight, such as Akaike weight, as suggested by Burnham and Anderson (2002).

1 REPLY 1
Rick_SAS
SAS Super FREQ

Since no one has commented, I will make a few remarks. 

 

I do not have a copy of B&A at home, but I believe the Akaike weights were not related to the kind of model averaging that you are doing. As I recall, in B&A, they used the full data set and ran all subsets or regression models. They then assign weights to the various models based on the AIC criterion for each model,

 

That is different than the MODELAVERAGE statement, which uses bootstrap resamples of the data and then computes an average, which is the bootstrap estimate for the parameter estimates. 

 

Now, nothing stops you from using a weighted average of the bootstrap estimates, but I don't know whether that makes statistical sense.

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!

Submit your idea!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 1333 views
  • 3 likes
  • 2 in conversation