BookmarkSubscribeRSS Feed
Garnett
Obsidian | Level 7

What experiences have folks had with ALG = HMC(stepsize=<> nsteps=<>) in PROC MCMC? In my experience, I can only get it to work with trivial problems that are just as easily run using metropolis-hastings. For example, I am fitting a hierarchical logistic regression model, and using HMC yields posteriors that are completely immobile unless the step size is extremely small (e.g. stepsize = 0.0001). Even then the posterior samples are highly localized, as one might expect. (I get convergence using the default sampler, but it takes a while and I'd rather speed things up.) Any thoughts or general advice on setting the tuning parameters for Hamiltonian Monte Carlo? 

1 REPLY 1
Garnett
Obsidian | Level 7

I ran ten chains with uniform(0,0.0001) randomly select stepsize and nsteps random uniform(1,100). The only chains that moved at all had step sizes less than 0.002. These chains explored the posterior, but barely. Convergence diagnostics were far from acceptable after 10,000 iterations. Still no luck using HMC for complex models. Default metropolis sampling works much better for these problem, and, for those problems where I can get HMC to work, the default sampler works just fine.

 

Please share any experiences that you have with HMC!

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 16. Read more here about why you should contribute and what is in it for you!

Submit your idea!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 1788 views
  • 0 likes
  • 1 in conversation