The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Handbook of Markov Chain Monte Carlo
Open accessAbstract
Hamiltonian dynamics can be used to produce distant proposals for the Metropolis algorithm, thereby avoiding the slow exploration of the state space that results from the diffusive behaviour of simple random-walk proposals. Though originating in physics, Hamiltonian dynamics can be applied to most problems with continuous state spaces by simply introducing fictitious "momentum" variables. A key to its usefulness is that Hamiltonian dynamics preserves volume, and its trajectories can thus be used to define complex mappings without the need to account for a hard-to-compute Jacobian factor - a property that can be exactly maintained even when the dynamics is approximated by discretizing time. In this review, I discuss theoretical and practical aspects of Hamiltonian Monte Carlo, and present some of its variations, including using windows of states for deciding on acceptance or rejection, computing trajectories using fast approximations, tempering during the course of a trajectory to handle isolated modes, and short-cut methods that prevent useless trajectories from taking much computation time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
Studies in Molecular Dynamics. I. General Method
Alder, B. J., & Wainwright, T. E. (1959) · The Journal of Chemical Physics · doi:10.1063/1.1730376 · Cited by 2,524
Understanding Molecular Simulation
(2002) · doi:10.1016/b978-0-12-267351-1.x5000-7 · Cited by 2,042
Simulated Tempering: A New Monte Carlo Scheme
Marinari, E., & Parisi, G. (1992) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/19/6/002 · Cited by 1,818
Equation of state calculations by fast computing machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · doi:10.2172/4390578 · Cited by 1,701
Weak convergence and optimal scaling of random walk Metropolis algorithms
Roberts, G. O., Gelman, A., & Gilks, W. R. (1997) · The Annals of Applied Probability · doi:10.1214/aoap/1034625254 · Cited by 1,693
Self-citationMonte Carlo Sampling Methods Using Markov Chains and Their Applications
Hastings, W. K. (1970) · Biometrika · doi:10.2307/2334940 · Cited by 1,443
Monte Carlo Strategies in Scientific Computing
Hesterberg, T. (2002) · Technometrics · doi:10.1198/tech.2002.s85 · Cited by 1,409
Simulating Hamiltonian Dynamics
Leimkuhler, B., & Reich, S. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511614118 · Cited by 1,130
Cited by
dynesty: a dynamic nested sampling package for estimating Bayesian posteriors and evidences
Speagle, J. S. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa278 · Cited by 2,230
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Bayesian estimation supersedes the t-test
Kruschke, J. K. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0029146 · Cited by 1,530
Bayesian statistics and modelling
van de Schoot, R., Depaoli, S., King, R., Kramer, B., Märtens, K., Tadesse, M. G., Vannucci, M., Gelman, A., Veen, D., Willemsen, J., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-020-00001-2 · Cited by 1,176
Self-citationShen, C. (2018) · Water Resources Research · doi:10.1029/2018wr022643 · Cited by 1,133
Programming With Models: Writing Statistical Algorithms for General Model Structures With NIMBLE
de Valpine, P., Turek, D., Paciorek, C. J., Anderson-Bergman, C., Lang, D. T., & Bodik, R. (2017) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2016.1172487 · Cited by 998
Vrugt, J. A. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.08.013 · Cited by 851
CHOMP: Covariant Hamiltonian optimization for motion planning
Zucker, M., Ratliff, N., Dragan, A. D., Pivtoraiko, M., Klingensmith, M., Dellin, C. M., Bagnell, J. A., & Srinivasa, S. S. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913488805 · Cited by 758
Why the Monte Carlo method is so important today
Kroese, D. P., Brereton, T., Taimre, T., & Botev, Z. I. (2014) · WIREs Computational Statistics · doi:10.1002/wics.1314 · Cited by 757
Advances in Variational Inference
Zhang, C., Butepage, J., Kjellstrom, H., & Mandt, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889774 · Cited by 671
Mathematics for Machine Learning
Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108679930 · Cited by 573
Yu, Z., Guindani, M., Grieco, S. F., Chen, L., Holmes, T. C., & Xu, X. (2022) · Neuron · doi:10.1016/j.neuron.2021.10.030 · Cited by 563
Self-assembly of magnetite nanocubes into helical superstructures
Singh, G., Chan, H., Baskin, A., Gelman, E., Repnin, N., Král, P., & Klajn, R. (2014) · Science · doi:10.1126/science.1254132 · Cited by 536
Bayesian Evolutionary Analysis with BEAST
Drummond, A. J., & Bouckaert, R. R. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781139095112 · Cited by 527
The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal Graphs
Ivanovic, B., & Pavone, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00246 · Cited by 467
Spatial and spatio-temporal models with R-INLA
Blangiardo, M., Cameletti, M., Baio, G., & Rue, H. (2013) · Spatial and Spatio-temporal Epidemiology · doi:10.1016/j.sste.2013.07.003 · Cited by 446
Bayesian Analysis Reporting Guidelines
Kruschke, J. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01177-7 · Cited by 440
von Toussaint, U. (2011) · Reviews of Modern Physics · doi:10.1103/revmodphys.83.943 · Cited by 422
ABCtoolbox: a versatile toolkit for approximate Bayesian computations
Wegmann, D., Leuenberger, C., Neuenschwander, S., & Excoffier, L. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-116 · Cited by 404
Schneider, T., Lan, S., Stuart, A., & Teixeira, J. (2017) · Geophysical Research Letters · doi:10.1002/2017gl076101 · Cited by 391
Agol, E., Dorn, C., Grimm, S. L., Turbet, M., Ducrot, E., Delrez, L., Gillon, M., Demory, B.-O., Burdanov, A., Barkaoui, K., et al. (2021) · The Planetary Science Journal · doi:10.3847/psj/abd022 · Cited by 331
Garske, T., Van Kerkhove, M. D., Yactayo, S., Ronveaux, O., Lewis, R. F., Staples, J. E., Perea, W., Ferguson, N. M., & for the Yellow Fever Expert Committee (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001638 · Cited by 327
Applied Stochastic Differential Equations
Särkkä, S., & Solin, A. (2019) · doi:10.1017/9781108186735 · Cited by 326
Data Analysis Recipes: Using Markov Chain Monte Carlo*
Hogg, D. W., & Foreman-Mackey, D. (2018) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/aab76e · Cited by 316
Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy
Sharma, S. (2017) · Annual Review of Astronomy and Astrophysics · doi:10.1146/annurev-astro-082214-122339 · Cited by 298
A Parallel Tempering algorithm for probabilistic sampling and multimodal optimization
Sambridge, M. (2014) · Geophysical Journal International · doi:10.1093/gji/ggt342 · Cited by 296
Multisystem Bayesian constraints on the transport coefficients of QCD matter
Everett, D., Ke, W., Paquet, J.-F., Vujanovic, G., Bass, S. A., Du, L., Gale, C., Heffernan, M., Heinz, U., Liyanage, D., et al. (2021) · Physical Review C · doi:10.1103/physrevc.103.054904 · Cited by 295
TAU-REX I: A NEXT GENERATION RETRIEVAL CODE FOR EXOPLANETARY ATMOSPHERES
Waldmann, I. P., Tinetti, G., Rocchetto, M., Barton, E. J., Yurchenko, S. N., & Tennyson, J. (2015) · The Astrophysical Journal · doi:10.1088/0004-637x/802/2/107 · Cited by 283
Zhang, J., Petersen, S. D., Radivojevic, T., Ramirez, A., Pérez-Manríquez, A., Abeliuk, E., Sánchez, B. J., Costello, Z., Chen, Y., Fero, M. J., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-17910-1 · Cited by 282
A method for efficiently sampling from distributions with correlated dimensions.
Turner, B. M., Sederberg, P. B., Brown, S. D., & Steyvers, M. (2013) · Psychological Methods · doi:10.1037/a0032222 · Cited by 282
A machine learning Automated Recommendation Tool for synthetic biology
Radivojević, T., Costello, Z., Workman, K., & Garcia Martin, H. (2020) · Nature Communications · doi:10.1038/s41467-020-18008-4 · Cited by 277
A guide to state–space modeling of ecological time series
Auger‐Méthé, M., Newman, K., Cole, D., Empacher, F., Gryba, R., King, A. A., Leos‐Barajas, V., Mills Flemming, J., Nielsen, A., Petris, G., et al. (2021) · Ecological Monographs · doi:10.1002/ecm.1470 · Cited by 275
Faster estimation of Bayesian models in ecology using Hamiltonian Monte Carlo
Monnahan, C. C., Thorson, J. T., & Branch, T. A. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12681 · Cited by 273
Bayesian inference with optimal maps
El Moselhy, T. A., & Marzouk, Y. M. (2012) · Journal of Computational Physics · doi:10.1016/j.jcp.2012.07.022 · Cited by 267
Laloy, E., Hérault, R., Lee, J., Jacques, D., & Linde, N. (2017) · Advances in Water Resources · doi:10.1016/j.advwatres.2017.09.029 · Cited by 258
Sampling methods for solving Bayesian model updating problems: A tutorial
Lye, A., Cicirello, A., & Patelli, E. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.107760 · Cited by 169
Progress in context-aware recommender systems — An overview
Raza, S., & Ding, C. (2019) · Computer Science Review · doi:10.1016/j.cosrev.2019.01.001 · Cited by 151
Neural Network Renormalization Group
Li, S.-H., & Wang, L. (2018) · Physical Review Letters · doi:10.1103/physrevlett.121.260601 · Cited by 140
Sharma, M., Tong, M., Korbak, T., Duperrouzel, D., Was, H., Korbak, J., Cheng, M., Askell, A., Bai, Y., Brain, C., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.13548 · Cited by 1,313
“Specifically, we use the No-U-Turn Sampler (Hoffman et al., 2014) with Hamiltonian Monte Carlo (Neal et al., 2011).”
Predictive Coding: a Theoretical and Experimental Review
Millidge, B., Seth, A., & Buckley, C. L. (2021) · arXiv · doi:10.48550/arxiv.2107.12979 · Cited by 106
Sensitivity to pain expectations: A Bayesian model of individual differences
Hoskin, R., Berzuini, C., Acosta-Kane, D., El-Deredy, W., Guo, H., & Talmi, D. (2019) · Cognition · doi:10.1016/j.cognition.2018.08.022 · Cited by 87
On sequential Monte Carlo, partial rejection control and approximate Bayesian computation
Peters, G. W., Fan, Y., & Sisson, S. A. (2012) · Statistics and Computing · doi:10.1007/s11222-012-9315-y · Cited by 69
Aitchison, L., & Lengyel, M. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005186 · Cited by 67
Adaptive Metropolis algorithm using variational Bayesian adaptive Kalman filter
Mbalawata, I. S., Särkkä, S., Vihola, M., & Haario, H. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2014.10.006 · Cited by 54
A practical guide for the generation of model-based virtual clinical trials
Craig, M., Gevertz, J. L., Kareva, I., & Wilkie, K. P. (2023) · Frontiers in Systems Biology · doi:10.3389/fsysb.2023.1174647 · Cited by 52
Saber, M., Giordano, K. R., Hur, Y., Ortiz, J. B., Morrison, H., Godbout, J. P., Murphy, S. M., Lifshitz, J., & Rowe, R. K. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14611 · Cited by 46
Bayesian Data Analysis in Empirical Software Engineering Research
Furia, C. A., Feldt, R., & Torkar, R. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2935974 · Cited by 42
Probabilistic mass-mapping with neural score estimation
Remy, B., Lanusse, F., Jeffrey, N., Liu, J., Starck, J.-L., Osato, K., & Schrabback, T. (2023) · Astronomy & Astrophysics · doi:10.1051/0004-6361/202243054 · Cited by 41
Direct parametric reconstruction from undersampled (k,t)-space data in dynamic contrast enhanced MRI
Dikaios, N., Arridge, S., Hamy, V., Punwani, S., & Atkinson, D. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.05.001 · Cited by 40
An efficient Bayesian inference framework for coalescent-based nonparametric phylodynamics
Lan, S., Palacios, J. A., Karcher, M., Minin, V. N., & Shahbaba, B. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv378 · Cited by 38
A generalized many-facet Rasch model and its Bayesian estimation using Hamiltonian Monte Carlo
Uto, M., & Ueno, M. (2020) · Behaviormetrika · doi:10.1007/s41237-020-00115-7 · Cited by 37
Garre, A., Huertas, J. P., González-Tejedor, G. A., Fernández, P. S., Egea, J. A., Palop, A., & Esnoz, A. (2018) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2017.11.023 · Cited by 31
Garre, A., González-Tejedor, G. A., Aznar, A., Fernández, P. S., & Egea, J. A. (2019) · Food Microbiology · doi:10.1016/j.fm.2019.06.002 · Cited by 26
Clemente-Carazo, M., Cebrián, G., Garre, A., & Palop, A. (2020) · Food Research International · doi:10.1016/j.foodres.2020.109538 · Cited by 26
A Bayesian many-facet Rasch model with Markov modeling for rater severity drift
Uto, M. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01997-z · Cited by 32
“MCMC, a random sampling-based estimation method, has been widely used in various fields to address this problem, including in IRT studies (Brooks, Gelman, Jones, & Meng, 2011; Fontanella et al., 2019; Fox, 2010; Uto, 2021b; Uto & Ueno, 2020; van Lier et al., 2018; Zhang, Xie, You, & Huang, 2011).”
MethodSpatial Prevalence and Determinants of Malaria among under-five Children in Ghana
Ejigu, B. A., & Wencheko, E. (2021) · doi:10.1101/2021.03.12.21253436 · Cited by 17
Johnson, R., Burch, K. S., Hou, K., Paciuc, M., Pasaniuc, B., & Sankararaman, S. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009483 · Cited by 16
RL with KL penalties is better viewed as Bayesian inference
Korbak, T., Perez, E., & Buckley, C. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.77 · Cited by 8
Metadata
- Authors
- Brooks, S., Gelman, A., Jones, G., & Meng, X.-L.
- Venue
- Chapman & Hall/CRC eBooks
- Publisher
- Chapman and Hall/CRC
- Published
- 2011-05-10
- OpenAlex
- W621546036
- Cited by
- 2,993
- References
- 40
- FWCI
- 28.58
- Type
- book
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.