The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
The geometric foundations of Hamiltonian Monte Carlo
Open accessAbstract
Although Hamiltonian Monte Carlo has proven an empirical success, the lack of a rigorous theoretical understanding of the algorithm has in many ways impeded both principled developments of the method and use of the algorithm in practice. In this paper, we develop the formal foundations of the algorithm through the construction of measures on smooth manifolds, and demonstrate how the theory naturally identifies efficient implementations and motivates promising generalizations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
(1988) · Elsevier eBooks · doi:10.1016/c2013-0-11200-7 · Cited by 5,131
Duane, S., Kennedy, A. D., Pendleton, B. J., & Roweth, D. (1987) · Physics Letters B · doi:10.1016/0370-2693(87)91197-x · Cited by 3,872
The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte CarloPreprint
Homan, M. D., & Gelman, A. (2014) · arXiv (Cornell University) · Cited by 3,077
An Adaptive Metropolis Algorithm
Haario, H., Saksman, E., & Tamminen, J. (2001) · Bernoulli · doi:10.2307/3318737 · Cited by 2,631
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (1999) · Springer Texts in Statistics · doi:10.1007/978-1-4757-3071-5 · Cited by 2,278
Methods of Information Geometry
Amari, S.-I., & Nagaoka, H. (2007) · Translations of Mathematical Monographs · doi:10.1090/mmono/191 · Cited by 2,204
Stochastic Differential Equations
Øksendal, B. (2003) · Universitext · doi:10.1007/978-3-642-14394-6 · Cited by 2,082
Understanding Molecular Simulation
(2002) · doi:10.1016/b978-0-12-267351-1.x5000-7 · Cited by 2,042
Halmos, P. R. (1950) · Graduate Texts in Mathematics · doi:10.1007/978-1-4684-9440-2 · Cited by 2,002
Monte Carlo and quasi-Monte Carlo methods
Caflisch, R. E. (1998) · Acta Numerica · doi:10.1017/s0962492900002804 · Cited by 1,754
The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
Hoffman, M. D., & Gelman, A. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1111.4246 · Cited by 1,713
Weak convergence and optimal scaling of random walk Metropolis algorithms
Roberts, G. O., Gelman, A., & Gilks, W. R. (1997) · The Annals of Applied Probability · doi:10.1214/aoap/1034625254 · Cited by 1,693
Markov Chains and Stochastic Stability
Meyn, S., Tweedie, R. L., & Glynn, P. W. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511626630 · Cited by 1,680
Ab Initio Molecular Dynamics: Basic Theory and Advanced Methods
Marx, D., & Hutter, J. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609633 · Cited by 1,485
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Self-citationMolecular Dynamics Simulation: Elementary Methods
Haile, J. M., Johnston, I., Mallinckrodt, A. J., & McKay, S. R. (1993) · Computers in Physics · doi:10.1063/1.4823234 · Cited by 1,341
Huber, M. (2011) · Handbook of Markov Chain Monte Carlo · doi:10.1201/b10905-10 · Cited by 1,176
Simulating Hamiltonian Dynamics
Leimkuhler, B., & Reich, S. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511614118 · Cited by 1,130
The local structure of Poisson manifolds
Weinstein, A. (1983) · Journal of Differential Geometry · doi:10.4310/jdg/1214437787 · Cited by 1,100
General state space Markov chains and MCMC algorithms
Roberts, G. O., & Rosenthal, J. S. (2004) · Probability Surveys · doi:10.1214/154957804100000024 · Cited by 734
Ricci curvature of Markov chains on metric spaces
Ollivier, Y. (2009) · Journal of Functional Analysis · doi:10.1016/j.jfa.2008.11.001 · Cited by 712
Geometrical Methods of Mathematical Physics
Schutz, B. F. (1980) · Cambridge University Press eBooks · doi:10.1017/cbo9781139171540 · Cited by 662
MCMC Methods for Functions: Modifying\nOld Algorithms to Make Them Faster
Cotter, S. L., Roberts, G. O., Stuart, A. M., & White, D. (2012) · MIMS EPrints (University of Southampton) · Cited by 637
Introduction to Topological Manifolds
Lee, J. M. (2011) · Graduate Texts in Mathematics · doi:10.1007/978-1-4419-7940-7 · Cited by 511
Diaconis, P. W., & Freedman, D. A. (1999) · SIAM Review · doi:10.1137/s0036144598338446 · Cited by 502
Statistical Physics of Particles
Kardar, M. (2007) · doi:10.1017/cbo9780511815898 · Cited by 473
(2017) · Stochastic Processes · doi:10.1201/9781315381619-26 · Cited by 434
Gauge Fields, Knots and Gravity
Baez, J., & Muniain, J. P. (1994) · Series on Knots and Everything · doi:10.1142/2324 · Cited by 367
A note on Metropolis-Hastings kernels for general state spaces
Tierney, L. (1998) · The Annals of Applied Probability · doi:10.1214/aoap/1027961031 · Cited by 338
Classical Dynamics: A Contemporary Approach
José, J. V., & Saletan, E. J. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511803772 · Cited by 303
Marginalization Paradoxes in Bayesian and Structural Inference
Dawid, A. P., Stone, M., & Zidek, J. V. (1973) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1973.tb00952.x · Cited by 296
A generalized guided Monte Carlo algorithm
Horowitz, A. M. (1991) · Physics Letters B · doi:10.1016/0370-2693(91)90812-5 · Cited by 282
Optimal tuning of the hybrid Monte Carlo algorithm
Beskos, A., Pillai, N., Roberts, G., Sanz-Serna, J.-M., & Stuart, A. (2013) · Bernoulli · doi:10.3150/12-bej414 · Cited by 261
Conditioning as disintegration
Chang, J. T., & Pollard, D. (1997) · Statistica Neerlandica · doi:10.1111/1467-9574.00056 · Cited by 241
Structure of Dynamical Systems
(1997) · doi:10.1007/978-1-4612-0281-3 · Cited by 168
Numerical Methods for Second‐Order Stochastic Differential Equations
Burrage, K., Lenane, I. J., & Lythe, G. (2007) · SIAM Journal on Scientific Computing · doi:10.1137/050646032 · Cited by 142
Shadow hybrid Monte Carlo: an efficient propagator in phase space of macromolecules
Izaguirre, J. A., & Hampton, S. S. (2004) · Journal of Computational Physics · doi:10.1016/j.jcp.2004.04.016 · Cited by 134
Hybrid Monte Carlo on Hilbert spaces
Beskos, A., Pinski, F. J., Sanz-Serna, J. M., & Stuart, A. M. (2011) · Stochastic Processes and their Applications · doi:10.1016/j.spa.2011.06.003 · Cited by 120
Strong Expectations Cancel Locality Effects: Evidence from Hindi
Husain, S., Vasishth, S., & Srinivasan, N. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100986 · Cited by 105
Bayesian non-linear large-scale structure inference of the Sloan Digital Sky Survey Data Release 7
Jasche, J., Kitaura, F.-S., Li, C., & Enßlin, T. A. (2010) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2010.17313.x · Cited by 91
A General Metric for Riemannian Manifold Hamiltonian Monte Carlo
Betancourt, M. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40020-9_35 · Cited by 88
Self-citationLearning Generative Models with Visual AttentionPreprint
Tang, Y., Srivastava, N., & Salakhutdinov, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6110 · Cited by 88
Geodesic Monte Carlo on Embedded Manifolds
Byrne, S., & Girolami, M. (2013) · Scandinavian Journal of Statistics · doi:10.1111/sjos.12036 · Cited by 87
Self-citationGeodesic Monte Carlo on Embedded Manifolds
Byrne, S., Girolami, M., et al. (2013) · Warwick Research Archive Portal (University of Warwick) · Cited by 82
Self-citationThe Great Society, Reagan's Revolution, and Generations of Presidential Voting
Ghitza, Y., Gelman, A., & Auerbach, J. (2022) · American Journal of Political Science · doi:10.1111/ajps.12713 · Cited by 74
Information-Geometric Markov Chain Monte Carlo Methods Using Diffusions
Livingstone, S., & Girolami, M. (2014) · Entropy · doi:10.3390/e16063074 · Cited by 38
Self-citationInformation-Geometric Markov Chain Monte Carlo Methods Using Diffusions
Livingstone, S., & Girolami, M. (2014) · Warwick Research Archive Portal (University of Warwick) · Cited by 36
Self-citationGeneralizing the No-U-Turn Sampler to Riemannian ManifoldsPreprint
Betancourt, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1304.1920 · Cited by 32
Self-citationDriving Markov chain Monte Carlo with a dependent random streamPreprint
Murray, I., & Elliott, L. T. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1204.3187 · Cited by 15
UNSUPERVISED TRANSIENT LIGHT CURVE ANALYSIS VIA HIERARCHICAL BAYESIAN INFERENCE
Sanders, N. E., Betancourt, M., & Soderberg, A. M. (2015) · The Astrophysical Journal · doi:10.1088/0004-637x/800/1/36 · Cited by 10
Self-citation
Research works printed but not linked: 25
- [7] Betancourt, M. (2014). Adiabatic Monte Carlo. Preprint. Available at arXiv:1405.3489. · arXiv
- [8] Betancourt, M. and Stein, L.C. (2011). The geometry of Hamiltonian Monte Carlo. Preprint. Available at arXiv:1410.5110. · arXiv
- [12] Cannas da Silva, A. (2001). Lectures on Symplectic Geometry. Lecture Notes in Math. 1764. Berlin: Springer.
- [13] Censor, A. and Grandini, D. (2014). Borel and continuous systems of measures. Rocky Mountain J. Math. 44 1073–1110. · doi:10.1216/rmj-2014-44-4-1073
- [21] Fang, Y., Sanz-Serna, J.-M. and Skeel, R.D. (2014). Compressible generalized hybrid Monte Carlo. J. Chem. Phys. 140 174108. · doi:10.1063/1.4874000
- [32] Hairer, E., Lubich, C. and Wanner, G. (2006). Geometric Numerical Integration: Structure-Preserving Algorithms for Ordinary Differential Equations, 2nd ed. Springer Series in Computational Mathematics 31. Berlin: Springer.
- [35] Holmes, S., Rubinstein-Salzedo, S. and Seiler, C. (2014). Curvature and concentration of Hamiltonian Monte Carlo in high dimensions. Preprint. Available at arXiv:1407.1114. · arXiv
- [41] Joulin, A. and Ollivier, Y. (2010). Curvature, concentration and error estimates for Markov chain Monte Carlo. Ann. Probab. 38 2418–2442. · doi:10.1214/10-aop541
- [43] Lan, S., Stathopoulos, V., Shahbaba, B. and Girolami, M. (2012). Lagrangian Dynamical Monte Carlo. Preprint. Available at arXiv:1211.3759. · arXiv
- [46] Lee, J.M. (2013). Introduction to Smooth Manifolds, 2nd ed. Graduate Texts in Mathematics 218. New York: Springer.
- [53] Neal, R.M. (2012). How to view an MCMC simulation as a permutation, with applications to parallel simulation and improved importance sampling. Preprint. Available at arXiv:1205.0070. · arXiv
- [57] Polettini, M. (2013). Generally covariant state-dependent diffusion. J. Stat. Mech. Theory Exp. 2013 P07005. · doi:10.1088/1742-5468/2013/07/p07005
- [58] Porter, E.K. and Carré, J. (2014). A Hamiltonian Monte-Carlo method for Bayesian inference of supermassive black hole binaries. Classical Quantum Gravity 31 145004, 22. · doi:10.1088/0264-9381/31/14/145004
- [63] Schofield, M.R., Barker, R.J., Gelman, A., Cook, E.R. and Briffa, K. (2014). Climate reconstruction using tree-ring data. J. Amer. Statist. Assoc. To appear. Available at arXiv:1510.02557. · arXiv
- [65] Simmons, D. (2012). Conditional measures and conditional expectation; Rohlin’s disintegration theorem. Discrete Contin. Dyn. Syst. 32 2565–2582. · doi:10.3934/dcds.2012.32.2565
- [74] Wang, H., Mo, H.J., Yang, X., Jing, Y.P. and Lin, W.P. (2014). Exploring the local universe with reconstructed initial density field I: Hamiltonian Markov chain Monte Carlo method with particle mesh dynamics. Preprint. Available at arXiv:1407.3451. · arXiv
- [16] Cowling, B.J., Freeman, G., Wong, J.Y., Wu, P., Liao, Q., Lau, E.H., Wu, J.T., Fielding, R. and Leung, G.M. (2012). Preliminary inferences on the age-specific seriousness of human disease caused by Avian influenza A (H7N9) infections in China, March to April 2013. European Communicable Disease Bulletin 18.
- [24] Folland, G.B. (1999). Real Analysis: Modern Techniques and Their Applications, 2nd ed. Pure and Applied Mathematics (New York). New York: Wiley.
- [52] Neal, R.M. (2011). MCMC using Hamiltonian dynamics. In Handbook of Markov Chain Monte Carlo (S. Brooks, A. Gelman, G.L. Jones and X.-L. Meng, eds.) New York: CRC Press.
- [56] Petersen, K. (1989). Ergodic Theory. Cambridge: Cambridge Univ. Press.
- [66] Sohl-Dickstein, J., Mudigonda, M. and DeWeese, M. (2014). Hamiltonian Monte Carlo without detailed balance. In Proceedings of the 31 st International Conference on Machine Learning. 719–726. Beijing, China.
- [69] Sutherland, D.J., Póczos, B. and Schneider, J. (2013). Active learning and search on low-rank matrices. In Proceedings of the 19 th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’13 212–220. New York: ACM.
- [73] Tjur, T. (1980). Probability Based on Radon Measures. Chichester: Wiley.
- [75] Wang, Z., Mohamed, S. and de Freitas, N. (2013). Adaptive Hamiltonian and Riemann Manifold Monte Carlo. In Proceedings of the 30 th International Conference on Machine Learning (ICML-13) 1462–1470. Atlanta, Georgia, USA.
- [78] Zaslavsky, G.M. (2005). Hamiltonian Chaos and Fractional Dynamics. Oxford: Oxford Univ. Press.
Cited by
Advanced Bayesian Multilevel Modeling with the R Package brms
Bürkner, P.-C. (2018) · The R Journal · doi:10.32614/rj-2018-017 · Cited by 3,015
Modelling monotonic effects of ordinal predictors in Bayesian regression models
Bürkner, P., & Charpentier, E. (2020) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12195 · Cited by 160
Zhao, T., Zeng, J., & Cheng, H. (2022) · Genetics · doi:10.1093/genetics/iyac034 · Cited by 52
Inferring kinetic parameters of oscillatory gene regulation from single cell time-series data
Burton, J., Manning, C. S., Rattray, M., Papalopulu, N., & Kursawe, J. (2021) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0393 · Cited by 9
Zhou, S., & Li, Q. (2025) · Scientific Reports · doi:10.1038/s41598-025-31685-9
“…adjust computational budgets: computed via adaptive Runge-Kutta methods with tolerance ϵ tol that balances gradient accuracy and computation cost 45 ( ) , while stability is ensured through spectral norm regularization that constrains the maximum eigenvalue of the Jacobian ∂f ∂h to remain below…”
Metadata
- Authors
- Betancourt, M., Byrne, S., Livingstone, S., & Girolami, M.
- Venue
- Bernoulli
- Published
- 2017-11-01
- Volume
- 23
- Issue
- 4A
- Pages
- 2257-2298
- ISSN
- 1350-7265 (ISSN-L)
- OpenAlex
- W2962703949
- Cited by
- 452
- References
- 53
- FWCI
- 22.24
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.