The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Bayesian inference with optimal maps
Open accessAbstract
We present a new approach to Bayesian inference that entirely avoids Markov chain simulation, by constructing a map that pushes forward the prior measure to the posterior measure. Existence and uniqueness of a suitable measure-preserving map is established by formulating the problem in the context of optimal transport theory. We discuss various means of explicitly parameterizing the map and computing it efficiently through solution of an optimization problem, exploiting gradient information from the forward model when possible. The resulting algorithm overcomes many of the computational bottlenecks associated with Markov chain Monte Carlo. Advantages of a map-based representation of the posterior include analytical expressions for posterior moments and the ability to generate arbitrary numbers of independent posterior samples without additional likelihood evaluations or forward solves. The optimization approach also provides clear convergence criteria for posterior approximation and facilitates model selection through automatic evaluation of the marginal likelihood. We demonstrate the accuracy and efficiency of the approach on nonlinear inverse problems of varying dimension, involving the inference of parameters appearing in ordinary and partial differential equations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Sequential Monte Carlo Methods in Practice
(2001) · Springer eBooks · doi:10.1007/978-1-4757-3437-9 · Cited by 7,366
Inverse Problem Theory and Methods for Model Parameter Estimation
Tarantola, A. (2005) · doi:10.1137/1.9780898717921 · Cited by 6,585
Stochastic Finite Elements: A Spectral Approach
Ghanem, R., & Spanos, P. D. (1991) · Springer eBooks · doi:10.1007/978-1-4612-3094-6 · Cited by 6,552
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
Xiu, D., & Karniadakis, G. E. (2002) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827501387826 · Cited by 4,807
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (2004) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4145-2 · Cited by 4,271
Construction of a genetic toggle switch in Escherichia coli
Gardner, T. S., Cantor, C. R., & Collins, J. J. (2000) · Nature · doi:10.1038/35002131 · Cited by 4,268
Wiener, N. (1938) · American Journal of Mathematics · doi:10.2307/2371268 · Cited by 3,074
Handbook of Markov Chain Monte Carlo
Brooks, S., Gelman, A., Jones, G., & Meng, X.-L. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905 · Cited by 2,993
Remarks on a Multivariate Transformation
Rosenblatt, M. (1952) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729394 · Cited by 2,863
Monte Carlo Strategies in Scientific Computing
Liu, J. S. (2004) · Springer Series in Statistics · doi:10.1007/978-0-387-76371-2 · Cited by 2,690
Sivia, D. S. (1996) · Cited by 2,678
MCMC Using Hamiltonian Dynamics
Neal, R. M. (2011) · Handbook of Markov Chain Monte Carlo · doi:10.1201/b10905-6 · Cited by 2,574
Statistical and Computational Inverse Problems
Kaipio, J. P., & Somersalo, E. (2005) · Applied Mathematical Sciences · doi:10.1007/b138659 · Cited by 2,345
Robust Stochastic Approximation Approach to Stochastic Programming
Nemirovski, A., Juditsky, A., Lan, G., & Shapiro, A. (2009) · SIAM Journal on Optimization · doi:10.1137/070704277 · Cited by 1,945
Markov Chain Monte Carlo in Practice
Gasparini, M. (1997) · Technometrics · doi:10.1080/00401706.1997.10485132 · Cited by 1,879
Inverse problems: A Bayesian perspective
Stuart, A. M. (2010) · Acta Numerica · doi:10.1017/s0962492910000061 · Cited by 1,791
Equation of state calculations by fast computing machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · doi:10.2172/4390578 · Cited by 1,701
Polar factorization and monotone rearrangement of vector‐valued functions
Brenier, Y. (1991) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160440402 · Cited by 1,641
Data analysis: a Bayesian tutorial
(1997) · Choice Reviews Online · doi:10.5860/choice.34-5742 · Cited by 1,630
Haario, H., Laine, M., Mira, A., & Saksman, E. (2006) · Statistics and Computing · doi:10.1007/s11222-006-9438-0 · Cited by 1,498
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Monte Carlo Sampling Methods Using Markov Chains and Their Applications
Hastings, W. K. (1970) · Biometrika · doi:10.2307/2334940 · Cited by 1,443
Huber, M. (2011) · Handbook of Markov Chain Monte Carlo · doi:10.1201/b10905-10 · Cited by 1,176
Vrugt, J. A., ter Braak, C. J. F., Diks, C. G. H., Robinson, B. A., Hyman, J. M., & Higdon, D. (2009) · International Journal of Nonlinear Sciences and Numerical Simulation · doi:10.1515/ijnsns.2009.10.3.273 · Cited by 1,145
Numerical Methods for Stochastic Computations: A Spectral Method Approach
Xiu, D. (2010) · Cited by 1,143
Roberts, G. O., & Rosenthal, J. S. (2009) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2009.06134 · Cited by 1,028
Monte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
The geometry of optimal transportation
Gangbo, W., & McCann, R. J. (1996) · Acta Mathematica · doi:10.1007/bf02392620 · Cited by 813
Monte Carlo Statistical Methods
(2005) · Technometrics · doi:10.1198/tech.2005.s272 · Cited by 725
Data Analysis: A Bayesian Tutorial
Fox, E. P. (1998) · Technometrics · doi:10.1080/00401706.1998.10485200 · Cited by 647
MCMC Methods for Functions: Modifying\nOld Algorithms to Make Them Faster
Cotter, S. L., Roberts, G. O., Stuart, A. M., & White, D. (2012) · MIMS EPrints (University of Southampton) · Cited by 637
Bayesian parameter estimation via variational methods
Jaakkola, T. S., & Jordan, M. I. (2000) · Statistics and Computing · doi:10.1023/a:1008932416310 · Cited by 603
Spectral methods for uncertainty quantification : with applications to computational fluid dynamics
Maître, O. P. L., & Knio, O. (2010) · Springer eBooks · Cited by 589
An adaptive multi-element generalized polynomial chaos method for stochastic differential equations
Wan, X., & Karniadakis, G. E. (2005) · Journal of Computational Physics · doi:10.1016/j.jcp.2005.03.023 · Cited by 577
Stochastic spectral methods for efficient Bayesian solution of inverse problems
Marzouk, Y. M., Najm, H. N., & Rahn, L. A. (2007) · Journal of Computational Physics · doi:10.1016/j.jcp.2006.10.010 · Cited by 470
Self-citationMartin, J., Wilcox, L. C., Burstedde, C., & Ghattas, O. (2012) · SIAM Journal on Scientific Computing · doi:10.1137/110845598 · Cited by 424
Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
Marzouk, Y. M., & Najm, H. N. (2009) · Journal of Computational Physics · doi:10.1016/j.jcp.2008.11.024 · Cited by 418
Self-citationThe regularity of mappings with a convex potential
Caffarelli, L. A. (1992) · Journal of the American Mathematical Society · doi:10.1090/s0894-0347-1992-1124980-8 · Cited by 397
The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations
Xiu, D., & Karniadakis, G. E. (2003) · Defense Technical Information Center (DTIC) · doi:10.21236/ada460654 · Cited by 393
A Stochastic Collocation Approach to Bayesian Inference in Inverse Problems
Marzouk, Y., & Xiu, D. (2009) · Communications in Computational Physics · doi:10.4208/cicp.2009.v6.p826 · Cited by 284
Self-citationParameter and State Model Reduction for Large-Scale Statistical Inverse Problems
Lieberman, C., Willcox, K., & Ghattas, O. (2010) · SIAM Journal on Scientific Computing · doi:10.1137/090775622 · Cited by 254
Inference from Simulations and Monitoring Convergence
Gelman, A., & Shirley, K. E. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905-7 · Cited by 171
Frangos, M., Marzouk, Y., Willcox, K. E., & Waanders, B. V. B. (2010) · Wiley eBooks · doi:10.1002/9780470685853.ch7 · Cited by 162
Self-citationImplementing MCMC: Estimating with Confidence
Flegal, J. M., & Jones, G. L. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905-8 · Cited by 140
Implicit particle filters for data assimilation
CHORIN, A. J., Morzfeld, M., & Tu, X. (2010) · Communications in Applied Mathematics and Computational Science · doi:10.2140/camcos.2010.5.221 · Cited by 140
Using Bayesian statistics in the estimation of heat source in radiation
Wang, J. B., & Zabaras, N. J. (2004) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2004.08.009 · Cited by 134
Sampling the posterior: An approach to non-Gaussian data assimilation
Apte, A., Hairer, M., Stuart, A. M., et al. (2006) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2006.06.009 · Cited by 133
Learn From Thy Neighbor: Parallel-Chain and Regional Adaptive MCMC
Craiu, R. V., Rosenthal, J. S., & Yang, C. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08393 · Cited by 126
A dynamical systems framework for intermittent data assimilation
Reich, S. (2010) · BIT Numerical Mathematics · doi:10.1007/s10543-010-0302-4 · Cited by 106
From Knothe's Transport to Brenier's Map and a Continuation Method for Optimal Transport
Carlier, G., Galichon, A., & Santambrogio, F. (2010) · SIAM Journal on Mathematical Analysis · doi:10.1137/080740647 · Cited by 76
Langevin-Type Models II: Self-Targeting Candidates for MCMC Algorithms*
Stramer, O., & Tweedie, R. L. (1999) · Methodology And Computing In Applied Probability · doi:10.1023/a:1010090512027 · Cited by 73
Higdon, D., Lee, H., & Bi, Z. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/78.978393 · Cited by 67
Nonparametric estimation of diffusions: a differential equations approach
Papaspiliopoulos, O., Pokern, Y., Roberts, G. O., & Stuart, A. M. (2012) · Biometrika · doi:10.1093/biomet/ass034 · Cited by 59
Cited by
Computational Optimal Transport
Peyré, G., & Cuturi, M. (2019) · now publishers, Inc. eBooks · doi:10.1561/9781680835519 · Cited by 847
Optimal Mass Transport: Signal processing and machine-learning applications
Kolouri, S., Park, S. R., Thorpe, M., Slepcev, D., & Rohde, G. K. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2695801 · Cited by 443
Quantification of model uncertainty in RANS simulations: A review
Xiao, H., & Cinnella, P. (2019) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2018.10.001 · Cited by 434
Probabilistic Forecasting and Bayesian Data Assimilation
Reich, S., & Cotter, C. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107706804 · Cited by 334
Particle filters for high‐dimensional geoscience applications: A review
van Leeuwen, P. J., Künsch, H. R., Nerger, L., Potthast, R., & Reich, S. (2019) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3551 · Cited by 297
Metadata
- Authors
- El Moselhy, T. A., & Marzouk, Y. M.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2012-10
- Volume
- 231
- Issue
- 23
- Pages
- 7815-7850
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W2023103251
- Cited by
- 267
- References
- 60
- FWCI
- 17.38
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.