The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems, Part II: Stochastic Newton MCMC with Application to Ice Sheet Flow Inverse Problems
Open accessAbstract
We address the numerical solution of infinite-dimensional inverse problems in the framework of Bayesian inference. In Part I of this paper [T. Bui-Thanh, O. Ghattas, J. Martin, and G. Stadler, SIAM J. Sci. Comput., 35 (2013), pp. A2494--A2523] we considered the linearized infinite-dimensional inverse problem. In Part II, we relax the linearization assumption and consider the fully nonlinear infinite-dimensional inverse problem using a Markov chain Monte Carlo (MCMC) sampling method. To address the challenges of sampling high-dimensional probability density functions (pdfs) arising upon discretization of Bayesian inverse problems governed by PDEs, we build upon the stochastic Newton MCMC method. This method exploits problem structure by taking as a proposal density a local Gaussian approximation of the posterior pdf, whose covariance operator is given by the inverse of the local Hessian of the negative log posterior pdf. The construction of the covariance is made tractable by invoking a low-rank approximation of the data misfit component of the Hessian. Here we introduce an approximation of the stochastic Newton proposal in which we compute the low-rank-based Hessian at just the maximum a posteriori (MAP) point, and then reuse this Hessian at each MCMC step. We compare the performance of the proposed method to the original stochastic Newton MCMC method and to an independence sampler. The comparison of the three methods is conducted on a synthetic ice sheet inverse problem. For this problem, the stochastic Newton MCMC method with a MAP-based Hessian converges at least as rapidly as the original stochastic Newton MCMC method, but is far cheaper since it avoids recomputing the Hessian at each step. On the other hand, it is more expensive per sample than the independence sampler; however, its convergence is significantly more rapid, and thus overall it is much cheaper. Finally, we present extensive analysis and interpretation of the posterior distribution and classify directions in parameter space based on the extent to which they are informed by the prior or the observations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195 · cited 1×
“The method of choice for exploring the posterior pdf is the Metropolis-Hastings (M-H) MCMC method [28, 39, 50, 56], which employs a given proposal probability density q ( m k , y ) at each sample point m k in parameter space to generate a proposed sample point y ∈ R n .”
Inverse Problem Theory and Methods for Model Parameter Estimation
Tarantola, A. (2005) · doi:10.1137/1.9780898717921 · Cited by 6,585
General methods for monitoring convergence of iterative simulations
Brooks, S. P., & Gelman, A. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474787 · Cited by 6,045
An analysis of the finite element method
(1980) · Advances in Water Resources · doi:10.1016/0309-1708(80)90069-x · Cited by 3,466
Markov Chains for Exploring Posterior Distributions
Tierney, L. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325750 · Cited by 3,452
Paterson, W. S. B., & Andrews, J. T. (1969) · Cited by 3,332
Inverse problems: A Bayesian perspective
Stuart, A. M. (2010) · Acta Numerica · doi:10.1017/s0962492910000061 · Cited by 1,791
Haario, H., Laine, M., Mira, A., & Saksman, E. (2006) · Statistics and Computing · doi:10.1007/s11222-006-9438-0 · Cited by 1,498
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Monte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
Exponential Convergence of Langevin Distributions and Their Discrete Approximations
Roberts, G. O., & Tweedie, R. L. (1996) · Bernoulli · doi:10.2307/3318418 · Cited by 998
Computer Model Calibration Using High-Dimensional Output
Higdon, D., Gattiker, J., Williams, B., & Rightley, M. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000000888 · Cited by 867
Dynamics of Ice Sheets and Glaciers
Greve, R., & Blatter, H. (2009) · Advances in geophysical and environmental mechanics and mathematics · doi:10.1007/978-3-642-03415-2 · Cited by 505
Martin, J., Wilcox, L. C., Burstedde, C., & Ghattas, O. (2012) · SIAM Journal on Scientific Computing · doi:10.1137/110845598 · Cited by 424
Self-citationDimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
Marzouk, Y. M., & Najm, H. N. (2009) · Journal of Computational Physics · doi:10.1016/j.jcp.2008.11.024 · Cited by 418
Finite Elements for the Beltrami operator on arbitrary surfaces
Dziuk, G. (1988) · Lecture Notes in Mathematics · doi:10.1007/bfb0082865 · Cited by 378
Bui-Thanh, T., Ghattas, O., Martin, J., & Stadler, G. (2013) · SIAM Journal on Scientific Computing · doi:10.1137/12089586x · Cited by 377
Self-citationMorlighem, M., Rignot, E., Seroussi, H., Larour, E., Ben Dhia, H., & Aubry, D. (2010) · Geophysical Research Letters · doi:10.1029/2010gl043853 · Cited by 369
Markov chain Monte Carlo methods for conditioning a permeability field to pressure data
Oliver, D. S., Bonet-Cunha, L., & Reynolds, A. C. (1997) · Mathematical Geology · doi:10.1007/bf02769620 · Cited by 279
Parameter and State Model Reduction for Large-Scale Statistical Inverse Problems
Lieberman, C., Willcox, K., & Ghattas, O. (2010) · SIAM Journal on Scientific Computing · doi:10.1137/090775622 · Cited by 254
Self-citationPrice, S. F., Payne, A. J., Howat, I. M., & Smith, B. E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017313108 · Cited by 211
Flath, H. P., Wilcox, L. C., Akçelik, V., Hill, J., van Bloemen Waanders, B., & Ghattas, O. (2011) · SIAM Journal on Scientific Computing · doi:10.1137/090780717 · Cited by 178
Self-citationBayesian inverse problems for functions and applications to fluid mechanics
Cotter, S. L., Dashti, M., Robinson, J. C., & Stuart, A. M. (2009) · Inverse Problems · doi:10.1088/0266-5611/25/11/115008 · Cited by 169
Cui, T., Fox, C., & O’Sullivan, M. J. (2011) · Water Resources Research · doi:10.1029/2010wr010352 · Cited by 145
Petrat, N., Zhu, H., Stadler, G., Hughes, T. J. R., & Ghattas, O. N. (2012) · Journal of Glaciology · doi:10.3189/2012jog11j182 · Cited by 104
Self-citationOptimal scalings for local Metropolis–Hastings chains on nonproduct targets in high dimensions
Beskos, A., Roberts, G. O., & Stuart, A. M. (2009) · The Annals of Applied Probability · doi:10.1214/08-aap563 · Cited by 98
Conditional Path Sampling of SDEs and the Langevin MCMC Method
Stuart, A. M., Voß, J., & Wilberg, P. (2004) · Communications in Mathematical Sciences · doi:10.4310/cms.2004.v2.n4.a7 · Cited by 91
Extreme-scale UQ for Bayesian inverse problems governed by PDEs
Bui–Thanh, T., Burstedde, C., Ghattas, O. N., Martin, J. L., Stadler, G., & Wilcox, L. C. (2012) · Cited by 75
Self-citationProposals which speed up function-space MCMC
Law, K. J. H. (2013) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2013.07.026 · Cited by 53
Bui–Thanh, T., & Ghattas, O. N. (2012) · Inverse Problems · doi:10.1088/0266-5611/28/5/055002 · Cited by 52
Self-citationRaymond, M., & Gudmundsson, G. H. (2009) · The Cryosphere · doi:10.5194/tc-3-265-2009 · Cited by 52
On markov chain monte carlo methods for nonlinear and non-gaussian state-space models
Geweke, J. F., & Tanizaki, H. (1999) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610919908813583 · Cited by 51
Note on the Sampling Distribution for the Metropolis-Hastings Algorithm
Geweke, J. F., & Tanizaki, H. (2003) · Communication in Statistics- Theory and Methods · doi:10.1081/sta-120018828 · Cited by 20
Cited by
The Bayesian Approach to Inverse Problems
Dashti, M., & Stuart, A. M. (2015) · Handbook of Uncertainty Quantification · doi:10.1007/978-3-319-11259-6_7-1 · Cited by 252
Differentiable programming for Earth system modeling
Gelbrecht, M., White, A., Bathiany, S., & Boers, N. (2023) · Geoscientific Model Development · doi:10.5194/gmd-16-3123-2023 · Cited by 31
Metadata
- Authors
- Petra, N., Martin, J., Stadler, G., & Ghattas, O.
- Venue
- SIAM Journal on Scientific Computing
- Published
- 2014-01
- Volume
- 36
- Issue
- 4
- Pages
- A1525-A1555
- ISSN
- 1064-8275 (ISSN-L)
- 1095-7197
- OpenAlex
- W2073945532
- Cited by
- 252
- References
- 34
- FWCI
- 14.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.