The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
Open accessAbstract
We consider a Bayesian approach to nonlinear inverse problems in which the unknown quantity is a spatial or temporal field, endowed with a hierarchical Gaussian process prior. Computational challenges in this construction arise from the need for repeated evaluations of the forward model (e.g., in the context of Markov chain Monte Carlo) and are compounded by high dimensionality of the posterior. We address these challenges by introducing truncated Karhunen-Loeve expansions, based on the prior distribution, to efficiently parameterize the unknown field and to specify a stochastic forward problem whose solution captures that of the deterministic forward model over the support of the prior. We seek a solution of this problem using Galerkin projection on a polynomial chaos basis, and use the solution to construct a reduced-dimensionality surrogate posterior density that is inexpensive to evaluate. We demonstrate the formulation on a transient diffusion equation with prescribed source terms, inferring the spatially-varying diffusivity of the medium from limited and noisy data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Deterministic Nonperiodic Flow
Lorenz, E. N. (1963) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2 · Cited by 19,398
Numerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
Numerical recipes in Pascal: the art of scientific computing
(1990) · Choice Reviews Online · doi:10.5860/choice.27-5158 · Cited by 11,811
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Cressie, N. (1992) · Terra Nova · doi:10.1111/j.1365-3121.1992.tb00605.x · Cited by 8,823
Methods of Mathematical Physics
Courant, R., & Hilbert, D. (1989) · Wiley eBooks · doi:10.1002/9783527617210 · Cited by 8,067
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Inverse Problem Theory and Methods for Model Parameter Estimation
Tarantola, A. (2005) · doi:10.1137/1.9780898717921 · Cited by 6,585
Stochastic Finite Elements: A Spectral Approach
Ghanem, R., & Spanos, P. D. (1991) · Springer eBooks · doi:10.1007/978-1-4612-3094-6 · Cited by 6,552
Turbulence and the dynamics of coherent structures. I. Coherent structures
Sirovich, L. (1987) · Quarterly of Applied Mathematics · doi:10.1090/qam/910462 · Cited by 6,224
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
Aronszajn, N. (1950) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1950-0051437-7 · Cited by 5,380
Rees, M., & Cressie, N. (1993) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982871 · Cited by 5,101
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
Xiu, D., & Karniadakis, G. E. (2002) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827501387826 · Cited by 4,807
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows
Berkooz, G., Holmes, P., & Lumley, J. L. (1993) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fl.25.010193.002543 · Cited by 4,431
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (2004) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4145-2 · Cited by 4,271
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050 · cited 1×
“Adopting a fully Bayesian approach, we let θ be a hyperparameter endowed with a conjugate inverse gamma hyperprior, θ ∼ IG(α, β) [53, 64, 65]:”
MethodWiener, N. (1938) · American Journal of Mathematics · doi:10.2307/2371268 · Cited by 3,074
Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV
Roy, H. L. L., Lecam, L., & Neyman, J. (1969) · Revue de l'Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1402306 · Cited by 2,835
Sivia, D. S. (1996) · Cited by 2,678
Computational Methods for Inverse Problems
Vogel, C. R. (2002) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717570 · Cited by 2,370
Statistical and Computational Inverse Problems
Kaipio, J. P., & Somersalo, E. (2005) · Applied Mathematical Sciences · doi:10.1007/b138659 · Cited by 2,345
Parameter Estimation and Inverse Problems
(2013) · Elsevier eBooks · doi:10.1016/c2009-0-61134-x · Cited by 1,987
Markov Chain Monte Carlo in Practice
Gasparini, M. (1997) · Technometrics · doi:10.1080/00401706.1997.10485132 · Cited by 1,879
Prior distributions for variance parameters in hierarchical modelsPreprint
Gelman, A. (2004) · RePEc: Research Papers in Economics · Cited by 1,576
High-Order Collocation Methods for Differential Equations with Random Inputs
Xiu, D., & Hesthaven, J. S. (2005) · SIAM Journal on Scientific Computing · doi:10.1137/040615201 · Cited by 1,522
GAUSSIAN PROCESSES FOR MACHINE LEARNING
SEEGER, M. (2004) · International Journal of Neural Systems · doi:10.1142/s0129065704001899 · Cited by 1,488
A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
Babuska, I. M., Nobile, F., & Tempone, R. F. (2007) · SIAM Journal on Numerical Analysis · doi:10.1137/050645142 · Cited by 1,458
The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals
Cameron, R. H., & Martin, W. T. (1947) · The Annals of Mathematics · doi:10.2307/1969178 · Cited by 1,268
Gaussian Processes for Regression
Williams, C. K. I., & Rasmussen, C. E. (1995) · Aston Publications Explorer (Aston University) · Cited by 1,246
(1991) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 1,077
Monte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines
Kimeldorf, G. S., & Wahba, G. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697089 · Cited by 939
Parameter Estimation and Inverse Problems
(2005) · International Geophysics · doi:10.1016/s0074-6142(05)x8014-7 · Cited by 902
Spline models for observational data
de Boor, C. (1991) · Journal of Approximation Theory · doi:10.1016/0021-9045(91)90041-8 · Cited by 729
Classes of kernels for machine learning: a statistics perspective
Genton, M. G. (2002) · doi:10.5555/944790.944815 · Cited by 607
An adaptive multi-element generalized polynomial chaos method for stochastic differential equations
Wan, X., & Karniadakis, G. E. (2005) · Journal of Computational Physics · doi:10.1016/j.jcp.2005.03.023 · Cited by 577
Galerkin methods for linear and nonlinear elliptic stochastic partial differential equations
Matthies, H. G., & Keese, A. (2004) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2004.05.027 · Cited by 566
Loève, M. (1978) · Graduate Texts in Mathematics · doi:10.1007/978-1-4612-6257-2 · Cited by 545
Statistical inverse problems: Discretization, model reduction and inverse crimes
Kaipio, J., & Somersalo, E. (2007) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2005.09.027 · Cited by 540
A Stochastic Projection Method for Fluid Flow
Le Maı̂tre, O. P., Reagan, M. T., Najm, H. N., Ghanem, R. G., & Knio, O. M. (2002) · Journal of Computational Physics · doi:10.1006/jcph.2002.7104 · Cited by 503
Self-citationStochastic spectral methods for efficient Bayesian solution of inverse problems
Marzouk, Y. M., Najm, H. N., & Rahn, L. A. (2007) · Journal of Computational Physics · doi:10.1016/j.jcp.2006.10.010 · Cited by 470
Self-citationParsimonious Bayesian Markov chain Monte Carlo inversion in a nonlinear geophysical problem
Malinverno, A. (2002) · Geophysical Journal International · doi:10.1046/j.1365-246x.2002.01847.x · Cited by 470
Numerical Challenges in the Use of Polynomial Chaos Representations for Stochastic Processes
Debusschere, B., Najm, H. N., Pébaÿ, P., Knio, O., Ghanem, R., & Maître, O. P. L. (2004) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827503427741 · Cited by 451
Self-citationIntroduction to Stochastic Processes
Hoel, P. G., Port, S. C., Stone, C. J., & Holley, R. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309295 · Cited by 384
Uncertainty quantification in reacting-flow simulations through non-intrusive spectral projection
Reagan, M. T., Najm, H. N., Ghanem, R. G., & Knio, O. M. (2003) · Combustion and Flame · doi:10.1016/s0010-2180(02)00503-5 · Cited by 333
Self-citationLawson, A., & Cressie, N. (1993) · The Statistician · doi:10.2307/2348117 · Cited by 306
(2007) · Springer Monographs in Mathematics · doi:10.1007/978-0-387-48116-6 · Cited by 280
Markov chain Monte Carlo methods for conditioning a permeability field to pressure data
Oliver, D. S., Bonet-Cunha, L., & Reynolds, A. C. (1997) · Mathematical Geology · doi:10.1007/bf02769620 · Cited by 279
Fast and reliable Markov chain Monte Carlo technique for cosmological parameter estimation
Dunkley, J., Bucher, M., Ferreira, P. G., Moodley, K., & Skordis, C. (2005) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2004.08464.x · Cited by 267
Comparison of Approximate Methods for Handling Hyperparameters
MacKay, D. J. C. (1999) · Neural Computation · doi:10.1162/089976699300016331 · Cited by 244
Hierarchical Bayesian models for inverse problems in heat conduction
Wang, J. B., & Zabaras, N. J. (2004) · Inverse Problems · doi:10.1088/0266-5611/21/1/012 · Cited by 165
Statistical Regularization of Inverse Problems
Tenorio, L. (2001) · SIAM Review · doi:10.1137/s0036144500358232 · Cited by 163
Inverse problems as statistics
Evans, S. N., & Stark, P. B. (2002) · Inverse Problems · doi:10.1088/0266-5611/18/4/201 · Cited by 155
Using Bayesian statistics in the estimation of heat source in radiation
Wang, J. B., & Zabaras, N. J. (2004) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2004.08.009 · Cited by 134
Jackson, C. S., Sen, M. K., & Stoffa, P. L. (2004) · Journal of Climate · Cited by 120
Wiener Chaos Expansion and Numerical Solutions of Stochastic Partial Differential Equations
Luo, W. (2006) · CaltechTHESIS (California Institute of Technology) · doi:10.7907/rpkx-bn02 · Cited by 104
Inverse Problems as Statistics
Stark, P. B. (2000) · Springer eBooks · doi:10.1007/978-3-7091-6296-5_13 · Cited by 95
Balakrishnan, S., Roy, A., Ierapetritou, M., Flach, G. P., & Georgopoulos, P. G. (2003) · Water Resources Research · doi:10.1029/2002wr001810 · Cited by 76
A SELF-STABILIZING LEARNING RULE FOR MINOR COMPONENT ANALYSIS
Möller, R. (2004) · International Journal of Neural Systems · doi:10.1142/s0129065704001863 · Cited by 66
A Markov random field model of contamination source identification in porous media flow
Wang, J., & Zabaras, N. J. (2005) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2005.09.016 · Cited by 45
Cited by
A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems
Benner, P., Gugercin, S., & Willcox, K. (2015) · SIAM Review · doi:10.1137/130932715 · Cited by 1,916
Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization
Peherstorfer, B., Willcox, K., & Gunzburger, M. (2018) · SIAM Review · doi:10.1137/16m1082469 · Cited by 1,061
Confronting the Challenge of Modeling Cloud and Precipitation Microphysics
Morrison, H., van Lier‐Walqui, M., Fridlind, A. M., Grabowski, W. W., Harrington, J. Y., Hoose, C., Korolev, A., Kumjian, M. R., Milbrandt, J. A., Pawlowska, H., et al. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2019ms001689 · Cited by 614
A review of surrogate models and their application to groundwater modeling
Asher, M. J., Croke, B. F. W., Jakeman, A. J., & Peeters, L. J. M. (2015) · Water Resources Research · doi:10.1002/2015wr016967 · Cited by 594
Laloy, E., & Vrugt, J. A. (2012) · Water Resources Research · doi:10.1029/2011wr010608 · Cited by 530
Metadata
- Authors
- Marzouk, Y. M., & Najm, H. N.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2009-04
- Volume
- 228
- Issue
- 6
- Pages
- 1862-1902
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W2074686342
- Cited by
- 418
- References
- 64
- FWCI
- 8.38
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.