Computer Model Calibration Using High-Dimensional Output
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
This work focuses on combining observations from field experiments with detailed computer simulations of a physical process to carry out statistical inference. Of particular interest here is determining uncertainty in resulting predictions. This typically involves calibration of parameters in the computer simulator as well as accounting for inadequate physics in the simulator. The problem is complicated by the fact that simulation code is sufficiently demanding that only a limited number of simulations can be carried out. We consider applications in characterizing material properties for which the field data and the simulator output are highly multivariate. For example, the experimental data and simulation output may be an image or may describe the shape of a physical object. We make use of the basic framework of Kennedy and O'Hagan. However, the size and multivariate nature of the data lead to computational challenges in implementing the framework. To overcome these challenges, we make use of basis representations (e.g., principal components) to reduce the dimensionality of the problem and speed up the computations required for exploring the posterior distribution. This methodology is applied to applications, both ongoing and historical, at Los Alamos National Laboratory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195 · cited 1×
“The precision parameters λ η , λ w , λ y , and λ v are sampled using Hastings (1970) updates.”
Design and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
Statistical and Computational Inverse Problems
Kaipio, J. P., & Somersalo, E. (2005) · Applied Mathematical Sciences · doi:10.1007/b138659 · Cited by 2,345
Predicting the output from a complex computer code when fast approximations are available
Kennedy, M. (2000) · Biometrika · doi:10.1093/biomet/87.1.1 · Cited by 1,605
Marron, J. S., Ramsey, J. O., & Silverman, B. W. (1998) · Journal of the American Statistical Association · doi:10.2307/2669864 · Cited by 1,403
Smith, J. Q., Bernardo, J. M., Berger, J. O., Dawid, A. P., & Smith, A. F. M. (1993) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982740 · Cited by 1,097
Muraki, E., Ramsay, J. O., & Silverman, B. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165264 · Cited by 1,013
Bayesian Computation and Stochastic Systems
Besag, J., Green, P., Higdon, D., & Mengersen, K. (1995) · Statistical Science · doi:10.1214/ss/1177010123 · Cited by 944
Self-citation
Cited by
Marine20—The Marine Radiocarbon Age Calibration Curve (0–55,000 cal BP)
Heaton, T. J., Köhler, P., Butzin, M., Bard, E., Reimer, R. W., Austin, W. E. N., Bronk Ramsey, C., Grootes, P. M., Hughen, K. A., Kromer, B., et al. (2020) · Radiocarbon · doi:10.1017/rdc.2020.68 · Cited by 1,988
Choosing the Sample Size of a Computer Experiment: A Practical Guide
Loeppky, J. L., Sacks, J., & Welch, W. J. (2009) · Technometrics · doi:10.1198/tech.2009.08040 · Cited by 758
A Framework for Validation of Computer Models
Bayarri, M. J., Berger, J. O., Paulo, R., Sacks, J., Cafeo, J. A., Cavendish, J., Lin, C.-H., & Tu, J. (2007) · Technometrics · doi:10.1198/004017007000000092 · Cited by 655
Parameter estimation for differential equations: a generalized smoothing approach
Ramsay, J. O., Hooker, G., Campbell, D., & Cao, J. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00610.x · Cited by 613
Learning about physical parameters: the importance of model discrepancy
Brynjarsdóttir, J., & OʼHagan, A. (2014) · Inverse Problems · doi:10.1088/0266-5611/30/11/114007 · Cited by 530
Bernhard, J. E., Moreland, J. S., Bass, S. A., Liu, J., & Heinz, U. (2016) · Physical Review C · doi:10.1103/physrevc.94.024907 · Cited by 508
Bayesian estimation of the specific shear and bulk viscosity of quark–gluon plasma
Bernhard, J. E., Moreland, J. S., & Bass, S. A. (2019) · Nature Physics · doi:10.1038/s41567-019-0611-8 · Cited by 461
Martin, J., Wilcox, L. C., Burstedde, C., & Ghattas, O. (2012) · SIAM Journal on Scientific Computing · doi:10.1137/110845598 · Cited by 424
Bayesian emulation of complex multi-output and dynamic computer models
Conti, S., & O’Hagan, A. (2010) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2009.08.006 · Cited by 417
Kernels for Vector-Valued Functions: A Review
Álvarez, M. A., Rosasco, L., & Lawrence, N. D. (2012) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000036 · Cited by 415
Quantification of Model Uncertainty: Calibration, Model Discrepancy, and Identifiability
Arendt, P. D., Apley, D. W., & Chen, W. (2012) · Journal of Mechanical Design · doi:10.1115/1.4007390 · Cited by 332
Tapia, G., Khairallah, S., Matthews, M., King, W. E., & Elwany, A. (2018) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-017-1045-z · Cited by 284
Petra, N., Martin, J., Stadler, G., & Ghattas, O. (2014) · SIAM Journal on Scientific Computing · doi:10.1137/130934805 · Cited by 252
Approximate Bayesian computation (ABC) gives exact results under the assumption of model error
Wilkinson, R. D. (2013) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2013-0010 · Cited by 247
Tuning without over-tuning: parametric uncertainty quantification for the NEMO ocean model
Williamson, D. B., Blaker, A. T., & Sinha, B. (2017) · Geoscientific Model Development · doi:10.5194/gmd-10-1789-2017 · Cited by 75
Advancing Fusion with Machine Learning Research Needs Workshop Report
Humphreys, D., Kupresanin, A., Boyer, M. D., Canik, J., Chang, C. S., Cyr, E. C., Granetz, R., Hittinger, J., Kolemen, E., Lawrence, E., et al. (2020) · Journal of Fusion Energy · doi:10.1007/s10894-020-00258-1 · Cited by 47
Investigating Parametric Dependence of Climate Feedbacks in the Atmospheric Component of CNRM‐CM6‐1
Peatier, S., Sanderson, B. M., Terray, L., & Roehrig, R. (2022) · Geophysical Research Letters · doi:10.1029/2021gl095084 · Cited by 21
“In contrast to conventional EOFs, the temporal dimension is replaced by the ensemble member dimension (as in Biegler et al., 2011; Higdon et al., 2008; Sanderson et al., 2008; D. M. Sexton et al., 2012).”
Method
Metadata
- Authors
- Higdon, D., Gattiker, J., Williams, B., & Rightley, M.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2008-06-01
- Volume
- 103
- Issue
- 482
- Pages
- 570-583
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2078454401
- Cited by
- 867
- References
- 24
- FWCI
- 40.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.