The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
A Framework for Validation of Computer Models
Abstract
We present a framework that enables computer model evaluation oriented toward answering the question: Does the computer model adequately represent reality? The proposed validation framework is a six-step procedure based on Bayesian and likelihood methodology. The Bayesian methodology is particularly well suited to treating the major issues associated with the validation process: quantifying multiple sources of error and uncertainty in computer models, combining multiple sources of information, and updating validation assessments as new information is acquired. Moreover, it allows inferential statements to be made about predictive error associated with model predictions in untested situations. The framework is implemented in a test bed example of resistance spot welding, to provide context for each of the six steps in the proposed validation process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McKay, M. D., Beckman, R. J., & Conover, W. J. (2000) · Technometrics · doi:10.2307/1271432 · Cited by 7,415
Design and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Self-citationMonte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences
Oreskes, N., Shrader-Frechette, K., & Belitz, K. (1994) · Science · doi:10.1126/science.263.5147.641 · Cited by 3,010
Verification and Validation in Computational Science and Engineering
Roache, P. J. (1998) · Cited by 2,157
Uncertainty in predictions of the climate response to rising levels of greenhouse gases
Stainforth, D. A., Aina, T., Christensen, C., Collins, M., Faull, N., Frame, D. J., Kettleborough, J. A., Knight, S., Martin, A., Murphy, J. M., et al. (2005) · Nature · doi:10.1038/nature03301 · Cited by 1,166
Probabilistic Sensitivity Analysis of Complex Models: A Bayesian Approach
Oakley, J. E., & O'Hagan, A. (2004) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2004.05304.x · Cited by 1,085
Marginal Likelihood From the Metropolis–Hastings Output
Chib, S., & Jeliazkov, I. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332848 · Cited by 1,062
Computer Model Calibration Using High-Dimensional Output
Higdon, D., Gattiker, J., Williams, B., & Rightley, M. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000000888 · Cited by 867
Cited by
Sensitivity analysis: A review of recent advances
Borgonovo, E., & Plischke, E. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.06.032 · Cited by 1,167
Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization
Peherstorfer, B., Willcox, K., & Gunzburger, M. (2018) · SIAM Review · doi:10.1137/16m1082469 · Cited by 1,061
Computer Model Calibration Using High-Dimensional Output
Higdon, D., Gattiker, J., Williams, B., & Rightley, M. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000000888 · Cited by 867
Comparing uncertainty analysis techniques for a SWAT application to the Chaohe Basin in China
Yang, J., Reichert, P., Abbaspour, K. C., Xia, J., & Yang, H. (2008) · Journal of Hydrology · doi:10.1016/j.jhydrol.2008.05.012 · Cited by 800
Bayesian analysis of computer code outputs: A tutorial
O’Hagan, A. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.11.025 · Cited by 755
The case for objective Bayesian analysis
Berger, J. (2006) · Bayesian Analysis · doi:10.1214/06-ba115 · Cited by 728
Self-citationLearning about physical parameters: the importance of model discrepancy
Brynjarsdóttir, J., & OʼHagan, A. (2014) · Inverse Problems · doi:10.1088/0266-5611/30/11/114007 · Cited by 530
Measures of agreement between computation and experiment: Validation metrics
Oberkampf, W. L., & Barone, M. F. (2006) · Journal of Computational Physics · doi:10.1016/j.jcp.2006.03.037 · Cited by 494
RECURSIVE CO-KRIGING MODEL FOR DESIGN OF COMPUTER EXPERIMENTS WITH MULTIPLE LEVELS OF FIDELITY
Le Gratiet, L., & Garnier, J. (2014) · International Journal for Uncertainty Quantification · doi:10.1615/int.j.uncertaintyquantification.2014006914 · Cited by 388
Diagnostics for Gaussian Process Emulators
Bastos, L. S., & O’Hagan, A. (2009) · Technometrics · doi:10.1198/tech.2009.08019 · Cited by 387
Review of multi-fidelity models
Giselle Fernández-Godino, M., & Lawrence Livermore National Laboratory, L. (2023) · Advances in Computational Science and Engineering · doi:10.3934/acse.2023015 · Cited by 368
Calibration, validation, and sensitivity analysis: What's what
Trucano, T. G., Swiler, L. P., Igusa, T., Oberkampf, W. L., & Pilch, M. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.11.031 · Cited by 365
Key computational modeling issues in Integrated Computational Materials Engineering
Panchal, J. H., Kalidindi, S. R., & McDowell, D. L. (2013) · Computer-Aided Design · doi:10.1016/j.cad.2012.06.006 · Cited by 362
Quantification of Model Uncertainty: Calibration, Model Discrepancy, and Identifiability
Arendt, P. D., Apley, D. W., & Chen, W. (2012) · Journal of Mechanical Design · doi:10.1115/1.4007390 · Cited by 332
Sequential design of computer experiments for the estimation of a probability of failure
Bect, J., Ginsbourger, D., Li, L., Picheny, V., & Vazquez, E. (2012) · Statistics and Computing · doi:10.1007/s11222-011-9241-4 · Cited by 321
Agent-Based Models in Empirical Social Research
Bruch, E., & Atwell, J. (2015) · Sociological Methods & Research · doi:10.1177/0049124113506405 · Cited by 296
Efficient surrogate models for reliability analysis of systems with multiple failure modes
Bichon, B. J., McFarland, J. M., & Mahadevan, S. (2011) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2011.05.008 · Cited by 290
Perspectives on the integration between first-principles and data-driven modeling
Bradley, W., Kim, J., Kilwein, Z., Blakely, L., Eydenberg, M., Jalvin, J., Laird, C., & Boukouvala, F. (2022) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2022.107898 · Cited by 231
Metadata
- Authors
- Bayarri, M. J., Berger, J. O., Paulo, R., Sacks, J., Cafeo, J. A., Cavendish, J., Lin, C.-H., & Tu, J.
- Venue
- Technometrics
- Publisher
- Informa UK Limited
- Published
- 2007-05
- Volume
- 49
- Issue
- 2
- Pages
- 138-154
- ISSN
- 0040-1706 (ISSN-L)
- 1537-2723
- OpenAlex
- W2027319489
- Cited by
- 655
- References
- 36
- FWCI
- 26.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.