Sensitivity analysis of model output: variance-based methods make the difference
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
This paper is intended to review a number of variancebased methods used in Sensitivity Analysis (SA) to ascertain how much a model (numerical or otherwise) depends on each or some of its input parameters.A class of variance-baaed methods (correlation ratio or importance measure) that is capable of measuring only the main effect contribution of each input parameter on the output variance are described briefly.In addition, two methods (Sobol' and FAST) that are capable of computing the so-called "Total Sensitivity Indices" (TSI), which measures a parameter's main effect and all the interactions (of any order) involving that parameter, are described in details.An illustrated example demonstrates that the incorporation of total effect indices is the only way to perform a rigorous quantitative sensitivity analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McKay, M. D., Beckman, R. J., & Conover, W. J. (2000) · Technometrics · doi:10.2307/1271432 · Cited by 7,415
The Advanced Theory of Statistics.
Clarke, G. M., Kendall, M., & Stuart, A. (1978) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344782 · Cited by 6,658
McKay, M. D., Beckman, R. J., & Conover, W. J. (1979) · Technometrics · doi:10.1080/00401706.1979.10489755 · Cited by 3,220
Sensitivity analysis for non-linear mathematical models
Sobol, I. M. (1993) · Medical Entomology and Zoology · Cited by 3,174
Sensitivity Estimates for Nonlinear Mathematical Models
Sobol, I. M. (1990) · Medical Entomology and Zoology · Cited by 2,806
Kendall's Advanced Theory of Statistics.
AA, Stuart, A., & Ord, K. (1995) · Journal of the American Statistical Association · doi:10.2307/2291187 · Cited by 2,619
A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output
Saltelli, A., Tarantola, S., & Chan, K. P.-S. (1999) · Technometrics · doi:10.1080/00401706.1999.10485594 · Cited by 2,275
Self-citationImportance measures in global sensitivity analysis of nonlinear models
Homma, T., & Saltelli, A. (1996) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(96)00002-6 · Cited by 2,011
Self-citationStudy of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory
Cukier, R. I., Fortuin, C. M., Shuler, K. E., Petschek, A. G., & Schaibly, J. H. (1973) · The Journal of Chemical Physics · doi:10.1063/1.1680571 · Cited by 1,046
Nonlinear sensitivity analysis of multiparameter model systems
Cukier, R. I., Levine, H. B., & Shuler, K. E. (1978) · Journal of Computational Physics · doi:10.1016/0021-9991(78)90097-9 · Cited by 694
Cited by
Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems
Helton, J. C., & Davis, F. J. (2003) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(03)00058-9 · Cited by 2,688
Making best use of model evaluations to compute sensitivity indices
Saltelli, A. (2002) · Computer Physics Communications · doi:10.1016/s0010-4655(02)00280-1 · Cited by 2,228
Self-citationImportance measures in global sensitivity analysis of nonlinear models
Homma, T., & Saltelli, A. (1996) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(96)00002-6 · Cited by 2,011
Self-citationSurvey of sampling-based methods for uncertainty and sensitivity analysis
Helton, J. C., Johnson, J. D., Sallaberry, C. J., & Storlie, C. B. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.11.017 · Cited by 1,237
A global sensitivity analysis tool for the parameters of multi-variable catchment models
van Griensven, A., Meixner, T., Grunwald, S., Bishop, T., Diluzio, M., & Srinivasan, R. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.09.008 · Cited by 1,223
Sensitivity Analysis for Chemical Models
Saltelli, A., Ratto, M., Tarantola, S., & Campolongo, F. (2005) · Chemical Reviews · doi:10.1021/cr040659d · Cited by 639
Self-citationThe role of sensitivity analysis in ecological modelling
Cariboni, J., Gatelli, D., Liska, R., & Saltelli, A. (2007) · Ecological Modelling · doi:10.1016/j.ecolmodel.2005.10.045 · Cited by 563
Self-citationIgnorance is bliss: Or seven reasons not to use uncertainty analysis
Pappenberger, F., & Beven, K. J. (2006) · Water Resources Research · doi:10.1029/2005wr004820 · Cited by 555
Sensitivity measures,anova-like Techniques and the use of bootstrap
Archer, G. E. B., Saltelli, A., & Sobol, I. M. (1997) · Journal of Statistical Computation and Simulation · doi:10.1080/00949659708811825 · Cited by 545
Self-citationKleijnen, J. P. C., & Sargent, R. G. (2000) · European Journal of Operational Research · doi:10.1016/s0377-2217(98)00392-0 · Cited by 491
Zhang, X., Trame, M., Lesko, L., & Schmidt, S. (2015) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.6 · Cited by 467
Saltelli, A., & Tarantola, S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618447 · Cited by 447
Self-citationTang, Y., Reed, P., Wagener, T., & van Werkhoven, K. (2007) · Hydrology and Earth System Sciences · doi:10.5194/hess-11-793-2007 · Cited by 422
An alternative way to compute Fourier amplitude sensitivity test (FAST)
Saltelli, A., & Bolado, R. (1998) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(97)00043-1 · Cited by 367
Self-citationAbout the use of rank transformation in sensitivity analysis of model output
Saltelli, A., & Sobol', I. M. (1995) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(95)00099-2 · Cited by 340
Self-citationIllustration of Sampling‐Based Methods for Uncertainty and Sensitivity Analysis
Helton, J. C., & Davis, F. J. (2002) · Risk Analysis · doi:10.1111/0272-4332.00041 · Cited by 312
Performance study of ceramic microfiltration membrane for oily wastewater treatment
Hua, F. L., Tsang, Y. F., Wang, Y. J., Chan, S. Y., Chua, H., & Sin, S. N. (2007) · Chemical Engineering Journal · doi:10.1016/j.cej.2006.10.017 · Cited by 294
Sensitivity analysis of an environmental model: an application of different analysis methods
Campolongo, F., & Saltelli, A. (1997) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(97)00021-5 · Cited by 292
Self-citationHelton, J. C., Davis, F. J., & Johnson, J. D. (2005) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2004.09.006 · Cited by 278
Design of inferential sensors in the process industry: A review of Bayesian methods
Khatibisepehr, S., Huang, B., & Khare, S. (2013) · Journal of Process Control · doi:10.1016/j.jprocont.2013.05.007 · Cited by 262
Metadata
- Authors
- Chan, K., Saltelli, A., & Tarantola, S.
- Venue
- Proceedings of the 29th conference on Winter simulation - WSC '97
- Publisher
- ACM Press
- Published
- 1997
- Pages
- 261-268
- ISSN
- 0891-7736 (ISSN-L)
- OpenAlex
- W2011470199
- Cited by
- 313
- References
- 24
- FWCI
- 41.60
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.