Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Uncertainty importance measures are quantitative tools aiming at identifying the contribution of uncertain inputs to output uncertainty. Their application ranges from food safety (Frey & Patil (2002)) to hurricane losses (Iman et al. (2005a, 2005b)). Results and indications an analyst derives depend on the method selected for the study. In this work, we investigate the assumptions at the basis of various indicator families to discuss the information they convey to the analyst/decisionmaker. We start with nonparametric techniques, and then present variance-based methods. By means of an example we show that output variance does not always reflect a decisionmaker state of knowledge of the inputs. We then examine the use of moment-independent approaches to global sensitivity analysis, i.e., techniques that look at the entire output distribution without a specific reference to its moments. Numerical results demonstrate that both moment-independent and variance-based indicators agree in identifying noninfluential parameters. However, differences in the ranking of the most relevant factors show that inputs that influence variance the most are not necessarily the ones that influence the output uncertainty distribution the most.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Global sensitivity indices for nonlinear mathematical models and their monte carlo estimates
Sobol′, I. M. (2001) · Mathematics and Computers in Simulation · doi:10.1016/s0378-4754(00)00270-6 · Cited by 6,389
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.1080/00401706.1991.10484804 · Cited by 4,943
Sensitivity Estimates for Nonlinear Mathematical Models
Sobol, I. M. (1990) · Medical Entomology and Zoology · Cited by 2,806
A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output
Saltelli, A., Tarantola, S., & Chan, K. P.-S. (1999) · Technometrics · doi:10.1080/00401706.1999.10485594 · Cited by 2,275 · cited 4×
“…regression fits the model output, in Section 3 we present the definition of variance-based importance measures (Iman, 1987) and the global sensitivity indices (Sobol, 1993, 2001, 2003; Rabitz et al., 1998; Rabitz & Alis, 1999; Saltelli et al., 1999, Saltelli et al., 2000; Alis & Rabitz, 2001).”
BackgroundMethodInfluentialImportance measures in global sensitivity analysis of nonlinear models
Homma, T., & Saltelli, A. (1996) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(96)00002-6 · Cited by 2,011
Lindley, D. V., & Savage, L. J. (1973) · The Mathematical Gazette · doi:10.2307/3615588 · Cited by 1,943
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
McCulloch, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2005.358_16.x · Cited by 1,842
Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models
Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004) · Cited by 1,797
The Jackknife Estimate of Variance
Efron, B., & Stein, C. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345462 · Cited by 1,436
Sensitivity Analysis for Importance Assessment
Saltelli, A. (2002) · Risk Analysis · doi:10.1111/0272-4332.00040 · Cited by 1,302
Probabilistic Sensitivity Analysis of Complex Models: A Bayesian Approach
Oakley, J. E., & O'Hagan, A. (2004) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2004.05304.x · Cited by 1,085
Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory
Cukier, R. I., Fortuin, C. M., Shuler, K. E., Petschek, A. G., & Schaibly, J. H. (1973) · The Journal of Chemical Physics · doi:10.1063/1.1680571 · Cited by 1,046
Identification and Review of Sensitivity Analysis Methods
Christopher Frey, H., & Patil, S. R. (2002) · Risk Analysis · doi:10.1111/0272-4332.00039 · Cited by 1,036
A new uncertainty importance measure
Borgonovo, E. (2007) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2006.04.015 · Cited by 1,026
Self-citationGeneral foundations of high‐dimensional model representations
Rabitz, H., & Aliş, Ö. F. (1999) · Journal of Mathematical Chemistry · doi:10.1023/a:1019188517934 · Cited by 904
Helton, J. C. (1993) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(93)90097-i · Cited by 735
Sensitivity Analysis as an Ingredient of Modeling
Saltelli, A., Tarantola, S., & Campolongo, F. (2000) · Cited by 604
Efficient input—output model representations
Rabitz, H., Aliş, Ö. F., Shorter, J., & Shim, K. (1999) · Computer Physics Communications · doi:10.1016/s0010-4655(98)00152-0 · Cited by 461
Saltelli, A., & Tarantola, S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618447 · Cited by 447
How Useful Is Quantitative Risk Assessment?
Apostolakis, G. E. (2004) · Risk Analysis · doi:10.1111/j.0272-4332.2004.00455.x · Cited by 411
Sensitivity analysis of an environmental model: an application of different analysis methods
Campolongo, F., & Saltelli, A. (1997) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(97)00021-5 · Cited by 292
Savage, L. J.: Foundations of Statistics. Dover Publ., Inc,. New York 1972. 310 S.
Bandemer, H. (1974) · Biometrische Zeitschrift · doi:10.1002/bimj.19740160812 · Cited by 270
A Robust Measure of Uncertainty Importance for Use in Fault Tree System Analysis
Iman, R. L., & Hora, S. C. (1990) · Risk Analysis · doi:10.1111/j.1539-6924.1990.tb00523.x · Cited by 264
Efficient Implementation of High Dimensional Model Representations
Alış, Ö. F., & Rabitz, H. (2001) · Journal of Mathematical Chemistry · doi:10.1023/a:1010979129659 · Cited by 257
Saltelli, A., & Marivoet, J. (1990) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(90)90065-u · Cited by 257
A Measure of Top – Down Correlation
Iman, R. L., & Conover, W. J. (1987) · Technometrics · doi:10.1080/00401706.1987.10488244 · Cited by 166
Patil, S. R., & Frey, H. C. (2004) · Risk Analysis · doi:10.1111/j.0272-4332.2004.00460.x · Cited by 62
Uncertainty Analysis for Computer Model Projections of Hurricane Losses
Iman, R. L., Johnson, M. E., & Watson, C. C. (2005) · Risk Analysis · doi:10.1111/j.1539-6924.2005.00674.x · Cited by 53
Homma, T., & Saltelli, A. (1995) · Journal of Nuclear Science and Technology · doi:10.1080/18811248.1995.9731832 · Cited by 37
Frey, H. C. (2002) · Risk Analysis · doi:10.1111/0272-4332.00037 · Cited by 34
Variance-Importance of System Components
Nakashima, K., & Yamato, K. (1982) · IEEE Transactions on Reliability · doi:10.1109/tr.1982.5221247 · Cited by 27
Cited by
Sensitivity analysis of environmental models: A systematic review with practical workflow
Pianosi, F., Beven, K., Freer, J., Hall, J. W., Rougier, J., Stephenson, D. B., & Wagener, T. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.02.008 · Cited by 1,704
Risk assessment and risk management: Review of recent advances on their foundation
Aven, T. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.12.023 · Cited by 1,713
Sensitivity analysis: A review of recent advances
Borgonovo, E., & Plischke, E. (2016) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.06.032 · Cited by 1,167
Self-citationVariable importance analysis: A comprehensive review
Wei, P., Lu, Z., & Song, J. (2015) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2015.05.018 · Cited by 525
Afzal, F., Yunfei, S., Nazir, M., & Bhatti, S. M. (2021) · International Journal of Managing Projects in Business · doi:10.1108/ijmpb-02-2019-0047 · Cited by 172
Metadata
- Authors
- Borgonovo, E.
- Venue
- Risk Analysis
- Publisher
- Wiley
- Published
- 2006-10
- Volume
- 26
- Issue
- 5
- Pages
- 1349-1361
- ISSN
- 0272-4332 (ISSN-L)
- 1539-6924
- OpenAlex
- W2009804339
- Cited by
- 258
- References
- 31
- FWCI
- 7.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.