The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices
Open accessAbstract
Sensitivity analysis provides information on the relative importance of model input parameters and assumptions. It is distinct from uncertainty analysis, which addresses the question ‘How uncertain is the prediction?’ Uncertainty analysis needs to map what a model does when selected input assumptions and parameters are left free to vary over their range of existence, and this is equally true of a sensitivity analysis. Despite this, many uncertainty and sensitivity analyses still explore the input space moving along one-dimensional corridors leaving space of the input factors mostly unexplored. Our extensive systematic literature review shows that many highly cited papers (42% in the present analysis) fail the elementary requirement to properly explore the space of the input factors. The results, while discipline-dependent, point to a worrying lack of standards and recognized good practices. We end by exploring possible reasons for this problem, and suggest some guidelines for proper use of the methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
Self-citationThe ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.1080/00401706.1991.10484804 · Cited by 4,943
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“The situation has worrying analogies with what we have witnessed in data analysis, where misuse of the p-value (Colquhoun, 2014) has been singled out as one of the reasons of the present reproducibility crisis affecting science (Ioannidis, 2005; Saltelli and Funtowicz, 2017).”
BackgroundVerification, Validation, and Confirmation of Numerical Models in the Earth Sciences
Oreskes, N., Shrader-Frechette, K., & Belitz, K. (1994) · Science · doi:10.1126/science.263.5147.641 · Cited by 3,010
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“Overall, it is clear that the consequences of bad statistics can be dramatic – for example when wrong cures for cancer are identified at the pre-clinical stage of research, and are then passed on to the clinical trial phase (Begley and Ellis, 2012).”
BackgroundStructural optimization using sensitivity analysis and a level-set method
Allaire, G., Jouve, F., & Toader, A.-M. (2004) · Journal of Computational Physics · doi:10.1016/j.jcp.2003.09.032 · Cited by 2,759
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
Sensitivity analysis of environmental models: A systematic review with practical workflow
Pianosi, F., Beven, K., Freer, J., Hall, J. W., Rougier, J., Stephenson, D. B., & Wagener, T. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.02.008 · Cited by 1,704
Cited by
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Razavi, S., Jakeman, A., Saltelli, A., Prieur, C., Iooss, B., Borgonovo, E., Plischke, E., Lo Piano, S., Iwanaga, T., Becker, W., et al. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104954 · Cited by 628
Self-citationToward SALib 2.0: Advancing the accessibility and interpretability of global sensitivity analyses
Iwanaga, T., Usher, W., & Herman, J. (2022) · Socio-Environmental Systems Modelling · doi:10.18174/sesmo.18155 · Cited by 367
Sensitivity analysis methods in the biomedical sciences
Qian, G., & Mahdi, A. (2020) · Mathematical Biosciences · doi:10.1016/j.mbs.2020.108306 · Cited by 169
Exploratory modeling for analyzing coupled human-natural systems under uncertainty
Moallemi, E. A., Kwakkel, J., de Haan, F. J., & Bryan, B. A. (2020) · Global Environmental Change · doi:10.1016/j.gloenvcha.2020.102186 · Cited by 130
The sensitivity of simulated streamflow to individual hydrologic processes across North America
Mai, J., Craig, J. R., Tolson, B. A., & Arsenault, R. (2022) · Nature Communications · doi:10.1038/s41467-022-28010-7 · Cited by 63
Metadata
- Authors
- Saltelli, A., Aleksankina, K., Becker, W., Fennell, P., Ferretti, F., Holst, N., Li, S., & Wu, Q.
- Venue
- Environmental Modelling & Software
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 114
- Pages
- 29-39
- ISSN
- 1364-8152 (ISSN-L)
- OpenAlex
- W2962804139
- Cited by
- 813
- References
- 46
- FWCI
- 17.25
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices. https://app.cochat.ai/papers/10.1016/j.envsoft.2019.01.012
- The paper
- Saltelli, A., Aleksankina, K., Becker, W., Fennell, P., Ferretti, F., Holst, N., Li, S., & Wu, Q. (2019). Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices. Environmental Modelling & Software. https://doi.org/10.1016/j.envsoft.2019.01.012
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.