The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Toward SALib 2.0: Advancing the accessibility and interpretability of global sensitivity analyses
Open accessAbstract
Sensitivity analysis is now considered a standard practice in environmental modeling. Several open-source libraries, such as the Sensitivity Analysis Library (SALib), have been published in the recent past aimed at simplifying the application of sensitivity analyses. Still, there remain issues in software usability and accessibility, as well as a lack of guidance in the interpretation of sensitivity analysis results. This paper describes the changes made and planned to SALib to advance the ease with which modelers may conduct sensitivity analysis and interpret results. We further offer our perspectives from the past 7 years of maintaining SALib for the consideration of those aspiring to launch their own software for sensitivity analysis, develop methodology, or those otherwise interested in becoming involved in a project like SALib. These include the value of a community of practice to foster best practices for sensitivity analysis, the potential for collaboration across different software (for sensitivity analysis) platforms, and the need to specifically support the software development that underpins computational science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“Here, cognitive load refers to the proportion of working memory that must be devoted to understanding and processing a task (Hermans, 2021; Sweller, 1988).”
BackgroundGlobal Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
Global sensitivity indices for nonlinear mathematical models and their monte carlo estimates
Sobol′, I. M. (2001) · Mathematics and Computers in Simulation · doi:10.1016/s0378-4754(00)00270-6 · Cited by 6,389
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.1080/00401706.1991.10484804 · Cited by 4,943
Saltelli, A., Annoni, P., Azzini, I., Campolongo, F., Ratto, M., & Tarantola, S. (2010) · Computer Physics Communications · doi:10.1016/j.cpc.2009.09.018 · Cited by 3,623
A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output
Saltelli, A., Tarantola, S., & Chan, K. P.-S. (1999) · Technometrics · doi:10.1080/00401706.1999.10485594 · Cited by 2,275
Making best use of model evaluations to compute sensitivity indices
Saltelli, A. (2002) · Computer Physics Communications · doi:10.1016/s0010-4655(02)00280-1 · Cited by 2,228
An effective screening design for sensitivity analysis of large models
Campolongo, F., Cariboni, J., & Saltelli, A. (2007) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2006.10.004 · Cited by 2,011
Sensitivity analysis of environmental models: A systematic review with practical workflow
Pianosi, F., Beven, K., Freer, J., Hall, J. W., Rougier, J., Stephenson, D. B., & Wagener, T. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.02.008 · Cited by 1,704
SALib: An open-source Python library for Sensitivity Analysis
Herman, J., & Usher, W. (2017) · The Journal of Open Source Software · doi:10.21105/joss.00097 · Cited by 1,524
Self-citationStudy of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory
Cukier, R. I., Fortuin, C. M., Shuler, K. E., Petschek, A. G., & Schaibly, J. H. (1973) · The Journal of Chemical Physics · doi:10.1063/1.1680571 · Cited by 1,046
A new uncertainty importance measure
Borgonovo, E. (2007) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2006.04.015 · Cited by 1,026
How to avoid a perfunctory sensitivity analysis
Saltelli, A., & Annoni, P. (2010) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2010.04.012 · Cited by 974
UQLab: A Framework for Uncertainty Quantification in Matlab
Marelli, S., & Sudret, B. (2014) · Vulnerability, Uncertainty, and Risk · doi:10.1061/9780784413609.257 · Cited by 899
Saltelli, A., Aleksankina, K., Becker, W., Fennell, P., Ferretti, F., Holst, N., Li, S., & Wu, Q. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.01.012 · Cited by 813
Designing and Building Parallel Programs: Concepts and Tools for Parallel Software Engineering
Foster, I. T. (1995) · International Linear Collider · Cited by 726
The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Razavi, S., Jakeman, A., Saltelli, A., Prieur, C., Iooss, B., Borgonovo, E., Plischke, E., Lo Piano, S., Iwanaga, T., Becker, W., et al. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104954 · Cited by 628
Self-citationPianosi, F., & Wagener, T. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.01.004 · Cited by 509
Efficient input—output model representations
Rabitz, H., Aliş, Ö. F., Shorter, J., & Shim, K. (1999) · Computer Physics Communications · doi:10.1016/s0010-4655(98)00152-0 · Cited by 461
Global sensitivity measures from given data
Plischke, E., Borgonovo, E., & Smith, C. L. (2013) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.11.047 · Cited by 429
Razavi, S., & Gupta, H. V. (2015) · Water Resources Research · doi:10.1002/2014wr016527 · Cited by 372
Random balance designs for the estimation of first order global sensitivity indices
Tarantola, S., Gatelli, D., & Mara, T. A. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.06.003 · Cited by 319
How do scientists develop and use scientific software?
Hannay, J. E., MacLeod, C., Singer, J., Langtangen, H. P., Pfahl, D., & Wilson, G. (2009) · 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering · doi:10.1109/secse.2009.5069155 · Cited by 275
Global Sensitivity Analysis for Systems with Independent and/or Correlated Inputs
Li, G., Rabitz, H., Yelvington, P. E., Oluwole, O. O., Bacon, F., Kolb, C. E., & Schoendorf, J. (2010) · The Journal of Physical Chemistry A · doi:10.1021/jp9096919 · Cited by 241
Trends in sensitivity analysis practice in the last decade
Ferretti, F., Saltelli, A., & Tarantola, S. (2016) · Science of The Total Environment · doi:10.1016/j.scitotenv.2016.02.133 · Cited by 241
Kwakkel, J. H. (2017) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2017.06.054 · Cited by 213
CLIMADA v1: a global weather and climate risk assessment platform
Aznar-Siguan, G., & Bresch, D. N. (2019) · Geoscientific Model Development · doi:10.5194/gmd-12-3085-2019 · Cited by 196
Building a Framework for Predictive Science
McKerns, M., Strand, L., Sullivan, T., Fang, A., & Aivazis, M. (2011) · Proceedings of the Python in Science Conference · doi:10.25080/majora-ebaa42b7-00d · Cited by 171
Open Access Meets Discoverability: Citations to Articles Posted to Academia.edu
Yuri, N., Carl, V., Price, R., Lund, B., David, J., Adnan, A., Mortonson, M. J., Josh, S., & Shron, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0148257 · Cited by 164
Distribution-based sensitivity analysis from a generic input-output sample
Pianosi, F., & Wagener, T. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2018.07.019 · Cited by 162
Ruano, M. V., Ribes, J., Seco, A., & Ferrer, J. (2012) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2012.03.008 · Cited by 155
Software Carpentry: Getting Scientists to Write Better Code by Making Them More Productive
Wilson, G. (2006) · Computing in Science & Engineering · doi:10.1109/mcse.2006.122 · Cited by 144
An effective algorithm for computing global sensitivity indices (EASI)
Plischke, E. (2009) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2009.11.005 · Cited by 143
Amplifying the impact of open access: Wikipedia and the diffusion of science
Teplitskiy, M., Lu, G., & Duede, E. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23687 · Cited by 138
sensobol : An R Package to Compute Variance-Based Sensitivity Indices
Puy, A., Piano, S. L., Saltelli, A., & Levin, S. A. (2022) · Journal of Statistical Software · doi:10.18637/jss.v102.i05 · Cited by 138
Certain trends in uncertainty and sensitivity analysis: An overview of software tools and techniques
Douglas-Smith, D., Iwanaga, T., Croke, B., & Jakeman, A. J. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.104588 · Cited by 120
Self-citationVARS-TOOL: A toolbox for comprehensive, efficient, and robust sensitivity and uncertainty analysis
Razavi, S., Sheikholeslami, R., Gupta, H. V., & Haghnegahdar, A. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2018.10.005 · Cited by 112
Wagener, T., & Pianosi, F. (2019) · Earth-Science Reviews · doi:10.1016/j.earscirev.2019.04.006 · Cited by 110
Bias correction for the estimation of sensitivity indices based on random balance designs
Tissot, J.-Y., & Prieur, C. (2012) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2012.06.010 · Cited by 103
Iwanaga, T., Wang, H., Hamilton, S. H., Grimm, V., Koralewski, T. E., Salado, A., Elsawah, S., Razavi, S., Yang, J., Glynn, P. D., et al. (2020) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104885 · Cited by 99
Self-citationCuntz, M., Mai, J., Zink, M., Thober, S., Kumar, R., Schafer, D. C., Schrön, M., Craven, J., Rakovec, O., Spieler, D., et al. (2015) · Water Resources Research · doi:10.1002/2015wr016907 · Cited by 98
Developing a community of practice around an open source energy modelling tool
Niet, T., Shivakumar, A., Gardumi, F., Usher, W., Williams, E., & Howells, M. (2021) · Energy Strategy Reviews · doi:10.1016/j.esr.2021.100650 · Cited by 98
Self-citationA Software Chasm: Software Engineering and Scientific Computing
Kelly, D. F. (2007) · IEEE Software · doi:10.1109/ms.2007.155 · Cited by 97
Little, J. C., Hester, E. T., Elsawah, S., Filz, G. M., Sandu, A., Carey, C. C., Iwanaga, T., & Jakeman, A. J. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2018.11.011 · Cited by 89
Self-citationCLIMADA v1.4.1: towards a globally consistent adaptation options appraisal tool
Bresch, D. N., & Aznar–Siguán, G. (2021) · Geoscientific model development · doi:10.5194/gmd-14-351-2021 · Cited by 89
Derivative based global sensitivity measures
Sobol, I. M., & Kucherenko, S. S. (2010) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2010.05.208 · Cited by 73
Pianosi, F., Sarrazin, F., & Wagener, T. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.104579 · Cited by 67
Community, C.-F. (2015) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4774216 · Cited by 58
Matlab/R workflows to assess critical choices in Global Sensitivity Analysis using the SAFE toolbox
Noacco, V., Sarrazin, F., Pianosi, F., & Wagener, T. (2019) · MethodsX · doi:10.1016/j.mex.2019.09.033 · Cited by 55
Saltelli, A., Aleksankina, K., Becker, W., Fennell, P. J., Ferretti, F., Holst, N., Li, S., & Wu, Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11359 · Cited by 49
Paleari, L., & Confalonieri, R. (2016) · Ecological Modelling · doi:10.1016/j.ecolmodel.2016.09.008 · Cited by 47
Sheikholeslami, R., Gharari, S., Papalexiou, S. M., & Clark, M. (2021) · Water Resources Research · doi:10.1029/2020wr028435 · Cited by 41
Steiner, M., Bourinet, J., & Lahmer, T. (2018) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2018.11.015 · Cited by 40
Rhodium: Python Library for Many-Objective Robust Decision Making and Exploratory Modeling
Hadjimichael, A., Gold, D., Hadka, D., & Reed, P. M. (2020) · Journal of Open Research Software · doi:10.5334/jors.293 · Cited by 37
An effective strategy for combining variance- and distribution-based global sensitivity analysis
Baroni, G., & Francke, T. (2020) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104851 · Cited by 28
Metadata
- Authors
- Iwanaga, T., Usher, W., & Herman, J.
- Venue
- Socio-Environmental Systems Modelling
- Publisher
- Wageningen University and Research
- Published
- 2022-05-31
- Volume
- 4
- Pages
- 18155
- ISSN
- 2663-3027 (ISSN-L)
- OpenAlex
- W4312362262
- Cited by
- 367
- References
- 55
- FWCI
- 45.28
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.