Tree-based ensemble methods for sensitivity analysis of environmental models: A performance comparison with Sobol and Morris techniques
Open accessIntegrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ML has the potential to help with sensitivity and uncertainty analysis, with finding numerical solutions for computationally expensive submodels, and assessing the validity of models.
“ML also has the potential to help with sensitivity and uncertainty analysis [386], with finding numerical solutions for computational expensive submodels [206,714], and assessing the validity of the models [556].”
From Tackling climate change with machine learning (2023) · cites this paper as [386]
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,028 · see citing works
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053 · see citing works
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300 · see citing works
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,940 · see citing works
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,843 · see citing works
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430 · see citing works
Global sensitivity indices for nonlinear mathematical models and their monte carlo estimates
Sobol′, I. M. (2001) · Mathematics and Computers in Simulation · doi:10.1016/s0378-4754(00)00270-6 · Cited by 6,389 · see citing works
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.1080/00401706.1991.10484804 · Cited by 4,943 · see citing works
The Elements of Statistical Learning
Hastie, T. J., Tibshirani, R. J., & Friedman, J. H. (2009) · Springer series in statistics · doi:10.1007/b94608 · Cited by 4,111 · see citing works
Bias in random forest variable importance measures: Illustrations, sources and a solution
Strobl, C., Boulesteix, A., Zeileis, A., & Hothorn, T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-25 · Cited by 3,755 · see citing works
Conditional variable importance for random forests
Strobl, C., Boulesteix, A., Kneib, T., Augustin, T., & Zeileis, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-307 · Cited by 3,299 · see citing works
Selection of relevant features and examples in machine learning
Blum, A. L., & Pat Langley, B. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00063-5 · Cited by 3,294 · see citing works
Permutation importance: a corrected feature importance measure
Altmann, A., Toloşi, L., Sander, O., & Lengauer, T. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq134 · Cited by 2,903 · see citing works
Factorial Sampling Plans for Preliminary Computational Experiments
Morris, M. D. (1991) · Technometrics · doi:10.2307/1269043 · Cited by 2,648 · see citing works
Making best use of model evaluations to compute sensitivity indices
Saltelli, A. (2002) · Computer Physics Communications · doi:10.1016/s0010-4655(02)00280-1 · Cited by 2,228 · see citing works
An effective screening design for sensitivity analysis of large models
Campolongo, F., Cariboni, J., & Saltelli, A. (2007) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2006.10.004 · Cited by 2,028 · see citing works
Importance measures in global sensitivity analysis of nonlinear models
Homma, T., & Saltelli, A. (1996) · Reliability Engineering & System Safety · doi:10.1016/0951-8320(96)00002-6 · Cited by 2,014 · see citing works
SALib: An open-source Python library for Sensitivity Analysis
Herman, J. D., & Usher, W. (2017) · The Journal of Open Source Software · doi:10.21105/joss.00097 · Cited by 1,549 · see citing works
Sensitivity Analysis for Importance Assessment
Saltelli, A. (2002) · Risk Analysis · doi:10.1111/0272-4332.00040 · Cited by 1,304 · see citing works
Identification and Review of Sensitivity Analysis Methods
Christopher Frey, H., & Patil, S. R. (2002) · Risk Analysis · doi:10.1111/0272-4332.00039 · Cited by 1,036 · see citing works
A new uncertainty importance measure
Borgonovo, E. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2006.04.015 · Cited by 1,030 · see citing works
How to avoid a perfunctory sensitivity analysis
Saltelli, A., & Annoni, P. (2010) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2010.04.012 · Cited by 1,010 · see citing works
Understanding Random Forests: From Theory to PracticePreprint
Louppe, G. (2014) · arXiv (Cornell University) · doi:10.13140/2.1.1570.5928 · Cited by 940 · see citing works
Sobol’ sensitivity analysis of a complex environmental model
Nossent, J., Elsen, P., & Bauwens, W. (2011) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2011.08.010 · Cited by 738 · see citing works
A survey on filter techniques for feature selection in gene expression microarray analysis
Lazar, C., Taminau, J., Meganck, S., Steenhoff, D., Coletta, A., Molter, C., de Schaetzen, V., Duque, R., Bersini, H., & Nowe, A. (2012) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2012.33 · Cited by 619 · see citing works
Thinking inside the box: A participatory, computer-assisted approach to scenario discovery
Bryant, B. P., & Lempert, R. J. (2009) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2009.08.002 · Cited by 550 · see citing works
Pianosi, F., & Wagener, T. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.01.004 · Cited by 517 · see citing works
On the Relative Importance of Input Factors in Mathematical Models
Saltelli, A., & Tarantola, S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618447 · Cited by 448 · see citing works
Global sensitivity measures from given data
Elmar Plischke, A., Borgonovo, E., & Smith, C. L. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.11.047 · Cited by 430 · see citing works
Tang, Y., Reed, P. M., Wagener, T., & van Werkhoven, K. (2007) · Hydrology and earth system sciences · doi:10.5194/hess-11-793-2007 · Cited by 424 · see citing works
Variable importance in binary regression trees and forests
Ishwaran, H. (2012) · Cited by 379 · see citing works
Qi, Y., Bar‐Joseph, Z., & Klein‐Seetharaman, J. (2006) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.20865 · Cited by 368 · see citing works
Variable importance in binary regression trees and forests
Ishwaran, H. (2007) · Electronic Journal of Statistics · doi:10.1214/07-ejs039 · Cited by 367 · see citing works
Identifying SNPs predictive of phenotype using random forests
Bureau, A., Dupuis, J., Falls, K. M., Lunetta, K. L., Hayward, B., Keith, T. P., & Eerdewegh, P. V. (2004) · Genetic Epidemiology · doi:10.1002/gepi.20041 · Cited by 366 · see citing works
Multi-method global sensitivity analysis of flood inundation models
Pappenberger, F., Beven, K. J., Ratto, M., et al. (2007) · Advances in Water Resources · doi:10.1016/j.advwatres.2007.04.009 · Cited by 296 · see citing works
Alternative representations of epistemic uncertainty
Helton, J. C., & Oberkampf, W. L. (2004) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2004.03.001 · Cited by 290 · see citing works
A new variable selection approach using Random Forests
Hapfelmeier, A., & Ulm, K. (2012) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.09.020 · Cited by 257 · see citing works
An importance quantification technique in uncertainty analysis for computer models
Ishigami, T., & Homma, T. (2002) · International Symposium on Uncertainty Modeling and Analysis (ISUMA) · doi:10.1109/isuma.1990.151285 · Cited by 254 · see citing works
Kwakkel, J. H. (2017) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2017.06.054 · Cited by 216 · see citing works
Self-citationStrobl, C., Hothorn, T., & Zeileis, A. (2009) · The R Journal · doi:10.32614/rj-2009-013 · Cited by 202 · see citing works
Do little interactions get lost in dark random forests?
Wright, M. N., Ziegler, A., & König, I. R. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-0995-8 · Cited by 198 · see citing works
Baroni, G., & Tarantola, S. (2013) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2013.09.022 · Cited by 174 · see citing works
Herman, J. D., Reed, P. M., & Wagener, T. (2013) · Water Resources Research · doi:10.1002/wrcr.20124 · Cited by 153 · see citing works
A new computational method of a moment-independent uncertainty importance measure
Liu, Q., & Homma, T. (2008) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2008.10.005 · Cited by 137 · see citing works
Harper, E. B., Stella, J. C., & Fremier, A. K. (2010) · Ecological Applications · doi:10.1890/10-0506.1 · Cited by 127 · see citing works
Kwakkel, J. H., & Jaxa-Rozen, M. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.11.020 · Cited by 103 · see citing works
Self-citationSingh, R., Wagener, T., Crane, R. G., MANN, M. E., & Ning, L. (2014) · Water Resources Research · doi:10.1002/2013wr014988 · Cited by 87 · see citing works
Butler, M. P., Reed, P. M., Fisher‐Vanden, K., Keller, K. M., & Wagener, T. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.05.001 · Cited by 76 · see citing works
Almeida, S., Holcombe, E. A., Pianosi, F., & Wagener, T. (2017) · Natural hazards and earth system sciences · doi:10.5194/nhess-17-225-2017 · Cited by 75 · see citing works
Borgonovo, E., Lu, X., Plischke, E., et al. (2017) · Water Resources Research · doi:10.1002/2017wr020767 · Cited by 73 · see citing works
Céline Guivarch, A., Rozenberg, J., & Schweizer, V. J. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.03.006 · Cited by 67 · see citing works
Sensitivity Analysis in Earth Observation Modelling
(2016) · Elsevier eBooks · doi:10.1016/c2014-0-03609-x · Cited by 65 · see citing works
Tang, T., Reed, P. M., Wagener, T., et al. (2006) · doi:10.5194/hessd-3-3333-2006 · Cited by 44 · see citing works
Touzani, S., & Busby, D. (2014) · Oil & Gas Science and Technology – Revue d’IFP Energies nouvelles · doi:10.2516/ogst/2013195 · Cited by 25 · see citing works
Factor Screening in Simulation Experiments: Review of Sequential Bifurcation
Kleijnen, J. P. C. (2009) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/b110059_8 · Cited by 18 · see citing works
Party on! A new, conditional variable importance measure available in the party package
Strobl, C., Hothorn, T., & Zeileis, A. (2009) · The R Journal · Cited by 18 · see citing works
Pianosi, F., Iwema, J., Rosolem, R., et al. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-803011-0.00007-0 · Cited by 16 · see citing works
Advancing the Frontiers of Simulation
(2009) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/b110059 · Cited by 13 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336 · see citing works
- Authors
- Jaxa-Rozen, M., & Kwakkel, J.
- Affiliations
- Delft University of Technology (NL)
- Corresponding author
- Jaxa-Rozen, Marc
- Venue
- Environmental Modelling & Software
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 107
- Pages
- 245-266
- ISSN
- 1364-8152 (ISSN-L)
- OpenAlex
- W2808170886
- Cited by
- 91
- References
- 60
- Citations by year
- 2026: 16 · 2025: 11 · 2024: 12 · 2023: 14 · 2022: 11 · 2021: 11 · 2020: 11 · 2019: 4 · 2018: 1
- FWCI
- 5.15
- Type
- journal article
- Language
- en
- Open access
- Locations
- Environmental Modelling & Software (publishedVersion)
- Archive ouverte UNIGE (University of Geneva) (submittedVersion, cc-by)
- Research Repository (Delft University of Technology) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by-nc-nd)
- Funders
- Netherlands Organization for Scientific Research (NWO) (408-13-030)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Probabilistic and Robust Engineering Design
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Simulation Techniques and Applications
- Keywords
- global sensitivity analysis, tree-based ensemble methods, random forest, extra trees, Sobol indices, Morris screening, elementary effects, environmental models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review