Random forests for global sensitivity analysis: A selective review
The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Abstract
The understanding of many physical and engineering problems involves running complex computational models. Such models take as input a high number of numerical and physical explanatory variables. The information on these underlying input parameters is often limited or uncertain. It is therefore important, based on the relationships between the input variables and the output, to identify and prioritize the most influential inputs. One may use global sensitivity analysis (GSA) methods which aim at ranking input random variables according to their importance in the output uncertainty, or even quantify the global influence of a particular input on the output. Using sensitivity metrics to ignore less important parameters is a form of dimension reduction in the model’s input parameter space. This suggests the use of meta-modeling as a quantitative approach for nonparametric GSA, where the original input/output relation is first approximated using various statistical regression techniques. Subsequently, the main goal of our work is to provide a comprehensive review paper in the domain of sensitivity analysis focusing on some interesting connections between random forests and GSA. The idea is to use a random forests methodology as an efficient non-parametric approach for building meta-models that allow an efficient sensitivity analysis. Apart its easy applicability to regression problems, the random forests approach presents further strong advantages by its ability to implicitly deal with correlation and high dimensional data, to handle interactions between variables and to identify informative inputs using a permutation based RF variable importance index which is easy and fast to compute. We further review an adequate set of tools for quantifying variable importance which are then exploited to reduce the model’s dimension enabling otherwise infeasible sensibility analysis studies. Numerical results from several simulations and a data exploration on a real dataset are presented to illustrate the effectiveness of such an approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
Multivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,000
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
Global Sensitivity Analysis. The Primer
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2007) · doi:10.1002/9780470725184 · Cited by 6,430
Global sensitivity indices for nonlinear mathematical models and their monte carlo estimates
Sobol′, I. M. (2001) · Mathematics and Computers in Simulation · doi:10.1016/s0378-4754(00)00270-6 · Cited by 6,389
Shapley, L. S. (1988) · The Shapley Value · doi:10.1017/cbo9780511528446.003 · Cited by 4,954
Biau, G., & Scornet, E. (2016) · Test · doi:10.1007/s11749-016-0481-7 · Cited by 4,149
Conditional variable importance for random forests
Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., & Zeileis, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-307 · Cited by 3,254
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
Remarks on a Multivariate Transformation
Rosenblatt, M. (1952) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729394 · Cited by 2,863
Variable selection using random forests
Genuer, R., Poggi, J.-M., & Tuleau-Malot, C. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.03.014 · Cited by 2,619
Self-citationRelative Importance for Linear Regression in R : The Package relaimpo
Grömping, U. (2006) · Journal of Statistical Software · doi:10.18637/jss.v017.i01 · Cited by 2,615
Global sensitivity analysis using polynomial chaos expansions
Sudret, B. (2008) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2007.04.002 · Cited by 2,539
A Class of Statistics with Asymptotically Normal Distribution
Hoeffding, W. (1948) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730196 · Cited by 1,928
Goldstein, A., Kapelner, A., Bleich, J., & Pitkin, E. (2015) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.907095 · Cited by 1,861
A Class of Statistics with Asymptotically Normal Distribution
Hoeffding, W. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_20 · Cited by 1,851
Visualizing the effects of predictor variables in black box supervised learning models
Apley, D. W., & Zhu, J. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12377 · Cited by 1,535
The Jackknife Estimate of Variance
Efron, B., & Stein, C. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345462 · Cited by 1,436
Understanding variable importances in forests of randomized trees
Louppe, G., Wehenkel, L. A., Sutera, A., & Geurts, P. (2013) · ORBi (University of Liège) · Cited by 1,364
Proceedings of the 26th International Conference on Neural Information Processing Systems
Burges, C. J. C., Bottou, L., Welling, M., Zoubin Ghahramani, A., & Weinberger, K. Q. (2013) · Cited by 1,323
Gentzkow, M., Kelly, B., & Taddy, M. (2019) · Journal of Economic Literature · doi:10.1257/jel.20181020 · Cited by 1,236
Correlation and variable importance in random forests
Gregorutti, B., Michel, B., & Saint-Pierre, P. (2017) · Statistics and Computing · doi:10.1007/s11222-016-9646-1 · Cited by 1,073
Introduction to Bivariate and Multivariate Analysis.
Sen, P. K., Lindeman, R. H., Merenda, P. F., & Gold, R. Z. (1981) · Journal of the American Statistical Association · doi:10.2307/2287559 · Cited by 1,055
A Review on Global Sensitivity Analysis Methods
Iooss, B., & Lemaître, P. (2015) · Operations Research/Computer Science Interfaces Series · doi:10.1007/978-1-4899-7547-8_5 · Cited by 994
Analysis of a Random Forests Model
Gérard Biau, A. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1005.0208 · Cited by 661
Analysis of variance designs for model output
Jansen, M. J. W. (1999) · Computer Physics Communications · doi:10.1016/s0010-4655(98)00154-4 · Cited by 650
Analysis of regression in game theory approach
Lipovetsky, S., & Conklin, M. (2001) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.446 · Cited by 650
Scornet, E., Biau, G., & Vert, J.-P. (2015) · The Annals of Statistics · doi:10.1214/15-aos1321 · Cited by 612
Handbook of Uncertainty Quantification
(2016) · Springer eBooks · doi:10.1007/978-3-319-11259-6 · Cited by 581
Analysis of a random forests model
BiauGérard (2012) · Journal of Machine Learning Research · doi:10.5555/2503308.2343682 · Cited by 575
Variable importance analysis: A comprehensive review
Wei, P., Lu, Z., & Song, J. (2015) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2015.05.018 · Cited by 525
Valuation of mortgage-backed securities using Brownian bridges to reduce effective dimension
Caflisch, R. E., Morokoff, W. J., & Owen, A. B. (1997) · The Journal of Computational Finance · doi:10.21314/jcf.1997.005 · Cited by 516
Causal Interpretations of Black-Box Models
Zhao, Q., & Hastie, T. (2021) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2019.1624293 · Cited by 462
An Efficient Explanation of Individual Classifications using Game Theory
StrumbeljErik, & KononenkoIgor (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1756007 · Cited by 380
Nicodemus, K. K., Malley, J. D., Strobl, C., & Ziegler, A. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-110 · Cited by 376
A Simple and Effective Model-Based Variable Importance MeasurePreprint
Greenwell, B., Boehmke, B. C., & McCarthy, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04755 · Cited by 357
Estimation of global sensitivity indices for models with dependent variables
Kucherenko, S., Tarantola, S., & Annoni, P. (2012) · Computer Physics Communications · doi:10.1016/j.cpc.2011.12.020 · Cited by 347
Iterative random forests to discover predictive and stable high-order interactions
Basu, S., Kumbier, K., Brown, J. B., & Yu, B. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711236115 · Cited by 317
Gene selection with guided regularized random forest
Deng, H., & Runger, G. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.018 · Cited by 304
Sobol' Indices and Shapley Value
Owen, A. B. (2014) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/130936233 · Cited by 266
The Shapley Value: Essays in Honor of Lloyd S. Shapley.
Cubitt, R., & Roth, A. E. (1991) · The Economic Journal · doi:10.2307/2233574 · Cited by 248
Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Models
Apley, D. W., & Zhu, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.08468 · Cited by 247
Shapley Effects for Global Sensitivity Analysis: Theory and Computation
Song, E., Nelson, B. L., & Staum, J. (2016) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/15m1048070 · Cited by 244
Global Sensitivity Analysis for Systems with Independent and/or Correlated Inputs
Li, G., Rabitz, H., Yelvington, P. E., Oluwole, O. O., Bacon, F., Kolb, C. E., & Schoendorf, J. (2010) · The Journal of Physical Chemistry A · doi:10.1021/jp9096919 · Cited by 241
Computer model validation with functional output
Bayarri, M. J., Walsh, D., Berger, J. O., Cafeo, J., Garcia-Donato, G., Liu, F., Palomo, J., Parthasarathy, R. J., Paulo, R., & Sacks, J. (2007) · The Annals of Statistics · doi:10.1214/009053607000000163 · Cited by 238
Generalized Functional ANOVA Diagnostics for High-Dimensional Functions of Dependent Variables
Hooker, G. (2007) · Journal of Computational and Graphical Statistics · doi:10.1198/106186007x237892 · Cited by 220
Computer Model Validation with Functional Output
(2015) · Cited by 204
Uncertainty Management in Simulation-Optimization of Complex Systems
Dellino, G., & Meloni, C. (2015) · Operations research, computer science. Interface series · doi:10.1007/978-1-4899-7547-8 · Cited by 192
Introduction to Sensitivity Analysis
(2007) · Global Sensitivity Analysis. The Primer · doi:10.1002/9780470725184.ch1 · Cited by 169
On Shapley Value for Measuring Importance of Dependent Inputs
Owen, A. B., & Prieur, C. (2017) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/16m1097717 · Cited by 169
Zhu, R., Zeng, D., & Kosorok, M. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1036994 · Cited by 168
Gamboa, F., Hal, H. I., & Chastaing, G. (2015) · Cited by 160
Global sensitivity metrics from active subspaces
Constantine, P. G., & Diaz, P. (2017) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2017.01.013 · Cited by 158
General formulation of HDMR component functions with independent and correlated variables
Li, G., & RABITZ, H. A. (2011) · Journal of Mathematical Chemistry · doi:10.1007/s10910-011-9898-0 · Cited by 147
Grouped variable importance with random forests and application to multiple functional data analysis
Gregorutti, B., Michel, B., & Saint-Pierre, P. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2015.04.002 · Cited by 145
A new computational method of a moment-independent uncertainty importance measure
Liu, Q., & Homma, T. (2008) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2008.10.005 · Cited by 139
Empirical comparison of tree ensemble variable importance measures
Auret, L., & Aldrich, C. (2010) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2010.12.004 · Cited by 125
Invariant Probabilistic Sensitivity Analysis
Baucells, M., & Borgonovo, E. (2013) · Management Science · doi:10.1287/mnsc.2013.1719 · Cited by 104
12th European Symposium on Artificial Neural Networks
Verleysen, M. (2004) · Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) · Cited by 80
Variance Reduction for Estimation of Shapley Effects and Adaptation to Unknown Input Distribution
Broto, B., Bachoc, F., & Depecker, M. (2020) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/18m1234631 · Cited by 72
Modeling the competition between lung metastases and the immune system using agents
Pennisi, M. A., Pappalardo, F., Palladini, A., Nicoletti, G., Nanni, P., Lollini, P., & Motta, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-s7-s13 · Cited by 64
Random Intersection TreesPreprint
Shah, R. D., & Meinshausen, N. (2013) · arXiv (Cornell University) · doi:10.5555/2627435.2627455 · Cited by 53
Benoumechiara, N., & Elie-Dit-Cosaque, K. (2019) · ESAIM Proceedings and Surveys · doi:10.1051/proc/201965266 · Cited by 44
A Generalized ANOVA Dimensional Decomposition for Dependent Probability Measures
Rahman, S. (2014) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/120904378 · Cited by 39
Wei, P., Lü, Z., & Song, J. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2015.04.015 · Cited by 26
L1-based compression of random forest models
Joly, A., Schnitzler, F., Geurts, P., & Wehenkel, L. A. (2012) · ORBi (University of Liège) · Cited by 25
Global Sensitivity Analysis: a new generation of mighty estimators based on rank statisticsPreprint
Gamboa, F., Gremaud, P. A., Klein, T., & Lagnoux, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01772 · Cited by 12
Treatment of dependency in sensitivity analysis for industrial reliability
Benoumechiara, N. (2019) · theses.fr (ABES) · doi:10.70675/d5422653z5ecfz41a6z9e5czba00e20b0650 · Cited by 6
GARROTE TREES AS TREE STRUCTURED REGRESSION ANALYSIS
Nakamura, M., Ochi, Y., Motogaito, H., & Goto, M. (2017) · Journal of the Japanese Society of Computational Statistics · doi:10.5183/jjscs.1612001_241 · Cited by 1
Cited by
Simsekler, M. C. E., Rodrigues, C., Qazi, A., Ellahham, S., & Ozonoff, A. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2020.107416 · Cited by 30
Metadata
- Authors
- Antoniadis, A., Lambert-Lacroix, S., & Poggi, J.-M.
- Venue
- Reliability Engineering & System Safety
- Publisher
- Elsevier BV
- Published
- 2021-02
- Volume
- 206
- Pages
- 107312
- ISSN
- 0951-8320 (ISSN-L)
- OpenAlex
- W3103897629
- Cited by
- 363
- References
- 73
- FWCI
- 18.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.