A new variable selection approach using Random Forests

R: A Language and Environment for Statistical Computing

R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181

Random Forests

Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538

The Elements of Statistical Learning

Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970

Modern Applied Statistics with S

Venables, W. N., & Ripley, B. D. (2002) · Statistics and Computing · doi:10.1007/978-0-387-21706-2 · Cited by 24,305

The Elements of Statistical Learning

Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162

UCI Machine Learning Repository

Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 24,155

Untitled work

(1992) · Cited by 23,431

Classification and Regression Trees.

Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825

Bagging predictors

Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325

The control of the false discovery rate in multiple testing under dependency

Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490

Classification and regression trees

Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053

An introduction to variable and feature selection

GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715

An Introduction to Variable and Feature Selection.

Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576

Random forests for classification in ecology

Cutler, D. R., Edwards, T. C., Beard, K. H., Cutler, A., Hess, K. T., Gibson, J., & Lawler, J. J. (2007) · Ecology · doi:10.1890/07-0539.1 · Cited by 4,950

Unbiased Recursive Partitioning: A Conditional Inference Framework

Hothorn, T., Hornik, K., & Zeileis, A. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x133933 · Cited by 4,021

Bias in random forest variable importance measures: Illustrations, sources and a solution

Strobl, C., Boulesteix, A.-L., Zeileis, A., & Hothorn, T. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-25 · Cited by 3,688

Conditional variable importance for random forests

Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., & Zeileis, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-307 · Cited by 3,254

Gene selection and classification of microarray data using random forest

Díaz-Uriarte, R., & Alvarez de Andrés, S. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-3 · Cited by 2,929

Permutation importance: a corrected feature importance measure

Altmann, A., Toloşi, L., Sander, O., & Lengauer, T. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq134 · Cited by 2,843

Modern Applied Statistics With S

(2003) · Technometrics · doi:10.1198/tech.2003.s33 · Cited by 2,762

Variable selection using random forests

Genuer, R., Poggi, J.-M., & Tuleau-Malot, C. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.03.014 · Cited by 2,619

An introduction to recursive partitioning: Rationale, application, and characteristics of classification and regression trees, bagging, and random forests.

Strobl, C., Malley, J., & Tutz, G. (2009) · Psychological Methods · doi:10.1037/a0016973 · Cited by 2,583

Estimating the error rate of a prediction rule: improvement on cross-validation

Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300

An Introduction to the Bootstrap

Grimshaw, S. D., Efron, B., & Tibshirani, R. J. (1995) · Technometrics · doi:10.2307/1269918 · Cited by 2,095

Hedonic housing prices and the demand for clean air

Harrison, D., & Rubinfeld, D. L. (1978) · Journal of Environmental Economics and Management · doi:10.1016/0095-0696(78)90006-2 · Cited by 1,854

Linear Model Selection by Cross-validation

Shao, J. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476299 · Cited by 1,790

Improvements on Cross-Validation: The 632+ Bootstrap Method

Efron, B., & Tibshirani, R. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474007 · Cited by 1,636

Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses

Niknian, M. (1995) · Technometrics · doi:10.1080/00401706.1995.10484341 · Cited by 1,462

Selection of important variables and determination of functional form for continuous predictors in multivariable model building

Sauerbrei, W., Royston, P., & Binder, H. (2007) · Statistics in Medicine · doi:10.1002/sim.3148 · Cited by 1,171

Empirical characterization of random forest variable importance measures

Archer, K. J., & Kimes, R. V. (2008) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2007.08.015 · Cited by 1,123

Bootstrap Methods for Developing Predictive Models

Austin, P. C., & Tu, J. V. (2004) · The American Statistician · doi:10.1198/0003130043277 · Cited by 622

Exploiting Nonlinear Recurrence and Fractal Scaling Properties for Voice Disorder Detection

Little, M. A., McSharry, P. E., Roberts, S. J., Costello, D. A., & Moroz, I. M. (2007) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-6-23 · Cited by 577

Proceedings of the Eighteenth International Conference on Machine Learning

Brodley, C. E., & Danyluk, A. (2001) · Cited by 568

'Gene shaving' as a method for identifying distinct sets of genes with similar expression patterns

Hastie, T., Tibshirani, R., Eisen, M. B., Alizadeh, A., Levy, R., Staudt, L., Chan, W. C., Botstein, D., & Brown, P. (2000) · Genome Biology · doi:10.1186/gb-2000-1-2-research0003 · Cited by 547

Model Selection Via Multifold Cross Validation

Zhang, P. (1993) · The Annals of Statistics · doi:10.1214/aos/1176349027 · Cited by 539

Screening large-scale association study data: exploiting interactions using random forests

Lunetta, K. L., Hayward, L. B., Segal, J., & Van Eerdewegh, P. (2004) · BMC Genetics · doi:10.1186/1471-2156-5-32 · Cited by 463

Data mining in the Life Sciences with Random Forest: a walk in the park or lost in the jungle?

Touw, W. G., Bayjanov, J. R., Overmars, L., Backus, L., Boekhorst, J., Wels, M., & van Hijum, S. A. F. T. (2013) · Briefings in Bioinformatics · doi:10.1093/bib/bbs034 · Cited by 453

Classification Trees With Unbiased Multiway Splits

Kim, H., & Loh, W.-Y. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753168271 · Cited by 391

The behaviour of random forest permutation-based variable importance measures under predictor correlation

Nicodemus, K. K., Malley, J. D., Strobl, C., & Ziegler, A. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-110 · Cited by 376

The Use of Resampling Methods to Simplify Regression Models in Medical Statistics

Sauerbrei, W. (1999) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00155 · Cited by 310

Unbiased split selection for classification trees based on the Gini Index

Strobl, C., Boulesteix, A.-L., & Augustin, T. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.12.030 · Cited by 308

Joint analysis of two microarray gene-expression data sets to select lung adenocarcinoma marker genes

Jiang, H., Deng, Y., Chen, H.-S., Tao, L., Sha, Q., Chen, J., Tsai, C.-J., & Zhang, S. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-81 · Cited by 290

Application of Breiman’s Random Forest to Modeling Structure-Activity Relationships of Pharmaceutical Molecules

Svetnik, V., Liaw, A., Tong, C., & Wang, T. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-25966-4_33 · Cited by 288

An application of Random Forests to a genome-wide association dataset: Methodological considerations & new findings

Goldstein, B. A., Hubbard, A. E., Cutler, A., & Barcellos, L. F. (2010) · BMC Genetics · doi:10.1186/1471-2156-11-49 · Cited by 225

Computational Statistics

(1994) · Contributions to statistics · doi:10.1007/978-3-642-57991-2 · Cited by 179

Bias in information-based measures in decision tree induction

White, A. P., & Liu, W. Z. (1994) · Machine Learning · doi:10.1007/bf00993349 · Cited by 175

Survival prediction using gene expression data: A review and comparison

van Wieringen, W. N., Kun, D., Hampel, R., & Boulesteix, A. (2008) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2008.05.021 · Cited by 154

Variable Selection Using Random Forests

Sandri, M. F., & Zuccolotto, P. (2007) · Springer eBooks · doi:10.1007/3-540-35978-8_30 · Cited by 120

Evaluating Microarray-based Classifiers: An Overview

Boulesteix, A., Strobl, C., Augustin, T., & Däumer, M. (2008) · Cancer Informatics · doi:10.4137/cin.s408 · Cited by 116

SNP interaction detection with Random Forests in high-dimensional genetic data

Winham, S. J., Colby, C. L., Freimuth, R. R., Wang, X., de Andrade, M., Huebner, M., & Biernacka, J. M. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-164 · Cited by 114

Danger: High Power! - Exploring the Statistical Properties of a Test for Random Forest Variable Importance

Strobl, C., & Zeileis, A. (2008) · Open access LMU (Ludwid Maxmilian's Universitat Munchen) · doi:10.5282/ubm/epub.2111 · Cited by 109

Assessing stability of gene selection in microarray data analysis

Qiu, X., Xiao, Y., Gordon, A. Y., & Yakovlev, A. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-50 · Cited by 78

Stable graphical model estimation with Random Forests for discrete, continuous, and mixed variables

Fellinghauer, B. A. G., Bühlmann, P., Ryffel, M., von Rhein, M., & Reinhardt, J. D. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2013.02.022 · Cited by 78

A framework to identify physiological responses in microarray-based gene expression studies: selection and interpretation of biologically relevant genes

Rodenburg, W., Heidema, A. G., Boer, J. M. A., Bovee-Oudenhoven, I. M. J., Feskens, E. J. M., Mariman, E. C. M., & Keijer, J. (2007) · Physiological Genomics · doi:10.1152/physiolgenomics.00167.2007 · Cited by 55

Introduction to statistics through resampling methods and R/S-PLUS

(2006) · Choice Reviews Online · doi:10.5860/choice.43-2852 · Cited by 54

Variable selection by Random Forests using data with missing values

Hapfelmeier, A., & Ulm, K. (2014) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2014.06.017 · Cited by 49

Maximal conditional chi-square importance in random forests

Wang, M., Chen, X. '., & Zhang, H. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq038 · Cited by 43

Bias Correction in Classification Tree Construction

Dobra, A., & Gehrke, J. E. (2001) · International Conference on Machine Learning · Cited by 36

Picking single-nucleotide polymorphisms in forests

Schwarz, D. F., Szymczak, S., Ziegler, A., et al. (2007) · BMC Proceedings · doi:10.1186/1753-6561-1-s1-s59 · Cited by 35

Random Forests based feature selection for decoding fMRI data

Genuer, R., Michel, V., Eger, E., & Thirion, B. (2010) · HAL · Cited by 23

A comparison of random forest variable selection methods for classification prediction modeling

Speiser, J. L., Miller, M. E., Tooze, J., & Ip, E. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.05.028 · Cited by 1,561

Correlation and variable importance in random forests

Gregorutti, B., Michel, B., & Saint-Pierre, P. (2017) · Statistics and Computing · doi:10.1007/s11222-016-9646-1 · Cited by 1,073

Analysis of machine learning techniques for heart failure readmissions

Mortazavi, B. J., Downing, N. S., Bucholz, E. M., Dharmarajan, K., Manhapra, A., Li, S.-X., Negahban, S. N., & Krumholz, H. M. (2016) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.116.003039 · Cited by 401

Tree-based ensemble methods for sensitivity analysis of environmental models: A performance comparison with Sobol and Morris techniques

Jaxa-Rozen, M., & Kwakkel, J. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2018.06.011 · Cited by 91

DNA methylation loci associated with atopy and high serum IgE: a genome-wide application of recursive Random Forest feature selection

Everson, T. M., Lyons, G., Zhang, H., Soto-Ramírez, N., Lockett, G. A., Patil, V. K., Merid, S. K., Sӧderhӓll, C., Melén, E., Holloway, J. W., et al. (2015) · Genome Medicine · doi:10.1186/s13073-015-0213-8 · Cited by 78