The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Evaluation of variable selection methods for random forests and omics data sets
Open accessAbstract
Machine learning methods and in particular random forests are promising approaches for prediction based on high dimensional omics data sets. They provide variable importance measures to rank predictors according to their predictive power. If building a prediction model is the main goal of a study, often a minimal set of variables with good prediction performance is selected. However, if the objective is the identification of involved variables to find active networks and pathways, approaches that aim to select all relevant variables should be preferred. We evaluated several variable selection procedures based on simulated data as well as publicly available experimental methylation and gene expression data. Our comparison included the Boruta algorithm, the Vita method, recurrent relative variable importance, a permutation approach and its parametric variant (Altmann) as well as recursive feature elimination (RFE). In our simulation studies, Boruta was the most powerful approach, followed closely by the Vita method. Both approaches demonstrated similar stability in variable selection, while Vita was the most robust approach under a pure null model without any predictor variables related to the outcome. In the analysis of the different experimental data sets, Vita demonstrated slightly better stability in variable selection and was less computationally intensive than Boruta. In conclusion, we recommend the Boruta and Vita approaches for the analysis of high-dimensional data sets. Vita is considerably faster than Boruta and thus more suitable for large data sets, but only Boruta can also be applied in low-dimensional settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
PD-1 and PD-L1 Immune Checkpoint Blockade to Treat Breast Cancer
Hartkopf, A. D., Taran, F.-A., Wallwiener, M., Walter, C. B., Krämer, B., Grischke, E.-M., & Brucker, S. Y. (2016) · Breast Care · doi:10.1159/000453569 · Cited by 30,845
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Nishimura, R., Osako, T., Nishiyama, Y., Tashima, R., Nakano, M., Fujisue, M., Toyozumi, Y., & Arima, N. (2013) · Oncology · doi:10.1159/000353099 · Cited by 13,166
Comprehensive molecular portraits of human breast tumours
The Cancer Genome Atlas Network (2012) · Nature · doi:10.1038/nature11412 · Cited by 12,129
NCBI GEO: archive for functional genomics data sets—update
Barrett, T., Wilhite, S. E., Ledoux, P., Evangelista, C., Kim, I. F., Tomashevsky, M., Marshall, K. A., Phillippy, K. H., Sherman, P. M., Holko, M., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1193 · Cited by 10,418
Feature Selection with the Boruta Package
Kursa, M. B., & Rudnicki, W. R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i11 · Cited by 5,659
Gene selection and classification of microarray data using random forest
Díaz-Uriarte, R., & Alvarez de Andrés, S. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-3 · Cited by 2,929
Permutation importance: a corrected feature importance measure
Altmann, A., Toloşi, L., Sander, O., & Lengauer, T. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq134 · Cited by 2,843
Variable selection using random forests
Genuer, R., Poggi, J.-M., & Tuleau-Malot, C. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.03.014 · Cited by 2,619
Correlation and variable importance in random forests
Gregorutti, B., Michel, B., & Saint-Pierre, P. (2017) · Statistics and Computing · doi:10.1007/s11222-016-9646-1 · Cited by 1,073
Outcome signature genes in breast cancer: is there a unique set?
Ein-Dor, L., Kela, I., Getz, G., Givol, D., & Domany, E. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bth469 · Cited by 802
Genome-wide association analysis by lasso penalized logistic regression
Wu, T. T., Chen, Y. F., Hastie, T., Sobel, E., & Lange, K. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp041 · Cited by 785
Gastrointestinal microbiome signatures of pediatric patients with irritable bowel syndrome
Saulnier, D. M., Riehle, K., Mistretta, T., Diaz, M., Mandal, D., Raza, S., Weidler, E. M., Qin, X., Coarfa, C., Milosavljevic, A., et al. (2011) · Gastroenterology · doi:10.1053/j.gastro.2011.06.072 · Cited by 672
VSURF: An R Package for Variable Selection Using Random Forests
Genuer, R., Poggi, J.-M., & Tuleau-Malot, C. (2015) · The R Journal · doi:10.32614/rj-2015-018 · Cited by 619
Robustness of Random Forest-based gene selection methods
Kursa, M. B. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-8 · Cited by 315
Stable feature selection for biomarker discovery
He, Z., & Yu, W. (2010) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2010.07.002 · Cited by 309
Prediction of high-responding peptides for targeted protein assays by mass spectrometry
Fusaro, V. A., Mani, D. R., Mesirov, J. P., & Carr, S. A. (2009) · Nature Biotechnology · doi:10.1038/nbt.1524 · Cited by 293
Swan, A. L., Mobasheri, A., Allaway, D., Liddell, S., & Bacardit, J. (2013) · OMICS: A Journal of Integrative Biology · doi:10.1089/omi.2013.0017 · Cited by 249
Probability Machines: Consistent Probability Estimation Using Nonparametric Learning Machines
Malley, J. D., Kruppa, J., Dasgupta, A., Malley, K. G., & Ziegler, A. (2012) · Methods of Information in Medicine · doi:10.3414/me00-01-0052 · Cited by 242
Smolinska, A., Hauschild, A.-C., Fijten, R. R. R., Dallinga, J. W., Baumbach, J., & van Schooten, F. J. (2014) · Journal of Breath Research · doi:10.1088/1752-7155/8/2/027105 · Cited by 219
A computationally fast variable importance test for random forests for high-dimensional data
Janitza, S., Celik, E., & Boulesteix, A.-L. (2018) · Advances in Data Analysis and Classification · doi:10.1007/s11634-016-0276-4 · Cited by 200
Stability and aggregation of ranked gene lists
Boulesteix, A.-L., & Slawski, M. (2009) · Briefings in Bioinformatics · doi:10.1093/bib/bbp034 · Cited by 177
Predictor correlation impacts machine learning algorithms: implications for genomic studies
Nicodemus, K. K., & Malley, J. D. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp331 · Cited by 170
Consistent Feature Selection for Pattern Recognition in Polynomial Time
Nilsson, R., Peña, J. M., Björkegren, J., & Tegner, J. N. (2007) · doi:10.5555/1248659.1248680 · Cited by 166
Machine learning in genome‐wide association studies
Szymczak, S., Biernacka, J. M., Cordell, H. J., González-Recio, Ó., König, I. R., Zhang, H., & Sun, Y. V. (2009) · Genetic Epidemiology · doi:10.1002/gepi.20473 · Cited by 161
Self-citationGene expression profile based classification models of psoriasis
Guo, P., Luo, Y., Mai, G., Zhang, M., Wang, G., Zhao, M., Gao, L., Li, F., & Zhou, F. (2013) · Genomics · doi:10.1016/j.ygeno.2013.11.001 · Cited by 140
Habermann, J. K., Doering, J., Hautaniemi, S., Roblick, U. J., Bündgen, N. K., Nicorici, D., Kronenwett, U., Rathnagiriswaran, S., Mettu, R. R., Ma, Y., et al. (2008) · International Journal of Cancer · doi:10.1002/ijc.24017 · Cited by 129
Parental ages and levels of DNA methylation in the newborn are correlated
Adkins, R. M., Thomas, F., Tylavsky, F. A., & Krushkal, J. (2011) · BMC Medical Genetics · doi:10.1186/1471-2350-12-47 · Cited by 122
Dietrich, S., Floegel, A., Weikert, C., Prehn, C. P., Adamski, J., Pischon, T., Boeing, H., & Drogan, D. (2016) · Hypertension · doi:10.1161/hypertensionaha.116.07292 · Cited by 114
Strobl, C., & Zeileis, A. (2008) · Open access LMU (Ludwid Maxmilian's Universitat Munchen) · doi:10.5282/ubm/epub.2111 · Cited by 109
BioMiCo: a supervised Bayesian model for inference of microbial community structure
Shafiei, M., Dunn, K. A., Boon, E., MacDonald, S. M., Walsh, D. A., Gu, H., & Bielawski, J. P. (2015) · Microbiome · doi:10.1186/s40168-015-0073-x · Cited by 97
Optimized application of penalized regression methods to diverse genomic data
Waldron, L., Pintilie, M., Tsao, M., Shepherd, F. A., Huttenhower, C., & Jurišica, I. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr591 · Cited by 95
Chen, Y.-A., Choufani, S., Ferreira, J. C., Grafodatskaya, D., Butcher, D. T., & Weksberg, R. (2011) · Genomics · doi:10.1016/j.ygeno.2010.12.004 · Cited by 90
r2VIM: A new variable selection method for random forests in genome-wide association studies
Szymczak, S., Holzinger, E. R., Dasgupta, A., Malley, J. D., Molloy, A. M., Mills, J. L., Brody, L. C., Stambolian, D., & Wilson, J. (2016) · BioData Mining · doi:10.1186/s13040-016-0087-3 · Cited by 63
Self-citationAncestry Dependent DNA Methylation and Influence of Maternal Nutrition
Mozhui, K., Smith, A. K., & Tylavsky, F. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0118466 · Cited by 62
Pineda, S., Real, F. X., Kogevinas, M., Carrato, A., Chanock, S. J., Malats, N., & Steen, K. V. (2015) · PLoS Genetics · doi:10.1371/journal.pgen.1005689 · Cited by 60
Phylogenetic approaches to microbial community classification
Ning, J., & Beiko, R. G. (2015) · Microbiome · doi:10.1186/s40168-015-0114-5 · Cited by 56
Alexe, G., Monaco, J., Doyle, S. T., Basavanhally, A. N., Reddy, A., Seiler, M., Ganesan, S., Bhanot, G., & Madabhushi, A. (2009) · Experimental Biology and Medicine · doi:10.3181/0902-mr-89 · Cited by 45
Integrative analysis of the connectivity and gene expression atlases in the mouse brain
Ji, S., Fakhry, A., & Deng, H. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.049 · Cited by 44
Drier, Y., & Domany, E. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017795 · Cited by 40
Stability of Feature Selection Algorithms and Ensemble Feature Selection Methods in Bioinformatics
Yang, P., Zhou, B. B., Yang, J. Y. H., et al. (2013) · doi:10.1002/9781118617151.ch14 · Cited by 36
Phenotype prediction based on genome-wide DNA methylation data
Wilhelm, T. E. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-193 · Cited by 31
Chen, Z., & Zhang, W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002956 · Cited by 27
Hrstka, R., Obacz, J., Brychtová, V., Podhorec, J., Fabián, P., Vojtěšek, B., & Dobes, P. (2015) · OncoTargets and Therapy · doi:10.2147/ott.s82235 · Cited by 23
Neto, E. C., Bare, J. C., & Margolin, A. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0107957 · Cited by 19
VARIABLE SELECTION METHOD FOR THE IDENTIFICATION OF EPISTATIC MODELS
Holzinger, E. R., Szymczak, S., Dasgupta, A., Malley, J. D., Li, Q., & Wilson, J. (2014) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789814644730_0020 · Cited by 13
Self-citationSimulating Gene Expression Data To Estimate Sample Size For Class and Biomarker Discovery
Islam, M. N., Hossain, M. G., Karim, M. R., Islam, M. R., Lestrel, P. E., & Islam, M. A. (2012) · Advances in life sciences · Cited by 11
Wang, Y., Li, Z., Wang, Y., Wang, X., Zheng, J., Duan, X., & Chen, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.08301 · Cited by 9
Research works printed but not linked: 2
- Rudnicki, 2015, Feature Selection for Data and Pattern Recognition, 11, 10.1007/978-3-662-45620-0_2 · doi:10.1007/978-3-662-45620-0_2
- Garczyk, 2015, AGR3 in breast cancer: prognostic impact and suitable serum-Based biomarker for early cancer detection, PLoS One, 10, e0122106., 10.1371/journal.pone.0122106 · doi:10.1371/journal.pone.0122106
Cited by
A comparison of random forest variable selection methods for classification prediction modeling
Speiser, J. L., Miller, M. E., Tooze, J., & Ip, E. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.05.028 · Cited by 1,561
The revival of the Gini importance?
Nembrini, S., König, I. R., & Wright, M. N. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty373 · Cited by 751
A review on longitudinal data analysis with random forest
Hu, J., & Szymczak, S. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad002 · Cited by 678
Self-citationClassification and prediction of diabetes disease using machine learning paradigm
Maniruzzaman, M., Rahman, M. J., Ahammed, B., & Abedin, M. M. (2020) · Health Information Science and Systems · doi:10.1007/s13755-019-0095-z · Cited by 369
Arnoriaga-Rodríguez, M., Mayneris-Perxachs, J., Burokas, A., Contreras-Rodríguez, O., Blasco, G., Coll, C., Biarnés, C., Miranda-Olivos, R., Latorre, J., Moreno-Navarrete, J.-M., et al. (2020) · Cell Metabolism · doi:10.1016/j.cmet.2020.09.002 · Cited by 157
Metadata
- Authors
- Degenhardt, F., Seifert, S., & Szymczak, S.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-10-16
- Volume
- 20
- Issue
- 2
- Pages
- 492-503
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W2766438525
- Cited by
- 724
- References
- 50
- FWCI
- 18.85
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- The German Federal Ministry of Education and Research (01ZX1510)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.