The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Benchmark of filter methods for feature selection in high-dimensional gene expression survival data
Open accessAbstract
Feature selection is crucial for the analysis of high-dimensional data, but benchmark studies for data with a survival outcome are rare. We compare 14 filter methods for feature selection based on 11 high-dimensional gene expression survival data sets. The aim is to provide guidance on the choice of filter methods for other researchers and practitioners. We analyze the accuracy of predictive models that employ the features selected by the filter methods. Also, we consider the run time, the number of selected features for fitting models with high predictive accuracy as well as the feature selection stability. We conclude that the simple variance filter outperforms all other considered filter methods. This filter selects the features with the largest variance and does not take into account the survival outcome. Also, we identify the correlation-adjusted regression scores filter as a more elaborate alternative that allows fitting models with similar predictive accuracy. Additionally, we investigate the filter methods based on feature rankings, finding groups of similar filters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Wickham, H. (2016) · Use R! · doi:10.1007/978-3-319-24277-4 · Cited by 33,115
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
Modeling Survival Data: Extending the Cox Model
Therneau, T. M., & Grambsch, P. M. (2000) · Statistics for Biology and Health · doi:10.1007/978-1-4757-3294-8 · Cited by 8,674
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
A review of feature selection techniques in bioinformatics
Saeys, Y., Inza, I., & Larrañaga, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm344 · Cited by 5,244
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
Feature selection for classification
DASH, M., & LIU, H. (1997) · Intelligent Data Analysis · doi:10.1016/s1088-467x(97)00008-5 · Cited by 3,574
(1998) · Cited by 3,476
ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and R
Wright, M. N., & Ziegler, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v077.i01 · Cited by 3,340
Ishwaran, H., Kogalur, U. B., Blackstone, E. H., & Lauer, M. S. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas169 · Cited by 2,714
Toward integrating feature selection algorithms for classification and clustering
Liu, H., & Yu, L. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.66 · Cited by 2,706
Regularization Paths for Cox's Proportional Hazards Model via Coordinate Descent
Simon, N., Friedman, J., Hastie, T., & Tibshirani, R. (2011) · Journal of Statistical Software · doi:10.18637/jss.v039.i05 · Cited by 2,499
Feature Selection: A Data Perspective
Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R. P., Tang, J., & Liu, H. (2018) · ACM Computing Surveys · doi:10.1145/3136625 · Cited by 2,442
An extensive empirical study of feature selection metrics for text classification
Forman, G. (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944974 · Cited by 2,394
Feature selection in machine learning: A new perspective
Cai, J., Luo, J., Wang, S., & Yang, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.11.077 · Cited by 2,061
xgboost: Extreme Gradient Boosting
Chen, T., He, T., Benesty, M., Khotilovich, V., Tang, Y., Cho, H., Chen, K., Mitchell, R., Cano, I., Zhou, T., et al. (2014) · CRAN: Contributed Packages · doi:10.32614/cran.package.xgboost · Cited by 2,025
A Survey on Evolutionary Computation Approaches to Feature Selection
Xue, B., Zhang, M., Browne, W. N., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2504420 · Cited by 1,841
Survival Analysis: Techniques for Censored and Truncated Data
Klein, J. P., & Moeschberger, M. L. (2003) · Statistics for Biology and Health · doi:10.1007/b97377 · Cited by 1,816
Schäfer, J., & Strimmer, K. (2005) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1175 · Cited by 1,561
Feature subset selection using a genetic algorithm
Yang, J., & Honavar, V. (1998) · IEEE Intelligent Systems · doi:10.1109/5254.671091 · Cited by 1,362
Conditional Likelihood Maximisation: A Unifying Framework for Mutual Information Feature Selection
Brown, G., Pocock, A., Zhao, M., & Luján, M. (2012) · Research Explorer (The University of Manchester) · Cited by 1,359
Ishwaran, H., Kogalur, U. B., Blackstone, E. H., & Lauer, M. S. (2008) · Cited by 1,310
A review of feature selection methods with applications
Jovic, A., Brkic, K., & Bogunovic, N. (2015) · 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) · doi:10.1109/mipro.2015.7160458 · Cited by 1,209
Martingale-based residuals for survival models
THERNEAU, T. M., GRAMBSCH, P. M., & FLEMING, T. R. (1990) · Biometrika · doi:10.1093/biomet/77.1.147 · Cited by 1,099
Unified Methods for Censored Longitudinal Data and Causality
van der Laan, M. J., & Robins, J. M. (2003) · Springer Series in Statistics · doi:10.1007/978-0-387-21700-0 · Cited by 959
A Review of Feature Selection and Feature Extraction Methods Applied on Microarray Data
Hira, Z. M., & Gillies, D. F. (2015) · Advances in Bioinformatics · doi:10.1155/2015/198363 · Cited by 936
A review of feature selection methods on synthetic data
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-012-0487-8 · Cited by 830 · cited 1×
“In [23], the classification accuracy of different filter, wrapper, and embedded methods on several artificial data sets is analyzed.”
BackgroundBoosting Algorithms: Regularization, Prediction and Model Fitting
Bühlmann, P., & Hothorn, T. (2007) · Statistical Science · doi:10.1214/07-sts242 · Cited by 726
Benchmark for filter methods for feature selection in high-dimensional classification data
Bommert, A., Sun, X., Bischl, B., Rahnenführer, J., & Lang, M. (2020) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2019.106839 · Cited by 725
Self-citationBOOSTING ALGORITHMS: REGULARIZATION, PREDICTION AND MODEL FITTINGPreprint
Bühlmann, P., & Hothorn, T. (2007) · Cited by 705
A review of microarray datasets and applied feature selection methods
Bolón-Canedo, V., Sánchez-Maroño, N., Alonso-Betanzos, A., Benítez, J. M., & Herrera, F. (2014) · Information Sciences · doi:10.1016/j.ins.2014.05.042 · Cited by 666
Feature selection using Joint Mutual Information Maximisation
Bennasar, M., Hicks, Y., & Setchi, R. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.07.007 · Cited by 659
A Review of Feature Selection and Its Methods
Venkatesh, B., & Anuradha, J. (2019) · Cybernetics and Information Technologies · doi:10.2478/cait-2019-0001 · Cited by 631
A survey on filter techniques for feature selection in gene expression microarray analysis
Lazar, C., Taminau, J., Meganck, S., Steenhoff, D., Coletta, A., Molter, C., de Schaetzen, V., Duque, R., Bersini, H., & Nowe, A. (2012) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2012.33 · Cited by 619
Stability of feature selection algorithms: a study on high-dimensional spaces
Kalousis, A., Prados, J., & Hilario, M. (2007) · Knowledge and Information Systems · doi:10.1007/s10115-006-0040-8 · Cited by 614
Fast Binary Feature Selection with Conditional Mutual Information
FleuretFrançois (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1044711 · Cited by 593
Gerds, T. A., & Schumacher, M. (2006) · Biometrical Journal · doi:10.1002/bimj.200610301 · Cited by 519
Optimal Whitening and Decorrelation
Kessy, A., Lewin, A., & Strimmer, K. (2018) · The American Statistician · doi:10.1080/00031305.2016.1277159 · Cited by 506
mlr3: A modern object-oriented machine learning framework in R
Lang, M., Binder, M., Richter, J., Schratz, P., Pfisterer, F., Coors, S., Au, Q., Casalicchio, G., Kotthoff, L., & Bischl, B. (2019) · Journal of Open Source Software · doi:10.21105/joss.01903 · Cited by 449
Filter Methods for Feature Selection – A Comparative Study
Sánchez-Maroño, N., Alonso-Betanzos, A., & Tombilla-Sanromán, M. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77226-2_19 · Cited by 425
Filter versus wrapper gene selection approaches in DNA microarray domains
Inza, I., Larrañaga, P., Blanco, R., & Cerrolaza, A. J. (2004) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2004.01.007 · Cited by 425
Liu, H., Li, J., & Wong, L. (2002) · PubMed · Cited by 410
Swarm Intelligence Algorithms for Feature Selection: A Review
Brezočnik, L., Fister, I., & Podgorelec, V. (2018) · Applied Sciences · doi:10.3390/app8091521 · Cited by 374
Predicting survival from microarray data—a comparative study
Bøvelstad, H. M., Nygård, S., Størvold, H. L., Aldrin, M., Borgan, Ø., Frigessi, A., & Lingjærde, O. C. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm305 · Cited by 318
Filtering for increased power for microarray data analysis
Hackstadt, A. J., & Hess, A. M. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-11 · Cited by 290
Information-Theoretic Feature Selection in Microarray Data Using Variable Complementarity
Meyer, P. E., Schretter, C., & Bontempi, G. (2008) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2008.923858 · Cited by 280
Advances in Neural Information Processing Systems 11 (NIPS 1998)
Giancarlo Ferrari-trecate, A., Williams, C. K. I., & Opper, M. (1999) · The MIT Press eBooks · Cited by 235
Resampling Methods for Meta-Model Validation with Recommendations for Evolutionary Computation
Bischl, B., Mersmann, O., Trautmann, H., & Weihs, C. (2012) · Evolutionary Computation · doi:10.1162/evco_a_00069 · Cited by 186
Feature clustering based support vector machine recursive feature elimination for gene selection
Huang, X., Zhang, L., Wang, B., Li, F., & Zhang, Z. (2017) · Applied Intelligence · doi:10.1007/s10489-017-0992-2 · Cited by 161
Large-scale benchmark study of survival prediction methods using multi-omics data
Herrmann, M., Probst, P., Hornung, R., Jurinović, V., & Boulesteix, A. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa167 · Cited by 161
A Comparative Study on Feature Selection Methods for Drug Discovery
Liu, Y. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci049875d · Cited by 134
Wah, Y. B., Ibrahim, N., Hamid, H. A., et al. (2018) · Pertanika journal of science & technology · Cited by 123
High-Dimensional Regression and Variable Selection Using CAR ScoresPreprint
Zuber, V., & Strimmer, K. (2016) · Cited by 99
Aphinyanaphongs, Y., Fu, L. D., Li, Z., Peskin, E. R., Efstathiadis, E., Aliferis, C., & Statnikov, A. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23110 · Cited by 85
A Comprehensive Comparison on Evolutionary Feature Selection Approaches to Classification
Xue, B., Zhang, M., & Browne, W. N. (2015) · International Journal of Computational Intelligence and Applications · doi:10.1142/s146902681550008x · Cited by 79
Automatic model selection for high-dimensional survival analysis
Lang, M., Kotthaus, H., Marwedel, P., Weihs, C., Rahnenführer, J., & Bischl, B. (2015) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2014.929131 · Cited by 56
Self-citationBatchJobsandBatchExperiments: Abstraction Mechanisms for UsingRin Batch Environments
Bischl, B., Lang, M., Mersmann, O., Rahnenführer, J., & Weihs, C. (2015) · Journal of Statistical Software · doi:10.18637/jss.v064.i11 · Cited by 51
Self-citationDarshan, S. L. S., & Jaidhar, C. D. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2017.12.046 · Cited by 32
Correlation‐adjusted regression survival scores for high‐dimensional variable selection
Welchowski, T., Zuber, V., & Schmid, M. C. (2019) · Statistics in Medicine · doi:10.1002/sim.8116 · Cited by 29
Self-citationBommert, A., Rahnenführer, J., & Lang, M. (2017) · Computational and Mathematical Methods in Medicine · doi:10.1155/2017/7907163 · Cited by 15
Self-citationAdjusted Measures for Feature Selection Stability for Data Sets with Similar Features
Bommert, A., & Rahnenführer, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64583-0_19 · Cited by 14
Self-citationstabm: Stability Measures for Feature Selection
Bommert, A., & Lang, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03010 · Cited by 13
Self-citationDotolo, S., Marabotti, A., Rachiglio, A. M., Abate, R. E., Benedetto, M., Ciardiello, F., Luca, A. D., Normanno, N., Facchiano, A. M., & Tagliaferri, R. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab180 · Cited by 11
mlr3learners: Recommended Learners for 'mlr3'
Lang, M., Au, Q., Coors, S., Schratz, P., Becker, M., & Zobolas, J. (2019) · doi:10.32614/cran.package.mlr3learners · Cited by 8
mlr3pipelines: Preprocessing Operators and Pipelines for 'mlr3'
Binder, M., Pfisterer, F., Schneider, L., et al. (2019) · doi:10.32614/cran.package.mlr3pipelines · Cited by 3
carSurv: Correlation-Adjusted Regression Survival (CARS) Scores
Welchowski, T. (2018) · doi:10.32614/cran.package.carsurv · Cited by 2
Self-citationmlr3filters: Filter Based Feature Selection for 'mlr3'
Becker, M., Schratz, P., Lang, M., et al. (2019) · doi:10.32614/cran.package.mlr3filters · Cited by 2
Harrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4<361::aid-sim168>3.0.co;2-4
Tibshirani (1997) · doi:10.1002/(sici)1097-0258(19970228)16:4<385::aid-sim380>3.0.co;2-3
Research works printed but not linked: 9
- Kittler, 1978, Feature Set Search Algorithms, 41
- Tang, 2014, Feature Selection for Classification: A Review, pages 37–64
- Bommert, 2020, Integration of Feature Selection Stability in Model Fitting
- Kursa, 2020, praznik: Tools for Information-Based Feature Selection
- Yang, 1999, Data visualization and feature selection: New algorithms for nongaussian data, 687
- Meyer, 2006, On the use of variable complementarity for feature selection in cancer classification, 91
- Sonabend, 2020, mlr3proba: Probabilistic Supervised Learning for ‘mlr3’
- Simon, 2011, Regularization paths for Cox’s proportional hazards model via coordinate descent, J Stat Softw, 39, 1, 10.18637/jss.v039.i05 · DOI · Paper page
- Yang, 2020, OrderedList: Similarities of Ordered Gene Lists
Cited by
Data-centric Artificial Intelligence: A Survey
Zha, D., Bhat, Z. P., Lai, K.-H., Yang, F., Jiang, Z., Zhong, S., & Hu, X. (2025) · ACM Computing Surveys · doi:10.1145/3711118 · Cited by 334
Machine Learning for Perovskite Solar Cells and Component Materials: Key Technologies and Prospects
Liu, Y., Tan, X., Liang, J., Han, H., Xiang, P., & Yan, W. (2023) · Advanced Functional Materials · doi:10.1002/adfm.202214271 · Cited by 174
Metadata
- Authors
- Bommert, A., Welchowski, T., Schmid, M., & Rahnenführer, J.
- Affiliations
- TU Dortmund University (DE)
- University of Bonn (DE)
- Corresponding author
- Bommert, Andrea
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-09-08
- Volume
- 23
- Issue
- 1
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- PMC
- PMC8769710
- OpenAlex
- W3196757689
- Cited by
- 182
- References
- 74
- Citations by year
- 2026: 38 · 2025: 34 · 2024: 43 · 2023: 37 · 2022: 30
- FWCI
- 8.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Briefings in Bioinformatics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Deutsche Forschungsgemeinschaft (LiDO3, 271512359, SFB876, SCHM 2966/2-1)
- Technische Universität Dortmund (SFB 876, 271512359)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Keywords
- feature selection, filter methods, gene expression data, survival analysis, high-dimensional data, benchmarking, feature ranking, prediction accuracy, feature selection stability
- MeSH terms
- Algorithms, Gene Expression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.