The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
The Influence of Feature Selection Methods on Accuracy, Stability and Interpretability of Molecular Signatures
Open accessAbstract
Biomarker discovery from high-dimensional data is a crucial problem with enormous applications in biology and medicine. It is also extremely challenging from a statistical viewpoint, but surprisingly few studies have investigated the relative strengths and weaknesses of the plethora of existing feature selection methods. In this study we compare 32 feature selection methods on 4 public gene expression datasets for breast cancer prognosis, in terms of predictive performance, stability and functional interpretability of the signatures they produce. We observe that the feature selection method has a significant influence on the accuracy, stability and interpretability of signatures. Surprisingly, complex wrapper and embedded methods generally do not outperform simple univariate feature selection methods, and ensemble feature selection has generally no positive effect. Overall a simple Student's t-test seems to provide the best results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954 · cited 1×
“We test SVM recursive feature elimination (RFE) ( Guyon et al. , 2002), which starts with all variables and iteratively removes the variables which contribute least to a linear SVM classifier trained on the current set of variables.”
MethodWrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer
Wang, Y., Klijn, J. G., Zhang, Y., Sieuwerts, A. M., Look, M. P., Yang, F., Talantov, D., Timmermans, M., Meijer-van Gelder, M. E., Yu, J., et al. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17947-1 · Cited by 2,846
Online Learning for Matrix Factorization and Sparse Coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.0050 · Cited by 2,258
Meinshausen, N., & Bühlmann, P. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00740.x · Cited by 2,215
Sotiriou, C., Wirapati, P., Loi, S., Harris, A., Fox, S., Smeds, J., Nordgren, H., Farmer, P., Praz, V., Haibe-Kains, B., et al. (2006) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djj052 · Cited by 2,063
Evolving gene/transcript definitions significantly alter the interpretation of GeneChip data
Dai, M. (2005) · Nucleic Acids Research · doi:10.1093/nar/gni179 · Cited by 1,797
Gene-Expression Signatures in Breast Cancer
Sotiriou, C., & Pusztai, L. (2009) · New England Journal of Medicine · doi:10.1056/nejmra0801289 · Cited by 1,485
Selection bias in gene extraction on the basis of microarray gene-expression data
Ambroise, C., & McLachlan, G. J. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.102102699 · Cited by 1,480
A new method to measure the semantic similarity of GO terms
Wang, J. Z., Du, Z., Payattakool, R., Yu, P. S., & Chen, C.-F. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm087 · Cited by 1,377 · cited 2×
“…from each signature the list of 10 GO terms with the smallest p-values, and compared the two lists of GO terms by the similarity measure of Wang et al. (2007) which takes into account not only the overlap between the lists but also the relationships between GO BP. Finally, to assess the…”
MethodConcordance among Gene-Expression–Based Predictors for Breast Cancer
Fan, C., Oh, D. S., Wessels, L., Weigelt, B., Nuyten, D. S. A., Nobel, A. B., van't Veer, L. J., & Perou, C. M. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa052933 · Cited by 1,341
NCBI GEO: archive for high-throughput functional genomic data
Barrett, T., Troup, D. B., Wilhite, S. E., Ledoux, P., Rudnev, D., Evangelista, C., Kim, I. F., Soboleva, A., Tomashevsky, M., Marshall, K. A., et al. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn764 · Cited by 1,041
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025
Pitfalls in the Use of DNA Microarray Data for Diagnostic and Prognostic Classification
Simon, R., Radmacher, M. D., Dobbin, K., & McShane, L. M. (2003) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/95.1.14 · Cited by 1,006
Wirapati, P., Sotiriou, C., Kunkel, S., Farmer, P., Pradervand, S., Haibe-Kains, B., Desmedt, C., Ignatiadis, M., Sengstag, T., Schütz, F., et al. (2008) · Breast Cancer Research · doi:10.1186/bcr2124 · Cited by 891
Pawitan, Y., Bjöhle, J., Amler, L., Borg, A.-L., Egyhazi, S., Hall, P., Han, X., Holmberg, L., Huang, F., Klaar, S., et al. (2005) · Breast Cancer Research · doi:10.1186/bcr1325 · Cited by 831
Outcome signature genes in breast cancer: is there a unique set?
Ein-Dor, L., Kela, I., Getz, G., Givol, D., & Domany, E. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bth469 · Cited by 802
Genetic Reclassification of Histologic Grade Delineates New Clinical Subtypes of Breast Cancer
Ivshina, A. V., George, J., Senko, O., Mow, B., Putti, T. C., Smeds, J., Lindahl, T., Pawitan, Y., Hall, P., Nordgren, H., et al. (2006) · Cancer Research · doi:10.1158/0008-5472.can-05-4414 · Cited by 752
Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer
Ein-Dor, L., Zuk, O., & Domany, E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601231103 · Cited by 689
Robust biomarker identification for cancer diagnosis with ensemble feature selection methods
Abeel, T., Helleputte, T., Van de Peer, Y., Dupont, P., & Saeys, Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp630 · Cited by 574
Dimensionality Reduction via Sparse Support Vector Machines
Bi, J., Bennett, K. P., Embrechts, M. J., Breneman, C. M., Song, M., Guyon, I., & Elisseeff, A. (2003) · Cited by 407
Microarrays and molecular research: noise discovery?
Ioannidis, J. P. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17878-7 · Cited by 287
Reyal, F., van Vliet, M. H., Armstrong, N. J., Horlings, H. M., de Visser, K. E., Kok, M., Teschendorff, A. E., Mook, S., Veer, L. V. ‘., Caldas, C., et al. (2008) · Breast Cancer Research · doi:10.1186/bcr2192 · Cited by 142
Lai, C., Reinders, M. J. T., Veer, L. J. V., & Wessels, L. F. A. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-235 · Cited by 129
Abraham, G., Kowalczyk, A., Loi, S., Haviv, I., & Zobel, J. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-277 · Cited by 102
Predicting prognosis of breast cancer with gene signatures: are we lost in a sea of data?
Iwamoto, T., & Pusztai, L. (2010) · Genome Medicine · doi:10.1186/gm202 · Cited by 52
Outcome signature genes in breast cancer: is there a unique set?
Kela, I., Ein‐Dor, L., Getz, G. A., Givol, D., & Domany, E. (2005) · Breast Cancer Research · doi:10.1186/bcr1168 · Cited by 48
Shi, W., Bessarabova, M., Dosymbekov, D., Dezső, Z., Nikolskaya, T., Dudoladova, M., Serebryiskaya, T., Bugrim, A. E., Guryanov, A., Brennan, R., et al. (2010) · The Pharmacogenomics Journal · doi:10.1038/tpj.2010.35 · Cited by 45
Pathway analysis reveals functional convergence of gene expression profiles in breast cancer
Shen, R., Chinnaiyan, A. M., & Ghosh, D. (2008) · BMC Medical Genomics · doi:10.1186/1755-8794-1-28 · Cited by 41
Cited by
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
Correlation and variable importance in random forests
Gregorutti, B., Michel, B., & Saint-Pierre, P. (2017) · Statistics and Computing · doi:10.1007/s11222-016-9646-1 · Cited by 1,073
Machine Learning methods for Quantitative Radiomic Biomarkers
Parmar, C., Grossmann, P., Bussink, J., Lambin, P., & Aerts, H. J. W. L. (2015) · Scientific Reports · doi:10.1038/srep13087 · Cited by 1,019
Deep learning in cancer diagnosis, prognosis and treatment selection
Tran, K. A., Kondrashova, O., Bradley, A., Williams, E. D., Pearson, J. V., & Waddell, N. (2021) · Genome Medicine · doi:10.1186/s13073-021-00968-x · Cited by 932
Stability of feature selection algorithm: A review
Khaire, U. M., & Dhanalakshmi, R. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.06.012 · Cited by 630
Metadata
- Authors
- Haury, A.-C., Gestraud, P., & Vert, J.-P.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-12-21
- Volume
- 6
- Issue
- 12
- Pages
- e28210
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2146739527
- Cited by
- 392
- References
- 35
- FWCI
- 7.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.