The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Robust biomarker identification for cancer diagnosis with ensemble feature selection methods
Open accessAbstract
Motivation: Biomarker discovery is an important topic in biomedical applications of computational biology, including applications such as gene and SNP selection from high-dimensional data. Surprisingly, the stability with respect to sampling variation or robustness of such selection processes has received attention only recently. However, robustness of biomarkers is an important issue, as it may greatly influence subsequent biological validations. In addition, a more robust set of markers may strengthen the confidence of an expert in the results of a selection method. Results: Our first contribution is a general framework for the analysis of the robustness of a biomarker selection algorithm. Secondly, we conducted a large-scale analysis of the recently introduced concept of ensemble feature selection, where multiple feature selections are combined in order to increase the robustness of the final set of selected features. We focus on selection methods that are embedded in the estimation of support vector machines (SVMs). SVMs are powerful classification models that have shown state-of-the-art performance on several diagnosis and prognosis tasks on biological data. Their feature selection extensions also offered good results for gene selection tasks. We show that the robustness of SVMs for biomarker discovery can be substantially increased by using ensemble feature selection techniques, while at the same time improving upon classification performances. The proposed methodology is evaluated on four microarray datasets showing increases of up to almost 30% in robustness of the selected biomarkers, along with an improvement of ∼15% in classification performance. The stability improvement with ensemble methods is particularly noticeable for small signature sizes (a few tens of genes), which is most relevant for the design of a diagnosis or prognosis model from a gene signature. Contact: yvan.saeys@psb.ugent.be Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,708
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., et al. (1999) · Science · doi:10.1126/science.286.5439.531 · Cited by 11,516
Gene selection for cancer classification using support vector machines
Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002) · Machine Learning · doi:10.1023/a:1012487302797 · Cited by 9,954
Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling
Alizadeh, A. A., Eisen, M. B., Davis, R. E., Ma, C., Lossos, I. S., Rosenwald, A., Boldrick, J. C., Sabet, H., Tran, T., Yu, X., et al. (2000) · Nature · doi:10.1038/35000501 · Cited by 9,925
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Cited by
A survey on feature selection methods
Chandrashekar, G., & Sahin, F. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.024 · Cited by 5,189
Feature Selection: A Data Perspective
Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R. P., Tang, J., & Liu, H. (2018) · ACM Computing Surveys · doi:10.1145/3136625 · Cited by 2,442
“Most of the existing methods employ a simple yet effective linear aggregation function (Saeys et al. 2008; Abeel et al. 2010; Yang and Mao 2011).”
MethodDisentangling type 2 diabetes and metformin treatment signatures in the human gut microbiota
MetaHIT consortium, Forslund, K., Hildebrand, F., Nielsen, T., Falony, G., Le Chatelier, E., Sunagawa, S., Prifti, E., Vieira-Silva, S., Gudmundsdottir, V., et al. (2015) · Nature · doi:10.1038/nature15766 · Cited by 2,116
Feature selection in machine learning: A new perspective
Cai, J., Luo, J., Wang, S., & Yang, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.11.077 · Cited by 2,061
Applications of Support Vector Machine (SVM) Learning in Cancer Genomics
(2018) · Cancer Genomics & Proteomics · doi:10.21873/cgp.20063 · Cited by 1,528
Feature Selection: A Data Perspective
Li, J., Cheng, K., Wang, S., Morstatter, F., Treviño, R. P., Tang, J., & Liu, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.07996 · Cited by 739
A review of microarray datasets and applied feature selection methods
Bolón-Canedo, V., Sánchez-Maroño, N., Alonso-Betanzos, A., Benítez, J. M., & Herrera, F. (2014) · Information Sciences · doi:10.1016/j.ins.2014.05.042 · Cited by 666
Supervised, Unsupervised, and Semi-Supervised Feature Selection: A Review on Gene Selection
Ang, J. C., Mirzal, A., Haron, H., & Hamed, H. N. A. (2016) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2015.2478454 · Cited by 641
Stability of feature selection algorithm: A review
Khaire, U. M., & Dhanalakshmi, R. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.06.012 · Cited by 630
Ensembles for feature selection: A review and future trends
Bolón-Canedo, V., & Alonso-Betanzos, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.008 · Cited by 541
A Review of Ensemble Methods in Bioinformatics
Yang, P., Hwa Yang, Y., B. Zhou, B., & Y. Zomaya, A. (2010) · Current Bioinformatics · doi:10.2174/157489310794072508 · Cited by 503
Enhancer-promoter interactions are encoded by complex genomic signatures on looping chromatin
Whalen, S., Truty, R. M., & Pollard, K. S. (2016) · Nature Genetics · doi:10.1038/ng.3539 · Cited by 456
Recent advances in feature selection and its applications
Li, Y., Li, T., & Liu, H. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1059-8 · Cited by 400
“For example, in [29], an ensemble feature selection method is adopted to identify biomarker for cancer diagnosis.”
MethodHaury, A.-C., Gestraud, P., & Vert, J.-P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028210 · Cited by 392
Ensemble deep learning in bioinformatics
Cao, Y., Geddes, T. A., Yang, J. Y. H., & Yang, P. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0217-y · Cited by 354
Stable feature selection for biomarker discovery
He, Z., & Yu, W. (2010) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2010.07.002 · Cited by 309
Zwanenburg, A. (2019) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-019-04391-8 · Cited by 306
Ensemble feature selection: Homogeneous and heterogeneous approaches
Seijo-Pardo, B., Porto-Díaz, I., Bolón-Canedo, V., & Alonso-Betanzos, A. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.11.017 · Cited by 300
Gruson, D., Helleputte, T., Rousseau, P., & Gruson, D. (2019) · Clinical Biochemistry · doi:10.1016/j.clinbiochem.2019.04.013 · Cited by 125
Self-citationPhosphosignature predicts dasatinib response in non-small cell lung cancer
Klammer, M., Kaminski, M., Zedler, A., Oppermann, F., Blencke, S., Marx, S., Müller, S., Tebbe, A., Godl, K., & Schaab, C. (2012) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m111.016410 · Cited by 118
Neuromarkers for Mental Disorders: Harnessing Population Neuroscience
Jollans, L., & Whelan, R. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00242 · Cited by 56
“Bootstrap aggregation (bagging) has previously been used with large genetic datasets, and showed significant improvements over standard (non-bagged) methods in terms of model accuracy and stability (74).”
MethodUnveiling new disease, pathway, and gene associations via multi-scale neural network
Gaudelet, T., Malod-Dognin, N., Sánchez-Valle, J., Pancaldi, V., Valencia, A., & Pržulj, N. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231059 · Cited by 25
Metadata
- Authors
- Abeel, T., Helleputte, T., Van de Peer, Y., Dupont, P., & Saeys, Y.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-11-25
- Volume
- 26
- Issue
- 3
- Pages
- 392-398
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2117004913
- Cited by
- 574
- References
- 28
- FWCI
- 9.12
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.