The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
A Review of Ensemble Methods in Bioinformatics
Abstract
Ensemble learning is an intensively studied technique in machine learning and pattern recognition. Recent work in computational biology has seen an increasing use of ensemble learning methods due to their unique advantages in dealing with small sample size, high-dimensionality, and complex data structures. The aim of this article is two-fold. Firstly, it is to provide a review of the most widely used ensemble learning methods and their application in various bioinformatics problems, including the main topics of gene expression, mass spectrometry-based proteomics, gene-gene interaction identification from genome-wide association studies, and prediction of regulatory elements from DNA and protein sequences. Secondly, we try to identify and summarize future trends of ensemble methods in bioinformatics. Promising directions such as ensemble of support vector machines, meta-ensembles, and ensemble based feature selection are discussed. Keywords: Ensemble learning, bioinformatics, microarray, mass spectrometry-based proteomics, gene-gene interaction, regulatory elements prediction, ensemble of support vector machines, meta ensemble, ensemble feature selection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951 · cited 1×
“For example, stacked generalization [18] combines the base classifiers through a meta-classifier to maximize the generalization.”
MethodMass spectrometry-based proteomics
Aebersold, R., & Mann, M. (2003) · Nature · doi:10.1038/nature01511 · Cited by 6,955
KEGG for linking genomes to life and the environment
Kanehisa, M., Araki, M., Goto, S., Hattori, M., Hirakawa, M., Itoh, M., Katayama, T., Kawashima, S., Okuda, S., Tokimatsu, T., et al. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm882 · Cited by 6,782
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290
A review of feature selection techniques in bioinformatics
Saeys, Y., Inza, I., & Larrañaga, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm344 · Cited by 5,244
Complement factor H polymorphism in age-related macular degeneration
Klein, R. J., Zeiss, C., Chew, E. Y., Tsai, J.-Y., Sackler, R. S., Haynes, C., Henning, A. K., SanGiovanni, J. P., Mane, S. M., Mayne, S. T., et al. (2005) · Science · doi:10.1126/science.1109557 · Cited by 4,492
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
Dietterich, T. G. (2000) · Machine Learning · doi:10.1023/a:1007607513941 · Cited by 2,941
Gene selection and classification of microarray data using random forest
Díaz-Uriarte, R., & Alvarez de Andrés, S. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-3 · Cited by 2,929
Genome-wide association studies for common diseases and complex traits
Hirschhorn, J. N., & Daly, M. J. (2005) · Nature Reviews Genetics · doi:10.1038/nrg1521 · Cited by 2,863
Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
Dudoit, S., Fridlyand, J., & Speed, T. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479248 · Cited by 2,672
Boosting the margin: a new explanation for the effectiveness of voting methods
Bartlett, P., Freund, Y., Lee, W. S., & Schapire, R. E. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691352 · Cited by 2,306
Detecting gene–gene interactions that underlie human diseases
Cordell, H. J. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2579 · Cited by 1,350
Microarray data analysis: from disarray to consolidation and consensus
Allison, D. B., Cui, X., Page, G. P., & Sabripour, M. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1749 · Cited by 1,339 · cited 2×
“Typical high-throughput techniques include using microarray to measure gene expression [2] (Fig.”
MethodArcing classifier (with discussion and a rejoinder by the author)
Breiman, L. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691079 · Cited by 1,105
Machine learning in bioinformatics
Larrañaga, P., Calvo, B., Santana, R., Bielza, C., Galdiano, J., Inza, I., Lozano, J. A., Armañanzas, R., Santafé, G., Pérez, A., et al. (2006) · Briefings in Bioinformatics · doi:10.1093/bib/bbk007 · Cited by 867
Application of majority voting to pattern recognition: an analysis of its behavior and performance
Lam, L., & Suen, S. Y. (1997) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.618255 · Cited by 863
Tissue Classification with Gene Expression Profiles
Ben-Dor, A., Bruhn, L., Friedman, N., Nachman, I., Schummer, M., & Yakhini, Z. (2000) · Journal of Computational Biology · doi:10.1089/106652700750050943 · Cited by 741
Statnikov, A., Wang, L., & Aliferis, C. F. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-319 · Cited by 686
Robust Feature Selection Using Ensemble Feature Selection Techniques
Saeys, Y., Abeel, T., & Van de Peer, Y. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-87481-2_21 · Cited by 663
Is cross-validation valid for small-sample microarray classification?
Braga-Neto, U. M., & Dougherty, E. R. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg419 · Cited by 597
Robust biomarker identification for cancer diagnosis with ensemble feature selection methods
Abeel, T., Helleputte, T., Van de Peer, Y., Dupont, P., & Saeys, Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp630 · Cited by 574
BagBoosting for tumor classification with gene expression data
Dettling, M. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth447 · Cited by 542
Comparison of statistical methods for classification of ovarian cancer using mass spectrometry data
Wu, B., Abbott, T., Fishman, D., McMurray, W., Mor, G., Stone, K., Ward, D., Williams, K., & Zhao, H. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg210 · Cited by 478
Screening large-scale association study data: exploiting interactions using random forests
Lunetta, K. L., Hayward, L. B., Segal, J., & Van Eerdewegh, P. (2004) · BMC Genetics · doi:10.1186/1471-2156-5-32 · Cited by 463
Qu, Y., Adam, B.-L., Yasui, Y., Ward, M. D., Cazares, L. H., Schellhammer, P. F., Feng, Z., Semmes, O. J., & Wright, G. L. (2002) · Clinical Chemistry · doi:10.1093/clinchem/48.10.1835 · Cited by 433
Ensemble machine learning on gene expression data for cancer classification.
Tan, A. C., & Gilbert, D. (2003) · PubMed · Cited by 404
An extensive comparison of recent classification tools applied to microarray data
Lee, J. W., Lee, J. B., Park, M., & Song, S. H. (2005) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2004.03.017 · Cited by 395
Prediction of protein–protein interactions using random decision forest framework
Chen, X.-W., & Liu, M. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti721 · Cited by 382
Identifying SNPs predictive of phenotype using random forests
Bureau, A., Dupuis, J., Falls, K., Lunetta, K. L., Hayward, B., Keith, T. P., & Van Eerdewegh, P. (2005) · Genetic Epidemiology · doi:10.1002/gepi.20041 · Cited by 368
Computational methods for the prediction of protein interactions
Valencia, A., & Pazos, F. (2002) · Current Opinion in Structural Biology · doi:10.1016/s0959-440x(02)00333-0 · Cited by 354
Ensemble classifier for protein fold pattern recognition
Shen, H.-B., & Chou, K.-C. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl170 · Cited by 353
Switching between selection and fusion in combining classifiers: an experiment
Kuncheva, L. I. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.990871 · Cited by 348
Somorjai, R. L., Dolenko, B., & Baumgartner, R. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg182 · Cited by 332
Multistrategy ensemble learning: reducing error by combining ensemble learning techniques
Webb, G. I., & Zheng, Z. (2004) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2004.29 · Cited by 323
Diversity in search strategies for ensemble feature selection
Tsymbal, A., Pechenizkiy, M., & Cunningham, P. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.003 · Cited by 321
Pathways to the analysis of microarray data
Curtis, R. K., Orešič, M., & Vidal-Puig, A. (2005) · Trends in Biotechnology · doi:10.1016/j.tibtech.2005.05.011 · Cited by 308
A random forest approach to the detection of epistatic interactions in case-control studies
Jiang, R., Tang, W., Wu, X., & Fu, W. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s1-s65 · Cited by 306
Computational Detection and Location of Transcription Start Sites in Mammalian Genomic DNA
Down, T. A., & Hubbard, T. J. P. (2002) · Genome Research · doi:10.1101/gr.216102 · Cited by 295
Jiang, H., Deng, Y., Chen, H.-S., Tao, L., Sha, Q., Chen, J., Tsai, C.-J., & Zhang, S. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-81 · Cited by 290
Gama, J., & Brazdil, P. (2000) · Machine Learning · doi:10.1023/a:1007652114878 · Cited by 281
Machine Learning for Detecting Gene-Gene Interactions: A Review
McKinney, B. A., Reif, D. M., Ritchie, M. D., & Moore, J. H. (2006) · Applied Bioinformatics · doi:10.2165/00822942-200605020-00002 · Cited by 254
Yasui, Y. (2003) · Biostatistics · doi:10.1093/biostatistics/4.3.449 · Cited by 254
Pathway analysis using random forests classification and regression
Pang, H., Lin, A., Holford, M., Enerson, B. E., Lu, B., Lawton, M. P., Floyd, E., & Zhao, H. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl344 · Cited by 239
Prediction of glycosylation sites using random forests
Hamby, S. E., & Hirst, J. D. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-500 · Cited by 236
Amaratunga, D., Cabrera, J., & Lee, Y.-S. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn356 · Cited by 228
Wang, S.-Q., Yang, J., & Chou, K.-C. (2006) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2006.05.006 · Cited by 178
Stability and aggregation of ranked gene lists
Boulesteix, A.-L., & Slawski, M. (2009) · Briefings in Bioinformatics · doi:10.1093/bib/bbp034 · Cited by 177
Feature selection and nearest centroid classification for protein mass spectrometry
Levner, I. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-68 · Cited by 172
Glycosylation site prediction using ensembles of Support Vector Machine classifiers
Caragea, C., Sinapov, J., Silvescu, A., Dobbs, D., & Honavar, V. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-438 · Cited by 168
Gene Expression Profile Classification: A Review
Asyalı, M. H., Çolak, D., Demirkaya, O., & Inan, M. S. (2006) · Current Bioinformatics · doi:10.2174/157489306775330615 · Cited by 167
Approaches to dimensionality reduction in proteomic biomarker studies
Hilario, M., & Kalousis, A. (2007) · Briefings in Bioinformatics · doi:10.1093/bib/bbn005 · Cited by 165
Izmirlian, G. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1310.015 · Cited by 162
Liu, B., Cui, Q., Jiang, T., & Ma, S. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-136 · Cited by 158
Predicting gene function in a hierarchical context with an ensemble of classifiers
Guan, Y., Myers, C. L., Hess, D. C., Barutçuoğlu, Z., Caudy, A. A., & Troyanskaya, O. G. (2008) · Genome biology · doi:10.1186/gb-2008-9-s1-s3 · Cited by 150
Tree and spline based association analysis of gene–gene interaction models for ischemic stroke
Cook, N. R., Zee, R. Y. L., & Ridker, P. M. (2004) · Statistics in Medicine · doi:10.1002/sim.1749 · Cited by 146
Proteomic mass spectra classification using decision tree based ensemble methods
Geurts, P., Fillet, M., de Seny, D., Meuwis, M., Malaise, M., Merville, M.-P., & Wehenkel, L. A. (2005) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti494 · Cited by 144
A novel ensemble machine learning for robust microarray data classification
Peng, Y. (2005) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2005.04.001 · Cited by 137
Cell and tumor classification using gene expression data: Construction of forests
Zhang, H., Yu, C., & Singer, B. H. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0230559100 · Cited by 133
Use of classification trees for association studies
Zhang, H., & Bonney, G. E. (2000) · Genetic Epidemiology · Cited by 133
High-resolution human core-promoter prediction with CoreBoost_HM
Wang, X., Xuan, Z., Zhao, X., Li, Y., & Zhang, M. Q. (2008) · Genome Research · doi:10.1101/gr.081638.108 · Cited by 120
Performance of random forest when SNPs are in linkage disequilibrium
Meng, Y., Yu, Y., Cupples, L. A., Farrer, L. A., & Lunetta, K. L. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-78 · Cited by 114
A forest-based approach to identifying gene and gene–gene interactions
Chen, X. '., Liu, C., Zhang, M., & Zhang, H. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0709868104 · Cited by 114
Revealing differences in gene network inference algorithms on the network level by ensemble methods
Altay, G., & Emmert‐Streib, F. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq259 · Cited by 108
Identifying differentially expressed genes from microarray experiments via statistic synthesis
Yang, J. Y. H., Xiao, Y., & Segal, M. R. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bti108 · Cited by 107
Ge, G., & Wong, G. W. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-275 · Cited by 103
Yang, P., Zhou, B. B., Zhang, Z., & Zomaya, A. Y. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-s1-s5 · Cited by 92
Self-citationA genetic programming-based approach to the classification of multiclass microarray datasets
Liu, K., & Xu, C. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn644 · Cited by 83
Netzer, M., Millonig, G., Osl, M., Pfeifer, B. E., Praun, S., Villinger, J., Vogel, W., & Baumgärtner, C. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp093 · Cited by 82
Prediction of protein-protein interaction sites using an ensemble method
Deng, L., Guan, J., Dong, Q., & Zhou, S. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-426 · Cited by 74
A boosting approach for motif modeling using ChIP-chip data
Hong, P., Liu, X. S., Zhou, Q., Lu, X., Liu, J. S., & Wong, W. H. (2005) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti402 · Cited by 61
EMD: an ensemble algorithm for discovering regulatory motifs in DNA sequences
Hu, J., Yang, Y. D., & Kihara, D. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-342 · Cited by 61
Performance of Error Estimators for Classification
Dougherty, E. R., Sima, C., Hua, >., Hanczar, B., & Braga-Neto, U. (2010) · Current Bioinformatics · doi:10.2174/157489310790596385 · Cited by 59
Zeng, J., Zhu, S., & Yan, H. (2009) · Briefings in Bioinformatics · doi:10.1093/bib/bbp027 · Cited by 57
Lee, B. J., Shin, M. S., Oh, Y. J., Oh, H. S., & Ryu, K. H. (2009) · Proteome Science · doi:10.1186/1477-5956-7-27 · Cited by 57
Tree-structured supervised learning and the genetics of hypertension
Huang, J., Lin, A., Narasimhan, B., Quertermous, T., Hsiung, C. A., Ho, L.-T., Grove, J., Olivier, M., Ranade, K., RISCH, N. J., et al. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403794101 · Cited by 54
Long, P. M., & Vega, V. B. (2003) · Machine Learning · doi:10.1023/a:1023937123600 · Cited by 52
MotifVoter: a novel ensemble method for fine-grained integration of generic motif finders
Wijaya, E., Yiu, S., Son, N. T., Kanagasabai, R., & Sung, W.-K. K. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn420 · Cited by 47
Computational analyses of eukaryotic promoters
Zhang, M. Q. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-s6-s3 · Cited by 43
Boosting with stumps for predicting transcription start sites
Zhao, X., Xuan, Z., & Zhang, M. Q. (2007) · Genome biology · doi:10.1186/gb-2007-8-2-r17 · Cited by 41
On consensus biomarker selection
Dutkowski, J., & Gambin, A. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-s5-s5 · Cited by 39
The wisdom of the commons: ensemble tree classifiers for prostate cancer prognosis
Koziol, J. A., Feng, A. C., Jia, Z., Wang, Y., Goodison, S., McClelland, M., & Mercola, D. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn354 · Cited by 39
Statistical methods in genetics
Montana, G. (2006) · Briefings in Bioinformatics · doi:10.1093/bib/bbl028 · Cited by 39
Wu, C.-C., Asgharzadeh, S., Triche, T. J., & D’Argenio, D. Z. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq044 · Cited by 36
A genetic ensemble approach for gene-gene interaction identification
Yang, P., Ho, J. W. K., Zomaya, A. Y., & Zhou, B. B. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-524 · Cited by 31
Self-citationDetecting reliable gene interactions by a hierarchy of Bayesian network classifiers
Armañanzas, R., Inza, I., & Larrañaga, P. (2008) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2008.02.010 · Cited by 29
Yoo, P. D., Ho, Y. S., Zhou, B. B., & Zomaya, A. Y. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-272 · Cited by 27
Yanover, C., Singh, M., & Zaslavsky, E. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp090 · Cited by 24
A framework for probabilistic combination of multiple classifiers at an abstract level
Kang, H.-J., Kim, K., & Kim, J. H. (1997) · Engineering Applications of Artificial Intelligence · doi:10.1016/s0952-1976(97)00020-1 · Cited by 22
Protein structure prediction in genomics
Jones, D. T. (2001) · Briefings in Bioinformatics · doi:10.1093/bib/2.2.111 · Cited by 19
Zhang, Z., Zhang, S., Wong, M.-Y., Wareham, N. J., & Sha, Q. (2008) · Genetic Epidemiology · doi:10.1002/gepi.20304 · Cited by 17
A voting approach to identify a small number of highly predictive genes using multiple classifiers
Hassan, M. R., Hossain, M. M., Bailey, J., Macintyre, G., Ho, J. W. K., & Ramamohanarao, K. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-s1-s19 · Cited by 14
(1996)
Cited by
Ensemble deep learning: A review
Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105151 · Cited by 2,143
Random Forest for Bioinformatics
Qi, Y. (2012) · Ensemble Machine Learning · doi:10.1007/978-1-4419-9326-7_11 · Cited by 754
Zitnik, M., Nguyen, F., Wang, B., Leskovec, J., Goldenberg, A., & Hoffman, M. M. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.012 · Cited by 675
Ren, Y., Zhang, L., & Suganthan, P. N. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471235 · Cited by 675
Efficient Machine Learning for Big Data: A Review
Al-Jarrah, O. Y., Yoo, P. D., Muhaidat, S., Karagiannidis, G. K., & Taha, K. (2015) · Big Data Research · doi:10.1016/j.bdr.2015.04.001 · Cited by 647
Metadata
- Authors
- Yang, P., Hwa Yang, Y., B. Zhou, B., & Y. Zomaya, A.
- Venue
- Current Bioinformatics
- Publisher
- Bentham Science Publishers Ltd.
- Published
- 2010-12-01
- Volume
- 5
- Issue
- 4
- Pages
- 296-308
- ISSN
- 1574-8936 (ISSN-L)
- OpenAlex
- W1996202672
- Cited by
- 503
- References
- 96
- FWCI
- 4.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.