The DOI matches its Crossref record; 143 of the 143 references it cites were found in a registry or an index.
Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article]
Abstract
Ensemble methods use multiple models to get better performance. Ensemble methods have been used in multiple research fields such as computational intelligence, statistics and machine learning. This paper reviews traditional as well as state-of-the-art ensemble methods and thus can serve as an extensive summary for practitioners and beginners. The ensemble methods are categorized into conventional ensemble methods such as bagging, boosting and random forest, decomposition methods, negative correlation learning methods, multi-objective optimization based ensemble methods, fuzzy ensemble methods, multiple kernel learning ensemble methods and deep learning based ensemble methods. Variations, improvements and typical applications are discussed. Finally this paper gives some recommendations for future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N.-C., Tung, C. C., & Liu, H. H. (1998) · Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.1998.0193 · Cited by 23,564
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 14,918
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Research works printed but not linked: 50
- busseti, 2012, Deep learning for time series modeling, Tech Rep CS 229
- berg, 2010, Large Scale Visual Recognition Challenge 2010
- qiu, 0, Ensemble deep learning for regression and timeseries forecasting, Proc IEEE Symp Comput Intell Ensemble Learn, 1
- 10.3844/jcssp.2011.387.393 · doi:10.3844/jcssp.2011.387.393
- 10.4249/scholarpedia.2925 · doi:10.4249/scholarpedia.2925
- 10.2116/analsci.24.647 · doi:10.2116/analsci.24.647
- chandra, 0, Multi-objective ensemble construction, learning and evolution, Proc PPSN Workshop Multi-objective Problem Solving from Nature (Part 9th Int Conf Parallel Problem Solving from Nature PPSN-IX), 9
- 10.1109/MCI.2012.2228598 · doi:10.1109/mci.2012.2228598
- 10.1016/j.neucom.2006.04.009 · doi:10.1016/j.neucom.2006.04.009
- 10.1109/FUZZ-IEEE.2013.6622503 · doi:10.1109/fuzz-ieee.2013.6622503
- 10.1007/978-3-642-03040-6_111 · doi:10.1007/978-3-642-03040-6_111
- rakotomamonjy, 2008, SimpleMKL, J Mach Learn Res, 9, 2491
- vezhnevets, 2005, Modest Adaboost-teaching Adaboost to generalize better, Graphicon, 12, 987
- 10.1109/FUZZY.1996.551810 · doi:10.1109/fuzzy.1996.551810
- gopika, 2014, An analysis on ensemble methods in classification tasks, Int J Adv Res Comput Commun Eng, 3, 7423
- 10.1007/s10462-009-9124-7 · DOI · Paper page
- 10.1016/S0165-0114(98)00223-1 · doi:10.1016/s0165-0114(98)00223-1
- 10.1109/FUZZY.2008.4630606 · doi:10.1109/fuzzy.2008.4630606
- 10.1145/2330784.2331010 · doi:10.1145/2330784.2331010
- kondo, 2008, RBF networks ensemble construction based on evolutionary multi-objective optimization, J Adv Comput Intell Inform, 12, 297, 10.20965/jaciii.2008.p0297 · doi:10.20965/jaciii.2008.p0297
- kocev, 2007, Ensembles of Multiobjective Decision Trees
- 10.1016/j.compbiomed.2008.02.007 · doi:10.1016/j.compbiomed.2008.02.007
- 10.1109/CEC.2014.6900552 · doi:10.1109/cec.2014.6900552
- 10.1007/978-3-540-72523-7_46 · doi:10.1007/978-3-540-72523-7_46
- scherer, 2014, Multiple Fuzzy Classification Systems
- 10.1007/11881599_97 · doi:10.1007/11881599_97
- 10.1109/CBMS.2007.43 · doi:10.1109/cbms.2007.43
- fu, 2013, Ensemble learning algorithm in classification of fuzzy-classes*, J Comput Inform Syst, 9, 8929
- 10.1109/GEFS.2008.4484560 · doi:10.1109/gefs.2008.4484560
- 10.1007/3-540-45105-6_117 · doi:10.1007/3-540-45105-6_117
- 10.1109/HIS.2006.264942 · doi:10.1109/his.2006.264942
- feely, 2000, Predicting stock market volatility using neural networks
- 10.1109/ICSMC.2011.6083928 · doi:10.1109/icsmc.2011.6083928
- freund, 0, Experiments with a new boosting algorithm, Proc Int Conf Machine Learning, 96, 148
- lanckriet, 2004, Learning the kernel matrix with semidefinite programming, J Mach Learn Res, 5, 27
- 10.1109/CIEL.2013.6613137 · doi:10.1109/ciel.2013.6613137
- 10.1109/TKDE.2007.190671 · doi:10.1109/tkde.2007.190671
- 10.1109/ICNC.2010.5583605 · doi:10.1109/icnc.2010.5583605
- zhang, 2012, Wind power short-term forecasting based on empirical mode decomposition and chaotic phase space reconstruction, Automation of Electronic Power Systems, 36, 24
- 10.1109/TSMCC.2007.905847 · doi:10.1109/tsmcc.2007.905847
- 10.1109/CIEL.2014.7015741 · doi:10.1109/ciel.2014.7015741
- brown, 2005, Managing diversity in regression ensembles, J Mach Learn Res, 6, 1621
- 10.1109/CSO.2011.50 · doi:10.1109/cso.2011.50
- 10.1016/S1004-4132(06)60093-5 · doi:10.1016/s1004-4132(06)60093-5
- pisetta, 2012, New insights into decision tree ensembles
- chen, 0, Evolutionary multiobjective ensemble learning based on Bayesian feature selection, Proc IEEE Congr Evolutionary Computation, 267
- 10.1109/CSO.2012.195 · doi:10.1109/cso.2012.195
- 10.1007/978-3-540-24581-0_47 · doi:10.1007/978-3-540-24581-0_47
- 10.1007/978-3-642-25832-9_20 · doi:10.1007/978-3-642-25832-9_20
- 10.1109/CSO.2009.307 · doi:10.1109/cso.2009.307
Cited by
Sagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103
A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects
Mienye, I. D., & Sun, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3207287 · Cited by 1,298
Global monitoring of antimicrobial resistance based on metagenomics analyses of urban sewage
Hendriksen, R. S., Munk, P., Njage, P., van Bunnik, B., McNally, L., Lukjancenko, O., Röder, T., Nieuwenhuijse, D., Pedersen, S. K., Kjeldgaard, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-08853-3 · Cited by 1,199
Shen, S., Sadoughi, M., Li, M., Wang, Z., & Hu, C. (2020) · Applied Energy · doi:10.1016/j.apenergy.2019.114296 · Cited by 537
Radiomics in breast cancer classification and prediction
Conti, A., Duggento, A., Indovina, I., Guerrisi, M., & Toschi, N. (2021) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2020.04.002 · Cited by 386
Metadata
- Authors
- Ren, Y., Zhang, L., & Suganthan, P. N.
- Venue
- IEEE Computational Intelligence Magazine
- Published
- 2016-02
- Volume
- 11
- Issue
- 1
- Pages
- 41-53
- ISSN
- 1556-603X (ISSN-L)
- OpenAlex
- W2244486986
- Cited by
- 675
- References
- 143
- FWCI
- 51.18
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article]. https://app.cochat.ai/papers/10.1109/mci.2015.2471235
- The paper
- Ren, Y., Zhang, L., & Suganthan, P. N. (2016). Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article]. IEEE Computational Intelligence Magazine. https://doi.org/10.1109/mci.2015.2471235
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
