The DOI matches its Crossref record; 254 of the 254 references it cites were found in a registry or an index.
Ensemble deep learning: A review
Open accessAbstract
Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning models combine the advantages of both the deep learning models as well as the ensemble learning such that the final model has better generalization performance. This paper reviews the state-of-art deep ensemble models and hence serves as an extensive summary for the researchers. The ensemble models are broadly categorised into bagging, boosting, stacking, negative correlation based deep ensemble models, explicit/implicit ensembles, homogeneous/heterogeneous ensemble, decision fusion strategies based deep ensemble models. Applications of deep ensemble models in different domains are also briefly discussed. Finally, we conclude this paper with some potential future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–254 of 254
Heterogeneous Ensemble for Default Prediction of Peer-to-Peer Lending in China
Li, W., Ding, S., Chen, Y., & Yang, S. (2018) · IEEE Access · doi:10.1109/access.2018.2810864 · Cited by 67
Improved heart disease detection from ECG signal using deep learning based ensemble model
Rath, A., Mishra, D., Panda, G., Satapathy, S. C., & Xia, K. (2022) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2022.100732 · Cited by 67
(2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72523-7 · Cited by 67
Ju, C., Combs, M., Lendle, S., Franklin, J. M., Wyss, R., Schneeweiß, S., & van der Laan, M. J. (2019) · Journal of Applied Statistics · doi:10.1080/02664763.2019.1582614 · Cited by 64
Deep Additive Least Squares Support Vector Machines for Classification With Model Transfer
Wang, G., Zhang, G., Choi, K., & Jie Lu, B. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2759090 · Cited by 64
Sharma, A., & Rani, R. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.08.011 · Cited by 62
Sparse Deep Stacking Network for Image Classification
Li, J., Chang, H., & Yang, J. J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9786 · Cited by 60
Human Protein Subcellular Localization with Integrated Source and Multi-label Ensemble Classifier
Guo, X., Liu, F., Ju, Y., Wang, Z., & Wang, C. (2016) · Scientific Reports · doi:10.1038/srep28087 · Cited by 60
Duan, F., & Dai, L. (2016) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2593693 · Cited by 60
Diversity creation methods: a survey and categorisation
BROWN, G. (2004) · Information Fusion · doi:10.1016/s1566-2535(04)00037-5 · Cited by 56
Hierarchical Ensemble Clustering
Zheng, L., Li, T., & Ding, C. H. Q. (2010) · Proceedings · doi:10.1109/icdm.2010.98 · Cited by 55
Multi-label ensemble based on variable pairwise constraint projection
Li, P., Li, H., & Wu, M. (2012) · Information Sciences · doi:10.1016/j.ins.2012.07.066 · Cited by 53
Transductive multi-label ensemble classification for protein function prediction
Yu, G., Domeniconi, C., Rangwala, H., Zhang, G., & Yu, Z. (2012) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339700 · Cited by 51
Ganaie, M. A., & Tanveer, M. (2022) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2022.3170351 · Cited by 51
Self-citationCortes, C., Mohri, M., & Syed, U. (2014) · International Conference on Machine Learning · Cited by 49
On building ensembles of stacked denoising auto-encoding classifiers and their further improvement
Alvear-Sandoval, R. F., & Figueiras-Vidal, A. R. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.03.008 · Cited by 49
Hutchinson, B., Deng, L., & Yu, D. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6288994 · Cited by 46
Semi-supervised ensemble classification in subspaces
Yu, G., Zhang, G., Yu, Z., Domeniconi, C., You, J., & Han, G. (2012) · Applied Soft Computing · doi:10.1016/j.asoc.2011.12.019 · Cited by 46
Novel genetic-based negative correlation learning for estimating soil temperature
Kazemi, S. M., Bidgoli, B. M., Shamshirband, S., Karimi, S. M., Ghorbani, M. A., Chau, K., & Pour, R. K. (2018) · Engineering Applications of Computational Fluid Mechanics · doi:10.1080/19942060.2018.1463871 · Cited by 46
Tabik, S., Alvear-Sandoval, R. F., Ruiz, M. M., Sancho‐Gómez, J., Figueiras-Vidal, A. R., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.04.002 · Cited by 45
A survey of neural network ensembles
Zhao, Y., Gao, J., & Yang, X. (2006) · International Conference on Neural Networks and Brain · doi:10.1109/icnnb.2005.1614650 · Cited by 44
SVM-Based Deep Stacking Networks
Wang, J., Feng, K., & Wu, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015273 · Cited by 44
Liu, J., Zhao, S., & Wang, G. (2017) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2017.10.003 · Cited by 41
Random features for Kernel Deep Convex Network
Huang, P.-S., Deng, L., Hasegawa‐Johnson, M., & He, X. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638237 · Cited by 40
Incremental Ensemble Learning for Electricity Load Forecasting
(2016) · Acta Polytechnica Hungarica · doi:10.12700/aph.13.2.2016.2.6 · Cited by 40
Online Active Learning Paired Ensemble for Concept Drift and Class Imbalance
Zhang, H., Liu, W., Shan, J., & Liu, Q. (2018) · IEEE Access · doi:10.1109/access.2018.2882872 · Cited by 39
A Deep Learning Approach to Unsupervised Ensemble LearningPreprint
Shaham, U., Cheng, X., Dror, O., Jaffe, A., Nadler, B., Chang, J. T., & Kluger, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02285 · Cited by 38
Deep ensemble neural-like P systems for segmentation of central serous chorioretinopathy lesion
Xue, J., Wang, Z., Kong, D., Wang, Y., Liu, X., Fan, W., Yuan, S., Niu, S., & Li, D. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.08.016 · Cited by 37
Semi-Supervised Deep Coupled Ensemble Learning With Classification Landmark Exploration
Li, J., Wu, S., Liu, C., Yu, Z., & Wong, H. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2933724 · Cited by 35
Ensembles of Neural Networks for Robust Reinforcement Learning
Hans, A., & Udluft, S. (2010) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.66 · Cited by 34
Gradual DropIn of Layers to Train Very Deep Neural Networks
Smith, L. N., Hand, E., & Doster, T. J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.515 · Cited by 34
ieRSPOP: A novel incremental rough set-based pseudo outer-product with ensemble learning
Das, R. T., Ang, K. K., & Quek, C. H. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.04.015 · Cited by 34
Mosca, A., & Magoulas, G. D. (2018) · EPiC series in computing · doi:10.29007/qlvr · Cited by 34
Ensemble Network Architecture for Deep Reinforcement Learning
Chen, X., Cao, L., Li, C., et al. (2018) · Mathematical Problems in Engineering · doi:10.1155/2018/2129393 · Cited by 34
An evolutionary approach to build ensembles of multi-label classifiers
Moyano, J. M., Gibaja, E., Cios, K. J., & Ventura, S. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.11.013 · Cited by 33
Grasp for Stacking via Deep Reinforcement Learning
Zhang, J., Zhang, W., Song, R., Ma, L., & Li, Y. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197508 · Cited by 33
UESTS: An Unsupervised Ensemble Semantic Textual Similarity Method
Hassan, B., Abdelrahman, S., Bahgat, R., & Farag, I. (2019) · IEEE Access · doi:10.1109/access.2019.2925006 · Cited by 32
Unsupervised Ensemble Strategy for Retinal Vessel Segmentation
Liu, B., Gu, L., & Lu, F. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32239-7_13 · Cited by 32
Incremental Learning by Heterogeneous Bagging Ensemble
Zhao, Q., Jiang, Y., & Xu, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17313-4_1 · Cited by 31
Selective negative correlation learning approach to incremental learning
Tang, K., Lin, M., Minku, F. L., & Yao, X. (2009) · Neurocomputing · doi:10.1016/j.neucom.2008.09.022 · Cited by 29
A framework for parameter estimation and model selection in kernel deep stacking networks
Welchowski, T., & Schmid, M. C. (2016) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2016.04.002 · Cited by 28
EnAET: Self-Trained Ensemble AutoEncoding Transformations for Semi-Supervised Learning.Preprint
Wang, X., Kihara, D., Luo, J., & Qi, G.-J. (2019) · arXiv (Cornell University) · Cited by 28
Ahn, E., Kumar, A., Feng, D. D., FULHAM, M. J., & Kim, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03359 · Cited by 26
Generalized Negative Correlation Learning for Deep EnsemblingPreprint
Buschjäger, S., Pfahler, L., & Morik, K. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02952 · Cited by 26
Two Novel On-policy Reinforcement Learning Algorithms based on TD(λ)-methods
Wiering, M., & van Hasselt, H. P. (2007) · doi:10.1109/adprl.2007.368200 · Cited by 24
Visual Representation and Classification by Learning Group Sparse Deep Stacking Network
Li, J., Chang, H., Yang, J. J., Luo, W. H., & Fu, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2765833 · Cited by 20
Kang, T., Chen, P., Quackenbush, J. F., & Ding, W. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403184 · Cited by 15
Recurrent Deep-Stacking Networks for sequence classification
Palangi, H., Deng, L., & Ward, R. K. (2014) · doi:10.1109/chinasip.2014.6889295 · Cited by 9
Residual Networks Behave Like Boosting Algorithms
Siu, C. (2019) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2019.00017 · Cited by 9
HiBsteR: Hierarchical Boosted Deep Metric Learning for Image Retrieval
Waltner, G., Opitz, M., Possegger, H., & Bischof, H. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00069 · Cited by 8
(1996)
Cited by
Recent advances and applications of deep learning methods in materials science
Choudhary, K., DeCost, B., Chen, C., Jain, A., Tavazza, F., Cohn, R., Park, C. W., Choudhary, A., Agrawal, A., Billinge, S. J. L., et al. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00734-6 · Cited by 1,172
Khan, A. A., Chaudhari, O., & Chandra, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122778 · Cited by 530
Comprehensive review on twin support vector machines
Tanveer, M., Rajani, T., Rastogi, R., Shao, Y. H., & Ganaie, M. A. (2024) · Annals of Operations Research · doi:10.1007/s10479-022-04575-w · Cited by 297
Self-citationForecast combinations: An over 50-year review
Wang, X., Hyndman, R. J., Li, F., & Kang, Y. (2023) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.11.005 · Cited by 280
Kim, J., Kim, H., Kim, H., Lee, D., & Yoon, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11223-9 · Cited by 263
Metadata
- Authors
- Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N.
- Venue
- Engineering Applications of Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2022-10
- Volume
- 115
- Pages
- 105151
- ISSN
- 0952-1976 (ISSN-L)
- OpenAlex
- W3149839747
- Cited by
- 2,143
- References
- 254
- FWCI
- 143.31
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.