The DOI matches its Crossref record; 254 of the 254 references it cites were found in a registry or an index.
Ensemble deep learning: A review
Open accessAbstract
Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning models combine the advantages of both the deep learning models as well as the ensemble learning such that the final model has better generalization performance. This paper reviews the state-of-art deep ensemble models and hence serves as an extensive summary for the researchers. The ensemble models are broadly categorised into bagging, boosting, stacking, negative correlation based deep ensemble models, explicit/implicit ensembles, homogeneous/heterogeneous ensemble, decision fusion strategies based deep ensemble models. Applications of deep ensemble models in different domains are also briefly discussed. Finally, we conclude this paper with some potential future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2014) · Cited by 33,419
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · Cited by 14,134
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
DeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951 · cited 4×
“The concept of stacking or stacked regression was initially given by [77].”
BackgroundMethodInfluentialThe random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,506
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Multi-column deep neural networks for image classification
Ciresan, D., Meier, U., & Schmidhuber, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248110 · Cited by 3,720
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“Ambiguity decomposition was given for single dataset based ensemble methods, later on, multiple dataset bias-variance-covariance decomposition was introduced in [27, 28, 29, 30] and is given as:”
MethodDeep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Sagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103
Rokach, L. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-009-9124-7 · Cited by 2,657
Multi-Label Classification: An Overview
Tsoumakas, G., & Katakis, I. (2007) · International Journal of Data Warehousing and Mining · doi:10.4018/jdwm.2007070101 · Cited by 2,508
2013 IEEE Conference on Computer Vision and Pattern Recognition
(2013) · doi:10.1109/cvpr19808.2013 · Cited by 2,396
Boosting the margin: a new explanation for the effectiveness of voting methods
Bartlett, P., Freund, Y., Lee, W. S., & Schapire, R. E. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691352 · Cited by 2,306
Classifier chains for multi-label classification
Read, J., Pfahringer, B., Holmes, G., & Frank, E. (2011) · Machine Learning · doi:10.1007/s10994-011-5256-5 · Cited by 2,289
Deep Networks with Stochastic Depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104
(2013) · Cited by 2,056
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00117832 · Cited by 1,912
The Theory and Practice of Online Learning
(2008) · Athabasca University Press eBooks · doi:10.15215/aupress/9781897425084.01 · Cited by 1,841
Neural Network Ensembles, Cross Validation, and Active Learning
Krogh, A., & Vedelsby, J. (1994) · Cited by 1,838
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Temporal Ensembling for Semi-Supervised Learning
Laine, S., & Aila, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02242 · Cited by 1,395
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06228 · Cited by 1,246
Artificial Intelligence and Statistics
Ziegel, E. (1989) · Technometrics · doi:10.1080/00401706.1989.10488504 · Cited by 1,217
Learning and generalization characteristics of the random vector functional-link net
Pao, Y.-H., Park, G.-H., & Sobajic, D. J. (1994) · Neurocomputing · doi:10.1016/0925-2312(94)90053-1 · Cited by 1,138
Arcing classifier (with discussion and a rejoinder by the author)
Breiman, L. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691079 · Cited by 1,105
Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding
Sutton, R. S. (1995) · Cited by 1,072
Semi-Supervised Learning (Chapelle, O. et al., Eds.; 2006) [Book reviews]
Chapelle, O., Scholkopf, B., & Zien, E. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2015974 · Cited by 1,066
On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality
Friedman, J. H. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009778005914 · Cited by 1,040
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2012
Müller, A., Sejdinović, D., & Piechocki, R. J. (2012) · Cited by 1,027
Proceedings of the twenty-first international conference on Machine learning
Brodley, C. E. (2004) · Cited by 1,020
Diversity creation methods: a survey and categorisation
Brown, G., Wyatt, J., Harris, R., & Yao, X. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.004 · Cited by 985
Learn++: an incremental learning algorithm for supervised neural networks
Polikar, R., Upda, L., Upda, S. S., & Honavar, V. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.983933 · Cited by 888
Tao, D., Tang, X., Li, X., & Wu, X. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.134 · Cited by 879
Random k-Labelsets: An Ensemble Method for Multilabel Classification
Tsoumakas, G., & Vlahavas, I. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74958-5_38 · Cited by 871
Residual networks behave like ensembles of relatively shallow networks
Veit, A., Wilber, M. J., & Belongie, S. (2016) · neural information processing systems · Cited by 851
Ali, F., El-Sappagh, S., Islam, S. M. R., Kwak, D., Ali, A., Imran, M., & Kwak, K.-S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.008 · Cited by 818
2010 IEEE International Conference on Data Mining
(2010) · doi:10.1109/icdm17440.2010 · Cited by 779
2020 IEEE International Conference on Robotics and Automation (ICRA)
(2020) · doi:10.1109/icra40945.2020 · Cited by 761
2018 International Joint Conference on Neural Networks (IJCNN)
(2018) · doi:10.1109/ijcnn40505.2018 · Cited by 746
The Loss Surfaces of Multilayer Networks
Choromanska, A., Henaff, M., Mathieu, M., Arous, G. B., & LeCun, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.0233 · Cited by 733
Ensemble learning via negative correlation
Liu, Y., & Yao, X. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00073-8 · Cited by 712
(2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2417514 · Cited by 706
Residual Networks Behave Like Ensembles of Relatively Shallow Networks
Veit, A., Wilber, M., & Belongie, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06431 · Cited by 705
Ren, Y., Zhang, L., & Suganthan, P. N. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471235 · Cited by 675
Self-citationEnsemble approaches for regression: A survey
Mendes-Moreira, J., Soares, C., Jorge, A. M., & Sousa, J. F. D. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379786 · Cited by 667
The Power of Ensembles for Active Learning in Image Classification
Beluch, W. H., Genewein, T., Nurnberger, A., & Kohler, J. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00976 · Cited by 655
Bias plus variance decomposition for zero-one loss functions
Kohavi, R., & Wolpert, D. H. (1996) · Cited by 652
Deep Stacked Hierarchical Multi-Patch Network for Image Deblurring
Zhang, H., Dai, Y., Li, H., & Koniusz, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00613 · Cited by 652
Facial Expression Recognition via a Boosted Deep Belief Network
Liu, P., Han, S., Meng, Z., & Tong, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.233 · Cited by 650
A SURVEY OF CLUSTERING ENSEMBLE ALGORITHMS
VEGA-PONS, S., & RUIZ-SHULCLOPER, J. (2011) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001411008683 · Cited by 609
Bühlmann, P., & Yu, B. (2002) · The Annals of Statistics · doi:10.1214/aos/1031689014 · Cited by 602
Generalizing Pooling Functions in CNNs: Mixed, Gated, and Tree
Lee, C., Gallagher, P., & Tu, Z. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2703082 · Cited by 582
González, S., García, S., Del Ser, J., Rokach, L., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.007 · Cited by 582
Oza, N. C. (2006) · 2005 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2005.1571498 · Cited by 569
Grassmann, F., Mengelkamp, J., Brandl, C., Harsch, S., Zimmermann, M. E., Linkohr, B., Peters, A., Heid, I. M., Palm, C., & Weber, B. H. F. (2018) · Ophthalmology · doi:10.1016/j.ophtha.2018.02.037 · Cited by 549
Credit Card Fraud Detection Using AdaBoost and Majority Voting
Randhawa, K. K., Loo, C. K., Seera, M., Lim, C. P., & Nandi, A. K. (2018) · IEEE Access · doi:10.1109/access.2018.2806420 · Cited by 545
2019 IEEE Congress on Evolutionary Computation (CEC)
(2019) · doi:10.1109/cec44084.2019 · Cited by 504
A Review of Ensemble Methods in Bioinformatics
Yang, P., Hwa Yang, Y., B. Zhou, B., & Y. Zomaya, A. (2010) · Current Bioinformatics · doi:10.2174/157489310794072508 · Cited by 503
Identifying suspicious URLs: an application of large-scale online learning
Ma, J., Saul, L. K., Savage, S., & Voelker, G. M. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553462 · Cited by 498
2016 23rd International Conference on Pattern Recognition (ICPR)
(2016) · doi:10.1109/icpr40739.2016 · Cited by 476
Twenty-Ninth AAAI Conference on Artificial Intelligence
Albrecht, S. V., Crandall, J. W., & Ramamoorthy, R. (2015) · National Conference on Artificial Intelligence · Cited by 464
Empirical Mode Decomposition based ensemble deep learning for load demand time series forecasting
Qiu, X., Ren, Y., Suganthan, P. N., & Amaratunga, G. A. J. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.01.015 · Cited by 450
Self-citationThe Impact of Diversity on Online Ensemble Learning in the Presence of Concept Drift
Minku, L. L., White, A. P., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.156 · Cited by 440
Ensemble methods for wind and solar power forecasting—A state-of-the-art review
Ren, Y., Suganthan, P. N., & Srikanth, N. (2015) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.04.081 · Cited by 435
Self-citationHIBAG—HLA genotype imputation with attribute bagging
Zheng, X., Shen, J., Cox, C., Wakefield, J. C., Ehm, M. G., Nelson, M. R., & Weir, B. S. (2014) · The Pharmacogenomics Journal · doi:10.1038/tpj.2013.18 · Cited by 424
Recognition of emotions using multimodal physiological signals and an ensemble deep learning model
Yin, Z., Zhao, M., Wang, Y., Yang, J., & Zhang, J. (2017) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.12.005 · Cited by 416
Cao, Z., Pan, X., Yang, Y., Huang, Y., & Shen, H.-B. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty085 · Cited by 403
Li, Y., Song, Y., Jia, L., Gao, S., Li, Q., & Qiu, M. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3008010 · Cited by 399
Sentiment classification: The contribution of ensemble learning
Wang, G., Sun, J., Ma, J., Xu, K., & Gu, J. (2014) · Decision Support Systems · doi:10.1016/j.dss.2013.08.002 · Cited by 379
Critical limitations of consensus clustering in class discovery
Șenbabaoğlu, Y., Michailidis, G., & Li, J. Z. (2014) · Scientific Reports · doi:10.1038/srep06207 · Cited by 379
Ju, C., Bibaut, A., & van der Laan, M. (2018) · Journal of Applied Statistics · doi:10.1080/02664763.2018.1441383 · Cited by 374
Locally Weighted Ensemble Clustering
Huang, D., Wang, C.-D., & Lai, J.-H. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2702343 · Cited by 371
Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing
Xu, J., Chen, L., & Ren, S. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2725277 · Cited by 368 · cited 1×
“With the limitation of getting the complete data in real-world problems, online/incremental learning has been applied to various tasks like learning social representations [174], fog computing [175], identifying suspicious URLs [176], etc.”
MethodEnsemble deep learning for regression and time series forecasting
Qiu, X., Zhang, L., Ren, Y., Suganthan, P., & Amaratunga, G. (2014) · 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL) · doi:10.1109/ciel.2014.7015739 · Cited by 368
Self-citationError-Correcting Output Coding Corrects Bias and Variance
Kong, E. B., & Dietterich, T. G. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50046-3 · Cited by 365
Limits on the majority vote accuracy in classifier fusion
Kuncheva, L. I., Whitaker, C. J., Shipp, C. A., & Duin, R. P. W. (2003) · Pattern Analysis & Applications · doi:10.1007/s10044-002-0173-7 · Cited by 356
Application of Credit Card Fraud Detection: Based on Bagging Ensemble Classifier
Zareapoor, M., & Shamsolmoali, P. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.04.201 · Cited by 355
Ensemble deep learning in bioinformatics
Cao, Y., Geddes, T. A., Yang, J. Y. H., & Yang, P. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0217-y · Cited by 354
Managing Diversity in Regression Ensembles
Brown, G., Wyatt, J., & Peter Tiňo, B. (2005) · Research Explorer (The University of Manchester) · doi:10.5555/1046920.1194899 · Cited by 336
Diverse ensembles for active learning
Melville, P., & Mooney, R. J. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015385 · Cited by 319
Convolutional Channel Features
Yang, B., Yan, J., Lei, Z., & Li, S. Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.18 · Cited by 301
Ensemble feature selection: Homogeneous and heterogeneous approaches
Seijo-Pardo, B., Porto-Díaz, I., Bolón-Canedo, V., & Alonso-Betanzos, A. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.11.017 · Cited by 300
AdaNet: Adaptive Structural Learning of Artificial Neural NetworksPreprint
Cortes, C., Gonzalvo, X., Kuznetsov, V., Mohri, M., & Yang, S. (2016) · International Conference on Machine Learning · doi:10.48550/arxiv.1607.01097 · Cited by 299
Learning to Count with CNN Boosting
Walach, E., & Wolf, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_41 · Cited by 294
Combining Estimates in Regression and Classification
Leblanc, M., & Tibshirani, R. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476733 · Cited by 290
Random vector functional link neural network based ensemble deep learning
Shi, Q., Katuwal, R., Suganthan, P. N., & Tanveer, M. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107978 · Cited by 286
Self-citationCrowd Counting with Deep Negative Correlation Learning
Shi, Z., Zhang, L., Liu, Y., Cao, X., Ye, Y., Cheng, M.-M., & Zheng, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00564 · Cited by 283
Randomizing Outputs to Increase Prediction Accuracy
Breiman, L. (2000) · Machine Learning · doi:10.1023/a:1007682208299 · Cited by 276
Zhou, Z.-H., Chawla, N. V., Jin, Y., & Williams, G. J. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2350953 · Cited by 275
Adaboost-based security level classification of mobile intelligent terminals
Wang, F., Jiang, D., Wen, H., & Song, H. (2019) · The Journal of Supercomputing · doi:10.1007/s11227-019-02954-y · Cited by 270
Ensemble of CNN for multi-focus image fusion
Amin-Naji, M., Aghagolzadeh, A., & Ezoji, M. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.02.003 · Cited by 269
Constructing diverse classifier ensembles using artificial training examples
Melville, P., & Mooney, R. J. (2003) · Cited by 263
2019 IEEE Winter Conference on Applications of Computer Vision (WACV)
(2019) · doi:10.1109/wacv43230.2019 · Cited by 260
Chen, G., Ye, D., Xing, Z., Chen, J., & Cambria, E. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966144 · Cited by 255
The ensemble deep learning model for novel COVID-19 on CT images
Zhou, T., Lu, H., Yang, Z., Qiu, S., Huo, B., & Dong, Y. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106885 · Cited by 254
Ensemble deep learning for speech recognition
Deng, L., & Platt, J. C. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-433 · Cited by 248
Hothorn, T., Lausen, B., Benner, A., & Radespiel‐Tröger, M. (2004) · Statistics in Medicine · doi:10.1002/sim.1593 · Cited by 246
Das, A. K., Ghosh, S., Thunder, S., Dutta, R., Agarwal, S., & Chakrabarti, A. (2021) · Pattern Analysis and Applications · doi:10.1007/s10044-021-00970-4 · Cited by 238
Roughly balanced bagging for imbalanced data
Hido, S., Kashima, H., & Takahashi, Y. (2009) · Statistical Analysis and Data Mining: The ASA Data Science Journal · doi:10.1002/sam.10061 · Cited by 227
Machine Learning Proceedings 1995
(1995) · Elsevier eBooks · doi:10.1016/c2009-0-27705-1 · Cited by 226
Neighbourhood sampling in bagging for imbalanced data
Błaszczyński, J., & Stefanowski, J. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.07.064 · Cited by 211
Random vector functional link network: Recent developments, applications, and future directions
Malik, A. K., Gao, R., Ganaie, M. A., Tanveer, M., & Suganthan, P. N. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110377 · Cited by 211
Self-citationScalable stacking and learning for building deep architectures
Deng, L., Yu, D., & Platt, J. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288333 · Cited by 210
Zhou, Z.-H., & Tang, W. (2006) · Knowledge-Based Systems · doi:10.1016/j.knosys.2005.11.003 · Cited by 210
Muhlbaier, M. D., Topalis, A., & Polikar, R. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2008326 · Cited by 207
Sparse Deep Stacking Network for Fault Diagnosis of Motor
Sun, C., Ma, M., Zhao, Z., & Chen, X. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2819674 · Cited by 202
Predicting gene function using hierarchical multi-label decision tree ensembles
Schietgat, L., Vens, C., Struyf, J., Blockeel, H., Kocev, D., & Džeroski, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-2 · Cited by 198
Deep reinforcement learning for automated stock trading: an ensemble strategy
Yang, H., Liu, X.-Y., Zhong, S., & Walid, A. (2020) · Proceedings of the First ACM International Conference on AI in Finance · doi:10.1145/3383455.3422540 · Cited by 196 · cited 2×
“2020 Deep reinforcement learning for automated stock trading: An ensemble strategy[171] Reinforcement learning Stock trading agency”
MethodPredicting drug side effects by multi-label learning and ensemble learning
Zhang, W., Liu, F., Luo, L., & Zhang, J. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0774-y · Cited by 187
Ensemble Algorithms in Reinforcement Learning
Wiering, M. A., & van Hasselt, H. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.920231 · Cited by 185
Rai, H. M., & Chatterjee, K. (2022) · Applied Intelligence · doi:10.1007/s10489-021-02696-6 · Cited by 182
gifani, P., Shalbaf, A., & Vafaeezadeh, M. (2021) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02286-w · Cited by 181
Tanveer, M., Rashid, A. H., Ganaie, M. A., Reza, M., Razzak, I., & Hua, K.-L. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3083274 · Cited by 176
Self-citationBranchOut: Regularization for Online Ensemble Tracking with Convolutional Neural Networks
Han, B., Sim, J., & Adam, H. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.63 · Cited by 172
Exploiting unlabeled data in ensemble methods
Bennett, K. P., Demiriz, A., & Maclin, R. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775090 · Cited by 171
Improved short-term load forecasting using bagged neural networks
Khwaja, A. S., Naeem, M., Anpalagan, A., Venetsanopoulos, A., & Venkatesh, B. (2015) · Electric Power Systems Research · doi:10.1016/j.epsr.2015.03.027 · Cited by 171
Martín, A., Lara-Cabrera, R., & Camacho, D. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.12.006 · Cited by 170
Gencay, R., & Qi, M. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.935086 · Cited by 169
A Unifeid Bias-Variance Decomposition and its Applications
Domingos, P. (2000) · International Conference on Machine Learning · Cited by 167
Qiu, X., Suganthan, P. N., & Amaratunga, G. A. J. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.01.015 · Cited by 166
Self-citationHutchinson, B., Deng, L., & Yu, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.268 · Cited by 165
RotBoost: A technique for combining Rotation Forest and AdaBoost
Zhang, C.-X., & Zhang, J.-S. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.03.006 · Cited by 165
Variance and Bias for General Loss Functions
James, G. M. (2003) · Machine Learning · doi:10.1023/a:1022899518027 · Cited by 160
Singla, P., Duhan, M., & Saroha, S. (2021) · Earth Science Informatics · doi:10.1007/s12145-021-00723-1 · Cited by 159
Ensemble clustering using factor graph
Huang, D., Lai, J., & Wang, C. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.08.015 · Cited by 155
Liu, H., Liu, T., Wu, J., Tao, D., & Fu, Y. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783287 · Cited by 154
Bagging Survival TreesPreprint
Hothorn, T., Lausen, B., Benner, A., & Radespiel‐Tröger, M. (2002) · SSRN Electronic Journal · Cited by 153
Deep convex net: a scalable architecture for speech pattern classification
Deng, L., & Yu, D. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-607 · Cited by 152
Stacked Extreme Learning Machines
Zhou, H., Huang, G.-B., Lin, Z., Wang, H., & Soh, Y. C. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2363492 · Cited by 151
Towards deeper understanding: Deep convex networks for semantic utterance classification
Tür, G., Deng, L., Hakkani-Tür, D. Z., & He, X. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6289054 · Cited by 143
Kleinberg, E. M. (1990) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/bf01531079 · Cited by 143
Sukegawa, S., Fujimura, A., Taguchi, A., Yamamoto, N., Kitamura, A., Goto, R., Nakano, K., Takabatake, K., Kawai, H., Nagatsuka, H., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-10150-x · Cited by 142
Wang, X., Kihara, D., Luo, J., & Qi, G.-J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3044220 · Cited by 141
Support Vector Machine Ensemble with Bagging
Kim, H., Pang, S., Je, H.-M., Kim, D., & Bang, S.-Y. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45665-1_31 · Cited by 138
BIER — Boosting Independent Embeddings Robustly
Opitz, M., Waltner, G., Possegger, H., & Bischof, H. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.555 · Cited by 138
Nonlinear Regression via Deep Negative Correlation Learning
Zhang, L., Shi, Z., Cheng, M., Liu, Y., Bian, J.-W., Zhou, J. T., Guoyan Zheng, A., & Zeng, Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2943860 · Cited by 138
Boosted Convolutional Neural Networks
Moghimi, M. K., Belongie, S., Saberian, M., Yang, J. W., Vasconcelos, N. M., & Li, L.-J. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.24 · Cited by 136
A multi-layer and multi-ensemble stock trader using deep learning and deep reinforcement learning
Carta, S., Corriga, A., Ferreira, A., Podda, A. S., & Recupero, D. R. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01839-5 · Cited by 136
Chen, W., Pradhan, B., Li, S., et al. (2019) · Natural Resources Research · doi:10.1007/s11053-019-09465-w · Cited by 133
Incremental Boosting Convolutional Neural Network for Facial Action Unit RecognitionPreprint
Han, S., Meng, Z., Khan, A.-S., & Tong, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05395 · Cited by 129
Deep Boosting for Image Denoising
Chen, C., Xiong, Z., Tian, X., & Wu, F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_1 · Cited by 126
Swapout: Learning an ensemble of deep architecturesPreprint
Singh, S., Hoiem, D., & Forsyth, D. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06465 · Cited by 124
An Ensemble-Based Incremental Learning Approach to Data Fusion
Parikh, D., & Robi Polikar, A. (2007) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2006.883873 · Cited by 122
Alami, N., Meknassi, M., & En-Nahnahi, N. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.01.037 · Cited by 120
A novel deep stacking least squares support vector machine for rolling bearing fault diagnosis
Li, X., Yang, Y., Pan, H., et al. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.05.005 · Cited by 119
Stacked autoencoder based deep random vector functional link neural network for classification
Katuwal, R., & Suganthan, P. N. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105854 · Cited by 118
Self-citationUse of kernel deep convex networks and end-to-end learning for spoken language understanding
Deng, L., Tür, G., He, X., & Hakkani-Tür, D. Z. (2012) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424224 · Cited by 115
Deep Reinforcement Learning for Automated Stock Trading: An Ensemble StrategyPreprint
Yang, H., Liu, X.-Y., Zhong, S., & Walid, A. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3690996 · Cited by 115
Wolpert, D. H. (1997) · Neural Computation · doi:10.1162/neco.1997.9.6.1211 · Cited by 113
Real-World Image Denoising with Deep Boosting
Chen, C., Xiong, Z., Tian, X., Zha, Z.-J., & Wu, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2921548 · Cited by 110
Multi-label classification with weighted classifier selection and stacked ensemble
Xia, Y., Chen, K., & Yang, Y. (2020) · Information Sciences · doi:10.1016/j.ins.2020.06.017 · Cited by 110
Response models based on bagging neural networks
Ha, K.-N., Cho, S., & MacLachlan, D. L. (2005) · Journal of Interactive Marketing · doi:10.1002/dir.20028 · Cited by 108
Lepton spectra as a measure of b quark polarization at LEP
Mele, B., & Altarelli, G. (1993) · Physics Letters B · doi:10.1016/0370-2693(93)90272-j · Cited by 108
31st International Conference on Machine Learning, ICML 2014
Sejdinović, D., Strathmann, H., Lomelí, M., Andrieu, C., & Gretton, A. (2014) · International Conference on Machine Learning · Cited by 107
Deep Learning‐ and Word Embedding‐Based Heterogeneous Classifier Ensembles for Text Classification
Kilimci, Z. H., & Akyokuş, S. (2018) · Complexity · doi:10.1155/2018/7130146 · Cited by 107
DeL-IoT: A deep ensemble learning approach to uncover anomalies in IoT
Tsogbaatar, E., Bhuyan, M. H., Taenaka, Y., Fall, D., Gonchigsumlaa, K., Elmroth, E., & Kadobayashi, Y. (2021) · Internet of Things · doi:10.1016/j.iot.2021.100391 · Cited by 107
MRI segmentation fusion for brain tumor detection
Cabria, I., & Gondra, I. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.10.003 · Cited by 105
Infinite Ensemble for Image Clustering
Liu, H., Shao, M., Li, S., & Fu, Y. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939813 · Cited by 103
Ensemble-based deep reinforcement learning for chatbots
Cuayáhuitl, H., Lee, D., Ryu, S., Cho, Y. J., Choi, S., Indurthi, S., Yu, S., Choi, H., Hwang, I.-C., & Kim, J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.08.007 · Cited by 99
When Semi-supervised Learning Meets Ensemble Learning
Zhou, Z. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02326-2_53 · Cited by 96
Liu, F., Xu, F., & Yang, S. (2017) · IEEE International Conference on Multimedia Big Data · doi:10.1109/bigmm.2017.29 · Cited by 96
Pruning an ensemble of classifiers via reinforcement learning
Partalas, I., Tsoumakas, G., & Vlahavas, I. P. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.06.007 · Cited by 94
Deep stacking networks for information retrieval
Deng, L., He, X., & Gao, J. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638239 · Cited by 87
On diversity and accuracy of homogeneous and heterogeneous ensembles
Bian, S., & Wang, W. (2007) · International Journal of Hybrid Intelligent Systems · doi:10.3233/his-2007-4204 · Cited by 86
Wang, B., Xue, B., & Zhang, M. (2020) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec48606.2020.9185541 · Cited by 86
Horizontal and Vertical Ensemble with Deep Representation for ClassificationPreprint
Xie, J., Xu, B., & Chuang, Z. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.2759 · Cited by 86
A case study on bagging, boosting and basic ensembles of neural networks for OCR
Mao, J. (2002) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1998.687135 · Cited by 81
An ensemble based data fusion approach for early diagnosis of Alzheimer’s disease
Robi Polikar, A., Topalis, A., Parikh, D., Green, D., Frymiare, J. L., Kounios, J., & Clark, C. M. (2006) · Information Fusion · doi:10.1016/j.inffus.2006.09.003 · Cited by 77
Gao, Z., Wang, L., Soroushmehr, S. M. R., Wood, A., Gryak, J., Nallamothu, B. K., & Najarian, K. (2022) · BMC Medical Imaging · doi:10.1186/s12880-022-00734-4 · Cited by 76
Deep ensemble learning-based approach to real-time power system state estimation
Bhusal, N., Shukla, R. M., Gautam, M., Benidris, M., & Sengupta, S. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.106806 · Cited by 75
Stacking-Based Deep Neural Network: Deep Analytic Network for Pattern Classification
Low, C.-Y., Park, J., & Teoh, A. B. J. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2908387 · Cited by 74
A new ensemble convolutional neural network with diversity regularization for fault diagnosis
Wen, L., Xie, X., Li, X., & Gao, L. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.12.002 · Cited by 70
Snapshot boosting: a fast ensemble framework for deep neural networks
Zhang, W., Jiang, J., Shao, Y., & Cui, B. (2019) · Science China Information Sciences · doi:10.1007/s11432-018-9944-x · Cited by 69
Heterogeneous Ensemble for Default Prediction of Peer-to-Peer Lending in China
Li, W., Ding, S., Chen, Y., & Yang, S. (2018) · IEEE Access · doi:10.1109/access.2018.2810864 · Cited by 67
Cited by
Recent advances and applications of deep learning methods in materials science
Choudhary, K., DeCost, B., Chen, C., Jain, A., Tavazza, F., Cohn, R., Park, C. W., Choudhary, A., Agrawal, A., Billinge, S. J. L., et al. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00734-6 · Cited by 1,172
Khan, A. A., Chaudhari, O., & Chandra, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122778 · Cited by 530
Comprehensive review on twin support vector machines
Tanveer, M., Rajani, T., Rastogi, R., Shao, Y. H., & Ganaie, M. A. (2024) · Annals of Operations Research · doi:10.1007/s10479-022-04575-w · Cited by 297
Self-citationForecast combinations: An over 50-year review
Wang, X., Hyndman, R. J., Li, F., & Kang, Y. (2023) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.11.005 · Cited by 280
Kim, J., Kim, H., Kim, H., Lee, D., & Yoon, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11223-9 · Cited by 263
Metadata
- Authors
- Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N.
- Venue
- Engineering Applications of Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2022-10
- Volume
- 115
- Pages
- 105151
- ISSN
- 0952-1976 (ISSN-L)
- OpenAlex
- W3149839747
- Cited by
- 2,143
- References
- 254
- FWCI
- 143.31
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.