Cited by 1,127Machine Learning and Data ClassificationAdvanced Neural Network ApplicationsMachine Learning and Algorithms

A comprehensive review on ensemble deep learning: Opportunities and challenges

Open access
Mohammed, Ammar, Kora, Rania·2023·Journal of King Saud University - Computer and Information Sciences

Abstract

In machine learning, two approaches outperform traditional algorithms: ensemble learning and deep learning. The former refers to methods that integrate multiple base models in the same framework to obtain a stronger model that outperforms them. The success of an ensemble method depends on several factors, including how the baseline models are trained and how they are combined. In the literature, there are common approaches to building an ensemble model successfully applied in several domains. On the other hand, deep learning-based models have improved the predictive accuracy of machine learning across a wide range of domains. Despite the diversity of deep learning architectures and their ability to deal with complex problems and the ability to extract features automatically, the main challenge in deep learning is that it requires a lot of expertise and experience to tune the optimal hyper-parameters, which makes it a tedious and time-consuming task. Numerous recent research efforts have been made to approach ensemble learning to deep learning to overcome this challenge. Most of these efforts focus on simple ensemble methods that have some limitations. Hence, this review paper provides comprehensive reviews of the various strategies for ensemble learning, especially in the case of deep learning. Also, it explains in detail the various features or factors that influence the success of ensemble methods. In addition, it presents and accurately categorized several research efforts that used ensemble learning in a wide range of domains.

Integrity signals

Registry

Crossref · 10.1016/j.jksuci.2023.01.014

Cites

203 of 203 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

1 retracted

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Mohammed, A., & Kora, R.
Affiliations
Cairo University (EG)
Corresponding author
  • Mohammed, Ammar
  • Kora, Rania
Venue
Journal of King Saud University - Computer and Information Sciences
Published
2023-02
Volume
35
Issue
2
Pages
757-774
ISSN
1319-1578 (ISSN-L)
OpenAlex
W4318677156
Cited by
1,127
References
203
Citations by year
2026: 238 · 2025: 443 · 2024: 357 · 2023: 88 · 2022: 1
FWCI
105.71
Type
journal article
Language
en
Open access
Locations
  • Journal of King Saud University - Computer and Information Sciences (publishedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Keywords
ensemble deep learning, ensemble learning, deep learning, hyperparameter optimization, deep learning architectures

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review