Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 2,938

The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.

Ensemble based systems in decision making

Polikar, R. · 2006 · IEEE Circuits and Systems Magazine

Abstract

In matters of great importance that have financial, medical, social, or other implications, we often seek a second opinion before making a decision, sometimes a third, and sometimes many more. In doing so, we weigh the individual opinions, and combine them through some thought process to reach a final decision that is presumably the most informed one. The process of consulting "several experts" before making a final decision is perhaps second nature to us; yet, the extensive benefits of such a process in automated decision making applications have only recently been discovered by computational intelligence community. Also known under various other names, such as multiple classifier systems, committee of classifiers, or mixture of experts, ensemble based systems have shown to produce favorable results compared to those of single-expert systems for a broad range of applications and under a variety of scenarios. Design, implementation and application of such systems are the main topics of this article. Specifically, this paper reviews conditions under which ensemble based systems may be more beneficial than their single classifier counterparts, algorithms for generating individual components of the ensemble systems, and various procedures through which the individual classifiers can be combined. We discuss popular ensemble based algorithms, such as bagging, boosting, AdaBoost, stacked generalization, and hierarchical mixture of experts; as well as commonly used combination rules, including algebraic combination of outputs, voting based techniques, behavior knowledge space, and decision templates. Finally, we look at current and future research directions for novel applications of ensemble systems. Such applications include incremental learning, data fusion, feature selection, learning with missing features, confidence estimation, and error correcting output codes; all areas in which ensemble systems have shown great promise

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/mcas.2006.1688199

Cites

76 of 76 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 22

  1. 10.1109/IJCNN.2004.1380080 · DOI
  2. 10.1016/S0167-6393(03)00032-3 · doi:10.1016/s0167-6393(03)00032-3
  3. 10.1016/0165-0114(94)90023-X · doi:10.1016/0165-0114(94)90023-x
  4. grim, 2001, Information analysis of multiple classifier fusion, Proc 1st Int Workshop on Multiple Classifier Systems, 2096, 168, 10.1007/3-540-48219-9_17 · doi:10.1007/3-540-48219-9_17
  5. 10.1016/S0165-0114(99)00161-X · doi:10.1016/s0165-0114(99)00161-x
  6. 10.1007/BF00117809 · doi:10.1007/bf00117809
  7. 10.1007/11494683_33 · doi:10.1007/11494683_33
  8. 10.1109/72.501737 · doi:10.1109/72.501737
  9. chawla, 2002, Distributed pasting of small votes, Proc 1st Int Workshop on Multiple Classifier Systems, 2364, 52, 10.1007/3-540-45428-4_5 · doi:10.1007/3-540-45428-4_5
  10. ayad, 2005, Cluster-Based Cumulative Ensembles, 6th Int Workshop on Multiple Classifier Sys, 3541, 236, 10.1007/11494683_24 · doi:10.1007/11494683_24
  11. smith, 2005, Decoding Rules for Error Correcting Output Code Ensembles, 6th Int Workshop on Multiple Classifier Sys, 3541, 53, 10.1007/11494683_6 · doi:10.1007/11494683_6
  12. rajan, 2004, Lecture Notes in Computer Science, 3077, 283, 10.1007/978-3-540-25966-4_28 · DOI
  13. strehl, 2002, Cluster Ensembles-? Knowledge Reuse Framework for Combining Multiple Partitions, Journal of Machine Learning Research, 3, 583
  14. 10.1007/BF00118940 · doi:10.1007/bf00118940
  15. 10.2307/2348873 · doi:10.2307/2348873
  16. 10.1016/0167-8655(93)90046-G · doi:10.1016/0167-8655(93)90046-g
  17. 10.1109/ICSMC.2004.1399793 · doi:10.1109/icsmc.2004.1399793
  18. 10.1109/IGARSS.2001.976668 · doi:10.1109/igarss.2001.976668
  19. 10.1177/002029400103400802 · doi:10.1177/002029400103400802
  20. 10.1109/ICPR.2004.1334133 · doi:10.1109/icpr.2004.1334133
  21. 10.1109/IJCNN.2003.1223406 · doi:10.1109/ijcnn.2003.1223406
  22. authors, 2005, Proceedings of International Workshop on Multiple Classifier Systems (2000-2005)

Cited by

See all 2,938

Metadata

Authors
Polikar, R.
Venue
IEEE Circuits and Systems Magazine
Published
2006
Volume
6
Issue
3
Pages
21-45
ISSN
  • 0163-6812 (ISSN-L)
  • 1531-636X
OpenAlex
W2167917621
Cited by
2,938
References
76
FWCI
60.09
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.