CoChat

A Survey of Predictive Modeling on Imbalanced Domains

Open access
Branco, Paula, Torgo, Luís, Ribeiro, Rita P. · 2017 · ACM Computing Surveys

The DOI matches its Crossref record; 261 of the 266 references it cites were found in a registry or an index.

Abstract

Many real-world data-mining applications involve obtaining predictive models using datasets with strongly imbalanced distributions of the target variable. Frequently, the least-common values of this target variable are associated with events that are highly relevant for end users (e.g., fraud detection, unusual returns on stock markets, anticipation of catastrophes, etc.). Moreover, the events may have different costs and benefits, which, when associated with the rarity of some of them on the available training data, creates serious problems to predictive modeling techniques. This article presents a survey of existing techniques for handling these important applications of predictive analytics. Although most of the existing work addresses classification tasks (nominal target variables), we also describe methods designed to handle similar problems within regression tasks (numeric target variables). In this survey, we discuss the main challenges raised by imbalanced domains, propose a definition of the problem, describe the main approaches to these tasks, propose a taxonomy of the methods, summarize the conclusions of existing comparative studies as well as some theoretical analyses of some methods, and refer to some related problems within predictive modeling.

Overview

Integrity signals

Registry

Crossref · 10.1145/2907070

Cites

261 of 261 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 261 references

Research works printed but not linked: 52

  1. Akbani Rehan, 2004, Machine Learning: ECML
  2. Alejo Roberto, 2013, Rosa Maria Valdovinos, and J. Horacio Pacheco-Sánchez
  3. Alejo Roberto, 2007, Ramón Alberto Mollineda, and José Salvador Sánchez.
  4. Eleuterio Roberto Alejo, 2011, Vicente García Jiménez, and Rosa María Valdovinos Rosas.
  5. Attenberg Josh, Imbalanced Learning: Foundations
  6. Bi Jinbo, Proc. of the 20th Int. Conf. on Machine Learning. 43--50
  7. Branco Paula, Re-sampling Approaches for Regression Tasks under Imbalanced Domains. Master's thesis. Dept. Computer Science
  8. Breiman Leo, 1984, Stone
  9. Chawla Nitesh V., 2003, Bowyer
  10. Chen Chao, 2004, Using random forest to learn imbalanced data
  11. Chyi Yu-Meei, 2003, Department of Information Management
  12. Cieslak David A., 2008, Chawla
  13. Doucette John, 2008, Heywood
  14. Drummond Chris, Workshop on Learning from Imbalanced Datasets II, 11
  15. Elkan Charles, 2001, IJCAI'01: Proc. of 17th Int. Joint Conf. of Artificial Intelligence, 1
  16. Ferri César, 2005, Proceedings of the Second Workshop on ROC Analysis in Machine Learning. 33--40
  17. Ferri César, Proceedings of the 28th International Conference on Machine Learning (ICML-11)
  18. Forman George, 2004, Knowledge Discovery in Databases: PKDD
  19. He Haibo, 2008, IEEE International Joint Conference on Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE, 1322--1328
  20. Holte Robert C., IJCAI, 89
  21. 10.5555/1681514.1682710 · doi:10.5555/1681514.1682710
  22. Japkowicz Nathalie, 2000, AAAI Workshop on Learning from Imbalanced Data Sets, 68
  23. Japkowicz Nathalie, 2003, Workshop on Learning from Imbalanced Data Sets II, 1723
  24. Japkowicz Natalie, Imbalanced Learning: Foundations
  25. Jeatrakul Piyasak, 2010, Kok Wai Wong, and Chun Che Fung
  26. Joshi Mahesh V., Proceedings IEEE International Conference on Data Mining, 2001. ICDM 2001. IEEE, 257--264
  27. Kubat Miroslav, 1997, Proc. of the 14th Int. Conf. on Machine Learning. Morgan Kaufmann, 179--186
  28. Liu Alexander, 2007, Martin
  29. Liu Wei, 2010, Chawla
  30. Maloof Marcus A., 2003, ICML-2003 Workshop on Learning from Imbalanced Data Sets II, 2
  31. Mani Inderjeet, 2003, Proceedings of Workshop on Learning from Imbalanced Datasets.
  32. 10.5555/1314498.1314514 · doi:10.5555/1314498.1314514
  33. Pearson Ronald, 2003, Proceedings of the ICML, 3
  34. Provost Foster J, 1998, ICML'98: Proc. of the 15th Int. Conf. on Machine Learning. Morgan Kaufmann Publishers, 445--453
  35. Raeder Troy, 2012, Chawla
  36. Rita, 2003, Ribeiro and Luís Torgo
  37. Rijsbergen Cornelis V., 1979, Information Retrieval. Dept. of Computer Science
  38. Sánchez-Crisostomo Juan Pablo, 2014, Rosa María Valdovinos, and J. Horacio Pacheco-Sánchez
  39. Sánchez-Monedero Javier, 2013, Pedro Antonio Gutiérrez, and Cesar Hervás-Martínez
  40. Songwattanasiri Panote, 2010, Proceedings of the Annual International Conference on Computer Science Education: Innovation and Technology
  41. Torgo Luís, 2003, Ribeiro
  42. Torgo Luís, 2007, Ribeiro
  43. Wagstaff Kiri L., 2013, Gilmore
  44. Wallace Byron C., 2011 IEEE 11th International Conference on Data Mining (ICDM). IEEE, 754--763
  45. Wang Heng, 2015, Concept drift detection for imbalanced stream data. arXiv Preprint arXiv:1504.01044 · arXiv
  46. Wang Xiaoguang, Advances in Artificial Intelligence
  47. Weiss Gary M., Data Mining
  48. Weiss Gary M., Imbalanced Learning: Foundations
  49. Cheng, Proceedings of the 7th Australasian Data Mining Conference-Volume 87
  50. Wu Gang, ICML 2003 Workshop on Learning from Imbalanced Data Sets II
  51. 10.5555/951949.952181 · doi:10.5555/951949.952181
  52. Zhang Dongmei, 2011, A novel improved SMOTE resampling algorithm based on fractal, J. Comput. Inform. Syst., 7, 2204

Cited by

Items 901–1,000 of 1,000

Metadata

Authors
Branco, P., Torgo, L., & Ribeiro, R. P.
Affiliations
  • Universidade do Porto (PT)
  • LIAAD-INESC TEC, DCC-Faculty of Sciences, University of Porto, Porto, Portugal
Venue
ACM Computing Surveys
Published
2016-08-13
Volume
49
Issue
2
Pages
1-50
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W2490420619
Cited by
1,129
References
266
Citations by year
2026: 101 · 2025: 113 · 2024: 167 · 2023: 167 · 2022: 176 · 2021: 137 · 2020: 96 · 2019: 72 · 2018: 60 · 2017: 37 · 2016: 3
FWCI
47.12
Type
journal article
Language
en
Open access
Locations
  • ACM Computing Surveys (publishedVersion)
  • Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
Funders
  • North Portugal Regional Operational Programme (Project NORTE-07-0124-FEDER-000059)
  • European Regional Development Fund (POCI-01-0145-FEDER-006961)
  • Fundação para a Ciência e a Tecnologia (PD/BD/105788/2014, SFRH/BSAB/113896/2015)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
  • Social Sciences › Business, Management and Accounting › Marketing › Customer churn and segmentation
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
class imbalance, predictive modeling, rare event prediction, cost-sensitive learning, classification, regression analysis, fraud detection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.