The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Learning from imbalanced data: open challenges and future directions
Open accessAbstract
Despite more than two decades of continuous development learning from imbalanced data is still a focus of intense research. Starting as a problem of skewed distributions of binary tasks, this topic evolved way beyond this conception. With the expansion of machine learning and data mining, combined with the arrival of big data era, we have gained a deeper insight into the nature of imbalanced learning, while at the same time facing new emerging challenges. Data-level and algorithm-level methods are constantly being improved and hybrid approaches gain increasing popularity. Recent trends focus on analyzing not only the disproportion between classes, but also other difficulties embedded in the nature of data. New real-life problems motivate researchers to focus on computationally efficient, adaptive and real-time methods. This paper aims at discussing open issues and challenges that need to be addressed to further develop the field of imbalanced learning. Seven vital areas of research in this topic are identified, covering the full spectrum of learning from imbalanced data: classification, regression, clustering, data streams, big data analytics and applications, e.g., in social media and computer vision. This paper provides a discussion and suggestions concerning lines of future research for each of them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Limited data sample size causes biased prediction due to impartiality and incompleteness in the dataset [64].”
From Artificial intelligence bias in medical system designs: a systematic review (2023) · cites this paper as [64]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It has been well-documented that machine learning training is severely impaired by imbalanced class sizes (Krawczyk, 2016; Johnson and Khoshgoftaar, 2020).”
From Deep Learning-Based Extreme Heatwave Forecast (2022) · cites this paper as Krawczyk, 2016
Experimental — accuracy not yet measuredIn the citing paper
“On the other hand, there is a shortage of data for large river systems (in HYDRoSWOT), resulting in less training data for the machine learning model (Krawczyk, 2016).”
From Enhancing River Channel Dimension Estimation: A Machine Learning Approach Leveraging the National Water Model, Hydrographic Networks, and Landscape Characteristics (2024) · cites this paper as Krawczyk, 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 1×
“Therefore, more advanced methods were proposed that try to maintain structures of groups and/or generate new data according to underlying distributions [9].”
MethodHe, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521 · cited 1×
“This way wemay vary the level of oversampling according to example types (first idea can be tracked to ADASYN method that ignored safe examples [23]) or supervise the undersampling procedure in order not to discard the important minority representatives.”
MethodThe class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295 · cited 1×
“This domain is known as learning from imbalanced data [29].”
BackgroundGalar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794 · cited 2×
“[17], an indepth insight into imbalanced data characteristics by López et al.”
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
CLASSIFICATION OF IMBALANCED DATA: A REVIEW
SUN, Y., WONG, A. K. C., & KAMEL, M. S. (2009) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001409007326 · Cited by 1,692 · cited 2×
“Binary classification problems can be considered as the most developed branch of learning from imbalanced data [51].”
BackgroundLópez, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590 · cited 1×
“[36] and discussion on new perspectives for evaluation classifiers on skewed datasets [42] deserve mentioning.”
BackgroundData Preprocessing in Data Mining
García, S., Luengo, J., & Herrera, F. (2015) · Intelligent Systems Reference Library · doi:10.1007/978-3-319-10247-4 · Cited by 1,368
Vehicle detection in aerial imagery : A small target detection benchmark
Razakarivony, S., & Jurie, F. (2016) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.11.002 · Cited by 916 · cited 1×
“Target detection [45] Classification of specified targets appearing with varied frequency (multi-class problem)”
Background
Cited by
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
“…networks, and medical diagnosis), providing a novel and contemporaneous set of challenges to the machine learning and data science researchers (Krawczyk, 2016; Haixiang et al., 2017; Maua & Galinac Grbac, 2017; Zhang et al., 2017; Zuo et al., 2016; Lichtenwalter et al., 2010; Krawczyk et al.,…”
BackgroundLuque, A., Carrasco, A., Martín, A., & de las Heras, A. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.02.023 · Cited by 1,128
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
“It has been more studied in this static framework and many new algorithms have already been introduced, for their comprehensive review see the recent monograph [73] or surveys [72,101,172] .”
Self-citationHyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., et al. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1484 · Cited by 930
Metadata
- Authors
- Krawczyk, B.
- Affiliations
- Wrocław University of Science and Technology (PL)
- Corresponding author
- Krawczyk, Bartosz
- ORCID
- Krawczyk, Bartosz
- Venue
- Progress in Artificial Intelligence
- Published
- 2016-04-22
- Volume
- 5
- Issue
- 4
- Pages
- 221-232
- ISSN
- 2192-6352 (ISSN-L)
- 2192-6360
- OpenAlex
- W2338318698
- Cited by
- 2,459
- References
- 70
- Citations by year
- 2026: 233 · 2025: 299 · 2024: 340 · 2023: 337 · 2022: 340 · 2021: 343 · 2020: 240 · 2019: 167 · 2018: 104 · 2017: 53 · 2016: 2
- FWCI
- 89.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Progress in Artificial Intelligence (publishedVersion, cc-by)
- Funders
- Polish National Science Center (DEC-2013/09/B/ST6/02264)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
- Keywords
- imbalanced learning, class imbalance, skewed distributions, binary classification, regression analysis, clustering, data streams, big data analytics, social media applications, computer vision applications, real-time learning, adaptive learning, computational efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning from imbalanced data: open challenges and future directions. https://app.cochat.ai/papers/10.1007/s13748-016-0094-0
- The paper
- Krawczyk, B. (2016). Learning from imbalanced data: open challenges and future directions. Progress in Artificial Intelligence. https://doi.org/10.1007/s13748-016-0094-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.