A Survey of Predictive Modeling on Imbalanced Domains
Open accessThe DOI matches its Crossref record; 261 of the 266 references it cites were found in a registry or an index.
Abstract
Many real-world data-mining applications involve obtaining predictive models using datasets with strongly imbalanced distributions of the target variable. Frequently, the least-common values of this target variable are associated with events that are highly relevant for end users (e.g., fraud detection, unusual returns on stock markets, anticipation of catastrophes, etc.). Moreover, the events may have different costs and benefits, which, when associated with the rarity of some of them on the available training data, creates serious problems to predictive modeling techniques. This article presents a survey of existing techniques for handling these important applications of predictive analytics. Although most of the existing work addresses classification tasks (nominal target variables), we also describe methods designed to handle similar problems within regression tasks (numeric target variables). In this survey, we discuss the main challenges raised by imbalanced domains, propose a definition of the problem, describe the main approaches to these tasks, propose a taxonomy of the methods, summarize the conclusions of existing comparative studies as well as some theoretical analyses of some methods, and refer to some related problems within predictive modeling.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Here, techniques such as under-sampling and synthetic data have been found to enhance model performance [16].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
In the citing paper
“Earlier trends of opportunistic data collection and post hoc justifications of large datasets are gradually moving towards a requirement for more deliberative data collection methods [35,36], sampling techniques [16] and minimal data architectures [57] to deliver better performance without reducing model accuracy.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · cited 1×
“Developments made in this context include one-class SVMs (e.g., Sch¨olkopf et al. [2001], Manevitz and Yousef [2002], Raskutti and Kowalczyk [2004], Zhuang and Dai [2006a, 2006b], and Lee and Cho [2006]) and the use of an autoencoder (or autoassociator) (e.g., Japkowicz et al. [1995] and Japkowicz…”
Method
Research works printed but not linked: 52
- Akbani Rehan, 2004, Machine Learning: ECML
- Alejo Roberto, 2013, Rosa Maria Valdovinos, and J. Horacio Pacheco-Sánchez
- Alejo Roberto, 2007, Ramón Alberto Mollineda, and José Salvador Sánchez.
- Eleuterio Roberto Alejo, 2011, Vicente García Jiménez, and Rosa María Valdovinos Rosas.
- Attenberg Josh, Imbalanced Learning: Foundations
- Bi Jinbo, Proc. of the 20th Int. Conf. on Machine Learning. 43--50
- Branco Paula, Re-sampling Approaches for Regression Tasks under Imbalanced Domains. Master's thesis. Dept. Computer Science
- Breiman Leo, 1984, Stone
- Chawla Nitesh V., 2003, Bowyer
- Chen Chao, 2004, Using random forest to learn imbalanced data
- Chyi Yu-Meei, 2003, Department of Information Management
- Cieslak David A., 2008, Chawla
- Doucette John, 2008, Heywood
- Drummond Chris, Workshop on Learning from Imbalanced Datasets II, 11
- Elkan Charles, 2001, IJCAI'01: Proc. of 17th Int. Joint Conf. of Artificial Intelligence, 1
- Ferri César, 2005, Proceedings of the Second Workshop on ROC Analysis in Machine Learning. 33--40
- Ferri César, Proceedings of the 28th International Conference on Machine Learning (ICML-11)
- Forman George, 2004, Knowledge Discovery in Databases: PKDD
- He Haibo, 2008, IEEE International Joint Conference on Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE, 1322--1328
- Holte Robert C., IJCAI, 89
- 10.5555/1681514.1682710 · doi:10.5555/1681514.1682710
- Japkowicz Nathalie, 2000, AAAI Workshop on Learning from Imbalanced Data Sets, 68
- Japkowicz Nathalie, 2003, Workshop on Learning from Imbalanced Data Sets II, 1723
- Japkowicz Natalie, Imbalanced Learning: Foundations
- Jeatrakul Piyasak, 2010, Kok Wai Wong, and Chun Che Fung
- Joshi Mahesh V., Proceedings IEEE International Conference on Data Mining, 2001. ICDM 2001. IEEE, 257--264
- Kubat Miroslav, 1997, Proc. of the 14th Int. Conf. on Machine Learning. Morgan Kaufmann, 179--186
- Liu Alexander, 2007, Martin
- Liu Wei, 2010, Chawla
- Maloof Marcus A., 2003, ICML-2003 Workshop on Learning from Imbalanced Data Sets II, 2
- Mani Inderjeet, 2003, Proceedings of Workshop on Learning from Imbalanced Datasets.
- 10.5555/1314498.1314514 · doi:10.5555/1314498.1314514
- Pearson Ronald, 2003, Proceedings of the ICML, 3
- Provost Foster J, 1998, ICML'98: Proc. of the 15th Int. Conf. on Machine Learning. Morgan Kaufmann Publishers, 445--453
- Raeder Troy, 2012, Chawla
- Rita, 2003, Ribeiro and Luís Torgo
- Rijsbergen Cornelis V., 1979, Information Retrieval. Dept. of Computer Science
- Sánchez-Crisostomo Juan Pablo, 2014, Rosa María Valdovinos, and J. Horacio Pacheco-Sánchez
- Sánchez-Monedero Javier, 2013, Pedro Antonio Gutiérrez, and Cesar Hervás-Martínez
- Songwattanasiri Panote, 2010, Proceedings of the Annual International Conference on Computer Science Education: Innovation and Technology
- Torgo Luís, 2003, Ribeiro
- Torgo Luís, 2007, Ribeiro
- Wagstaff Kiri L., 2013, Gilmore
- Wallace Byron C., 2011 IEEE 11th International Conference on Data Mining (ICDM). IEEE, 754--763
- Wang Heng, 2015, Concept drift detection for imbalanced stream data. arXiv Preprint arXiv:1504.01044 · arXiv
- Wang Xiaoguang, Advances in Artificial Intelligence
- Weiss Gary M., Data Mining
- Weiss Gary M., Imbalanced Learning: Foundations
- Cheng, Proceedings of the 7th Australasian Data Mining Conference-Volume 87
- Wu Gang, ICML 2003 Workshop on Learning from Imbalanced Data Sets II
- 10.5555/951949.952181 · doi:10.5555/951949.952181
- Zhang Dongmei, 2011, A novel improved SMOTE resampling algorithm based on fractal, J. Comput. Inform. Syst., 7, 2204
Cited by
Chicco, D., & Jurman, G. (2020) · BMC Genomics · doi:10.1186/s12864-019-6413-7 · Cited by 6,143
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Multiple instance learning: A survey of problem characteristics and applications
Carbonneau, M.-A., Cheplygina, V., Granger, E., & Gagnon, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.009 · Cited by 740
“There exist many methods to deal with imbalanced data [155].”
MethodTruong, N. D., Nguyen, A. D., Kuhlmann, L., Bonyadi, M. R., Yang, J., Ippolito, S., & Kavehei, O. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.04.018 · Cited by 635
Ensemble Learning for Disease Prediction: A Review
Mahajan, P., Uddin, S., Hajati, F., & Moni, M. A. (2023) · Healthcare · doi:10.3390/healthcare11121808 · Cited by 407
“We followed a thorough literature search approach to discover all relevant publications in this study.”
BackgroundMethodInfluentialThe class imbalance problem in deep learning
Ghosh, K., Bellinger, C., Corizzo, R., Branco, P., Krawczyk, B., & Japkowicz, N. (2024) · Machine Learning · doi:10.1007/s10994-022-06268-8 · Cited by 312
Self-citationA Comprehensive Investigation of the Role of Imbalanced Learning for Software Defect Prediction
Song, Q., Guo, Y., & Shepperd, M. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2836442 · Cited by 295
“For a fuller discussion of the merits and demerits of various classification performance metrics see [10], [21], [52].”
BackgroundOn the class overlap problem in imbalanced data classification
Vuttipittayamongkol, P., Elyan, E., & Petrovski, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106631 · Cited by 290
“The in-depth review of existing solutions to classification of imbalanced datasets is presented in an alternative perspective rather than data and algorithm levels, which was commonly arranged in other review papers [19, 8, 29, 30, 7].”
BackgroundInfluentialNeighbourhood-based undersampling approach for handling imbalanced and overlapped data
Vuttipittayamongkol, P., & Elyan, E. (2020) · Information Sciences · doi:10.1016/j.ins.2019.08.062 · Cited by 286
“These are common metrics and widely used for imbalanced learning [21, 15, 19, 2, 3].”
BackgroundMethodKEEL 3.0: An Open Source Software for Multi-Stage Analysis in Data Mining
Triguero, I., González, S., Moyano, J. M., García, S., Alcalá-Fdez, J., Luengo, J., Fernández, A., del Jesús, M. J., Sánchez, L., & Herrera, F. (2017) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.10.1.82 · Cited by 286
“Taking binary problems as an example, this issue is typically known as the class imbalanced problem 31 ; 10 , in which positive data samples (usually the class of interest) are highly outnumbered by negative ones 29 .”
LR-SMOTE — An improved unbalanced data set oversampling based on K-means and SVM
Liang, X. W., Jiang, A. P., Li, T., Xue, Y. Y., & Wang, G. T. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105845 · Cited by 282
Imani, M., Beikmohammadi, A., & Arabnia, H. R. (2025) · Technologies · doi:10.3390/technologies13030088 · Cited by 256
“Instead of interpolating between existing minority class instances, GNUS introduces controlled random perturbations, ensuring that the synthetic samples remain realistic while enhancing the model’s generalization capabilities [22].”
A comparison among interpretative proposals for Random Forests
Aria, M., Cuccurullo, C., & Gnasso, A. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100094 · Cited by 242
Generative Adversarial Minority Oversampling
Mullick, S. S., Datta, S., & Das, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00178 · Cited by 228
“We evaluate the performance of a classifier in terms of two indices which are not biased toward any particular class [40], namely Average Class Specific Accuracy (ACSA) [21, 44] and Geometric Mean (GM) [26, 4].”
MethodData‐Driven Design for Metamaterials and Multiscale Systems: A Review
Lee, D., Chen, W. (., Wang, L., Chan, Y., & Chen, W. (2024) · Advanced Materials · doi:10.1002/adma.202305254 · Cited by 235
“This supervision is non-trivial in that (1) properties of unseen unit cells are unknown before evaluation; (2) the evaluation is typically resource-intensive, particularly for large datasets; and (3) distributional control in regression tasks is more challenging and has been under-explored compared to that in classifi…”
BackgroundA review of the F-measure: its history, properties, criticism, and alternatives
Christen, P., Hand, D. J., & Kirielle, N. (2024) · ACM Computing Surveys · doi:10.1145/3606367 · Cited by 236
“therefore can be poor indicators of the usefulness of the classification method used [7, 46, 51, 52].”
MethodBenchmarking Computational Doublet-Detection Methods for Single-Cell RNA Sequencing Data
Xi, N. M., & Li, J. J. (2021) · Cell Systems · doi:10.1016/j.cels.2020.11.008 · Cited by 208
Buchlak, Q. D., Esmaili, N., Leveque, J.-C., Farrokhi, F., Bennett, C., Piccardi, M., & Sethi, R. K. (2020) · Neurosurgical Review · doi:10.1007/s10143-019-01163-8 · Cited by 227
“This bias may be counteracted by distribution over-sampling, sample weighting, synthesis of new data, and prediction post-processing [21].”
BackgroundM2m: Imbalanced Classification via Major-to-Minor Translation
Kim, J., Jeong, J., & Shin, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01391 · Cited by 223
“To evaluate the classification performance of the models on the balanced test distribution, we mainly report two popular metrics: the balanced accuracy (bACC) [21, 44] and the geometric mean scores (GM) [27, 3], which are defined by the arithmetic and geometric mean over class-wise sensitivity (i.”
MethodA hybrid machine learning approach to cerebral stroke prediction based on imbalanced medical dataset
Liu, T., Fan, W., & Wu, C. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101723 · Cited by 220
Handling data irregularities in classification: Foundations, trends, and future challenges
Das, S., Datta, S., & Chaudhuri, B. B. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.008 · Cited by 216
Automatic fault classification in photovoltaic modules using Convolutional Neural Networks
Fonseca Alves, R. H., Deus Júnior, G. A. D., Marra, E. G., & Lemos, R. P. (2021) · Renewable Energy · doi:10.1016/j.renene.2021.07.070 · Cited by 211
Fully Convolutional Neural Network for Rapid Flood Segmentation in Synthetic Aperture Radar Imagery
Nemni, E., Bullock, J., Belabbes, S., & Bromley, L. (2020) · Remote Sensing · doi:10.3390/rs12162532 · Cited by 209
SMOGN: a Pre-processing Approach for Imbalanced Regression
Branco, P., Torgo, L., & Ribeiro, R. P. (2017) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 209
Self-citationThe receiver operating characteristic curve accurately assesses imbalanced datasets
Richardson, E., Trevizani, R., Greenbaum, J. A., Carter, H., Nielsen, M., & Peters, B. (2024) · Patterns · doi:10.1016/j.patter.2024.100994 · Cited by 200
Density-based weighting for imbalanced regression
Steininger, M., Kobs, K., Davidson, P., Krause, A., & Hotho, A. (2021) · Machine Learning · doi:10.1007/s10994-021-06023-5 · Cited by 194
“It would be feasible to apply this to imbalanced domains but it was not evaluated for this yet (Branco et al. 2016b).”
BackgroundMethodResultInfluentialMachine Learning Solutions for Osteoporosis—A Review
Smets, J., Shevroja, E., Hügle, T., Leslie, W. D., & Hans, D. (2020) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.4292 · Cited by 197
“(120) Consequently, this metric often overestimates the real performance of the model.”
BackgroundRadial-Based Undersampling for imbalanced data classification
Koziarski, M. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107262 · Cited by 190
Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
Ding, C., Pang, G., & Shen, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00724 · Cited by 197
“Supervised anomaly detection is similar to imbalanced classification [6,15,30] in that they both detect rare classes with a few labeled examples.”
BackgroundConfusion-Matrix-Based Kernel Logistic Regression for Imbalanced Data Classification
Ohsaki, M., Wang, P., Matsuda, K., Katagiri, S., Watanabe, H., & Ralescu, A. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2682249 · Cited by 182
“(8), (9), (10), (11), and (12), respectively, where N is the total number of instances, NTP is the number of true positives, NTN is the number of true negatives, NFP is the number of false positives, and NFN is the number of false negatives [5], [44], [45].”
BackgroundMethodInfluentialPredicting and explaining employee turnover intention
Lazzari, M., Alvarez, J. M., & Ruggieri, S. (2022) · International Journal of Data Science and Analytics · doi:10.1007/s41060-022-00329-w · Cited by 181
“Ensemble of decision trees achieve very good performances in general, with few configuration parameters [16], and especially when the distribution of classes is imbalanced [9], which is typically the case for turnover data.”
BackgroundLi, Z., Huang, M., Liu, G., & Jiang, C. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114750 · Cited by 175
Automatic emotion detection in text streams by analyzing Twitter data
Hasan, M., Rundensteiner, E., & Agu, E. (2019) · International Journal of Data Science and Analytics · doi:10.1007/s41060-018-0096-z · Cited by 169
Aguiar, G., Krawczyk, B., & Cano, A. (2024) · Machine Learning · doi:10.1007/s10994-023-06353-6 · Cited by 164
“Figure 2 presents a taxonomy (He and Garcia, 2009; Branco et al., 2016; Krawczyk, 2016; Fernández et al., 2018) of approaches for tackling the class imbalance problem.”
BackgroundCombined Cleaning and Resampling algorithm for multi-class imbalanced data with label noise
Koziarski, M., Woźniak, M., & Krawczyk, B. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106223 · Cited by 165
DELPHI: accurate deep ensemble model for protein interaction sites prediction
Li, Y., Golding, G. B., & Ilie, L. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa750 · Cited by 162
Stop Oversampling for Class Imbalance Learning: A Review
Tarawneh, A. S., Hassanat, A. B. A., Tarawneh, A. S., & Almuhaimeed, A. (2022) · IEEE Access · doi:10.1109/access.2022.3169512 · Cited by 214
“This is troublesome since such methods may raise the likelihood of the learning process being overfitted [73]–[75], [75], [76].”
BackgroundImbalanced regression and extreme value prediction
Ribeiro, R. P., & Moniz, N. (2020) · Machine Learning · doi:10.1007/s10994-020-05900-9 · Cited by 207
Self-citationRadial-Based oversampling for noisy imbalanced data classification
Koziarski, M., Krawczyk, B., & Woźniak, M. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.04.089 · Cited by 152
Host-based IDS: A review and open issues of an anomaly detection system in IoT
Martins, I., Resende, J. S., Sousa, P. R., Silva, S., Antunes, L. F., & da Gama, J. M. P. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.03.001 · Cited by 197
“Particularly, anomaly detection in cybersecurity is associated with an imbalanced and dynamic domain where the least-expected outcome is highly relevant, potentially undermining its performance and compromising the security system [9].”
BackgroundResampling approaches to handle class imbalance: a review from a data perspective
Carvalho, M. M., Pinho, A. J., & Brás, S. (2025) · Journal Of Big Data · doi:10.1186/s40537-025-01119-4 · Cited by 207
Integrated Churn Prediction and Customer Segmentation Framework for Telco Business
Shu-li, W., Yau, W., Ong, T. S., & Chong, S.-C. (2021) · IEEE Access · doi:10.1109/access.2021.3073776 · Cited by 167
“The research of [38] indicated that in an imbalanced dataset, the selection of metrics must also consider the preferences of the user.”
BackgroundSMOTE-LOF for noise identification in imbalanced data classification
Asniar, A., Maulidevi, N. U., & Surendro, K. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.01.014 · Cited by 164
Pre-processing approaches for imbalanced distributions in regression
Branco, P., Torgo, L., & Ribeiro, R. P. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.11.100 · Cited by 142
Self-citationDeep learning-based BCI for gait decoding from EEG with LSTM recurrent neural network
Tortora, S., Ghidoni, S., Chisari, C., Micera, S., & Artoni, F. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab9842 · Cited by 142
“Their detailed formula can be found in many unbalanced learning related papers (Lopez et al 2013, Branco et al 2016).”
BackgroundAdaptive Learning-Based $k$ -Nearest Neighbor Classifiers With Resilience to Class Imbalance
Mullick, S. S., Datta, S., & Das, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2812279 · Cited by 137
“Along the second line of thinking, the focus is shifted from the classifier to the training set itself, which is properly pre-processed by either under-sampling (the majority class) or over-sampling (the minority class) [10], [32]–[34].”
BackgroundPrequential AUC: properties of the area under the ROC curve for data streams with concept drift
Brzeziński, D., & Stefanowski, J. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1022-8 · Cited by 132
Sadeghzadeh, A. M., Shiravi, S., & Jalili, R. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3052888 · Cited by 144
Cano, A., & Krawczyk, B. (2022) · Machine Learning · doi:10.1007/s10994-022-06168-x · Cited by 144
“Class imbalance is one of the most relevant challenges (Branco et al., 2016).”
BackgroundUnequal-Training for Deep Face Recognition With Long-Tailed Noisy Data
Zhong, Y., Deng, W., Wang, M., Hu, J., Peng, J., Tao, X., & Huang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00800 · Cited by 146
“…in face recognition is reminiscent of the conventional class imbalance problem that has been comprehensively studied in classical machine learning [2,10], but significantly differs from conventional class imbalance problem in two aspects: first, the long-tailed data in face recognition is…”
BackgroundSusan, S., & Kumar, A. (2020) · Engineering Reports · doi:10.1002/eng2.12298 · Cited by 143
Radial-Based Oversampling for Multiclass Imbalanced Data Classification
Krawczyk, B., Koziarski, M., & Woźniak, M. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2913673 · Cited by 126
“Imbalanced class distributions can pose a significant learning difficulty to most of the classifiers [1], [2].”
BackgroundMachine Learning Thermo‐Barometry: Application to Clinopyroxene‐Bearing Magmas
Petrelli, M., Caricchi, L., & Perugini, D. (2020) · Journal of Geophysical Research Solid Earth · doi:10.1029/2020jb020130 · Cited by 138
“a widely recognized strategy to evaluate the goodness of predictions in regression analyses (Branco et al., 2016).”
BackgroundMethodInfluentialSMOTE-RkNN: A hybrid re-sampling method based on SMOTE and reverse k-nearest neighbors
Zhang, A., Yu, H., Huan, Z., Yang, X., Zheng, S., & Gao, S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.02.038 · Cited by 121
EEG-based seizure prediction via Transformer guided CNN
Li, C., Huang, X., Song, R., Qian, R., Liu, X., & Chen, X. (2022) · Measurement · doi:10.1016/j.measurement.2022.111948 · Cited by 127
A study on combining dynamic selection and data preprocessing for imbalance learning
Roy, A., Cruz, R. M. O., Sabourin, R., & Cavalcanti, G. D. C. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.01.060 · Cited by 125
RA-GCN: Graph convolutional network for disease prediction problems with imbalanced data
Ghorbani, M., Kazi, A., Baghshah, M. S., Rabiee, H. R., & Navab, N. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102272 · Cited by 133
“However, along with other metrics, accuracy can reflect the effect of the class imbalance problem on the classifiers’ performance [61].”
BackgroundNedeljkovic, D. M., & Jakovljević, Ž. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102585 · Cited by 121
Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised LearningPreprint
Kim, J., Hur, Y., Park, S., Yang, E., Hwang, S. J., & Shin, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08844 · Cited by 245
“To evaluate the classification performance of models trained under the imbalanced dataset, we report two popular metrics: balanced accuracy (bACC) [21, 43] and geometric mean scores (GM) [7, 27], which are defined by the arithmetic and geometric mean over class-wise sensitivity, respectively.”
MethodGhori, K. M., Abbasi, R. A., Awais, M., Imran, M. A., Ullah, A., & Szathmáry, L. (2019) · IEEE Access · doi:10.1109/access.2019.2962510 · Cited by 126
“way of NTL detection for many reasons [5].”
Self-Paced Balance Learning for Clinical Skin Disease Recognition
Yang, J., Wu, X., Liang, J., Sun, X., Cheng, M., Rosin, P. L., & Wang, L. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2917524 · Cited by 112
“[39] then focus on a more general issue of imbalanced predictive modeling.”
BackgroundAssessment of the Potential of Wrist-Worn Wearable Sensors for Driver Drowsiness Detection
Kundinger, T., Sofra, N., & Riener, A. (2020) · Sensors · doi:10.3390/s20041029 · Cited by 115
“Concerning performance measures, accuracy might be as one of the traditional measures suitable but is not when dealing with unbalanced data because its focus is more on the majority classes than on the minority ones [89].”
BackgroundAn SDN-based Intrusion Detection System using SVM with Selective Logging for IP Traceback
Hadem, P., Saikia, D. K., & Moulik, S. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108015 · Cited by 117
Adaptive Chunk-Based Dynamic Weighted Majority for Imbalanced Data Streams With Concept Drift
Lu, Y., Cheung, Y., & Tang, Y. Y. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2951814 · Cited by 102
“Another typical data mining problem is class imbalance, where one class has much more samples than another class [12], [13].”
BackgroundDrug target prediction through deep learning functional representation of gene signatures
Chen, H., King, F. J., Zhou, B., Wang, Y., Canedy, C. J., Hayashi, J., Zhong, Y., Chang, M. W., Pache, L., Wong, J. L., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-46089-y · Cited by 119
On Supervised Class-Imbalanced Learning: An Updated Perspective and Some Key Challenges
Das, S., Mullick, S. S., & Zelinka, I. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3160658 · Cited by 127
“[12]restrictedthemselvestoonlylistingthepopular performance evaluation measures rather than highlighting the research efforts investigating the suitability of such an extensive collection of indices to different class-imbalanced applications.”
BackgroundInfluentialEpiDope: a deep neural network for linear B-cell epitope prediction
Collatz, M., Mock, F., Barth, E., Hölzer, M., Sachse, K., & Marz, M. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa773 · Cited by 102
Geometric SMOTE for regression
Camacho, L., Douzas, G., & Bação, F. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116387 · Cited by 127
García, V., Sánchez, J. S., Marqués, A. I., Florencia, R., & Rivera, G. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.113026 · Cited by 101
“…that class imbalance may cause an important deterioration of the performance attainable by most standard classifiers because they are strongly biased towards the classification of the negative examples and are not competent enough to classify the minority class correctly (Branco et al., 2016).”
BackgroundElyan, E., Moreno‐García, C. F., & Jayne, C. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05130-z · Cited by 104
“For those interested in algorithmic-based solutions, we refer the reader to a recent survey [20] for more details.”
Zeng, L., Huang, W., Xiong, Y., Ren, S., & Zhu, T. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105694 · Cited by 93
Epileptic Seizure Prediction Using Deep Transformer Model
Bhattacharya, A., Baweja, T., & Karri, S. P. K. (2021) · International Journal of Neural Systems · doi:10.1142/s0129065721500581 · Cited by 98
An Explainable Machine Learning Pipeline for Stroke Prediction on Imbalanced Data
Kokkotis, C., Giarmatzis, G., Γιαννακού, Ε., Moustakidis, S., Tsatalas, T., Tsiptsios, D., Vadikolias, Κ., & Aggelousis, N. (2022) · Diagnostics · doi:10.3390/diagnostics12102392 · Cited by 105
“The false-positive rate (FP rate ) and the false-negative rate (FN rate ) were also considered in our study given their important role in medical applications [36].”
ResultMulti-class and feature selection extensions of Roughly Balanced Bagging for imbalanced data
Lango, M., & Stefanowski, J. (2017) · Journal of Intelligent Information Systems · doi:10.1007/s10844-017-0446-7 · Cited by 93
“A recent, comprehensive review of pre-processing methods could be found in Branco et al. (2016) and their comparative studies are provided by Napierala and Stefanowski (2016), Van Hulse et al. (2007).”
BackgroundMethodYang, C. B., Fridgeirsson, E. A., Kors, J. A., Reps, J., & Rijnbeek, P. R. (2024) · Journal Of Big Data · doi:10.1186/s40537-023-00857-7 · Cited by 145
“As a result, various methods have been proposed to improve prediction performance when developing prediction models using imbalanced data [1, 2].”
MethodAutomated prediction of mastitis infection patterns in dairy herds using machine learning
Hyde, R. M., Down, P. M., Bradley, A. J., Breen, J. E., Hudson, C. D., Leach, K. A., & Green, M. J. (2020) · Scientific Reports · doi:10.1038/s41598-020-61126-8 · Cited by 109
Exploring the impact of foot-by-foot track geometry on the occurrence of rail defects
Mohammadi, R., He, Q., Ghofrani, F., Pathak, A., & Aref, A. J. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.03.004 · Cited by 91
A Survey of Data Quality Requirements That Matter in ML Development Pipelines
Priestley, M., O’donnell, F., & Simperl, E. (2023) · Journal of Data and Information Quality · doi:10.1145/3592616 · Cited by 86
“Here, techniques such as under-sampling and synthetic data have been found to enhance model performance [16].”
BackgroundMethodLu, Y., Cheung, Y., & Tang, Y. Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2916196 · Cited by 87
“2916196 binary classification [1], [2].”
Value-added tax fraud detection with scalable anomaly detection techniques
Vanhoeyveld, J., Martens, D., & Peeters, B. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105895 · Cited by 98
Bayes Imbalance Impact Index: A Measure of Class Imbalanced Data Set for Classification Problem
Lu, Y., Cheung, Y., & Tang, Y. Y. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2944962 · Cited by 108
“A comprehensive review of the imbalance recovery methods can be found in [5], [6].”
Poverty Classification Using Machine Learning: The Case of Jordan
Alsharkawi, A., Al-Fetyani, M., Dawas, M., Saadeh, H., & Yaman, M. A. (2021) · Sustainability · doi:10.3390/su13031412 · Cited by 94
Li, Q., Xu, Y. H., & Ren, C. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2993807 · Cited by 78
“In previous studies, sampling techniques have been proposed to rebalance the data under the risk of information loss or redundancy [31].”
MethodGaussian noise up-sampling is better suited than SMOTE and ADASYN for clinical decision making
Metsch, J. M., & Heider, D. (2021) · BioData Mining · doi:10.1186/s13040-021-00283-6 · Cited by 90
“It is based on up-sampling [27], i.e., it randomly selects samples from the minority class and adds them to the training data.”
BackgroundA survey on machine learning methods for churn prediction
Geiler, L., Affeldt, S., & Nadif, M. (2022) · International Journal of Data Science and Analytics · doi:10.1007/s41060-022-00312-5 · Cited by 101
“In the context of imbalance datasets, authors argue that decision trees are not viable [18,139], while others propose an insensitive splitting strategies based, for instance, on the Hellinger distance [18,149].”
MethodSoltanzadeh, P., Feizi‐Derakhshi, M., & Hashemzadeh, M. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109721 · Cited by 78
Dynamic Weighted Majority for Incremental Learning of Imbalanced Data Streams with Concept Drift
Lu, Y., Cheung, Y., & Tang, Y. Y. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/333 · Cited by 75
Pan, J., Ou, X., & Liang, X. (2021) · Forests · doi:10.3390/f12060768 · Cited by 80
“However, the best performance of region detection, which reaches 70.2% in mIOU, is achieved by FireDGWF because the intersection between the detection regions obtained with the two methods (WSFS and lightweight Faster R-CNN) corresponds to the results.”
MethodInfluentialUsing random forest to identify longitudinal predictors of health in a 30-year cohort study
Loef, B., Wong, A., Janssen, N., Strak, M., Hoekstra, J., Picavet, H. S. J., Boshuizen, H. C., Verschuren, W. M. M., & Herber-Gast, G.-C. M. (2022) · Scientific Reports · doi:10.1038/s41598-022-14632-w · Cited by 94
Hashing-Based Undersampling Ensemble for Imbalanced Pattern Classification Problems
Ng, W. W. Y., Xu, S., Zhang, J., Tian, X., Rong, T., & Kwong, S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3000754 · Cited by 75
Odat, E., & Yaseen, Q. M. (2023) · IEEE Access · doi:10.1109/access.2023.3244656 · Cited by 72
“Furthermore, several experiments have shown that the accuracy does not greatly change in every experiment when using random under-sampling [41].”
BackgroundMitra, S., Chakraborty, B., & Mitra, P. (2023) · Energy · doi:10.1016/j.energy.2023.129920 · Cited by 86
Using deep learning for mammography classification
Hepsağ, P. U., Özel, S. A., & Yazıcı, A. (2017) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk.2017.8093429 · Cited by 73
Synthetic resampling strategies and machine learning for digital soil mapping in Iran
Taghizadeh‐Mehrjardi, R., Schmidt, K., Eftekhari, K., Behrens, T., Jamshidi, M., Davatgar, N., Toomanian, N., & Scholten, T. (2019) · European Journal of Soil Science · doi:10.1111/ejss.12893 · Cited by 75
“A more detailed description of the eight used resampling techniques can be found in Branco, Torgo, and Ribeiro (2016).”
MethodHäfner, S., Yifang Ban, A., & Nascetti, A. (2022) · Remote Sensing of Environment · doi:10.1016/j.rse.2022.113192 · Cited by 84
Overlap-Based Undersampling for Improving Imbalanced Data Classification
Vuttipittayamongkol, P., Elyan, E., Petrovski, A., & Jayne, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03493-1_72 · Cited by 72
“The advantages of data-level methods over algorithm-level ones are that no deep understandings of the learning algorithm are required [2] and it is flexible to any learning algorithm.”
MethodPoisoning GNN-based Recommender Systems with Generative Surrogate-based Attacks
Nguyen, T. T., Quach, N. D. K., Nguyên, T. T., Huynh, T. T., Vu, V. H., Nguyen, P. L., Jo, J. H., & Nguyen, Q. V. H. (2022) · ACM Transactions on Information Systems · doi:10.1145/3567420 · Cited by 113
Appropriateness of performance indices for imbalanced data classification: An analysis
Mullick, S. S., Datta, S., Dhekane, S. G., & Das, S. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107197 · Cited by 78
“Class imbalance [5, 6] is a form of data irregularity which is fairly common in many real-world classification problems [6, 7, 4] such as like medical diagnosis, fraud detection, etc.”
BackgroundRun-time prediction of business process indicators using evolutionary decision rules
Marquez-Chamorro, A. E., Resinas, M., Ruiz–Cortés, A., & Toro, M. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.05.069 · Cited by 71
Metadata
- Authors
- Branco, P., Torgo, L., & Ribeiro, R. P.
- Affiliations
- Universidade do Porto (PT)
- LIAAD-INESC TEC, DCC-Faculty of Sciences, University of Porto, Porto, Portugal
- Venue
- ACM Computing Surveys
- Published
- 2016-08-13
- Volume
- 49
- Issue
- 2
- Pages
- 1-50
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2490420619
- Semantic Scholar
- 736018160f8e6f6bd9b2a9101cd13ee67e573097
- Cited by
- 1,129
- References
- 266
- Citations by year
- 2026: 101 · 2025: 113 · 2024: 167 · 2023: 167 · 2022: 176 · 2021: 137 · 2020: 96 · 2019: 72 · 2018: 60 · 2017: 37 · 2016: 3
- FWCI
- 47.12
- Type
- journal article
- Language
- en
- Open access
- Locations
- ACM Computing Surveys (publishedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Funders
- North Portugal Regional Operational Programme (Project NORTE-07-0124-FEDER-000059)
- European Regional Development Fund (POCI-01-0145-FEDER-006961)
- Fundação para a Ciência e a Tecnologia (PD/BD/105788/2014, SFRH/BSAB/113896/2015)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Social Sciences › Business, Management and Accounting › Marketing › Customer churn and segmentation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- class imbalance, predictive modeling, rare event prediction, cost-sensitive learning, classification, regression analysis, fraud detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.