A Survey of Predictive Modeling on Imbalanced Domains
Open accessThe DOI matches its Crossref record; 261 of the 266 references it cites were found in a registry or an index.
Abstract
Many real-world data-mining applications involve obtaining predictive models using datasets with strongly imbalanced distributions of the target variable. Frequently, the least-common values of this target variable are associated with events that are highly relevant for end users (e.g., fraud detection, unusual returns on stock markets, anticipation of catastrophes, etc.). Moreover, the events may have different costs and benefits, which, when associated with the rarity of some of them on the available training data, creates serious problems to predictive modeling techniques. This article presents a survey of existing techniques for handling these important applications of predictive analytics. Although most of the existing work addresses classification tasks (nominal target variables), we also describe methods designed to handle similar problems within regression tasks (numeric target variables). In this survey, we discuss the main challenges raised by imbalanced domains, propose a definition of the problem, describe the main approaches to these tasks, propose a taxonomy of the methods, summarize the conclusions of existing comparative studies as well as some theoretical analyses of some methods, and refer to some related problems within predictive modeling.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Here, techniques such as under-sampling and synthetic data have been found to enhance model performance [16].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
In the citing paper
“Earlier trends of opportunistic data collection and post hoc justifications of large datasets are gradually moving towards a requirement for more deliberative data collection methods [35,36], sampling techniques [16] and minimal data architectures [57] to deliver better performance without reducing model accuracy.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · cited 1×
“Developments made in this context include one-class SVMs (e.g., Sch¨olkopf et al. [2001], Manevitz and Yousef [2002], Raskutti and Kowalczyk [2004], Zhuang and Dai [2006a, 2006b], and Lee and Cho [2006]) and the use of an autoencoder (or autoassociator) (e.g., Japkowicz et al. [1995] and Japkowicz…”
Method
Research works printed but not linked: 52
- Akbani Rehan, 2004, Machine Learning: ECML
- Alejo Roberto, 2013, Rosa Maria Valdovinos, and J. Horacio Pacheco-Sánchez
- Alejo Roberto, 2007, Ramón Alberto Mollineda, and José Salvador Sánchez.
- Eleuterio Roberto Alejo, 2011, Vicente García Jiménez, and Rosa María Valdovinos Rosas.
- Attenberg Josh, Imbalanced Learning: Foundations
- Bi Jinbo, Proc. of the 20th Int. Conf. on Machine Learning. 43--50
- Branco Paula, Re-sampling Approaches for Regression Tasks under Imbalanced Domains. Master's thesis. Dept. Computer Science
- Breiman Leo, 1984, Stone
- Chawla Nitesh V., 2003, Bowyer
- Chen Chao, 2004, Using random forest to learn imbalanced data
- Chyi Yu-Meei, 2003, Department of Information Management
- Cieslak David A., 2008, Chawla
- Doucette John, 2008, Heywood
- Drummond Chris, Workshop on Learning from Imbalanced Datasets II, 11
- Elkan Charles, 2001, IJCAI'01: Proc. of 17th Int. Joint Conf. of Artificial Intelligence, 1
- Ferri César, 2005, Proceedings of the Second Workshop on ROC Analysis in Machine Learning. 33--40
- Ferri César, Proceedings of the 28th International Conference on Machine Learning (ICML-11)
- Forman George, 2004, Knowledge Discovery in Databases: PKDD
- He Haibo, 2008, IEEE International Joint Conference on Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE, 1322--1328
- Holte Robert C., IJCAI, 89
- 10.5555/1681514.1682710 · doi:10.5555/1681514.1682710
- Japkowicz Nathalie, 2000, AAAI Workshop on Learning from Imbalanced Data Sets, 68
- Japkowicz Nathalie, 2003, Workshop on Learning from Imbalanced Data Sets II, 1723
- Japkowicz Natalie, Imbalanced Learning: Foundations
- Jeatrakul Piyasak, 2010, Kok Wai Wong, and Chun Che Fung
- Joshi Mahesh V., Proceedings IEEE International Conference on Data Mining, 2001. ICDM 2001. IEEE, 257--264
- Kubat Miroslav, 1997, Proc. of the 14th Int. Conf. on Machine Learning. Morgan Kaufmann, 179--186
- Liu Alexander, 2007, Martin
- Liu Wei, 2010, Chawla
- Maloof Marcus A., 2003, ICML-2003 Workshop on Learning from Imbalanced Data Sets II, 2
- Mani Inderjeet, 2003, Proceedings of Workshop on Learning from Imbalanced Datasets.
- 10.5555/1314498.1314514 · doi:10.5555/1314498.1314514
- Pearson Ronald, 2003, Proceedings of the ICML, 3
- Provost Foster J, 1998, ICML'98: Proc. of the 15th Int. Conf. on Machine Learning. Morgan Kaufmann Publishers, 445--453
- Raeder Troy, 2012, Chawla
- Rita, 2003, Ribeiro and Luís Torgo
- Rijsbergen Cornelis V., 1979, Information Retrieval. Dept. of Computer Science
- Sánchez-Crisostomo Juan Pablo, 2014, Rosa María Valdovinos, and J. Horacio Pacheco-Sánchez
- Sánchez-Monedero Javier, 2013, Pedro Antonio Gutiérrez, and Cesar Hervás-Martínez
- Songwattanasiri Panote, 2010, Proceedings of the Annual International Conference on Computer Science Education: Innovation and Technology
- Torgo Luís, 2003, Ribeiro
- Torgo Luís, 2007, Ribeiro
- Wagstaff Kiri L., 2013, Gilmore
- Wallace Byron C., 2011 IEEE 11th International Conference on Data Mining (ICDM). IEEE, 754--763
- Wang Heng, 2015, Concept drift detection for imbalanced stream data. arXiv Preprint arXiv:1504.01044 · arXiv
- Wang Xiaoguang, Advances in Artificial Intelligence
- Weiss Gary M., Data Mining
- Weiss Gary M., Imbalanced Learning: Foundations
- Cheng, Proceedings of the 7th Australasian Data Mining Conference-Volume 87
- Wu Gang, ICML 2003 Workshop on Learning from Imbalanced Data Sets II
- 10.5555/951949.952181 · doi:10.5555/951949.952181
- Zhang Dongmei, 2011, A novel improved SMOTE resampling algorithm based on fractal, J. Comput. Inform. Syst., 7, 2204
Cited by
Items 301–400 of 1,000
FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair
Fatima, S., Hemmati, H., & Briand, L. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3472476 · Cited by 46
“For this, we used random over-sampling [65], [12], which adds random copies of the minority class to our training dataset, which otherwise would be imbalanced (fewer positive examples).”
MethodTao, L., Wang, Q., Yu, F., Cao, H., Liang, Y., Luo, H., & Guo, J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128959 · Cited by 27
Lai, K. D., Nguyen, T. T., & Lê, T. H. (2021) · Annals of Emerging Technologies in Computing · doi:10.33166/aetic.2021.02.007 · Cited by 25
“The measurements we used for our comparative analyses were precision, recall, specificity, AUC, loss of validation [13].”
MethodPredictive Analysis of Diabetes-Risk with Class Imbalance
ElSeddawy, A. I. B., Karim, F. K., Hussein, A. M., & Khafaga, D. S. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/3078025 · Cited by 31
“(e balance between sensitivity and specificity using area under the curve-receiver operation curve (AUC-ROC) of one is a perfect model [59].”
MethodMogos, A. S., Liang, X., & Chung, C. Y. (2023) · IEEE Transactions on Power Delivery · doi:10.1109/tpwrd.2023.3268248 · Cited by 29
Abed, M., & Mehryaar, E. (2024) · Sustainability · doi:10.3390/su16051891 · Cited by 27
Modeling the risk of water pollution by pesticides from imbalanced data
Trajanov, A., Kuzmanovski, V., Réal, B., Marks‐Perreau, J., Džeroski, S., & Debeljak, M. (2018) · Environmental Science and Pollution Research · doi:10.1007/s11356-018-2099-7 · Cited by 23
Luo, R., Songyi, D., Wang, C., Peng, C., Tang, Z., Yu, Y., & Wang, S. (2018) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/428/1/012004 · Cited by 22
“1020-1024 [5] Chen T and Carlos G 2016 Xgboost: A scalable tree boosting system Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (ACM:2016) [6] Branco P, Luís T and Rita P R 2016 A survey of predictive modeling on imbalanced domains ACM Computing Surveys (CSUR) p 31 [7…”
BackgroundYang, Y., Hu, J., Liu, Y., & Chen, X. (2019) · Expert Systems · doi:10.1111/exsy.12377 · Cited by 22
“The empirical studies of the three ‐ way decision module could be conducted, and some approaches of dealing with imbalanced classification may be utilized (Branco, Torgo, & Ribeiro, 2016; Fernández, Garcia, Herrera, & Chawla, 2018; Torgo, Ribeiro, Pfahringer, & Branco, 2013).”
MethodAWSMOTE: An SVM-Based Adaptive Weighted SMOTE for Class-Imbalance Learning
Wang, J., Zou, C.-A., & Fu, G. (2021) · Scientific Programming · doi:10.1155/2021/9947621 · Cited by 38
Enhancing machine learning thermobarometry for clinopyroxene-bearing magmas
López, M. Á., Parodi, V., Musu, A., Jorgenson, C., Carfì, A., Mastrogiovanni, F., Caricchi, L., Perugini, D., & Petrelli, M. (2024) · Computers & Geosciences · doi:10.1016/j.cageo.2024.105707 · Cited by 22
ALGAN: Time Series Anomaly Detection with Adjusted-LSTM GAN
Bashar, M. A., & Nayak, R. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00810-2 · Cited by 40
Dogo, E. M., Nwulu, N. I., Twala, B., & Aigbavboa, C. O. (2020) · IEEE Access · doi:10.1109/access.2020.3038658 · Cited by 25
“Performance metrics for comparing experimental results in imbalanced classification problems are fundamental in discovering the quality of relationships between the data and the predicted event targets [58], [59].”
BackgroundBorg, T., Heidari, N., Noorani, A. M., SLEVIN, M. A., Cullen, A., Olgiati, S., Zerbi, A., Danovi, A., & Wilson, A. (2021) · Stem Cells International · doi:10.1155/2021/6648437 · Cited by 21
“This imbalance in the dataset can generate a bias in a class-specific analysis, in our case a gender bias in the minority class which is the class representing women [29].”
BackgroundDynamic Class Queue for Large Scale Face Recognition In the Wild
Bi, L., Xi, T., Zhang, G., Feng, H., Han, J., Liu, J., Ding, E., & Liu, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00376 · Cited by 30
“As witnessed by various studies[2, 29, 33], long-tailed classification is itself a challenging problem.”
BackgroundA Novel Data Augmentation Technique and Deep Learning Model for Web Application Security
Karacan, H., & Sevri, M. (2021) · IEEE Access · doi:10.1109/access.2021.3125785 · Cited by 22
“The imbalanced dataset caused a classification problem that is prone to bias due to skew in the class distribution in the dataset [32].”
BackgroundNon-animal models for blood–brain barrier permeability evaluation of drug-like compounds
Dehnbostel, F. O., Dixit, V. A., Preißner, R., & Banerjee, P. (2024) · Scientific Reports · doi:10.1038/s41598-024-59734-9 · Cited by 25
Feature extraction based on word embedding models for intrusion detection in network traffic
Corizzo, R., Zdravevski, E., Russell, M., Vagliano, A., & Japkowicz, N. (2020) · Journal of Surveillance Security and Safety · doi:10.20517/jsss.2020.15 · Cited by 20
Syrius: Synthesis of Rules for Intrusion Detectors
Alcantara, L., Padilha, G. A. G., Abreu, R., & d’Amorim, M. (2021) · IEEE Transactions on Reliability · doi:10.1109/tr.2021.3061297 · Cited by 26
Deep security analysis of program code: A systematic literature review
Sonnekalb, T., Heinze, T. S., & Mäder, P. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-10029-x · Cited by 30
“The precision recall curve highlights the skewed data, while the ROC curve concentrates more on the performance (Branco et al. 2016).”
BackgroundDeep attentive spatio-temporal feature learning for automatic resting-state fMRI denoising
Heo, K.-S., Shin, D.-H., Hung, S., Lin, W., Zhang, H., Shen, D. G., & Kam, T. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119127 · Cited by 23
Huber, M., Schober, P. R., Petersen, S., & Luedi, M. M. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02156-w · Cited by 31
“Prediction modelling efforts are often used with imbalanced data where the adverse outcome occurs only rarely: While the AUROC is formally not biased towards such a minority class [12], the AUROC metric might suggest a too optimistic impression of the classifier in highly imbalanced data [13].”
BackgroundA Multi-solution Study on GDPR AI-enabled Completeness Checking of DPAs
Azeem, M. I., & Abualhaija, S. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10491-3 · Cited by 29
Dynamic Ensemble Selection and Data Preprocessing for Multi-Class Imbalance Learning
Cruz, R. M. O., Souza, M. A., Sabourin, R., & Cavalcanti, G. D. C. (2018) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001419400093 · Cited by 21
Undersampling Near Decision Boundary for Imbalance Problems
Zhang, J., Wang, T., Ng, W. W. Y., Zhang, S., & Nugent, C. (2019) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc48188.2019.8949290 · Cited by 21
“This is commonly encountered in many realworld applications, for examples anomaly detection [2], electricity pricing [3], and diagnosis of rare diseases [4].”
BackgroundMethodFelton, B. R., O’Neil, G. L., Robertson, M.-M., Fitch, G. M., & Goodall, J. L. (2019) · Water · doi:10.3390/w11061158 · Cited by 24
“This set of performance criteria is not exhaustive but is appropriate to evaluate the testing area given the nearly balanced true wetland and true non-wetland classes [51].”
BackgroundAutomated Neuron Detection in High-Content Fluorescence Microscopy Images Using Machine Learning
Mata, G., Radojević, M., Fernandez-Lozano, C., Smal, I., Werij, N., Morales, M., Meijering, E. H. W., & Rubio, J. (2018) · Neuroinformatics · doi:10.1007/s12021-018-9399-4 · Cited by 20
On Convergence of the Class Membership Estimator in Fuzzy $k$-Nearest Neighbor Classifier
Banerjee, I., Mullick, S. S., & Das, S. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2018.2874017 · Cited by 19
“Furthermore, it is well known that FkNN fails to achieve commendable accuracy in presence of class imbalance [28], [29], i.”
BackgroundChen, Z.-S., Zhu, Q., Xu, Y., He, Y., Su, Q., Liu, Y. C., & Nagy, Z. K. (2021) · Soft Computing · doi:10.1007/s00500-021-05641-4 · Cited by 19
A novel cost‐sensitive algorithm and new evaluation strategies for regression in imbalanced domains
Sadouk, L., Gadi, T., & Essoufi, E. H. (2021) · Expert Systems · doi:10.1111/exsy.12680 · Cited by 19
“Very few efforts have been made regarding evaluation approaches for regression tasks in imbalanced domains (Branco et al., 2016).”
BackgroundMachine learning-based sensitivity of steel frames with highly imbalanced and high-dimensional data
Koh, H., & Blum, H. B. (2022) · Engineering Structures · doi:10.1016/j.engstruct.2022.114126 · Cited by 22
Efficient Generative Adversarial Networks for Imbalanced Traffic Collision Datasets
Chen, M., Chiang, H., & Huang, W. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3162395 · Cited by 19
“Though a skewed dataset may still be used to train a model that can accurately classify underrepresented data, most of the results of such a model will tend to be skewed towards the overrepresented categories [15], [16].”
BackgroundPredicting severely imbalanced data disk drive failures with machine learning models
Ahmed, J., & Green, R. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100361 · Cited by 27
Mvula, P. K., Branco, P., Jourdan, G.-V., & Viktor, H. L. (2023) · Discover Data · doi:10.1007/s44248-023-00003-x · Cited by 25
“Additional techniques include data augmentation which can be done through methods such as over-/under-sampling, ensemble methods such as bagging and boosting, or using scalar and graphical metrics which are adequate for imbalanced settings [163].”
MethodSelf-citationComputer-aided diagnostic system for hypertensive retinopathy: A review
Suman, S., Tiwari, A. K., & Singh, K. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107627 · Cited by 23
Machine learning from real data: A mental health registry case study
Gentili, E., Franchini, G., Zese, R., Alberti, M., Ferrara, M., Domenicano, I., & Grassi, L. G. (2023) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2023.100132 · Cited by 28
Addressing Imbalanced Data in Network Intrusion Detection: A Review and Survey
Al-Qarni, E. A., & Al-Asmari, G. A. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.0150215 · Cited by 19
“Branco et al. [7] undertook a negative impact test of class imbalance on classifiers like decision trees, neural networks, and k-nearest neighbor.”
BackgroundGANs in the Panorama of Synthetic Data Generation Methods
Vaz, B., & Figueira, Á. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3657294 · Cited by 30
“Additionally, the motivation for creating synthetic data can be linked to the reduction of costs and time.”
Bridging expert knowledge with deep learning techniques for just-in-time defect prediction
Zhou, X., Han, D., & Lo, D. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10591-0 · Cited by 29
“…has traditionally been the primary evaluation metric in prior JIT defect prediction research, it is essential to acknowledge that it can sometimes provide an overly optimistic assessment of model performance when dealing with imbalanced datasets (Davis and Goadrich 2006; Branco et al. 2016).”
Mobile QoE prediction in the field
Boz, E., Finley, B., Oulasvirta, A., Kilkki, K., & Manner, J. (2019) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2019.101039 · Cited by 24
“For evaluation, we use several common imbalanced learning metrics including G-Mean, index balanced accuracy (IBA) of G-Mean, and F1 [9].”
BackgroundMethodPredicting Louisiana Public High School Dropout through Imbalanced Learning Techniques
Orooji, M., & Chen, J. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00085 · Cited by 19
Health care fraud classifiers in practice
Ekin, T., Frigau, L., & Conversano, C. (2021) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.2633 · Cited by 28
Benchmarking quantum tomography completeness and fidelity with machine learning
Yong-Siah, T., Shin, S., Jeong, H., Kim, Y., Kim, Y.-H., Struchalin, G. I., Kovlakov, E. V., Straupe, S. S., Kulik, S. P., Leuchs, G., et al. (2021) · Library Open Repository (Universidad Complutense Madrid) · Cited by 20
An empirical evaluation of imbalanced data strategies from a practitioner’s point of view
Wainer, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124863 · Cited by 18
An improved deep forest for alleviating the data imbalance problem
Gao, J., Liu, K., Wang, B., Wang, D., & Hong, Q. (2020) · Soft Computing · doi:10.1007/s00500-020-05279-8 · Cited by 19
Tekouabou, S. C. K., Alaoui, E. A. A., Chabbar, I., Toulni, H., Cherif, W., & Silkan, H. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115975 · Cited by 20
Das, S., Wang, Y., Gong, J., Ding, L., Munchak, S. J., Wang, C., Wu, D. L., Liao, L., Olson, W. S., & Barahona, D. (2022) · Remote Sensing · doi:10.3390/rs14153631 · Cited by 26
Przybyła‐Kasperek, M. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109612 · Cited by 18
Wang, X., Liu, X., & Euston, T. L. (2022) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2022.130066 · Cited by 18
Spatial-SMOTE for handling imbalance in spatial regression tasks
Gavas, R. D., Das, M., Ghosh, S. K., & Pal, A. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15919-4 · Cited by 19
“Hence, standard measures of regression testing are not applicable here [18].”
Nazari, M.-J., Shalbafan, M., Eissazade, N., Khalilian, E., Vahabi, Z., Masjedi, N., Ghidary, S. S., Saadat, M., & Sadegh‐Zadeh, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303699 · Cited by 18
“The F1 score and balanced accuracy are particularly valuable when dealing with imbalanced datasets [41–43].”
BackgroundAdvances in Feature Selection for Data and Pattern Recognition: An Introduction
Stańczyk, U., Zielosko, B. M., & Jain, L. C. (2017) · Intelligent systems reference library · doi:10.1007/978-3-319-67588-6_1 · Cited by 18
Range Based Confusion Matrix for Imbalanced Time Series Classification
Zhou, X., & Valle, A. D. (2020) · International Conference on Data Science and Machine Learning Applications (CDMA) · doi:10.1109/cdma47397.2020.00006 · Cited by 18
“The above metrics (true positives, true negatives, precision, and recall) are all extracted from a completed confusion matrix, and along with area under the ROC curve represent typical approaches to evaluate performance of a binary classifier [10].”
BackgroundMethodWireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000114 · Cited by 59
WSMOTER: a novel approach for imbalanced regression
Camacho, L., & Bação, F. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05608-6 · Cited by 27
Dou, L., Li, X.-L., Ding, H., Xu, L., & Xiang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2991477 · Cited by 18
“In this paper, several unbalanced strategies are used to solve the unbalanced problem of training dataset, including resampling methods and ensemble classifiers [49], [110]–[116].”
MethodHeld, P., Schubert, R. A., Pridgen, S., Kovacevic, M., Montes, M., Christ, N. M., Banerjee, U., & Smith, D. L. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.03.066 · Cited by 19
Model Optimization in Imbalanced Regression
Silva, A., Ribeiro, R. P., & Moniz, N. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-18840-4_1 · Cited by 27
Self-citationPermuted KPCA and SMOTE to Guide GAN-Based Oversampling for Imbalanced HSI Classification
Miftahushudur, T., Grieve, B., & Yin, H. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3326963 · Cited by 23
Lee, S.-J., Oh, H. J., Son, Y., Kim, J., Kwon, I.-J., Kim, B., Lee, J.-H., & Kim, H.-K. (2024) · BMC Oral Health · doi:10.1186/s12903-024-03898-3 · Cited by 27
Davidashvilly, S., Cardei, M. A., Hssayeni, M. D., Chi, C., & Ghoraani, B. (2024) · BioMedical Engineering OnLine · doi:10.1186/s12938-024-01214-2 · Cited by 22
“This decision was made due to the imbalanced nature of the PD dataset, which required taking both true positives and false negatives into account [22].”
BackgroundLocal Data Characteristics in Learning Classifiers from Imbalanced Data
Błaszczyński, J., & Stefanowski, J. (2017) · Studies in computational intelligence · doi:10.1007/978-3-319-67946-4_2 · Cited by 21
A Multitiered Solution for Anomaly Detection in Edge Computing for Smart Meters
Utomo, D., & Hsiung, P. (2020) · Sensors · doi:10.3390/s20185159 · Cited by 25
“[15] concluded that, for three minority/majority samples 1/99, 5/95, and 10/90 in five strategies, including SMOTE and ADASYN, did not yield good results.”
BackgroundMethodJahn, S., & Hertig, E. (2020) · Air Quality Atmosphere & Health · doi:10.1007/s11869-020-00961-0 · Cited by 24
“Typical evaluation metrics as accuracy and error rate are not suitable for highly imbalanced data sets when the primary goal is the identification of rare events (Branco et al. 2016).”
BackgroundGlobal Data Distribution Weighted Synthetic Oversampling Technique for Imbalanced Learning
Wang, Z., & Hong-ju, W. (2021) · IEEE Access · doi:10.1109/access.2021.3067060 · Cited by 17
“In the research on class imbalance, the technology aimed at improving the classification model can be divided into three directions: Special-purpose Learning Methods, datalevel method, and prediction post-processing [1], [8].”
BackgroundMethodExploiting limited players’ behavioral data to predict churn in gamification
Loria, E., & Marconi, A. (2021) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2021.101057 · Cited by 20
Actively Balanced Bagging for Imbalanced Data
Błaszczyński, J., & Stefanowski, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-60438-1_27 · Cited by 17
Class-Weighted Evaluation Metrics for Imbalanced Data ClassificationPreprint
Gupta, A. K., Tatbul, N., Marcus, R., Zhou, S., Lee, I., & Gottschlich, J. (2021) · arXiv (Cornell University) · Cited by 25
van Braak, B., Osterrieder, J. R., & Machado, M. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103972 · Cited by 23
GDHS: An efficient hybrid sampling method for multi-class imbalanced data classification
Yan, Y., Lv, Y., Han, S., Yu, C., & Zhou, P. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130088 · Cited by 17
Wong, T.-T. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2986749 · Cited by 23
Counterfactual-based minority oversampling for imbalanced classification
Wang, S., Luo, H., Huang, S., Li, Q., Liu, L., Su, G., & Liu, M. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106024 · Cited by 19
Aldraimli, M., Osman, S. O. S., Grishchuck, D., Ingram, S., Lyon, R., Mistry, A., Oliveira, J., Samuel, R. J., Shelley, L. E. A., Soria, D., et al. (2022) · Advances in Radiation Oncology · doi:10.1016/j.adro.2021.100890 · Cited by 16
Predicting the capacity of thin-walled beams at elevated temperature with machine learning
Couto, C., Tong, Q., & Gernay, T. (2022) · Fire Safety Journal · doi:10.1016/j.firesaf.2022.103596 · Cited by 16
Identification of neurotoxic compounds in cyanobacteria exudate mixtures
Zi, Y., Barker, J. R., MacIsaac, H. J., Zhang, R., Gras, R., Chiang, Y., Zhou, Y., Lu, F., Cai, W., Sun, C., et al. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.159257 · Cited by 16
Transfer learning for the efficient detection of COVID-19 from smartphone audio data
Campana, M. G., Delmastro, F., & Pagani, E. (2023) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2023.101754 · Cited by 19
Ajuwon, B. I., Richardson, A., Roper, K. G., Sheel, M., Audu, R., Salako, B. L., Bojuwoye, M. O., Katibi, I. A., & Lidbury, B. A. (2023) · Scientific Reports · doi:10.1038/s41598-023-30440-2 · Cited by 18
Mardikoraem, M., & Woldring, D. (2023) · Pharmaceutics · doi:10.3390/pharmaceutics15051337 · Cited by 20
“Note that it is also generally advised to use multiple metrics to establish more rigorous analyses, specifically in imbalanced datasets [59,60].”
BackgroundAn Online Anomaly Detection Approach for Fault Detection on Fire Alarm Systems
Tomé, E. S., Ribeiro, R. P., Dutra, I., & Rodrigues, A. S. (2023) · Sensors · doi:10.3390/s23104902 · Cited by 17
“However, this approach comes with two main problems: the first is that very few examples of abnormality are expected when compared to the examples of normality, which poses additional difficulties to the learning task [12].”
BackgroundSelf-citationAttention-Based Wildland Fire Spread Modeling Using Fire-Tracking Satellite Observations
Zou, Y., Sadeghi, M., Liu, Y., Puchko, A., Le, S., Chen, Y., Andela, N., & Gentine, P. (2023) · Fire · doi:10.3390/fire6080289 · Cited by 20
“All the model simulations were evaluated using four metrics: recall, precision, F-1, and a precision–recall area under the curve (PR_AUC) score [32] if applicable.”
MethodLearning from Imbalanced Data in Healthcare: State-of-the-Art and Research Challenges
Roy, D., Roy, A., & Roy, U. (2024) · Studies in computational intelligence · doi:10.1007/978-981-99-8853-2_2 · Cited by 16
Guhan, T., & Revathy, N. (2024) · Signal Image and Video Processing · doi:10.1007/s11760-024-03470-0 · Cited by 16
“The study [3] evaluates the various methods performance evaluation in the context of predictive modeling with skewed distribution based on the imbalanced dataset.”
GEP-based classifier for mining imbalanced data
Jędrzejowicz, J., & Jędrzejowicz, P. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114058 · Cited by 18
Chen, X., Liu, H., Liu, F., Huang, T., Shen, R., Deng, Y., & Chen, D. (2021) · Environmental Pollution · doi:10.1016/j.envpol.2021.118153 · Cited by 18
Wireless for Machine LearningPreprint
Hellström, H., da Silva, J. M. D., Fodor, V., & Fischione, C. (2020) · arXiv.org · doi:10.48550/arxiv.2008.13492 · Cited by 19
“Simultaneously, breakthroughs in Machine Learning (ML) are allowing us to take advantage of large data sets to solve a wide range of complex problems, such as image recognition [2], language processing [3], and predictive modeling [4].”
BackgroundKe, J. X. C., DhakshinaMurthy, A., George, R. B., & Branco, P. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00199-0 · Cited by 23
Self-citationInterpretable Minority Synthesis for Imbalanced Classification
He, Y., Lin, F., Yuan, X., & Tzeng, N.-F. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/350 · Cited by 16
“Existing studies can be clas-sified into two categories [ Branco et al. , 2016; Huang et al. , 2016].”
BackgroundMethodPanchavati, S., Zelin, N. S., Garikipati, A., Pellegrini, E., Iqbal, Z., Barnes, G., Hoffman, J. L., Calvert, J. S., Mao, Q., & Das, R. (2022) · American Journal of Infection Control · doi:10.1016/j.ajic.2021.11.012 · Cited by 22
Orji, F. A., & Vassileva, J. (2023) · Journal of Educational Technology Systems · doi:10.1177/00472395231191139 · Cited by 31
“Random oversampling is one of the most common methods that have been applied by researchers to handle the issue of unbalanced classes (Branco et al., 2016).”
MethodSala, D. A., Deyne, A. V. Y.-D., Mannens, E., & Jalalvand, A. (2023) · Metals · doi:10.3390/met13101699 · Cited by 15
“Although the ROC can be quite informative for classification tasks, in cases with a high class imbalance, it can be quite misleading [22].”
BackgroundInfluentialVoice spoofing detection for multiclass attack classification using deep learning
Boyd, J., Fahim, M., & Olukoya, O. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100503 · Cited by 29
Kamboj, P., Banerjee, A., Boerwinkle, V. L., & Gupta, S. K. S. (2024) · Frontiers in Neurology · doi:10.3389/fneur.2023.1324461 · Cited by 15
“This triggers the fundamental Achillies heel of classification science, that is, class imbalance (20), where the statistical approach lacks enough pathological data to effectively distinguish abnormal patterns amidst significant individual variation.”
BackgroundAn automated approach for binary classification on imbalanced data
Vieira, P., & Rodrigues, F. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-023-02046-7 · Cited by 20
“Several performance metrics extensively used in balanced domains cannot be applied to the imbalanced case since the use of the majority class in the metric could lead to a misleading evaluation of performance [4].”
Palli, A. S., Jaafar, J., Gilal, A. R., Alsughayyir, A., Gomes, H. M., Alshanqiti, A. M., & Omar, M. B. (2024) · Journal of Information and Communication Technology · doi:10.32890/jict2024.23.1.5 · Cited by 32
Luca, G. P. D., Parghi, N., Hayek, R. E., Bloch‐Elkouby, S., Peterkin, D., Wolfe, A., Rogers, M. L., & GALYNKER, I. I. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299048 · Cited by 19
A unified model-based framework for doublet or multiplet detection in single-cell multiomics data
Hu, H., Wang, X., Feng, S., Xu, Z., Liu, J., Heidrich-O’Hare, E., Chen, Y., Yue, M., Zeng, L., Rong, Z., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-49448-x · Cited by 15
“The F 1 score is de fi ned as F 1score= 2*precision*recall precision+recall ð 41 Þ The AUPRC metric has been widely used for the benchmarking of multiplet detection methods 37 , as it is suitable for the scenario where the two binary classes are imbalanced 48 .”
Adversarial attacks based on time-series features for traffic detection
Lu, H., Liu, J., Peng, J., & Lu, J. (2024) · Computers & Security · doi:10.1016/j.cose.2024.104175 · Cited by 15
Improving Interpretable Prediction Models for Antimicrobial Resistance
Cánovas-Segura, B., Morales, A., Lopez-Martinez-Carrasco, A., Campos, M., Juárez, J. M., Rodríguez, L. L., & Palacios, F. (2019) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2019.00111 · Cited by 16
“Imbalanced datasets can affect the accuracy of most prediction models, and the best approach to deal with them may depend on different factors, such as the data mining technique or even the error measure employed to build the model [12].”
Rescaled-LSTM for Predicting Aircraft Component Replacement Under Imbalanced Dataset Constraint
Dangut, M. D., Skaf, Z., & Jennions, I. K. (2020) · Advances in Science and Engineering Technology International Conferences (ASET) · doi:10.1109/aset48392.2020.9118253 · Cited by 19
“…in many application domains, for example, in aircraft predictive maintenance, the historical data is most times imbalanced, for instance, aircraft component replacements due to unscheduled maintenance are most time rare in the overall maintenance records database (Branco, Torgo, and Ribeiro 2016).”
BackgroundBandgap analysis of transition-metal dichalcogenide and oxide via machine learning approach
Kumar, U., Mishra, K. A., Kushwaha, A., & Cho, S. B. (2022) · Journal of Physics and Chemistry of Solids · doi:10.1016/j.jpcs.2022.110973 · Cited by 18
Metadata
- Authors
- Branco, P., Torgo, L., & Ribeiro, R. P.
- Affiliations
- Universidade do Porto (PT)
- LIAAD-INESC TEC, DCC-Faculty of Sciences, University of Porto, Porto, Portugal
- Venue
- ACM Computing Surveys
- Published
- 2016-08-13
- Volume
- 49
- Issue
- 2
- Pages
- 1-50
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2490420619
- Semantic Scholar
- 736018160f8e6f6bd9b2a9101cd13ee67e573097
- Cited by
- 1,129
- References
- 266
- Citations by year
- 2026: 101 · 2025: 113 · 2024: 167 · 2023: 167 · 2022: 176 · 2021: 137 · 2020: 96 · 2019: 72 · 2018: 60 · 2017: 37 · 2016: 3
- FWCI
- 47.12
- Type
- journal article
- Language
- en
- Open access
- Locations
- ACM Computing Surveys (publishedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Funders
- North Portugal Regional Operational Programme (Project NORTE-07-0124-FEDER-000059)
- European Regional Development Fund (POCI-01-0145-FEDER-006961)
- Fundação para a Ciência e a Tecnologia (PD/BD/105788/2014, SFRH/BSAB/113896/2015)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Social Sciences › Business, Management and Accounting › Marketing › Customer churn and segmentation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- class imbalance, predictive modeling, rare event prediction, cost-sensitive learning, classification, regression analysis, fraud detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.