A Survey of Predictive Modeling on Imbalanced Domains
Open accessThe DOI matches its Crossref record; 261 of the 266 references it cites were found in a registry or an index.
Abstract
Many real-world data-mining applications involve obtaining predictive models using datasets with strongly imbalanced distributions of the target variable. Frequently, the least-common values of this target variable are associated with events that are highly relevant for end users (e.g., fraud detection, unusual returns on stock markets, anticipation of catastrophes, etc.). Moreover, the events may have different costs and benefits, which, when associated with the rarity of some of them on the available training data, creates serious problems to predictive modeling techniques. This article presents a survey of existing techniques for handling these important applications of predictive analytics. Although most of the existing work addresses classification tasks (nominal target variables), we also describe methods designed to handle similar problems within regression tasks (numeric target variables). In this survey, we discuss the main challenges raised by imbalanced domains, propose a definition of the problem, describe the main approaches to these tasks, propose a taxonomy of the methods, summarize the conclusions of existing comparative studies as well as some theoretical analyses of some methods, and refer to some related problems within predictive modeling.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Here, techniques such as under-sampling and synthetic data have been found to enhance model performance [16].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
In the citing paper
“Earlier trends of opportunistic data collection and post hoc justifications of large datasets are gradually moving towards a requirement for more deliberative data collection methods [35,36], sampling techniques [16] and minimal data architectures [57] to deliver better performance without reducing model accuracy.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · cited 1×
“Developments made in this context include one-class SVMs (e.g., Sch¨olkopf et al. [2001], Manevitz and Yousef [2002], Raskutti and Kowalczyk [2004], Zhuang and Dai [2006a, 2006b], and Lee and Cho [2006]) and the use of an autoencoder (or autoassociator) (e.g., Japkowicz et al. [1995] and Japkowicz…”
Method
Research works printed but not linked: 52
- Akbani Rehan, 2004, Machine Learning: ECML
- Alejo Roberto, 2013, Rosa Maria Valdovinos, and J. Horacio Pacheco-Sánchez
- Alejo Roberto, 2007, Ramón Alberto Mollineda, and José Salvador Sánchez.
- Eleuterio Roberto Alejo, 2011, Vicente García Jiménez, and Rosa María Valdovinos Rosas.
- Attenberg Josh, Imbalanced Learning: Foundations
- Bi Jinbo, Proc. of the 20th Int. Conf. on Machine Learning. 43--50
- Branco Paula, Re-sampling Approaches for Regression Tasks under Imbalanced Domains. Master's thesis. Dept. Computer Science
- Breiman Leo, 1984, Stone
- Chawla Nitesh V., 2003, Bowyer
- Chen Chao, 2004, Using random forest to learn imbalanced data
- Chyi Yu-Meei, 2003, Department of Information Management
- Cieslak David A., 2008, Chawla
- Doucette John, 2008, Heywood
- Drummond Chris, Workshop on Learning from Imbalanced Datasets II, 11
- Elkan Charles, 2001, IJCAI'01: Proc. of 17th Int. Joint Conf. of Artificial Intelligence, 1
- Ferri César, 2005, Proceedings of the Second Workshop on ROC Analysis in Machine Learning. 33--40
- Ferri César, Proceedings of the 28th International Conference on Machine Learning (ICML-11)
- Forman George, 2004, Knowledge Discovery in Databases: PKDD
- He Haibo, 2008, IEEE International Joint Conference on Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE, 1322--1328
- Holte Robert C., IJCAI, 89
- 10.5555/1681514.1682710 · doi:10.5555/1681514.1682710
- Japkowicz Nathalie, 2000, AAAI Workshop on Learning from Imbalanced Data Sets, 68
- Japkowicz Nathalie, 2003, Workshop on Learning from Imbalanced Data Sets II, 1723
- Japkowicz Natalie, Imbalanced Learning: Foundations
- Jeatrakul Piyasak, 2010, Kok Wai Wong, and Chun Che Fung
- Joshi Mahesh V., Proceedings IEEE International Conference on Data Mining, 2001. ICDM 2001. IEEE, 257--264
- Kubat Miroslav, 1997, Proc. of the 14th Int. Conf. on Machine Learning. Morgan Kaufmann, 179--186
- Liu Alexander, 2007, Martin
- Liu Wei, 2010, Chawla
- Maloof Marcus A., 2003, ICML-2003 Workshop on Learning from Imbalanced Data Sets II, 2
- Mani Inderjeet, 2003, Proceedings of Workshop on Learning from Imbalanced Datasets.
- 10.5555/1314498.1314514 · doi:10.5555/1314498.1314514
- Pearson Ronald, 2003, Proceedings of the ICML, 3
- Provost Foster J, 1998, ICML'98: Proc. of the 15th Int. Conf. on Machine Learning. Morgan Kaufmann Publishers, 445--453
- Raeder Troy, 2012, Chawla
- Rita, 2003, Ribeiro and Luís Torgo
- Rijsbergen Cornelis V., 1979, Information Retrieval. Dept. of Computer Science
- Sánchez-Crisostomo Juan Pablo, 2014, Rosa María Valdovinos, and J. Horacio Pacheco-Sánchez
- Sánchez-Monedero Javier, 2013, Pedro Antonio Gutiérrez, and Cesar Hervás-Martínez
- Songwattanasiri Panote, 2010, Proceedings of the Annual International Conference on Computer Science Education: Innovation and Technology
- Torgo Luís, 2003, Ribeiro
- Torgo Luís, 2007, Ribeiro
- Wagstaff Kiri L., 2013, Gilmore
- Wallace Byron C., 2011 IEEE 11th International Conference on Data Mining (ICDM). IEEE, 754--763
- Wang Heng, 2015, Concept drift detection for imbalanced stream data. arXiv Preprint arXiv:1504.01044 · arXiv
- Wang Xiaoguang, Advances in Artificial Intelligence
- Weiss Gary M., Data Mining
- Weiss Gary M., Imbalanced Learning: Foundations
- Cheng, Proceedings of the 7th Australasian Data Mining Conference-Volume 87
- Wu Gang, ICML 2003 Workshop on Learning from Imbalanced Data Sets II
- 10.5555/951949.952181 · doi:10.5555/951949.952181
- Zhang Dongmei, 2011, A novel improved SMOTE resampling algorithm based on fractal, J. Comput. Inform. Syst., 7, 2204
Cited by
Items 101–200 of 1,000
New Appliance Detection for Nonintrusive Load Monitoring
Zhang, J., Chen, X., Ng, W. W. Y., Lai, C. S., & Lai, L. L. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2916213 · Cited by 69
“such as diagnosis of rare diseases, forecasting rare extreme returns in financial markets [8], power system dynamic sta-”
BackgroundBinhammad, M. H. Y., Othman, A., Abuljadayel, L., Mheiri, H. A., Alkaabi, M., & Almarri, M. (2024) · Creative Education · doi:10.4236/ce.2024.157091 · Cited by 101
“In the description, the methodology is used (Branco et al., 2017).”
Addressing the antibody germline bias and its effect on language models for improved antibody design
Olsen, T. H., Moal, I. H., & Deane, C. M. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae618 · Cited by 67
On the Dynamics of Classification Measures for Imbalanced and Streaming Data
Brzeziński, D., Stefanowski, J., Susmaga, R., & Szczęch, I. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2899061 · Cited by 83
“Over the past years, the problem of improving classifier performance on such skewed data has received much interest, resulting in several proposals of specialized data preprocessing methods and classifier modifications [1], [2].”
BackgroundTang, J., Henderson, A., & Gardner, P. (2021) · The Analyst · doi:10.1039/d0an02155e · Cited by 79
Zaghloul, M., Barakat, S., & Rezk, A. (2024) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2024.103865 · Cited by 110
Manipulating Recommender Systems: A Survey of Poisoning Attacks and Countermeasures
Nguyen, T. T., Nguyen, Q. V. H., Nguyên, T. T., Huynh, T. T., Nguyen, T. T., Weidlich, M., & Yin, H. (2024) · ACM Computing Surveys · doi:10.1145/3677328 · Cited by 125
“Considering the vital role poisoning attacks play in the field of machine learning, they have been studied for a wide range of machine learning models, including support vector machines [124], decision trees [49], regression models [21], and neural networks [54].”
BackgroundMachine Learning Classifiers on Breast Cancer Recurrences
Magboo, V. P. C., & Magboo, M. S. A. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.09.044 · Cited by 65
An Oversampling Method of Unbalanced Data for Mechanical Fault Diagnosis Based on MeanRadius-SMOTE
Duan, F., Zhang, S., Yan, Y., & Cai, Z. (2022) · Sensors · doi:10.3390/s22145166 · Cited by 73
“Generally, the solution to the problem of unbalanced data sets is mainly divided into data and algorithm aspects, and sometimes they are combined [16].”
BackgroundResampling strategies for imbalanced time series forecasting
Moniz, N., Branco, P., & Torgo, L. (2017) · International Journal of Data Science and Analytics · doi:10.1007/s41060-017-0044-3 · Cited by 74
“Typically the problem of imbalanced domains is tackled either by pre-processing methods, special-purpose learning methods or post-processing methods [5].”
MethodSelf-citationInteger Convolutional Neural Network for Seizure Detection
Truong, N. D., Nguyen, A. D., Kuhlmann, L., Bonyadi, M. R., Yang, J., Ippolito, S. J., & Kavehei, O. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2018.2842761 · Cited by 68
“Imbalanced number of instances in each class introduces a challenge in many classification tasks [29].”
BackgroundEnhanced Machine Learning Techniques for Early HARQ Feedback Prediction in 5G
Strodthoff, N., Göktepe, B., Schierl, T., Hellge, C., & Samek, W. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2934001 · Cited by 78
Improving Enzyme Optimum Temperature Prediction with Resampling Strategies and Ensemble Learning
Gado, J. E., Beckham, G. T., & Payne, C. M. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00489 · Cited by 70
Flakify: A Black-Box, Language Model-Based Predictor for Flaky Tests
Fatima, S., Ghaleb, T. A., & Briand, L. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3201209 · Cited by 62
“which used the synthetic minority oversampling technique (SMOTE) [56], we used random oversampling [57], which adds random copies of the minority class to the dataset.”
MethodA Classification Method Based on Feature Selection for Imbalanced Data
Liu, Y., Wang, Y., Ren, X., Zhou, H., & Diao, X. (2019) · IEEE Access · doi:10.1109/access.2019.2923846 · Cited by 64
“applications, such as fraud detection, cancer diagnosing, network intrusion detection, and entity resolution [7], [8].”
BackgroundWang, Y., Coiera, E., Runciman, W., & Magrabi, F. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0483-8 · Cited by 63
“Sensitivity can also be improved by increasing misclassification costs for rare classes so that they gain more importance during classifier training [47].”
BackgroundSeng, Z., Kareem, S. A., & Varathan, K. D. (2021) · IEEE Access · doi:10.1109/access.2021.3088414 · Cited by 75
“Several difficulties, including standard classification algorithms and inappropriate global learning metrics, were responsible for the performance degradation in imbalanced classification [1], [21], [22].”
BackgroundInfluentialOptimizing CNN-LSTM neural networks with PSO for anomalous query access control
Kim, T.-Y., & Cho, S. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.07.154 · Cited by 64
Performance analysis of machine learning classifiers for non-technical loss detection
Ghori, K. M., Imran, M. A., Nawaz, A., Abbasi, R. A., Ullah, A., & Szathmáry, L. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01649-9 · Cited by 72
A Crash Injury Model Involving Autonomous Vehicle: Investigating of Crash and Disengagement Reports
Sinha, A., Vu, V., Chand, S., Wijayaratna, K. P., & Dixit, V. V. (2021) · Sustainability · doi:10.3390/su13147938 · Cited by 72
Zelenkov, Y. A., & Volodarskiy, N. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115559 · Cited by 68
Pang, K., Li, L., Ouyang, W., Liu, X., & Tang, Y. (2022) · Diagnostics · doi:10.3390/diagnostics12051068 · Cited by 84
“A better sampling technique or more datasets in order to obtain balanced datasets can achieve better performance [58].”
MethodNg, W. W. Y., Zhang, J., Lai, C. S., Pedrycz, W., Lai, L. L., & Wang, X. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2850930 · Cited by 64
“When class imbalance happens, the traditional classifiers yield poor generalization performance on the minority class (in a twoclass problem, a class containing more training samples than the other class is referred as the majority class, while the other one is referred as the minority class) [11].”
BackgroundInstance weighted SMOTE by indirectly exploring the data distribution
Zhang, A., Yu, H., Zhou, S., Huan, Z., & Yang, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108919 · Cited by 60
FIRE-DES++: Enhanced online pruning of base classifiers for dynamic ensemble selection
Cruz, R. M. O., Oliveira, D. V. R., Cavalcanti, G. D. C., & Sabourin, R. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.037 · Cited by 67
Jeune, L. L., Goedemé, T., & Mentens, N. (2021) · IEEE Access · doi:10.1109/access.2021.3075066 · Cited by 72
“For example, Receiver Operating Characteristic (ROC) or Precision-Recall (PR) curves with an Area Under Curve (AUC) value [50] use thresholding to evaluate the performance of a dataset.”
Two density-based sampling approaches for imbalanced and overlapping data
Mayabadi, S., & Saadatfar, H. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108217 · Cited by 65
Fernández, A., Carmona, C. J., del Jesús, M. J., & Herrera, F. (2017) · International Journal of Neural Systems · doi:10.1142/s0129065717500289 · Cited by 64
Sharma, A., & Rani, R. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.08.011 · Cited by 62
Laña, I., Medina, J., Vlahogianni, E. I., & Ser, J. D. (2021) · Sensors · doi:10.3390/s21041121 · Cited by 82
“● Imbalanced and cost-sensitive learning [206], [207], which link to the need for avoiding model bias, not only to ensure the generalization of its output, but also to reduce the”
BackgroundiTTCA-RF: a random forest predictor for tumor T cell antigens
Jiao, S., Zou, Q., Guo, H., & Shi, L. (2021) · Journal of Translational Medicine · doi:10.1186/s12967-021-03084-x · Cited by 58
LDAS: Local density-based adaptive sampling for imbalanced data classification
Yan, Y., Jiang, Y., Zheng, Z., Yu, C., Zhang, Y., & Zhang, Y. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116213 · Cited by 74
Zhang, X., Akber, M. Z., & Zheng, W. (2022) · Journal of Building Engineering · doi:10.1016/j.jobe.2022.104997 · Cited by 66
A prescriptive analytics framework for efficient E-commerce order delivery
Kandula, S., Krishnamoorthy, S., & Roy, D. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113584 · Cited by 72
Optimal Entropy Genetic Fuzzy-C-Means SMOTE (OEGFCM-SMOTE)
Moutaouakil, K. E., Roudani, M., & Ouissari, A. E. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110235 · Cited by 59
Deep learning Using Physically-Informed Input Data for Wetland Identification
O’Neil, G. L., Goodall, J. L., Behl, M., & Saby, L. (2020) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104665 · Cited by 59
Brzeziński, D., Minku, L. L., Pewinski, T., Stefanowski, J., & Szumaczuk, A. (2021) · Knowledge and Information Systems · doi:10.1007/s10115-021-01560-w · Cited by 61
Feature selection and its combination with data over-sampling for multi-class imbalanced datasets
Tsai, C., Chen, K.-C., & Lin, W. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111267 · Cited by 62
Procházka, A., Gulati, S., Holinka, Š., & Smutek, D. (2019) · Technology in Cancer Research & Treatment · doi:10.1177/1533033819830748 · Cited by 59
Adaptive Random Forests with Resampling for Imbalanced data Streams
Ferreira, L. E. B., Gomes, H. M., Bifet, A., & Oliveira, L. S. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852027 · Cited by 67
Hung, C., & Gini, G. C. (2021) · Molecular Diversity · doi:10.1007/s11030-021-10250-2 · Cited by 63
A Hybrid ConvLSTM-Based Anomaly Detection Approach for Combating Energy Theft
Gao, H., Kuenzel, S., & Zhang, X. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3201569 · Cited by 66
Predicting Drug Side Effects Using Data Analytics and the Integration of Multiple Data Sources
Lee, W., Huang, J.-Y., Chang, H., Lee, K., & Lai, C.-T. (2017) · IEEE Access · doi:10.1109/access.2017.2755045 · Cited by 58
“Though the machine learning procedure is an efficient and convenient method to construct data models based on known data instances that are subsequently used to predict unknown data, to ensure the success of this approach, the problem of class imbalance must be overcome [36], [37].”
MethodSpatio-temporal MLP network for seizure prediction using EEG signals
Li, C., Shao, C., Song, R., Xu, G., Liu, X., Qian, R., & Chen, X. (2022) · Measurement · doi:10.1016/j.measurement.2022.112278 · Cited by 60
Resampling strategies for imbalanced regression: a survey and empirical analysis
Avelino, J. G., Cavalcanti, G. D. C., & Cruz, R. M. O. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10724-3 · Cited by 73
“Our study thus differs from [29], which addresses only theoretical aspects of imbalanced problems in general.”
Fake News Detection Using Deep Learning: A Systematic Literature Review
Alnabhan, M. Q., & Branco, P. (2024) · IEEE Access · doi:10.1109/access.2024.3435497 · Cited by 84
“These algorithms include cost-sensitive learning, manipulating the loss functions, or building ensembles that are specially developed to address the class imbalance problem [231].”
BackgroundInfluentialSelf-citationImportance-SMOTE: a synthetic minority oversampling method for noisy imbalanced data
Liu, J. (2021) · Soft Computing · doi:10.1007/s00500-021-06532-4 · Cited by 50
“…been pointed out in many published works that imbalance is not the only challenge, and that, disjuncts, noise and overlapping problems are also the main reasons for the degradation of traditional classification models with imbalanced data (He and Garcia 2009; Branco et al. 2016; Laurikkala 2001).”
BackgroundJing, X., Wu, Z., Zhang, L., Li, Z., & Mu, D. (2023) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2023.3269463 · Cited by 52
“In imbalanced classification problems, the errors with minority classes are rated as more important than those with majority classes [29].”
Master Your Metrics with Calibration
Siblini, W., Fréry, J., He-Guelton, L., Oblé, F., & Wang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-44584-3_36 · Cited by 71
“Precision-based metrics give false positives more importance, but they are tied to the class prior [2,3].”
BackgroundClass-Imbalanced Learning on Graphs: A Survey
Ma, Y., Tian, Y., Moniz, N., & Chawla, N. V. (2025) · ACM Computing Surveys · doi:10.1145/3718734 · Cited by 91
Hybrid Learning Aided Inactive Constraints Filtering Algorithm to Enhance AC OPF Solution Time
Hasan, F., Kargarian, A., & Mohammadi, J. (2021) · IEEE Transactions on Industry Applications · doi:10.1109/tia.2021.3053516 · Cited by 59
“Although this function works well for many problems, it may not show good performance for imbalanced datasets [30].”
BackgroundLearning from High-Dimensional and Class-Imbalanced Datasets Using Random Forests
Pes, B. (2021) · Information · doi:10.3390/info12080286 · Cited by 62
“Despite more than two decades of continuous research, several open issues remain in the field of imbalance learning [3] and recent trends increasingly focus on the interaction between class imbalance and other difficulties embedded in the nature of the data [4].”
BackgroundMethodLi, J. J., & Tong, X. (2020) · Patterns · doi:10.1016/j.patter.2020.100115 · Cited by 67
“For detailed information, please refer to the two books(29,30) and the survey article.(31)) However, these two measures are not evaluation criteria for one decision rule (classifier) but rather evaluate a trained classification algorithm (e.”
A New Under-Sampling Method to Face Class Overlap and Imbalance
Guzmán-Ponce, A., Rosas, R. M. V., Sánchez, J. S., & Marcial‐Romero, J. R. (2020) · Applied Sciences · doi:10.3390/app10155164 · Cited by 50
“…k NN) rule [22–24], clustering algorithms have been demonstrated to be even a more powerful strategy for addressing the class imbalance problem [16,25,26] because they may reduce the risk of removing potentially useful data and, therefore, they can achieve better results than the k NN-based…”
BackgroundGlobal Soil Salinity Prediction by Open Soil Vis-NIR Spectral Library
Zhou, Y., Chen, S., Hu, B., Ji, W., Li, S., Hong, Y., Xu, H., Wang, N., Xue, J., Zhang, X., et al. (2022) · Remote Sensing · doi:10.3390/rs14215627 · Cited by 48
“37%) will lead to the over-presentation of non-saline soil in the predictive model, so the saline soil will have lower accuracy [52].”
BackgroundMETASET: Exploring Shape and Property Spaces for Data-Driven Metamaterials Design
Chan, Y., Ahmed, F., Wang, L., & Chen, W. (2020) · Journal of Mechanical Design · doi:10.1115/1.4048629 · Cited by 54
Explainable Deep Few-shot Anomaly Detection with Deviation NetworksPreprint
Pang, G., Ding, C., Shen, C., & van den Hengel, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.00462 · Cited by 141
“Our studied problem is relevant to few-shot classification [51], PU learning ( i.e. , learning from positive and unlabeled examples) [52], and imbalanced classification [53], [54].”
An Analysis of Performance Metrics for Imbalanced Classification
Gaudreault, J.-G., Branco, P., & da Gama, J. M. P. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88942-5_6 · Cited by 64
Self-citationRDPVR: Random Data Partitioning with Voting Rule for Machine Learning from Class-Imbalanced Datasets
Hassanat, A. B. A., Tarawneh, A. S., Abed, S. S., Tarawneh, A. S., Alrashidi, M., & Alghamdi, M. (2022) · Electronics · doi:10.3390/electronics11020228 · Cited by 51
Spatial Distribution-based Imbalanced Undersampling
Yan, Y., Zhu, Y., Liu, R., Zhang, Y., Zhang, Y., & Zhang, L. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3161537 · Cited by 84
“Unfortunately, in practice, these methods may lead to a number of problems [9].”
BackgroundOversampling techniques for imbalanced data in regression
Belhouari, S. B., Islam, A., Kassoul, K., Al‐Fuqaha, A., & Bouzerdoum, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124118 · Cited by 62
Learning From High-Dimensional Biomedical Datasets: The Issue of Class Imbalance
Pes, B. (2020) · IEEE Access · doi:10.1109/access.2020.2966296 · Cited by 54
“Of course, metrics different from those here considered could also been used [24], [42], and the best choice of the evaluation framework in the context of imbalanced learning tasks is still a matter of debate [46].”
BackgroundA comprehensive review of the imbalance classification of protein post-translational modifications
Dou, L., Yang, F., Xu, L., & Zou, Q. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab089 · Cited by 50
Comparison of machine learning methods for the classification of cardiovascular disease
Hagan, R., Gillan, C. J., & Mallett, F. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100606 · Cited by 55
“We then applied the random oversampling technique [12] to reduce the bias between categories in order to produce a dataset that we can be use effectively with machine learning methods.”
MethodCost-sensitive learning strategies for high-dimensional and imbalanced data: a comparative study
Pes, B., & Lai, G. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.832 · Cited by 66
“In the context of supervised learning tasks, one of such issues is the imbalance in the class distribution ( Branco, Torgo & Ribeiro, 2016 ; Fernández et al., 2018a ), which may strongly degrade the generalization ability of traditional classification algorithms.”
BackgroundMethodPredictive Modeling of PROTAC Cell Permeability with Machine Learning
Poongavanam, V., Kölling, F., Giese, A., Göller, A. H., Lehmann, L. E., Meibom, D., & Kihlberg, J. O. (2023) · ACS Omega · doi:10.1021/acsomega.2c07717 · Cited by 49
A hybrid deep forest-based method for predicting synergistic drug combinations
Wu, L., Gao, J., Zhang, Y., Sui, B., Wen, Y., Wu, Q., Liu, K., He, S., & Bo, X. (2023) · Cell Reports Methods · doi:10.1016/j.crmeth.2023.100411 · Cited by 55
“TP + TN TP + FN + TN + FP (Equation 5) Precision = TP TP + FP (Equation 6) Recall = TP rate = TP TP + FN (Equation 7) 8) TN rate = TN TN + FP (Equation 9) 10) 11) There are more than 40 evaluation metrics used to deal with the problem of imbalanced data, which are introduced in a comprehensive review proposed by Branc…”
BackgroundLong-tailed visual recognition with deep models: A methodological survey and evaluation
Fu, Y., Xiang, L., Zahid, Y., Ding, G., Mei, T., Shen, Q., & Han, J. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.08.031 · Cited by 54
Man, C. K., Quddus, M., Theofilatos, A., Yu, R., & Imprialou, M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3207798 · Cited by 51
“More-over, matched case-control sampling limited the ability for neural networks to thoroughly learn the non-linear features of crash and non-crash cases [21].”
BackgroundThe evaluation of bankruptcy prediction models based on socio-economic costs
Radovanovic, J., & Haas, C. S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120275 · Cited by 64
Random Balance ensembles for multiclass imbalance learning
Rodríguez, J. J., Díez-Pastor, J.-F., González, Á. A., & Kuncheva, L. I. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105434 · Cited by 48
Optimization of Convolutional Neural Networks for Imbalanced Set Classification
Valova, I., Harris, C., Mai, T., & Gueorguieva, N. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.09.038 · Cited by 48
Potential Anchoring for imbalanced data classification
Koziarski, M. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108114 · Cited by 54
Corporate ESG rating prediction based on XGBoost-SHAP interpretable machine learning model
Jianfeng, Z., & Zhao, Z. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128809 · Cited by 57
Visual-based analysis of classification measures and their properties for class imbalanced problems
Brzeziński, D., Stefanowski, J., Susmaga, R., & Szczęch, I. (2018) · Information Sciences · doi:10.1016/j.ins.2018.06.020 · Cited by 57
Oversampling for Imbalanced Data via Optimal Transport
Yan, Y., Tan, M., Xu, Y., Cao, J., Ng, M. K., Min, H., & Wu, Q. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015605 · Cited by 56
“The imbalanced data issue occurs in many real-world applications, where the samples of one class are much more than samples of other classes (He and Garcia 2008; Branco, Torgo, and Ribeiro 2016; Lin et al. 2018; Gonz ´ alez et al. 2019).”
BackgroundOverview of Machine Learning: Part 2
Le, W., Maleki, F., Romero, F. P., Forghani, R., & Kadoury, S. (2020) · Neuroimaging Clinics of North America · doi:10.1016/j.nic.2020.06.003 · Cited by 55
Antimicrobial Resistance and Machine Learning: Challenges and Opportunities
Elyan, E., Hussain, A., Sheikh, A., Elmanama, A. A., Vuttipittayamongkol, P., & Hijazi, K. (2022) · IEEE Access · doi:10.1109/access.2022.3160213 · Cited by 48
Domain Shifts in Machine Learning Based Covid-19 Diagnosis From Blood Tests
Roland, T., Böck, C., Tschoellitsch, T., Maletzky, A., Hochreiter, S., Meier, J., & Klambauer, G. (2022) · Journal of Medical Systems · doi:10.1007/s10916-022-01807-1 · Cited by 42
“These metrics are negative predictive value (NPV), positive predictive value (PPV), balanced accuracy (BACC), accuracy (ACC), sensitivity, specificity and the F1-score (F1) [66].”
BackgroundAn Ensemble Learning Approach with Gradient Resampling for Class-Imbalance Problems
Zhao, H., Zhao, C., Zhang, X., Liu, N., Zhu, H., Liu, Q., & Xiong, H. (2023) · INFORMS journal on computing · doi:10.1287/ijoc.2023.1274 · Cited by 43
Liu, C., Jin, S., Wang, D., Zichao, L., Yu, J., Zhou, B., & Yang, C. (2020) · IEEE Access · doi:10.1109/access.2020.3018911 · Cited by 43
“Researchers have reported that this imbalanced structure hampers learning, resulting in an undesirable performance of data mining algorithms[1], [2], [3], [4].”
BackgroundShahabadi, M. S. E., Tabrizchi, H., Rafsanjani, M. K., Gupta, B. B., & Palmieri, F. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.120796 · Cited by 45
HyproBert: A Fake News Detection Model Based on Deep Hypercontext
Nadeem, M. I., Mohsan, S. A. H., Ahmed, K., Li, D., Zheng, Z., Shafiq, M., Karim, F. K., & Mostafa, S. M. (2023) · Symmetry · doi:10.3390/sym15020296 · Cited by 50
Procházka, A., Gulati, S., Holinka, Š., & Smutek, D. (2018) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2018.10.001 · Cited by 43
Zhang, C., Soda, P., Bi, J., Fan, G., Almpanidis, G., García, S., & Ding, W. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03772-1 · Cited by 43
“Interested readers may refer to overviews on this topic in [4, 6, 7, 8, 9].”
BackgroundSeamless Lightning Nowcasting with Recurrent-Convolutional Deep Learning
Leinonen, J., Hamann, U., & Germann, U. (2022) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-22-0043.1 · Cited by 60
Fuzzy rule-based oversampling technique for imbalanced and incomplete data learning
Liu, G., Yang, Y., & Li, B. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.05.044 · Cited by 39
O’Neil, G. L., Saby, L., Band, L. E., & Goodall, J. L. (2019) · Water Resources Research · doi:10.1029/2019wr024784 · Cited by 43
“…sets can be problematic for RF models, because these models aim to minimize the overall error rate, resulting in more predictions of the majority (i.e., nonwetland) class and fewer predictions of the minority (i.e., wetland) class (Branco et al., 2016; Chen et al., 2004; Zhu & Pierskalla, 2016).”
BackgroundInfluentialDeep Generative Model for Robust Imbalance Classification
Wang, X., Lyu, Y., & Jing, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01413 · Cited by 38
ProEGAN-MS: A Progressive Growing Generative Adversarial Networks for Electrocardiogram Generation
Yang, H., Liu, J., Zhang, L., Li, Y., & Zhang, H. (2021) · IEEE Access · doi:10.1109/access.2021.3069827 · Cited by 43
“Oversampling is the most commonly used ECG augmentation method, but it is easy to cause overfitting [22].”
MethodAn Adaptive Density Peaks Clustering Method With Fisher Linear Discriminant
Sun, L., Liu, R., Xu, J., & Zhang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2918952 · Cited by 39
“On the three imbalanced UCI datasets, the ADPC-FLD algorithm is compared with six state-of-the-art algorithms, including (1) the HKAP-LLE algorithm [38], (2) the hybrid support vectormachine algorithm (HSVM) [46], (3) the adaptive synthetic sampling with different error costs algorithm (ADASYN+DEC) [46], (4) the rando…”
MethodInfluentialA Neighborhood Undersampling Stacked Ensemble (NUS-SE) in imbalanced classification
Seng, Z., Kareem, S. A., & Varathan, K. D. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114246 · Cited by 42
Machine Learning for Technical Debt Identification
Tsoukalas, D., Mittas, N., Chatzigeorgiou, A., Kehagias, D. D., Ampatzoglou, A., Amanatidis, T., & Angelis, L. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3129355 · Cited by 37
“) outputs, respectively [39].”
Backgroundt-METASET: Task-Aware Acquisition of Metamaterial Datasets Through Diversity-Based Active Learning
Lee, D., Chan, Y., Chen, W., Wang, L., van Beek, A., & Chen, W. (2022) · Journal of Mechanical Design · doi:10.1115/1.4055925 · Cited by 45
“Overlooking the significant property imbalance, many methods assume that the subsequent stages of DDMD can accurately learn and perform inference under such strong property imbalance, ignoring the compounding impact of data bias [31].”
MethodHigh-Resolution Road Vehicle Collision Prediction for the City of Montreal
Hébert, A., Guedon, T., Tristan Glatard, B., & Jaumard, B. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006009 · Cited by 46
“Random under-sampling of the majority class usually performs better than more advanced methods like SMOTE or NearMiss [23].”
BackgroundMethodiGlu_AdaBoost: Identification of Lysine Glutarylation Using the AdaBoost Classifier
Dou, L., Li, X., Zhang, L., Xiang, H., & Xu, L. (2020) · Journal of Proteome Research · doi:10.1021/acs.jproteome.0c00314 · Cited by 42
Bahr, A., Schneider, M., Francis, M., Lehmann, H. M., Barg, I., Buschhoff, A.-S., Wulff, P., Strunskus, T., & Faupel, F. (2021) · Biosensors · doi:10.3390/bios11070203 · Cited by 37
“prediction SeizureNet [12] IntegerNet [26] This work iEEG dataset CHB-MIT CHB-MIT 96 % unspecified 90 % 10 fp/h unspecified 6.8 fp/h 93 % 94 % 98 % overall classification performance of the developed Figure 11. based on pre-ictal data.”
BackgroundInfluentialBatista, T. V. V., Bedregal, B., & de Moraes, R. M. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.080 · Cited by 37
Xu, Y., Yu, Z., & Chen, C. L. P. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3177695 · Cited by 42
Are smartphones and machine learning enough to diagnose tremor?
Balachandar, A., Algarni, M., de Oliveira, L. M., Marsili, L., Merola, A., Sturchio, A., Espay, A. J., Hutchison, W. D., Balasubramaniam, A., Rudzicz, F., et al. (2022) · Journal of Neurology · doi:10.1007/s00415-022-11293-7 · Cited by 39
Metadata
- Authors
- Branco, P., Torgo, L., & Ribeiro, R. P.
- Affiliations
- Universidade do Porto (PT)
- LIAAD-INESC TEC, DCC-Faculty of Sciences, University of Porto, Porto, Portugal
- Venue
- ACM Computing Surveys
- Published
- 2016-08-13
- Volume
- 49
- Issue
- 2
- Pages
- 1-50
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2490420619
- Semantic Scholar
- 736018160f8e6f6bd9b2a9101cd13ee67e573097
- Cited by
- 1,129
- References
- 266
- Citations by year
- 2026: 101 · 2025: 113 · 2024: 167 · 2023: 167 · 2022: 176 · 2021: 137 · 2020: 96 · 2019: 72 · 2018: 60 · 2017: 37 · 2016: 3
- FWCI
- 47.12
- Type
- journal article
- Language
- en
- Open access
- Locations
- ACM Computing Surveys (publishedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Funders
- North Portugal Regional Operational Programme (Project NORTE-07-0124-FEDER-000059)
- European Regional Development Fund (POCI-01-0145-FEDER-006961)
- Fundação para a Ciência e a Tecnologia (PD/BD/105788/2014, SFRH/BSAB/113896/2015)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Social Sciences › Business, Management and Accounting › Marketing › Customer churn and segmentation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- class imbalance, predictive modeling, rare event prediction, cost-sensitive learning, classification, regression analysis, fraud detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.