On the class overlap problem in imbalanced data classification
Open accessThe DOI matches its Crossref record; 141 of the 141 references it cites were found in a registry or an index.
Abstract
Abstract Class imbalance is an active research area in the machine learning community. However, existing and recent literature showed that class overlap had a higher negative impact on the performance of learning algorithms. This paper provides detailed critical discussion and objective evaluation of class overlap in the context of imbalanced data and its impact on classification accuracy. First, we present a thorough experimental comparison of class overlap and class imbalance. Unlike previous work, our experiment was carried out on the full scale of class overlap and an extreme range of class imbalance degrees. Second, we provide an in-depth critical technical review of existing approaches to handle imbalanced datasets. Existing solutions from selective literature are critically reviewed and categorised as class distribution-based and class overlap-based methods. Emerging techniques and the latest development in this area are also discussed in detail. Experimental results in this paper are consistent with existing literature and show clearly that the performance of the learning algorithm deteriorates across varying degrees of class overlap whereas class imbalance does not always have an effect. The review emphasises the need for further research towards handling class overlap in imbalanced datasets to effectively improve learning algorithms’ performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 6×
“benchmark data type min imb max imb compared methods data level CNN(1968) [136] real slightly extremely kNN:EA undersampling [97] Tomek-link(1976) [137] real slightly extremely kNN:EA undersampling [97] NCL(2001) [85] real slightly extremely kNN:EA undersampling [97] SMOTE(2002) [10] real slightly very highly DNN: CoS…”
BackgroundMethodInfluentialFocal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267 · cited 2×
“benchmark data type min imb max imb compared methods data level CNN(1968) [136] real slightly extremely kNN:EA undersampling [97] Tomek-link(1976) [137] real slightly extremely kNN:EA undersampling [97] NCL(2001) [85] real slightly extremely kNN:EA undersampling [97] SMOTE(2002) [10] real slightly very highly DNN: CoS…”
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Clustering by fast search and find of density peaks
Rodriguez, A., & Laio, A. (2014) · Science · doi:10.1126/science.1242072 · Cited by 4,942
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331 · cited 12×
“These disadvantages have led to many extensions of SMOTE such as DBSMOTE [47], DBMUTE [56], Borderline-SMOTE [13], Safe-Level-SMOTE [68] (SLSMOTE) and others [12, 80, 78].”
MethodInfluentialSupport Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2004) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,512
AUC: A misleading measure of the performance of predictive distribution models
Lobo, J. M., Jiménez‐Valverde, A., & Real, R. (2008) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2007.00358.x · Cited by 3,499
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
A systematic study of the class imbalance problem in convolutional neural networks
Buda, M., Maki, A., & Mazurowski, M. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.011 · Cited by 3,088 · cited 1×
“Some other reviews focused on the issue of imbalanced data classification in specific contexts such as big data [24, 25], multi-class problem [24, 26] and neural networks [27, 28].”
BackgroundSurvey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
A Review on Evaluation Metrics for Data Classification Evaluations
M, H., & M.N, S. (2015) · International Journal of Data Mining & Knowledge Management Process · doi:10.5121/ijdkp.2015.5201 · Cited by 2,693 · cited 1×
“For other assessment measures, the reader may refer to [41, 42, 43, 44].”
BackgroundExploratory Undersampling for Class-Imbalance Learning
Liu, X.-Y., Wu, J., & Zhou, Z.-H. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007853 · Cited by 2,465
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Using AUC and accuracy in evaluating learning algorithms
Huang, J., & Ling, C. X. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.50 · Cited by 2,148 · cited 19×
“Another commonly-used metric is the area under the receiver operating240 characteristic curve (AUC).”
BackgroundInfluentialAsymptotic Properties of Nearest Neighbor Rules Using Edited Data
Wilson, D. L. (1972) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1972.4309137 · Cited by 2,130
RUSBoost: A Hybrid Approach to Alleviating Class Imbalance
Seiffert, C., Khoshgoftaar, T. M., Van Hulse, J., & Napolitano, A. (2010) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2009.2029559 · Cited by 1,867
Conditional Image Synthesis With Auxiliary Classifier GANs
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 1,837
The Balanced Accuracy and Its Posterior Distribution
Brodersen, K. H., Ong, C. S., Stephan, K. E., & Buhmann, J. M. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.764 · Cited by 1,816
DeepMimic: example-guided deep reinforcement learning of physics-based character skills
Peng, X. B., Abbeel, P., Levine, S., & van de Panne, M. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201311 · Cited by 1,784
2011 International Joint Conference on Neural Networks
(2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2102870 · Cited by 1,767
The condensed nearest neighbor rule (Corresp.)
Hart, P. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054155 · Cited by 1,733
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
Lin, C.-F., & Wang, S.-D. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991432 · Cited by 1,494
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE
Douzas, G., Bacao, F., & Last, F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.06.056 · Cited by 1,277 · cited 5×
“These disadvantages have led to many extensions of SMOTE such as DBSMOTE [47], DBMUTE [56], Borderline-SMOTE [13], Safe-Level-SMOTE [68] (SLSMOTE) and others [12, 80, 78].”
BackgroundMethodInfluential2010 20th International Conference on Pattern Recognition
(2010) · doi:10.1109/icpr16097.2010 · Cited by 1,171
MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., Yao, X., & Murase, K. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.232 · Cited by 1,150
A Survey of Predictive Modeling on Imbalanced Domains
Branco, P., Torgo, L., & Ribeiro, R. P. (2017) · ACM Computing Surveys · doi:10.1145/2907070 · Cited by 1,129 · cited 4×
“The in-depth review of existing solutions to classification of imbalanced datasets is presented in an alternative perspective rather than data and algorithm levels, which was commonly arranged in other review papers [19, 8, 29, 30, 7].”
BackgroundInfluentialLuque, A., Carrasco, A., Martín, A., & de las Heras, A. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.02.023 · Cited by 1,128
(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
Learning Deep Representation for Imbalanced Classification
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.580 · Cited by 988
Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2732482 · Cited by 967
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
Clustering-based undersampling in class-imbalanced data
Lin, W.-C., Tsai, C.-F., Hu, Y.-H., & Jhang, J.-S. (2017) · Information Sciences · doi:10.1016/j.ins.2017.05.008 · Cited by 832
Facing Imbalanced Data--Recommendations for the Use of Performance Metrics
Jeni, L. A., Cohn, J. F., & De La Torre, F. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.47 · Cited by 790
Random forests: from early developments to recent advancements
Fawagreh, K., Gaber, M. M., & Elyan, E. (2014) · Systems Science & Control Engineering · doi:10.1080/21642583.2014.956265 · Cited by 776
Self-citationImproving Identification of Difficult Small Classes by Balancing Class Distribution
Laurikkala, J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-48229-6_9 · Cited by 748
Cluster-based under-sampling approaches for imbalanced data distributions
Yen, S.-J., & Lee, Y.-S. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.06.108 · Cited by 732
Big data preprocessing: methods and prospects
García, S., Ramírez-Gallego, S., Luengo, J., Benítez, J. M., & Herrera, F. (2016) · Big Data Analytics · doi:10.1186/s41044-016-0014-0 · Cited by 709
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
Chen, Y., Diethe, T., & Flach, P. A. (2016) · National Conference on Artificial Intelligence · Cited by 680
Evaluation Measures for Models Assessment over Imbalanced Data Sets
Bekkar, M., Djemaa, H. K., & Alitouche, T. A. (2013) · Journal of information engineering and applications · Cited by 630
Sáez, J. A., Luengo, J., Stefanowski, J., & Herrera, F. (2015) · Information Sciences · doi:10.1016/j.ins.2014.08.051 · Cited by 627
Effective data generation for imbalanced learning using conditional generative adversarial networks
Douzas, G., & Bacao, F. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.030 · Cited by 601
Diversity analysis on imbalanced data sets by using ensemble models
Wang, S., & Yao, X. (2009) · 2009 IEEE Symposium on Computational Intelligence and Data Mining · doi:10.1109/cidm.2009.4938667 · Cited by 548
Using deep neural network with small dataset to predict material defects
Feng, S., Zhou, H., & Dong, H. (2019) · Materials & Design · doi:10.1016/j.matdes.2018.11.060 · Cited by 512
PANDA: Pose Aligned Networks for Deep Attribute Modeling
Zhang, N., Paluri, M., Ranzato, M., Darrell, T., & Bourdev, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.212 · Cited by 495 · cited 2×
“benchmark data type min imb max imb compared methods data level CNN(1968) [136] real slightly extremely kNN:EA undersampling [97] Tomek-link(1976) [137] real slightly extremely kNN:EA undersampling [97] NCL(2001) [85] real slightly extremely kNN:EA undersampling [97] SMOTE(2002) [10] real slightly very highly DNN: CoS…”
Training deep neural networks on imbalanced data sets
Wang, S., Liu, W., Wu, J., Cao, L., Meng, Q., & Kennedy, P. J. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727770 · Cited by 491
A Systematic Review on Imbalanced Data Challenges in Machine Learning: Applications and Solutions
Kaur, H., Pannu, H. S., & Malhi, A. K. (2020) · ACM Computing Surveys · doi:10.1145/3343440 · Cited by 488
EUSBoost: Enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling
Galar, M., Fernández, A., Barrenechea, E., & Herrera, F. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.006 · Cited by 419
Evolutionary Undersampling for Classification with Imbalanced Datasets: Proposals and Taxonomy
García, S., & Herrera, F. (2009) · Evolutionary Computation · doi:10.1162/evco.2009.17.3.275 · Cited by 414
A novel ensemble method for classifying imbalanced data
Sun, Z., Song, Q., Zhu, X., Sun, H., Xu, B., & Zhou, Y. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.11.014 · Cited by 414
2020 IEEE International Conference on Systems, Man, and Cybernetics
(2018) · IEEE Systems, Man, and Cybernetics Magazine · doi:10.1109/msmc.2017.2769262 · Cited by 392
DBSMOTE: Density-Based Synthetic Minority Over-sampling TEchnique
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2012) · Applied Intelligence · doi:10.1007/s10489-011-0287-y · Cited by 390
Sun, J., Lang, J., Fujita, H., & Li, H. (2018) · Information Sciences · doi:10.1016/j.ins.2017.10.017 · Cited by 385
Class Imbalances versus Class Overlapping: An Analysis of a Learning System Behavior
Prati, R. C., Batista, G. E. A. P. A., & Monard, M. C. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24694-7_32 · Cited by 339
Tahir, M. A., Kittler, J., & Yan, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.03.014 · Cited by 312
Amin, A., Anwar, S., Adnan, A., Nawaz, M., Howard, N., Qadir, J., Hawalah, A., & Hussain, A. (2016) · IEEE Access · doi:10.1109/access.2016.2619719 · Cited by 310
An Ensemble Random Forest Algorithm for Insurance Big Data Analysis
Lin, W., Wu, Z., Lin, L., Wen, A., & Li, J. (2017) · IEEE Access · doi:10.1109/access.2017.2738069 · Cited by 309
2011 IEEE 11th International Conference on Data Mining
(2011) · doi:10.1109/icdm19089.2011 · Cited by 305
Handling limited datasets with neural networks in medical applications: A small-data approach
Shaikhina, T., & Khovanova, N. A. (2017) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2016.12.003 · Cited by 296
Beyond Skip Connections: Top-Down Modulation for Object Detection
Shrivastava, A., Sukthankar, R., Malik, J., & Gupta, A. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.06851 · Cited by 294
Adaptive semi-unsupervised weighted oversampling (A-SUWO) for imbalanced datasets
Nekooeimehr, I., & Lai-Yuen, S. K. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.10.031 · Cited by 291
Neighbourhood-based undersampling approach for handling imbalanced and overlapped data
Vuttipittayamongkol, P., & Elyan, E. (2020) · Information Sciences · doi:10.1016/j.ins.2019.08.062 · Cited by 286
Self-citationLR-SMOTE — An improved unbalanced data set oversampling based on K-means and SVM
Liang, X. W., Jiang, A. P., Li, T., Xue, Y. Y., & Wang, G. T. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105845 · Cited by 282
New Applications of Ensembles of Classifiers
Barandela, R., Valdovinos, R. M., & S�nchez, J. S. (2003) · Pattern Analysis & Applications · doi:10.1007/s10044-003-0192-z · Cited by 280
Evolutionary undersampling boosting for imbalanced classification of breast cancer malignancy
Krawczyk, B., Galar, M., Jeleń, Ł., & Herrera, F. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2015.08.060 · Cited by 263
Evaluation Measures of the Classification Performance of Imbalanced Data Sets
Gu, Q., Zhu, L., & Cai, Z. (2009) · Communications in Computer and Information Science · doi:10.1007/978-3-642-04962-0_53 · Cited by 254
Random Balance: Ensembles of variable priors classifiers for imbalanced data
Díez-Pastor, J. F., Rodríguez, J. J., García-Osorio, C., & Kuncheva, L. I. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.04.022 · Cited by 235
An insight into imbalanced Big Data classification: outcomes and challenges
Fernández, A., del Río, S., Chawla, N. V., & Herrera, F. (2017) · Complex & Intelligent Systems · doi:10.1007/s40747-017-0037-9 · Cited by 230
Diversified Sensitivity-Based Undersampling for Imbalance Classification Problems
Ng, W. W. Y., Hu, J., Yeung, D. S., Yin, S., & Roli, F. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2372060 · Cited by 228
Adversarial environment reinforcement learning algorithm for intrusion detection
Caminero, G., Lopez-Martin, M., & Carro, B. (2019) · Computer Networks · doi:10.1016/j.comnet.2019.05.013 · Cited by 222
Deep reinforcement learning for imbalanced classification
Lin, E., Chen, Q., & Qi, X. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01637-z · Cited by 221
On the k-NN performance in a challenging scenario of imbalance and overlapping
García, V., Mollineda, R. A., & Sánchez, J. S. (2008) · Pattern Analysis and Applications · doi:10.1007/s10044-007-0087-5 · Cited by 219
Handling data irregularities in classification: Foundations, trends, and future challenges
Das, S., Datta, S., & Chaudhuri, B. B. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.008 · Cited by 216
Redundancy-driven modified Tomek-link based undersampling: A solution to class imbalance
Devi, D., Biswas, S. K., & Purkayastha, B. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.10.006 · Cited by 211
Ijaz, M., Alfian, G., Syafrudin, M., & Rhee, J. (2018) · Applied Sciences · doi:10.3390/app8081325 · Cited by 207
Bi, J., & Zhang, C. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.05.037 · Cited by 198
Wallace, B. C., Small, K., Brodley, C. E., & Trikalinos, T. A. (2011) · 2011 IEEE 11th International Conference on Data Mining · doi:10.1109/icdm.2011.33 · Cited by 186
Ali-Gombe, A., & Elyan, E. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.043 · Cited by 181
Self-citationClassifying imbalanced data sets using similarity based hierarchical decomposition
Beyan, C., & Fisher, R. B. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.10.032 · Cited by 177
Comparing classifiers when the misallocation costs are uncertain
Adams, N. M., & Hand, D. J. (1999) · Pattern Recognition · doi:10.1016/s0031-3203(98)00154-x · Cited by 170
Entropy-based fuzzy support vector machine for imbalanced datasets
Fan, Q., Wang, Z., Li, D., Gao, D., & Zha, H. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.09.032 · Cited by 170
A new sampling method for classifying imbalanced data based on support vector machine ensemble
Jian, C., Gao, J., & Ao, Y. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.02.006 · Cited by 168
When is Undersampling Effective in Unbalanced Classification Tasks?
Pozzolo, A. D., Caelen, O., & Bontempi, G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23528-8_13 · Cited by 167
Deep learning for symbols detection and classification in engineering drawings
Elyan, E., Jamieson, L., & Ali-Gombe, A. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.05.025 · Cited by 166
Self-citationRadial-Based oversampling for noisy imbalanced data classification
Koziarski, M., Krawczyk, B., & Woźniak, M. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.04.089 · Cited by 165
Data Sampling Methods to Deal With the Big Data Multi-Class Imbalance Problem
Rendón, E., Alejo, R., Castorena, C., Isidro-Ortega, F. J., & Granda-Gutiérrez, E. E. (2020) · Applied Sciences · doi:10.3390/app10041276 · Cited by 165
Collell, G., Prelec, D., & Patil, K. R. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.035 · Cited by 161
Evolutionary-based selection of generalized instances for imbalanced classification
́a, S. G., Derrac, J., Triguero, I., Carmona, C. J., & Herrera, F. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.01.012 · Cited by 154
Fast-CBUS: A fast clustering-based undersampling method for addressing the class imbalance problem
Ofek, N., Rokach, L., Stern, R., & Shabtai, A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.03.011 · Cited by 152
Adaptive Learning-Based $k$ -Nearest Neighbor Classifiers With Resilience to Class Imbalance
Mullick, S. S., Datta, S., & Das, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2812279 · Cited by 148
Dealing with Data Difficulty Factors While Learning from Imbalanced Data
Stefanowski, J. (2015) · Studies in computational intelligence · doi:10.1007/978-3-319-18781-5_17 · Cited by 146
SMOTE based class-specific extreme learning machine for imbalanced learning
Raghuwanshi, B. S., & Shukla, S. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.06.022 · Cited by 145
Coupling different methods for overcoming the class imbalance problem
Nanni, L., Fantozzi, C., & Lazzarini, N. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.01.068 · Cited by 136
An overlap-sensitive margin classifier for imbalanced and overlapping data
Lee, H. K., & Kim, S. B. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.01.008 · Cited by 135
Relationships between Diversity of Classification Ensembles and Single-Class Performance Measures
Wang, S., & Yao, X. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.207 · Cited by 126
Overlapping, Rare Examples and Class Decomposition in Learning Classifiers from Imbalanced Data
Stefanowski, J. (2012) · Smart innovation, systems and technologies · doi:10.1007/978-3-642-28699-5_11 · Cited by 114
Balancing Strategies and Class Overlapping
Batista, G., Prati, R. C., & Monard, M. C. (2005) · Lecture notes in computer science · doi:10.1007/11552253_3 · Cited by 112
Wei, J., Huang, H., Yao, L., Hu, Y., Fan, Q., & Huang, D. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113504 · Cited by 97
Class imbalance learning using UnderBagging based kernelized extreme learning machine
Raghuwanshi, B. S., & Shukla, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.10.056 · Cited by 92
Cost-aware Pre-training for Multiclass Cost-sensitive Deep LearningPreprint
Chung, Y.-A., Lin, H.-T., & Yang, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.09337 · Cited by 91
Vuttipittayamongkol, P., & Elyan, E. (2020) · International Journal of Neural Systems · doi:10.1142/s0129065720500434 · Cited by 87
Self-citationTransfer Boosting With Synthetic Instances for Class Imbalanced Object Recognition
Zhang, X., Zhuang, Y., Wang, W., & Pedrycz, W. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2636370 · Cited by 80
Class-specific extreme learning machine for handling binary class imbalance problem
Raghuwanshi, B. S., & Shukla, S. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.05.011 · Cited by 80
Rivera, W., & Xanthopoulos, P. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.09.010 · Cited by 74
Affinity and class probability-based fuzzy support vector machine for imbalanced data sets
Tao, X., Li, Q., Ren, C., Guo, W., He, Q., Liu, R., & Zou, J. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.10.016 · Cited by 73
Overlap-Based Undersampling for Improving Imbalanced Data Classification
Vuttipittayamongkol, P., Elyan, E., Petrovski, A., & Jayne, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03493-1_72 · Cited by 72
Self-citationEmerging Paradigms in Machine Learning
Ramanna, S., Jain, L. C., & Howlett, R. J. (2012) · Smart innovation, systems and technologies · doi:10.1007/978-3-642-28699-5 · Cited by 71
Biased support vector machine for relevance feedback in image retrieval
Hoi, C.-H., Chan, C.-H., Huang, K., Lyu, M. R.-T., & King, I. (2005) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2004.1381186 · Cited by 71
DBMUTE: density-based majority under-sampling technique
Bunkhumpornpat, C., & Sinapiromsaran, K. (2016) · Knowledge and Information Systems · doi:10.1007/s10115-016-0957-5 · Cited by 69
Parallel selective sampling method for imbalanced and large data classification
D’Addabbo, A., & Maglietta, R. (2015) · Pattern Recognition Letters · doi:10.1016/j.patrec.2015.05.008 · Cited by 66
Overlap-Based Undersampling Method for Classification of Imbalanced Medical Datasets
Vuttipittayamongkol, P., & Elyan, E. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-49186-4_30 · Cited by 56
Self-citationFernandes, E. R. Q., & de Carvalho, A. C. P. L. F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.04.052 · Cited by 53
Classification with ClassOverlapping: A Systematic Study
Xiong, H., Wu, J., & Liu, L. (2010) · doi:10.2991/icebi.2010.43 · Cited by 49
Adaptive Oversampling for Imbalanced Data Classification
Ertekin, Ş. (2013) · Lecture notes in electrical engineering · doi:10.1007/978-3-319-01604-7_26 · Cited by 48
Class-specific kernelized extreme learning machine for binary class imbalance learning
Raghuwanshi, B. S., & Shukla, S. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.10.011 · Cited by 47
UnderBagging based reduced Kernelized weighted extreme learning machine for class imbalance learning
Raghuwanshi, B. S., & Shukla, S. (2018) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.07.002 · Cited by 44
Ali-Gombe, A., Elyan, E., Savoye, Y., & Jayne, C. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489387 · Cited by 39
Self-citationChallenges in Computational Statistics and Data Mining
Matwin, S., & Mielniczuk, J. (2015) · Studies in computational intelligence · doi:10.1007/978-3-319-18781-5 · Cited by 38
A Positive-biased Nearest Neighbour Algorithm for Imbalanced Classification
Zhang, X., & Li, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37456-2_25 · Cited by 33
Vluymans, S., Triguero, I., Chris Cornelis, A., & Saeys, Y. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.08.026 · Cited by 25
Multiple Fake Classes GAN for Data Augmentation in Face Image Dataset
Ali-Gombe, A., Elyan, E., & Jayne, C. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851953 · Cited by 25
Self-citationWang, S., Wang, D., Li, J., Huang, T., & Cai, Y. (2017) · Molecular Omics · doi:10.1039/c7mo00030h · Cited by 24
Adaptive FH-SVM for Imbalanced Classification
Wang, Q., Tian, Y., & Liu, D. (2019) · IEEE Access · doi:10.1109/access.2019.2940983 · Cited by 20
Instance-based entropy fuzzy support vector machine for imbalanced data
Cho, P., Lee, M., & Chang, W. (2019) · Pattern Analysis and Applications · doi:10.1007/s10044-019-00851-x · Cited by 16
Cited by
Artificial Intelligence to Improve Antibiotic Prescribing: A Systematic Review
Amin, D., Garzόn-Orjuela, N., Garcia Pereira, A., Parveen, S., Vornhagen, H., & Vellinga, A. (2023) · Antibiotics · doi:10.3390/antibiotics12081293 · Cited by 34
Metadata
- Authors
- Vuttipittayamongkol, P., Elyan, E., & Petrovski, A.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 212
- Pages
- 106631
- ISSN
- 0950-7051 (ISSN-L)
- OpenAlex
- W3109072952
- Cited by
- 290
- References
- 141
- FWCI
- 11.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.