On the Class Imbalance Problem

Guo, Xinjian; Yin, Yilong; Dong, Cailing; Yang, Gongping; Zhou, Guangtong

doi:10.1109/icnc.2008.871

Cited by 495Imbalanced Data Classification TechniquesMachine Learning and Data ClassificationData Stream Mining Techniques

On the Class Imbalance Problem

Guo, Xinjian, Yin, Yilong, Dong, Cailing, Yang, Gongping, Zhou, Guangtong·2008·2008 Fourth International Conference on Natural Computation

DOI 10.1109/icnc.2008.871

Open this paper in CoChat — free account

Abstract

The class imbalance problem has been recognized in many practical domains and a hot topic of machine learning in recent years. In such a problem, almost all the examples are labeled as one class, while far fewer examples are labeled as the other class, usually the more important class. In this case, standard machine learning algorithms tend to be overwhelmed by the majority class and ignore the minority class since traditional classifiers seeking an accurate performance over a full range of instances. This paper reviewed academic activities special for the class imbalance problem firstly. Then investigated various remedies in four different levels according to learning phases. Following surveying evaluation metrics and some other related factors, this paper showed some future directions at last.

Integrity signals

Registry

Crossref · 10.1109/icnc.2008.871

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2D Bounding Box detection with Faster R-CNN achieves an mAP (IoU>0.5) of 31 on the WoodScape dataset.
“| 2D Bounding Box | Faster R-CNN [43] | mAP (IoU>0.5) | 31 |”
From WoodScape: A Multi-Task, Multi-Camera Fisheye Dataset for Autonomous Driving (2019) · cites this paper as [43]

SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · see citing works
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,834 · see citing works
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,028 · see citing works
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466 · see citing works
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217 · see citing works
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · see citing works
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331 · see citing works
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R., & Monard, M. (2004) · SKDD · doi:10.1145/1007730.1007735 · Cited by 4,271 · see citing works
Fast Effective Rule Induction
Cohen, W. W. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50023-2 · Cited by 3,890 · see citing works
An extensive empirical study of feature selection metrics for text classification
Forman, G. (2003) · Cited by 2,379 · see citing works
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,161 · see citing works
Asymptotic Properties of Nearest Neighbor Rules Using Edited Data
Wilson, D. L. (1972) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1972.4309137 · Cited by 2,161 · see citing works
The condensed nearest neighbor rule (Corresp.)
Hart, P. E. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054155 · Cited by 1,750 · see citing works
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarević, A. M., Hall, L., & Bowyer, K. W. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,741 · see citing works
Mining with rarity: a unifying framework
Weiss, G. M. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007734 · Cited by 1,393 · see citing works
MetaCost
Domingos, P. (1999) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/312129.312220 · Cited by 1,309 · see citing works
Two Modifications of CNN
(1976) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,295 · see citing works
Robust classification for imprecise environments
Provost, F., & Fawcett, T. (2001) · Machine Learning · doi:10.1023/a:1007601015854 · Cited by 1,250 · see citing works
One-class svms for document classification
Manevitz, L. M., & Yousef, M. (2002) · doi:10.5555/944790.944808 · Cited by 1,219 · see citing works
A Multiple Resampling Method for Learning from Imbalanced Data Sets
Estabrooks, A., Jo, T., & Japkowicz, N. (2004) · Computational Intelligence · doi:10.1111/j.0824-7935.2004.t01-1-00228.x · Cited by 1,019 · see citing works
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921 · see citing works
Handling imbalanced datasets: A review
Kotsiantis, S. B., Kanellopoulos, D. N., & Pintelas, P. (2006) · Cited by 875 · see citing works
C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling
Drummond, C., & Holte, R. C. (2003) · Cited by 829 · see citing works
Improving Identification of Difficult Small Classes by Balancing Class Distribution
Laurikkala, J. P. S. (2001) · Lecture notes in computer science · doi:10.1007/3-540-48229-6_9 · Cited by 764 · see citing works
Controlling the Sensitivity of Support Vector Machines
Veropoulos, K., Campbell, I. C. G., & Cristianini, N. (1999) · Cited by 691 · see citing works
Class imbalances versus small disjuncts
Jo, T., & Japkowicz, N. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007737 · Cited by 687 · see citing works
AdaCost: Misclassification Cost-Sensitive Boosting
Fan, W., Stolfo, S. J., Zhang, J., & Chan, P. K. (1999) · Cited by 612 · see citing works
Learning from imbalanced data sets with boosting and data generation
Guo, H., & Viktor, H. L. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007736 · Cited by 606 · see citing works
Strategies for learning in class imbalance problems
Barandela, R., Sánchez, J. S., García, V., & Rangel, E. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00257-1 · Cited by 579 · see citing works
Feature selection for text categorization on imbalanced data
Zheng, Z., Xiaoyun, W., & Srihari, R. K. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007741 · Cited by 552 · see citing works
One-class classification
Tax, D. M. J. (2001) · Research Repository (Delft University of Technology) · Cited by 526 · see citing works
Learning from Imbalanced Data Sets: A Comparison of Various Strategies *
Japkowicz, N. (2000) · Cited by 455 · see citing works
Toward scalable learning with non-uniform class and cost distributions: a case study in credit card fraud detection
Chan, P. K., & Stolfo, S. J. (1998) · Cited by 452 · see citing works
Minority report in fraud detection
Phua, C., Alahakoon, D., & Lee, V. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007738 · Cited by 450 · see citing works
Feature Selection for Unbalanced Class Distribution and Naive Bayes
Mladenić, D., & Grobelnik, M. (1999) · Cited by 430 · see citing works
Learning When Data Sets are Imbalanced and When Costs are Unequal and Unknown
Maloof, M. A. (2003) · Cited by 406 · see citing works
Class Imbalances versus Class Overlapping: An Analysis of a Learning System Behavior
Prati, R. C., Batista, G., & Monard, M. C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24694-7_32 · Cited by 344 · see citing works
Adressing the curse of imbalanced training sets: one-sided selection
Kubát, M. (1997) · Medical Entomology and Zoology · Cited by 330 · see citing works
Class-Boundary Alignment for Imbalanced Dataset Learning
Wu, G., & Chang, E. Y. (2003) · Cited by 319 · see citing works
Learning when negative examples abound
Kubát, M., Holte, R. C., & Matwin, S. (1997) · Lecture notes in computer science · doi:10.1007/3-540-62858-4_79 · Cited by 288 · see citing works
Extreme re-balancing for SVMs
Raskutti, B., & Kowalczyk, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007739 · Cited by 286 · see citing works
Evaluating boosting algorithms to classify rare classes: comparison and improvements
Joshi, M. V., Kumar, V., & Agarwal, R. C. (2002) · Proceedings · doi:10.1109/icdm.2001.989527 · Cited by 274 · see citing works
ISSUES IN MINING IMBALANCED DATA SETS - A REVIEW PAPER
Sofa, V., & Anca, R. (2005) · Cited by 160 · see citing works
Supervised Versus Unsupervised Binary-Learning by Feedforward Neural Networks
Japkowicz, N. (2001) · Machine Learning · doi:10.1023/a:1007660820062 · Cited by 148 · see citing works
Concept-Learning in the Presence of Between-Class and Within-Class Imbalances
Japkowicz, N. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45153-6_7 · Cited by 135 · see citing works
On predicting rare classes with SVM ensembles in scene classification
Yan, R., Liu, Y., Jin, R., & Hauptmann, A. G. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2003.1199097 · Cited by 133 · see citing works
REPRESENTATION DESIGN AND BRUTE-FORCE INDUCTION IN A BOEING MANUFACTURING DOMAIN
Riddle, P., Segal, R. B., & Etzioni, O. (1994) · Applied Artificial Intelligence · doi:10.1080/08839519408945435 · Cited by 127 · see citing works
A Bias-Variance Analysis of a Real World Learning Problem: The CoIL Challenge 2000
van der Putten, P., & van Someren, M. (2004) · Machine Learning · doi:10.1023/b:mach.0000035476.95130.99 · Cited by 116 · see citing works
Learning classifiers from imbalanced data based on biased minimax probability machine
Huang, K., Yang, H., King, I., & Lyu, M. R.-T. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315213 · Cited by 97 · see citing works
A Mixture-of-Experts Framework for Learning from Imbalanced Data Sets
Estabrooks, A., & Japkowicz, N. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44816-0_4 · Cited by 86 · see citing works
Mixture of Expert Agents for Handling Imbalanced Data Sets
Kotsiantis, S. B., & Pintelas, P. (2003) · Cited by 81 · see citing works
Learning with Skewed Class Distributions
Monard, M. C., & Batista, G. E. A. P. A. (2002) · Cited by 66 · see citing works
A multistrategy approach for digital text categorization from imbalanced documents
del Castillo, M. D., & Serrano, J. I. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007740 · Cited by 64 · see citing works
A consistency-based model selection for one-class classification
Tax, D. M. J., & Müller, K. R. (2004) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2004.1334542 · Cited by 46 · see citing works
The effect of small disjuncts and class distribution on decision tree learning
Weiss, G. M., & Hirsh, H. (2003) · Cited by 42 · see citing works
Over-sampling algorithm based on preliminary classification in imbalanced data sets learning
Wang, W. (2006) · Journal of Computer Applications · Cited by 5 · see citing works

Flagged first, then by citations

Sorted by citations

A Comparative Performance Analysis of Data Resampling Methods on Imbalance Medical Data
Khushi, M., Shaukat, K., Alam, T. M., Hameed, I. A., Uddin, S., Luo, S., Yang, X., & Reyes, M. C. (2021) · IEEE Access · doi:10.1109/access.2021.3102399 · Cited by 335 · see citing works
WoodScape: A Multi-Task, Multi-Camera Fisheye Dataset for Autonomous Driving
Yogamani, S., Hughes, C., Horgan, J., Sistu, G., Chennupati, S., Uricar, M., Milz, S., Simon, M., Amende, K., Witt, C., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00940 · Cited by 303 · see citing works
“Depending on the particular task (see Section 4, for the full list), the class imbalance may be an issue [19], therefore, task-specific splits are also provided.”
Background
Prediction of strain level phage-host interactions across the Escherichia genus using only genomic information
Gaborieau, B., Vaysset, H., Tesson, F., Charachon, I., Dib, N., Bernier, J., Dequidt, T., Georjon, H., Clermont, O., Hersen, P., et al. (2024) · Nature Microbiology · doi:10.1038/s41564-024-01832-5 · Cited by 141 · see citing works
Testing Suicide Risk Prediction Algorithms Using Phone Measurements With Patients in Acute Mental Health Settings: Feasibility Study
Haines-Delmont, A., Chahal, G., Bruen, A. J., Wall, A., Khan, C. T., Sadashiv, R., & Fearnley, D. (2020) · JMIR mhealth and uhealth · doi:10.2196/15901 · Cited by 87 · see citing works
Selecting Representative Data Sets
Borovicka, T., Jirina, M., Kordik, P., & Jiri, M. (2012) · Advances in Data Mining Knowledge Discovery and Applications · doi:10.5772/50787 · Cited by 94 · see citing works
Uncertainty-Aware COVID-19 Detection from Imbalanced Sound Data
Xia, T., Han, J., Qendro, L., Dang, T., & Mascolo, C. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1320 · Cited by 20 · see citing works
Blood-Based Transcriptomic Biomarkers Are Predictive of Neurodegeneration Rather Than Alzheimer’s Disease
Shvetcov, A., Thomson, S., Spathos, J., Cho, A.-N., Wilkins, H. M., Andrews, S. J., Delerue, F., Couttas, T. A., Issar, J. K., Isik, F., et al. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms241915011 · Cited by 12 · see citing works

Physician-Friendly Machine Learning: A Case Study with Cardiovascular Disease Risk Prediction
Padmanabhan, M., Yuan, P., Chada, G., & Nguyen, H. V. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8071050 · Cited by 75 · see citing works
Breakdown of Machine Learning Algorithms
Meena, M., & Sehrawat, R. (2022) · Recent Trends in Artificial Intelligence & it s Applications · doi:10.46610/rtaia.2022.v01i03.005 · Cited by 1 · see citing works
Interpretable Machine Learning Assessment
Han, H., Wu, Y., Wang, J., & Han, A. (2022) · Neurocomputing · doi:10.1016/j.neucom.2023.126891 · Cited by 29 · see citing works
Application of Machine Learning in Animal Disease Analysis and Prediction
Zhang, S., Su, Q., & Chen, Q. (2020) · Current Bioinformatics · doi:10.2174/1574893615999200728195613 · Cited by 29 · see citing works
Machine Learning Techniques for the Management of Diseases: A Paper Review
Tim, N. K., Kamla, V. C., & Tagne, E. F. (2024) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-56396-6_23

Authors: Guo, X., Yin, Y., Dong, C., Yang, G., & Zhou, G.
Affiliations: Shandong University (CN)
ORCID: Yin, Yilong
Yang, Gongping
Venue: 2008 Fourth International Conference on Natural Computation
Publisher: IEEE
Published: 2008
Pages: 192-201
DOI: 10.1109/icnc.2008.871
OpenAlex: W2149308034
Cited by: 495
References: 56
Citations by year: 2026: 15 · 2025: 44 · 2024: 44 · 2023: 44 · 2022: 52 · 2021: 69 · 2020: 37 · 2019: 27 · 2018: 30 · 2017: 22 · 2016: 16 · 2015: 17 · 2014: 20 · 2013: 23 · 2012: 19
FWCI: 3.96
Type: conference paper
Language: en
Open access: closed
Locations: International Conference on Natural Computation (ICNC) (publishedVersion)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
Keywords: class imbalance, minority class, majority class, imbalanced classification, evaluation metrics, learning stages

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

On the Class Imbalance Problem

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks