The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Multiclass Imbalance Problems: Analysis and Potential Solutions
Abstract
Class imbalance problems have drawn growing interest recently because of their classification difficulty caused by the imbalanced class distributions. In particular, many ensemble methods have been proposed to deal with such imbalance. However, most efforts so far are only focused on two-class imbalance problems. There are unsolved issues in multiclass imbalance problems, which exist in real-world applications. This paper studies the challenges posed by the multiclass imbalance problems and investigates the generalization ability of some ensemble solutions, including our recently proposed algorithm AdaBoost.NC, with the aim of handling multiclass and imbalance effectively and directly. We first study the impact of multiminority and multimajority on the performance of two basic resampling techniques. They both present strong negative effects. "Multimajority" tends to be more harmful to the generalization performance. Motivated by the results, we then apply AdaBoost.NC to several real-world multiclass imbalance tasks and compare it to other popular ensemble methods. AdaBoost.NC is shown to be better at recognizing minority class examples and balancing the performance among classes in terms of G-mean without using any class decomposition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,387
(1992) · Cited by 23,431
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Witten, I. H. (2008) · Cited by 9,143
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Friedman, M. (1937) · Journal of the American Statistical Association · doi:10.1080/01621459.1937.10503522 · Cited by 7,005
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
Improved boosting algorithms using confidence-rated predictions
Schapire, R. E., & Singer, Y. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279960 · Cited by 2,547
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems
Hand, D. J., & Till, R. J. (2001) · Machine Learning · doi:10.1023/a:1010920819831 · Cited by 2,276
Improved Boosting Algorithms Using Confidence-rated Predictions
Schapire, R. E., & Singer, Y. (1999) · Machine Learning · doi:10.1023/a:1007614523901 · Cited by 1,971
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
In Defense of One-Vs-All Classification
Rifkin, R. M., & Junior, A. B. D. R. K. (2004) · Cited by 1,598
Cost-sensitive boosting for classification of imbalanced data
Sun, Y., Kamel, M. S., Wong, A. K. C., & Wang, Y. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.04.009 · Cited by 1,423
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
Classification by pairwise coupling
Hastie, T., & Tibshirani, R. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144844 · Cited by 1,299
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Approximations of the critical region of the fbietkan statistic
Iman, R. L., & Davenport, J. M. (1980) · Communications in Statistics - Theory and Methods · doi:10.1080/03610928008827904 · Cited by 966
In Defense of One-Vs-All Classification
RifkinRyan, & KlautauAldebaro (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1005336 · Cited by 891
ON MULTI‐CLASS COST‐SENSITIVE LEARNING
Zhou, Z., & Liu, X. (2010) · Computational Intelligence · doi:10.1111/j.1467-8640.2010.00358.x · Cited by 350
Boosting for Learning Multiple Classes with Imbalanced Class Distribution
Sun, Y., Kamel, M., & Wang, Y. (2006) · Sixth International Conference on Data Mining (ICDM'06) · doi:10.1109/icdm.2006.29 · Cited by 307
Multi-class pattern classification using neural networks
Ou, G., & Murphey, Y. L. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.04.041 · Cited by 289
Learning when negative examples abound
Kubat, M., Holte, R., & Matwin, S. (1997) · Lecture Notes in Computer Science · doi:10.1007/3-540-62858-4_79 · Cited by 281
Evaluating boosting algorithms to classify rare classes: comparison and improvements
Joshi, M. V., Kumar, V., & Agarwal, R. C. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989527 · Cited by 268
Simultaneous training of negatively correlated neural networks in an ensemble
Liu, Y., & Yao, X. (1999) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.809027 · Cited by 267
Self-citationAutomatically countering imbalance and its empirical relationship to cost
Chawla, N. V., Cieslak, D. A., Hall, L. O., & Joshi, A. (2008) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-008-0087-0 · Cited by 255
Boosted Classification Trees and Class Probability/Quantile Estimation
Mease, D., Wyner, A. J., & Buja, A. (2007) · ScholarlyCommons (University of Pennsylvania) · doi:10.5555/1248659.1248675 · Cited by 243
RAMOBoost: Ranked Minority Oversampling in Boosting
Chen, S., He, H., & Garcia, E. A. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2066988 · Cited by 208
Protein classification with imbalanced data
Zhao, X., Li, X., Chen, L., & Aihara, K. (2007) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.21870 · Cited by 131
Relationships between Diversity of Classification Ensembles and Single-Class Performance Measures
Wang, S., & Yao, X. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.207 · Cited by 118
Self-citationNegative correlation learning for classification ensembles
Wang, S., Chen, H., & Yao, X. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596702 · Cited by 109
Self-citationMulti-class protein fold classification using a new ensemble machine learning approach.
Tan, A. C., Gilbert, D., & Deville, Y. (2003) · PubMed · Cited by 103
Joshi, M. V., Agarwal, R. C., & Kumar, V. (2002) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775047.775092 · Cited by 101
Classifying imbalanced data using a bagging ensemble variation (BEV)
Li, C. (2007) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/1233341.1233378 · Cited by 100
Classification of weld flaws with imbalanced class data
Liao, T. W. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.044 · Cited by 95
Bagging and Boosting Negatively Correlated Neural Networks
Islam, M. M., Yao, X., Nirjon, S., Islam, M. A., & Murase, K. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2008.922055 · Cited by 85
Self-citationEfficient Classification of Multi-label and Imbalanced Data using Min-Max Modular Classifiers
Chen, K., Lu, B., & Kwok, J. T.-Y. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.246893 · Cited by 62
Semi-Supervised Boosting for Multi-Class Classification
Valizadegan, H., Jin, R., & Jain, A. K. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87481-2_34 · Cited by 57
Fernández, A., del Jesús, M. J., & Herrera, F. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14049-5_10 · Cited by 50
(1993) · Architectural Science Review · doi:10.1080/00038628.1993.9696752 · Cited by 48
(1996)
Cited by
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., Yao, X., & Murase, K. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.232 · Cited by 1,150
Self-citationBig Data technologies: A survey
Oussous, A., Benjelloun, F.-Z., Ait Lahcen, A., & Belfkih, S. (2018) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2017.06.001 · Cited by 980
Metadata
- Authors
- Wang, S., & Yao, X.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Published
- 2012-08
- Volume
- 42
- Issue
- 4
- Pages
- 1119-1130
- ISSN
- 1083-4419 (ISSN-L)
- 1941-0492
- OpenAlex
- W2024223694
- Cited by
- 567
- References
- 43
- FWCI
- 25.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.