The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques
Abstract
Class imbalance problem is quite pervasive in our nowadays human practice. This problem basically refers to the skewness in the data underlying distribution which, in turn, imposes many difficulties on typical machine learning algorithms. To deal with the emerging issues arising from multi-class skewed distributions, existing efforts are mainly divided into two categories: model-oriented solutions and data-oriented techniques. Focusing on the latter, this paper presents a new over-sampling technique which is inspired by Mahalanobis distance. The presented over-sampling technique, called MDO (Mahalanobis Distance-based Over-sampling technique), generates synthetic samples which have the same Mahalanobis distance from the considered class mean as other minority class examples. By preserving the covariance structure of the minority class instances and intelligently generating synthetic samples along the probability contours, new minority class instances are modelled better for learning algorithms. Moreover, MDO can reduce the risk of overlapping between different class regions which are considered as a serious challenge in multi-class problems. Our theoretical analyses and empirical observations across wide spectrum multi-class imbalanced benchmarks indicate that MDO is the method of choice by offering statistical superior MAUC and precision compared to the popular over-sampling techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,387
(1992) · Cited by 23,431
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Friedman, M. (1937) · Journal of the American Statistical Association · doi:10.1080/01621459.1937.10503522 · Cited by 7,005
On the generalized distance in statistics
Mahalanobis, P. C. (1936) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6,068
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
Supervised Machine Learning: A Review of Classification Techniques
Kotsiantis, S. B. (2007) · Informatica · Cited by 4,185
Alcalá‐Fdez, J., Fernández, A., Luengo, J., Derrac, J., García, S., Sánchez, L., & Herrera, F. (2011) · Consultation of the Doctoral Thesis Database (TESEO) (Ministerio de Educación, Cultura y Deporte) · Cited by 2,328
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems
Hand, D. J., & Till, R. J. (2001) · Machine Learning · doi:10.1023/a:1010920819831 · Cited by 2,276
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
Asymptotic Properties of Nearest Neighbor Rules Using Edited Data
Wilson, D. L. (1972) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1972.4309137 · Cited by 2,130
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
In Defense of One-Vs-All Classification
Rifkin, R. M., & Klautau, A. (2004) · Journal of Machine Learning Research · Cited by 2,056
The condensed nearest neighbor rule (Corresp.)
Hart, P. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054155 · Cited by 1,733
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
Classification by pairwise coupling
Hastie, T., & Tibshirani, R. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144844 · Cited by 1,299
(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Approximations of the critical region of the fbietkan statistic
Iman, R. L., & Davenport, J. M. (1980) · Communications in Statistics - Theory and Methods · doi:10.1080/03610928008827904 · Cited by 966
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
In Defense of One-Vs-All Classification
RifkinRyan, & KlautauAldebaro (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1005336 · Cited by 891
On Measures of Information and their Characterizations
(1975) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6157-0 · Cited by 811
Multiclass Imbalance Problems: Analysis and Potential Solutions
Wang, S., & Yao, X. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2187280 · Cited by 567
Fernández, A., López, V., Galar, M., del Jesus, M. J., & Herrera, F. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.01.018 · Cited by 388
On the effectiveness of preprocessing methods when dealing with different levels of class imbalance
García, V., Sánchez, J. S., & Mollineda, R. A. (2012) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.06.013 · Cited by 356
The effect of class distribution on classifier learning: an empirical study
Weiss, G. M., & Provost, F. J. (2001) · doi:10.7282/t3-vpfw-sf95 · Cited by 352
Class Imbalances versus Class Overlapping: An Analysis of a Learning System Behavior
Prati, R. C., Batista, G. E. A. P. A., & Monard, M. C. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24694-7_32 · Cited by 339
Adressing the curse of imbalanced training sets: one-sided selection
Kubát, M. (1997) · Medical Entomology and Zoology · Cited by 328
Boosting for Learning Multiple Classes with Imbalanced Class Distribution
Sun, Y., Kamel, M., & Wang, Y. (2006) · Sixth International Conference on Data Mining (ICDM'06) · doi:10.1109/icdm.2006.29 · Cited by 307
Learning when negative examples abound
Kubat, M., Holte, R., & Matwin, S. (1997) · Lecture Notes in Computer Science · doi:10.1007/3-540-62858-4_79 · Cited by 281
Evaluating boosting algorithms to classify rare classes: comparison and improvements
Joshi, M. V., Kumar, V., & Agarwal, R. C. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989527 · Cited by 268
Hellinger distance decision trees are robust and skew-insensitive
Cieslak, D. A., Hoens, T. R., Chawla, N. V., & Kegelmeyer, W. P. (2012) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-011-0222-1 · Cited by 248
Evolutionary rule-based systems for imbalanced data sets
Orriols-Puig, A., & Bernadó-Mansilla, E. (2009) · Soft Computing · doi:10.1007/s00500-008-0319-7 · Cited by 198
Demmel, J., Dumitriu, I., & Holtz, O. (2007) · Numerische Mathematik · doi:10.1007/s00211-007-0114-x · Cited by 169
Dynamic Sampling Approach to Training Neural Networks for Multiclass Imbalance Classification
Lin, M., Tang, K., & Yao, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2228231 · Cited by 165
A dynamic over-sampling procedure based on sensitivity for multi-class problems
Fernández‐Navarro, F., Hervás‐Martínez, C., & Gutiérrez, P. A. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.02.019 · Cited by 153
Chen, S., & He, H. (2010) · Evolving Systems · doi:10.1007/s12530-010-9021-y · Cited by 144
Demmel, J. W., Dumitriu, I., & Holtz, O. (2007) · Cited by 143
Protein classification with imbalanced data
Zhao, X., Li, X., Chen, L., & Aihara, K. (2007) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.21870 · Cited by 131
SERA: Selectively recursive approach towards nonstationary imbalanced stream data mining
Chen, S., & He, H. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178874 · Cited by 117
Classification of weld flaws with imbalanced class data
Liao, T. W. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.044 · Cited by 95
Mei, Q., & Radev, D. (2016) · doi:10.1093/oxfordhb/9780199573691.013.022 · Cited by 63
Imbalanced classification using support vector machine ensemble
Jiang, T., Gu, H., & Liu, W. (2010) · Neural Computing and Applications · doi:10.1007/s00521-010-0349-9 · Cited by 59
Margin-Based Over-Sampling Method for Learning from Imbalanced Datasets
Fan, X., Tang, K., & Weise, T. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-20847-8_26 · Cited by 45
Puntumapon, K., & Waiyamai, K. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30220-6_31 · Cited by 32
Towards Maximizing the Area Under the ROC Curve for Multi-Class Classification Problems
Tang, K., Wang, R., & Chen, T. (2011) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v25i1.7901 · Cited by 31
(1996)
Cited by
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
Clustering-based undersampling in class-imbalanced data
Lin, W.-C., Tsai, C.-F., Hu, Y.-H., & Jhang, J.-S. (2017) · Information Sciences · doi:10.1016/j.ins.2017.05.008 · Cited by 832
Multi-head CNN–RNN for multi-time series anomaly detection: An industrial case study
Canizo, M., Triguero, I., Conde, A., & Onieva, E. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.07.034 · Cited by 420
Under-sampling class imbalanced datasets by combining clustering analysis and instance selection
Tsai, C.-F., Lin, W.-C., Hu, Y.-H., & Yao, G.-T. (2019) · Information Sciences · doi:10.1016/j.ins.2018.10.029 · Cited by 329
Metadata
- Authors
- Abdi, L., & Hashemi, S.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2016-01-01
- Volume
- 28
- Issue
- 1
- Pages
- 238-251
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W2185967890
- Cited by
- 411
- References
- 56
- FWCI
- 19.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.