The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
SVMs Modeling for Highly Imbalanced Classification
Abstract
Traditional classification algorithms can be limited in their performance on highly unbalanced data sets. A popular stream of work for countering the problem of class imbalance has been the application of a sundry of sampling strategies. In this paper, we focus on designing modifications to support vector machines (SVMs) to appropriately tackle the problem of class imbalance. We incorporate different "rebalance" heuristics in SVM modeling, including cost-sensitive learning, and over- and undersampling. These SVM-based strategies are compared with various state-of-the-art approaches on a variety of data sets by using various metrics, including G-mean, area under the receiver operating characteristic curve, F-measure, and area under the precision/recall curve. We show that we are able to surpass or match the previously known best algorithms on each data set. In particular, of the four SVM variations considered in this paper, the novel granular SVMs-repetitive undersampling algorithm (GSVM-RU) is the best in terms of both effectiveness and efficiency. GSVM-RU is effective, as it can minimize the negative effect of information loss while maximizing the positive effect of data cleaning in the undersampling process. GSVM-RU is efficient by extracting much less support vectors and, hence, greatly speeding up SVM prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Self-citationWu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
A TUTORIAL ON SUPPORT VECTOR MACHINES FOR PATTERN RECOGNITION, DATA MINING AND KNOWLEDGE DISCOVERY
Burger, C. J. C. (1998) · Cited by 3,313
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
Cited by
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
Self-citationLópez, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
A Survey of Predictive Modeling on Imbalanced Domains
Branco, P., Torgo, L., & Ribeiro, R. P. (2017) · ACM Computing Surveys · doi:10.1145/2907070 · Cited by 1,129
Learning Deep Representation for Imbalanced Classification
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.580 · Cited by 988
Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2732482 · Cited by 967
Facing Imbalanced Data--Recommendations for the Use of Performance Metrics
Jeni, L. A., Cohn, J. F., & De La Torre, F. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.47 · Cited by 790
A survey on addressing high-class imbalance in big data
Leevy, J. L., Khoshgoftaar, T. M., Bauder, R. A., & Seliya, N. (2018) · Journal of Big Data · doi:10.1186/s40537-018-0151-6 · Cited by 759
An Attention-Based Deep Learning Approach for Sleep Stage Classification With Single-Channel EEG
Eldele, E., Chen, Z., Liu, C., Wu, M., Kwoh, C.-K., Li, X., & Guan, C. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3076234 · Cited by 693
Sáez, J. A., Luengo, J., Stefanowski, J., & Herrera, F. (2015) · Information Sciences · doi:10.1016/j.ins.2014.08.051 · Cited by 627
Jia, F., Lei, Y., Lu, N., & Xing, S. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.03.025 · Cited by 587
Support Vector Machines for Classification
Awad, M., & Khanna, R. (2015) · Efficient Learning Machines · doi:10.1007/978-1-4302-5990-9_3 · Cited by 543
A Systematic Review on Imbalanced Data Challenges in Machine Learning: Applications and Solutions
Kaur, H., Pannu, H. S., & Malhi, A. K. (2020) · ACM Computing Surveys · doi:10.1145/3343440 · Cited by 488
Fault Diagnosis for Electro-Mechanical Actuators Based on STL-HSTA-GRU and SM
Zhang, X., Tang, L., & Chen, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3127641 · Cited by 422
Incremental Learning of Concept Drift from Streaming Imbalanced Data
Ditzler, G., & Polikar, R. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.136 · Cited by 406
Fernández, A., López, V., Galar, M., del Jesus, M. J., & Herrera, F. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.01.018 · Cited by 388
Imbalanced Deep Learning by Minority Class Incremental Rectification
Dong, Q., Gong, S., & Zhu, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2832629 · Cited by 369
Sun, J., Li, H., Fujita, H., Fu, B., & Ai, W. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.006 · Cited by 362
Deep Imbalanced Learning for Face Recognition and Attribute Prediction
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2914680 · Cited by 354
Application of machine learning to construction injury prediction
Tixier, A. J.-P., Hallowell, M. R., Rajagopalan, B., & Bowman, D. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.05.016 · Cited by 350
Cost-sensitive learning methods for imbalanced data
Thai-Nghe, N., Gantner, Z., & Schmidt-Thieme, L. (2010) · The 2010 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596486 · Cited by 342
A new bearing fault diagnosis method based on modified convolutional neural networks
ZHANG, J., SUN, Y., GUO, L., GAO, H., HONG, X., & SONG, H. (2020) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2019.07.011 · Cited by 326
Shi, Q., & Zhang, H. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.2994868 · Cited by 326
Classification of Imbalanced Data by Oversampling in Kernel Space of Support Vector Machines
Mathew, J., Pang, C. K., Luo, M., & Leong, W. H. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2751612 · Cited by 311
Ghorbani, R., & Ghousi, R. (2020) · IEEE Access · doi:10.1109/access.2020.2986809 · Cited by 289
Class-imbalanced classifiers for high-dimensional data
Lin, W.-J., & Chen, J. J. (2013) · Briefings in Bioinformatics · doi:10.1093/bib/bbs006 · Cited by 284
Finding the Best Classification Threshold in Imbalanced Classification
Zou, Q., Xie, S., Lin, Z., Wu, M., & Ju, Y. (2016) · Big Data Research · doi:10.1016/j.bdr.2015.12.001 · Cited by 281
Ndikumana, E., Ho Tong Minh, D., Baghdadi, N., Courault, D., & Hossard, L. (2018) · Remote Sensing · doi:10.3390/rs10081217 · Cited by 277
Dynamic Curriculum Learning for Imbalanced Data Classification
Wang, Y., Gan, W., Yang, J., Wu, W., & Yan, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00512 · Cited by 261
ANN vs. SVM: Which one performs better in classification of MCCs in mammogram imaging
Ren, J. (2012) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.07.016 · Cited by 260
Human Digital Twin for Fitness Management
Barricelli, B. R., Casiraghi, E., Gliozzo, J., Petrini, A., & Valtolina, S. (2020) · IEEE Access · doi:10.1109/access.2020.2971576 · Cited by 259
Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data
Bhowan, U., Johnston, M., Zhang, M., & Yao, X. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2199119 · Cited by 259
Sky and Ground Segmentation in the Navigation Visions of the Planetary Rovers
Kuang, B., Rana, Z. A., & Zhao, Y. (2021) · Sensors · doi:10.3390/s21216996 · Cited by 14
Towards robust and label-efficient time series representation learning
Emadeldeen, A. I. A. E. (2023) · doi:10.32657/10356/170673 · Cited by 1
Metadata
- Authors
- Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Published
- 2009-02
- Volume
- 39
- Issue
- 1
- Pages
- 281-288
- ISSN
- 1083-4419 (ISSN-L)
- OpenAlex
- W1999318832
- Cited by
- 966
- References
- 29
- FWCI
- 31.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.