Diversity analysis on imbalanced data sets by using ensemble models
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Many real-world applications have problems when learning from imbalanced data sets, such as medical diagnosis, fraud detection, and text classification. Very few minority class instances cannot provide sufficient information and result in performance degrading greatly. As a good way to improve the classification performance of weak learner, some ensemble-based algorithms have been proposed to solve class imbalance problem. However, it is still not clear that how diversity affects classification performance especially on minority classes, since diversity is one influential factor of ensemble. This paper explores the impact of diversity on each class and overall performance. As the other influential factor, accuracy is also discussed because of the trade-off between diversity and accuracy. Firstly, three popular re-sampling methods are combined into our ensemble model and evaluated for diversity analysis, which includes under-sampling, over-sampling, and SMOTE - a data generation algorithm. Secondly, we experiment not only on two-class tasks, but also those with multiple classes. Thirdly, we improve SMOTE in a novel way for solving multi-class data sets in ensemble model - SMOTEBagging.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331 · cited 1×
“At the data level, various re-sampling techniques are applied to balance class distribution, including over-sampling minority class instances and under-sampling majority class instances [5], [ 6 ], [7], [8] . Particularly, SMOTE (Synthetic Minority Over-sampling Technique) [1] is a popular approach designed for genera…”
MethodA study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295 · cited 1×
“Many real-world applications encounter the problem of imbalanced data, such as medical diagnosis, fraud detection, text classification, and oil spills detection [4].”
BackgroundMeasures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy
Kuncheva, L. I., & Whitaker, C. J. (2003) · Machine Learning · doi:10.1023/a:1022859003006 · Cited by 2,335 · cited 1×
“It will be positive if classifiers tend to recognize the same instances correctly, and will perform negative if they commit errors on different instances [17].”
BackgroundAddressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
(1976) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1976.4309452 · Cited by 1,078
Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach
Guo, H., & Viktor, H. L. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007736 · Cited by 605
Cited by
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
A Survey of Predictive Modeling on Imbalanced Domains
Branco, P., Torgo, L., & Ribeiro, R. P. (2017) · ACM Computing Surveys · doi:10.1145/2907070 · Cited by 1,129
Clustering-based undersampling in class-imbalanced data
Lin, W.-C., Tsai, C.-F., Hu, Y.-H., & Jhang, J.-S. (2017) · Information Sciences · doi:10.1016/j.ins.2017.05.008 · Cited by 832
A survey on imbalanced learning: latest research, applications and future directions
Chen, W., Yang, K., Yu, Z., Shi, Y., & Chen, C. L. P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10759-6 · Cited by 506
EUSBoost: Enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling
Galar, M., Fernández, A., Barrenechea, E., & Herrera, F. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.05.006 · Cited by 419
A novel ensemble method for classifying imbalanced data
Sun, Z., Song, Q., Zhu, X., Sun, H., Xu, B., & Zhou, Y. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.11.014 · Cited by 414
Cost-sensitive decision tree ensembles for effective imbalanced classification
Krawczyk, B., Woźniak, M., & Schaefer, G. (2014) · Applied Soft Computing · doi:10.1016/j.asoc.2013.08.014 · Cited by 361
Under-sampling class imbalanced datasets by combining clustering analysis and instance selection
Tsai, C.-F., Lin, W.-C., Hu, Y.-H., & Yao, G.-T. (2019) · Information Sciences · doi:10.1016/j.ins.2018.10.029 · Cited by 329
Review of Classification Methods on Unbalanced Data Sets
Wang, L., Han, M., Li, X., Zhang, N., & Cheng, H. (2021) · IEEE Access · doi:10.1109/access.2021.3074243 · Cited by 307
A Comprehensive Investigation of the Role of Imbalanced Learning for Software Defect Prediction
Song, Q., Guo, Y., & Shepperd, M. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2836442 · Cited by 295
On the class overlap problem in imbalanced data classification
Vuttipittayamongkol, P., Elyan, E., & Petrovski, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106631 · Cited by 290
Neighbourhood-based undersampling approach for handling imbalanced and overlapped data
Vuttipittayamongkol, P., & Elyan, E. (2020) · Information Sciences · doi:10.1016/j.ins.2019.08.062 · Cited by 286
A broad review on class imbalance learning techniques
Rezvani, S., & Wang, X. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110415 · Cited by 281
Evolutionary undersampling boosting for imbalanced classification of breast cancer malignancy
Krawczyk, B., Galar, M., Jeleń, Ł., & Herrera, F. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2015.08.060 · Cited by 263
Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data
Bhowan, U., Johnston, M., Zhang, M., & Yao, X. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2199119 · Cited by 259
Self-citationSáez, J. A., Krawczyk, B., & Woźniak, M. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.03.012 · Cited by 242
“Hybrid methods, which try to integrate the preprocessing techniques with the inbuilt mechanisms, especially with classifier ensembles [28].”
MethodA Noise-Filtered Under-Sampling Scheme for Imbalanced Classification
Kang, Q., Chen, X., Li, S., & Zhou, M. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2606104 · Cited by 242
“3) UB-KF combines UB with KF. UB [35] creates T sub-majority dataset and then trains T weak classifiers.”
BackgroundMethodWan, X., Zhang, X., & Liu, L. (2021) · Applied Sciences · doi:10.3390/app11062606 · Cited by 90
“Due to its excellent performance, ensemble learning is widely used in category imbalanced tasks [33,34].”
BackgroundSelf-supervised Learning is More Robust to Dataset Imbalance
Liu, H., HaoChen, J. Z., Gaidon, A., & Ma, T. (2021) · arXiv · doi:10.48550/arxiv.2110.05025 · Cited by 84
“Early works on ensemble learning adjusted the boosting and bagging algorithms with resampling in the imbalanced setting [Guo and Viktor, 2004, Wang and Yao, 2009].”
SGBBA: An Efficient Method for Prediction System in Machine Learning using Imbalance Dataset
Islam, S., Sara, U., Kawsar, A., Rahman, A., Kundu, D., Das, D., Rezaul, A. N. M., & Hasan, M. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120351 · Cited by 37
Metadata
- Authors
- Wang, S., & Yao, X.
- Venue
- 2009 IEEE Symposium on Computational Intelligence and Data Mining
- Publisher
- IEEE
- Published
- 2009-03
- Pages
- 324-331
- OpenAlex
- W2136256517
- Cited by
- 548
- References
- 18
- FWCI
- 2.82
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.