The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
An empirical comparison and evaluation of minority oversampling techniques on a large number of imbalanced datasets
Abstract
Abstract Learning and mining from imbalanced datasets gained increased interest in recent years. One simple but efficient way to increase the performance of standard machine learning techniques on imbalanced datasets is the synthetic generation of minority samples. In this paper, a detailed, empirical comparison of 85 variants of minority oversampling techniques is presented and discussed involving 104 imbalanced datasets for evaluation. The goal of the work is to set a new baseline in the field, determine the oversampling principles leading to the best results under general circumstances, and also give guidance to practitioners on which techniques to use with certain types of datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
(2015) · Cited by 2,857
Alcalá‐Fdez, J., Fernández, A., Luengo, J., Derrac, J., García, S., Sánchez, L., & Herrera, F. (2011) · Repositorio de la Universidad de Oviedo (RUO) · Cited by 2,729
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning
Lemaître, G., Nogueira, F., & Aridas, C. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.06570 · Cited by 1,514
Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE
Douzas, G., Bacao, F., & Last, F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.06.056 · Cited by 1,277
Data mining and knowledge discovery handbook
(2011) · Choice Reviews Online · doi:10.5860/choice.48-5729 · Cited by 1,156
MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., Yao, X., & Murase, K. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.232 · Cited by 1,150
Kriegel, H.-P., Kröger, P., & Zimek, A. (2009) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/1497577.1497578 · Cited by 1,093
Data Mining for Imbalanced Datasets: An Overview
Chawla, N. V. (2009) · Data Mining and Knowledge Discovery Handbook · doi:10.1007/978-0-387-09823-4_45 · Cited by 1,082
van Dyk, D. A., & Meng, X.-L. (2001) · Journal of Computational and Graphical Statistics · doi:10.1198/10618600152418584 · Cited by 1,052
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
Training and assessing classification rules with imbalanced data
Menardi, G., & Torelli, N. (2014) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-012-0295-5 · Cited by 765
Sáez, J. A., Luengo, J., Stefanowski, J., & Herrera, F. (2015) · Information Sciences · doi:10.1016/j.ins.2014.08.051 · Cited by 627
Effective data generation for imbalanced learning using conditional generative adversarial networks
Douzas, G., & Bacao, F. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.030 · Cited by 601
Ramentol, E., Caballero, Y., Bello, R., & Herrera, F. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0465-6 · Cited by 489
To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques
Abdi, L., & Hashemi, S. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2458858 · Cited by 411
DBSMOTE: Density-Based Synthetic Minority Over-sampling TEchnique
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2012) · Applied Intelligence · doi:10.1007/s10489-011-0287-y · Cited by 390
Intelligent Information and Database Systems
Nguyên, N. T., Trawiński, B., & Kosala, R. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-15705-4 · Cited by 312
Adaptive semi-unsupervised weighted oversampling (A-SUWO) for imbalanced datasets
Nekooeimehr, I., & Lai-Yuen, S. K. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.10.031 · Cited by 291
Cost-Sensitive Learning with Neural Networks.
Kukar, M., & Kononenko, I. (1998) · Cited by 273
MSMOTE: Improving Classification Performance When Training Data is Imbalanced
Hu, S., Liang, Y., Ma, L., & He, Y. (2009) · 2009 Second International Workshop on Computer Science and Engineering · doi:10.1109/wcse.2009.756 · Cited by 264
Learning from imbalanced data in surveillance of nosocomial infection
Cohen, G., Hilario, M., Sax, H., Hugonnet, S., & Geissbuhler, A. (2006) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2005.03.002 · Cited by 258
Local neighbourhood extension of SMOTE for mining imbalanced data
Maciejewski, T., & Stefanowski, J. (2011) · 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949434 · Cited by 255
Handling class imbalance problem using oversampling techniques: A review
Gosain, A., & Sardana, S. (2017) · 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2017.8125820 · Cited by 247
Ma, L., & Fan, S. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1578-z · Cited by 240
Imbalanced Datasets: From Sampling to Classifiers
Hoens, T. R., & Chawla, N. V. (2013) · Wiley eBooks · doi:10.1002/9781118646106.ch3 · Cited by 204
Classification of Imbalanced Data by Using the SMOTE Algorithm and Locally Linear Embedding
Wang, J., Xu, M., Wang, H., & Zhang, J. (2006) · 2006 8th international Conference on Signal Processing · doi:10.1109/icosp.2006.345752 · Cited by 197
A survey of cost-sensitive decision tree induction algorithms
Lomax, S., & Vadera, S. (2013) · ACM Computing Surveys · doi:10.1145/2431211.2431215 · Cited by 193
Yu, H., Ni, J., & Zhao, J. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.08.018 · Cited by 188
Selective Pre-processing of Imbalanced Data for Improving Classification Performance
Stefanowski, J., & Wilk, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85836-2_27 · Cited by 188
Class Confidence Weighted kNN Algorithms for Imbalanced Data Sets
Liu, W., & Chawla, S. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-20847-8_29 · Cited by 185
Preprocessing unbalanced data using support vector machine
Farquad, M. A. H., & Bose, I. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.01.016 · Cited by 185
Self-Organizing Map Oversampling (SOMO) for imbalanced data set learning
Douzas, G., & Bacao, F. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.03.073 · Cited by 179
Nakamura, M., Kajiwara, Y., Otsuka, A., & Kimura, H. (2013) · BioData Mining · doi:10.1186/1756-0381-6-16 · Cited by 170
A dynamic over-sampling procedure based on sensitivity for multi-class problems
Fernández‐Navarro, F., Hervás‐Martínez, C., & Gutiérrez, P. A. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.02.019 · Cited by 167
RWO-Sampling: A random walk over-sampling approach to imbalanced data classification
Zhang, H., & Li, M. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.12.003 · Cited by 166
López, V., Fernández, A., & Herrera, F. (2014) · Information Sciences · doi:10.1016/j.ins.2013.09.038 · Cited by 160
KernelADASYN: Kernel based adaptive synthetic data generation for imbalanced learning
Tang, B., & He, H. (2015) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2015.7256954 · Cited by 137
RACOG and wRACOG: Two Probabilistic Oversampling Techniques
Das, B., Krishnan, N. C., & Cook, D. J. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2324567 · Cited by 136
A Novel Algorithm for Imbalance Data Classification Based on Genetic Algorithm Improved SMOTE
Jiang, K., Lu, J., & Xia, K. (2016) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-016-2179-2 · Cited by 132
CCR: A combined cleaning and resampling algorithm for imbalanced data classification
Koziarski, M., & Woźniak, M. (2017) · International Journal of Applied Mathematics and Computer Science · doi:10.1515/amcs-2017-0050 · Cited by 129
Noise Reduction A Priori Synthetic Over-Sampling for class imbalanced data sets
Rivera, W. (2017) · Information Sciences · doi:10.1016/j.ins.2017.04.046 · Cited by 123
Adaptive multi-objective swarm fusion for imbalanced data classification
Li, J., Fong, S. J., Wong, R. K., & Chu, V. W. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.03.007 · Cited by 117
A New Over-Sampling Approach: Random-SMOTE for Learning from Imbalanced Data Sets
Dong, Y., & Wang, X. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25975-3_30 · Cited by 110
A Novel Synthetic Minority Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., & Murase, K. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24958-7_85 · Cited by 109
Wang, S., Li, Z., Chao, W., & Cao, Q. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252696 · Cited by 103
ProWSyn: Proximity Weighted Synthetic Oversampling Technique for Imbalanced Data Set Learning
Barua, S., Islam, M. M., & Murase, K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37456-2_27 · Cited by 102
Gaussian-Based SMOTE Algorithm for Solving Skewed Class Distributions
Lee, H., Kim, J., & Kim, S. (2017) · International Journal of Fuzzy Logic and Intelligent Systems · doi:10.5391/ijfis.2017.17.4.229 · Cited by 102
PSO-based method for SVM classification on skewed data sets
Cervantes, J., García‐Lamont, F., Rodríguez, L., López‐Chau, A., Castilla, J. R., & Espinosa, A. T. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.10.041 · Cited by 98
Machine Learning and Cybernetics
Wang, X., Pedrycz, W., Chan, P. P. K., & He, Q. (2014) · Communications in computer and information science · doi:10.1007/978-3-662-45652-1 · Cited by 96
Ramentol, E., Torné, I. G., Choy, S. L., Bello, R., Caballero, Y., Cornelis, C., & Herrera, F. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.10.009 · Cited by 92
Learning from Imbalanced Data: Evaluation Matters
Raeder, T., Forman, G., & Chawla, N. V. (2011) · Intelligent systems reference library · doi:10.1007/978-3-642-23166-7_12 · Cited by 90
A Novel Boundary Oversampling Algorithm Based on Neighborhood Rough Set Model: NRSBoundary-SMOTE
Hu, F., & Li, H. (2013) · Mathematical Problems in Engineering · doi:10.1155/2013/694809 · Cited by 85
KRNN: k Rare-class Nearest Neighbour classification
Zhang, X., Li, Y., Ramamohanarao, K., Wu, L., Tari, Z., & Cheriet, M. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.08.023 · Cited by 83
Tan, P., Bailey, J., Ho, C. K., & Chawla, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30220-6 · Cited by 81
Rivera, W., & Xanthopoulos, P. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.09.010 · Cited by 74
Surrounding neighborhood-based SMOTE for learning from imbalanced data sets
García, V., Sánchez, J. S., Martín-Félez, R., & Mollineda, R. A. (2012) · Progress in Artificial Intelligence · doi:10.1007/s13748-012-0027-5 · Cited by 69
PDFOS: PDF estimation based over-sampling for imbalanced two-class problems
Gao, M., Hong, X., Chen, S., Harris, C. J., & Khalaf, E. F. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.02.006 · Cited by 67
Improving k Nearest Neighbor with Exemplar Generalization for Imbalanced Classification
Li, Y., & Zhang, X. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-20847-8_27 · Cited by 66
Huang, T., Leung, C. S., Li, C., & Zeng, Z. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34478-7 · Cited by 66
Addressing imbalanced classification with instance generation techniques: IPADE-ID
López, V., Triguero, I., Carmona, C. J., García, S., & Herrera, F. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.01.050 · Cited by 60
The generation mechanism of synthetic minority class examples
Tang, S., & Chen, S. (2008) · IEEE International Conference on Information Technology and Applications in Biomedicine · doi:10.1109/itab.2008.4570642 · Cited by 59
Hu, J. S., He, X., Yu, D., Yang, X., Yang, J.-Y., & Shen, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0107676 · Cited by 57
Handling Imbalanced Datasets by Partially Guided Hybrid Sampling for Pattern Recognition
Sandhan, T., & Choi, J. Y. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.258 · Cited by 56
An Improved SMOTE Imbalanced Data Classification Method Based on Support Degree
Li, K., Zhang, W., Lu, Q., & Fang, X. (2014) · International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI) · doi:10.1109/iiki.2014.14 · Cited by 55
Automatic Determination of Neighborhood Size in SMOTE
Yun, J., Ha, J., & Lee, J. (2016) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1145/2857546.2857648 · Cited by 53
A Novel Minority Cloning Technique for Cost-Sensitive Learning
Jiang, L., Chen, Q., & Li, C. (2015) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001415510040 · Cited by 50
(2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-19063-7 · Cited by 49
Margin-Based Over-Sampling Method for Learning from Imbalanced Datasets
Fan, X., Tang, K., & Weise, T. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-20847-8_26 · Cited by 48
Adaptive Oversampling for Imbalanced Data Classification
Ertekin, Ş. (2013) · Lecture notes in electrical engineering · doi:10.1007/978-3-319-01604-7_26 · Cited by 48
A Normal Distribution-Based Over-Sampling Approach to Imbalanced Data Classification
Zhang, H., & Wang, Z. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25853-4_7 · Cited by 39
Puntumapon, K., & Waiyamai, K. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30220-6_31 · Cited by 39
SYNTHETIC OVERSAMPLING OF INSTANCES USING CLUSTERING
SÁNCHEZ, A. I., Morales, E. F., & González, J. A. (2013) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213013500085 · Cited by 39
An over-sampling technique with rejection for imbalanced class learning
Lee, J., Kim, N.-R., & Lee, J.-H. (2015) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1145/2701126.2701181 · Cited by 37
A Positive-biased Nearest Neighbour Algorithm for Imbalanced Classification
Zhang, X., & Li, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37456-2_25 · Cited by 33
Cost-Sensitive Support Vector Machine for Semi-Supervised Learning
Qi, Z., Tian, Y., Shi, Y., & Yu, X. (2013) · Procedia Computer Science · doi:10.1016/j.procs.2013.05.336 · Cited by 28
Synthetic Oversampling for Advanced Radioactive Threat Detection
Bellinger, C., Japkowicz, N., & Drummond, C. (2015) · IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2015.58 · Cited by 28
NEATER: filtering of over-sampled data using non-cooperative game theory
Almogahed, B., & Kakadiaris, I. A. (2014) · Soft Computing · doi:10.1007/s00500-014-1484-5 · Cited by 27
Using Voronoi diagrams to improve classification performances when modeling imbalanced datasets
Young, W. A., Nykl, S. L., Weckman, G. R., & Chelberg, D. M. (2014) · Neural Computing and Applications · doi:10.1007/s00521-014-1780-0 · Cited by 23
Safe level graph for synthetic minority over-sampling techniques
Bunkhumpornpat, C., & Subpaiboonkit, S. (2013) · International Symposium on Communications and Information Technologies · doi:10.1109/iscit.2013.6645923 · Cited by 21
Diversity and separable metrics in over-sampling technique for imbalanced data classification
Mahmoudi, S., Moradi, P., Akhlaghian, F., & Moradi, R. (2014) · International Conference on Computer and Knowledge Engineering · doi:10.1109/iccke.2014.6993409 · Cited by 21
Classification of Imbalanced Data Sets by Using the Hybrid Re-sampling Algorithm Based on Isomap
Gu, Q., Cai, Z., & Zhu, L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04843-2_31 · Cited by 20
Absent Data Generating Classifier for Imbalanced Class Sizes
Pourhabib, A., Mallick, B. K., & Ding, Y. C. (2015) · OakTrust (Texas A&M University Libraries) · Cited by 20
Cateni, S., Colla, V., & Vannucci, M. (2011) · International Conference on Intelligent Systems Design and Applications (ISDA) · doi:10.1109/isda.2011.6121689 · Cited by 16
RBM-SMOTE: Restricted Boltzmann Machines for Synthetic Minority Oversampling Technique
Zięba, M., Tomczak, J. M., & Gonczarek, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-15702-3_37 · Cited by 14
László, Z., Török, L., & Kovács, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-90050-6_15 · Cited by 2
Self-citation
Cited by
Wongvorachan, T., He, S., & Bulut, O. (2023) · Information · doi:10.3390/info14010054 · Cited by 375
Metadata
- Authors
- Kovács, G.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2019-10
- Volume
- 83
- Pages
- 105662
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W2966679659
- Cited by
- 289
- References
- 94
- FWCI
- 12.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.