The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
A Comprehensive Analysis of Synthetic Minority Oversampling Technique (SMOTE) for handling class imbalance
Abstract
Abstract Imbalanced classification problems are often encountered in many applications. The challenge is that there is a minority class that has typically very little data and is often the focus of attention. One approach for handling imbalance is to generate extra data from the minority class, to overcome its shortage of data. The Synthetic Minority over-sampling TEchnique (SMOTE) is one of the dominant methods in the literature that achieves this extra sample generation. It is based on generating examples on the lines connecting a point and one its K -nearest neighbors. This paper presents a theoretical and experimental analysis of the SMOTE method. We explore the accuracy of how faithful it emulates the underlying density. To our knowledge, this is the first mathematical analysis of the SMOTE method. Moreover, we analyze the effect of the different factors on generation accuracy, such as the dimension, size of the training set and the considered number of neighbors K . We also provide a qualitative analysis that examines the factors affecting its accuracy. In addition, we explore the impact of SMOTE on classification boundary, and classification performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Exploratory Undersampling for Class-Imbalance Learning
Liu, X.-Y., Wu, J., & Zhou, Z.-H. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007853 · Cited by 2,465
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
RUSBoost: A Hybrid Approach to Alleviating Class Imbalance
Seiffert, C., Khoshgoftaar, T. M., Van Hulse, J., & Napolitano, A. (2010) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2009.2029559 · Cited by 1,867
SMOTEBoost: Improving Prediction of the Minority Class in Boosting
Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39804-2_12 · Cited by 1,668
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
Cost-sensitive boosting for classification of imbalanced data
Sun, Y., Kamel, M. S., Wong, A. K. C., & Wang, Y. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.04.009 · Cited by 1,423
Mining with rarity: a unifying framework
Weiss, G. M. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007734 · Cited by 1,393
Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE
Douzas, G., Bacao, F., & Last, F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.06.056 · Cited by 1,277
Applying Support Vector Machines to Imbalanced Datasets
Akbani, R., Kwek, S., & Japkowicz, N. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30115-8_7 · Cited by 1,134
Class imbalances versus small disjuncts
Jo, T., & Japkowicz, N. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007737 · Cited by 683
Calibrating Probability with Undersampling for Unbalanced Classification
Pozzolo, A. D., Caelen, O., Johnson, R. A., & Bontempi, G. (2015) · 2015 IEEE Symposium Series on Computational Intelligence · doi:10.1109/ssci.2015.33 · Cited by 667
AdaCost: Misclassification Cost-Sensitive Boosting
Fan, W., Stolfo, S. J., Zhang, J., & Chan, P. K. (1999) · Cited by 612
Kotz, S., Kozubowski, T. J., & Podgórski, K. (2001) · Cited by 592
Distributed data mining in credit card fraud detection
Chan, P. K., Fan, W., Prodromidis, A. L., & Stolfo, S. J. (1999) · IEEE Intelligent Systems · doi:10.1109/5254.809570 · Cited by 538
2015 IEEE Symposium Series on Computational Intelligence
(2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2479518 · Cited by 443
Class-Boundary Alignment for Imbalanced Dataset Learning
Wu, G., & Chang, E. Y. (2003) · Cited by 427
Evolutionary Undersampling for Classification with Imbalanced Datasets: Proposals and Taxonomy
García, S., & Herrera, F. (2009) · Evolutionary Computation · doi:10.1162/evco.2009.17.3.275 · Cited by 414
2011 IEEE 11th International Conference on Data Mining
(2011) · doi:10.1109/icdm19089.2011 · Cited by 305
MSMOTE: Improving Classification Performance When Training Data is Imbalanced
Hu, S., Liang, Y., Ma, L., & He, Y. (2009) · 2009 Second International Workshop on Computer Science and Engineering · doi:10.1109/wcse.2009.756 · Cited by 264
2019 IEEE International Conference on Data Mining (ICDM)
(2019) · doi:10.1109/icdm47104.2019 · Cited by 252
Class prediction for high-dimensional class-imbalanced data
Blagus, R., & Lusa, L. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-523 · Cited by 236
RAMOBoost: Ranked Minority Oversampling in Boosting
Chen, S., He, H., & Garcia, E. A. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2066988 · Cited by 208
Analysis of sampling techniques for imbalanced data: An n = 648 ADNI study
Dubey, R., Zhou, J., Wang, Y., Thompson, P. M., & Ye, J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.005 · Cited by 204
Luengo, J., Fernández, A., García, S., & Herrera, F. (2011) · Soft Computing · doi:10.1007/s00500-010-0625-8 · Cited by 191
Optimization of k nearest neighbor density estimates
Fukunaga, K., & Hostetler, L. (1973) · IEEE Transactions on Information Theory · doi:10.1109/tit.1973.1055003 · Cited by 188
A Bias and Variance Analysis for Multistep-Ahead Time Series Forecasting
Taieb, S. B., & Atiya, A. F. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2411629 · Cited by 186
Self-citationWallace, B. C., Small, K., Brodley, C. E., & Trikalinos, T. A. (2011) · 2011 IEEE 11th International Conference on Data Mining · doi:10.1109/icdm.2011.33 · Cited by 186
z-SVM: An SVM for Improved Classification of Imbalanced Data
Imam, T., Ting, K. M., & Kamruzzaman, J. (2006) · Lecture notes in computer science · doi:10.1007/11941439_30 · Cited by 176
A Robust Decision Tree Algorithm for Imbalanced Data Sets
Liu, W., Chawla, S., Cieslak, D. A., & Chawla, N. V. (2010) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972801.67 · Cited by 157
Advances in Knowledge Discovery and Data Mining
Zaki, M. J., Pudi, V., Ravindran, B., & Yu, J. X. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13672-6 · Cited by 146
A Novel Template Reduction Approach for the $K$-Nearest Neighbor Method
Fayed, H. A., & Atiya, A. F. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2018547 · Cited by 132
Self-citationKemp, F. (2003) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-12-00383_14.x · Cited by 114
Data mining for improved cardiac care
Rao, R. B., Krishnan, S., & Niculescu, R. S. (2006) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1147234.1147236 · Cited by 114
The effect of imbalanced data sets on LDA: A theoretical and empirical analysis
Xie, J., & Qiu, Z. (2006) · Pattern Recognition · doi:10.1016/j.patcog.2006.01.009 · Cited by 106
Synthetic Oversampling with the Majority Class: A New Perspective on Handling Extreme Imbalance
Sharma, S., Bellinger, C., Krawczyk, B., Zai͏̈ane, O. R., & Japkowicz, N. (2018) · Proceedings · doi:10.1109/icdm.2018.00060 · Cited by 103
Tan, P., Bailey, J., Ho, C. K., & Chawla, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30220-6 · Cited by 81
Class Based Weighted K-Nearest Neighbor over Imbalance Dataset
Dubey, H., & Pudi, V. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37456-2_26 · Cited by 68
Manifold-based synthetic oversampling with manifold conformance estimation
Bellinger, C., Drummond, C., & Japkowicz, N. (2017) · Machine-mediated learning · doi:10.1007/s10994-017-5670-4 · Cited by 66
Imbalanced classification in sparse and large behaviour datasets
Vanhoeyveld, J., & Martens, D. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-017-0517-y · Cited by 50
Exploring the Performance of Resampling Strategies for the Class Imbalance Problem
García, V., Sánchez, J. S., & Mollineda, R. A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13022-9_54 · Cited by 20
(1996)
Cited by
Zhang, T., Chen, J., Li, F., Zhang, K., Lv, H., He, S., & Xu, E. (2022) · ISA Transactions · doi:10.1016/j.isatra.2021.02.042 · Cited by 571
Support vector machine in structural reliability analysis: A review
Roy, A., & Chakraborty, S. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109126 · Cited by 502
FedHome: Cloud-Edge Based Personalized Federated Learning for In-Home Health Monitoring
Wu, Q., Chen, X., Zhou, Z., & Zhang, J. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3045266 · Cited by 392
Elreedy, D., Atiya, A. F., & Kamalov, F. (2024) · Machine Learning · doi:10.1007/s10994-022-06296-4 · Cited by 388
Self-citationArora, A., & Arora, A. (2022) · Future Healthcare Journal · doi:10.7861/fhj.2022-0013 · Cited by 161
Metadata
- Authors
- Elreedy, D., & Atiya, A. F.
- Venue
- Information Sciences
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 505
- Pages
- 32-64
- ISSN
- 0020-0255 (ISSN-L)
- OpenAlex
- W2963613787
- Cited by
- 756
- References
- 48
- FWCI
- 17.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.