The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
A theoretical distribution analysis of synthetic minority oversampling technique (SMOTE) for imbalanced learning
Open accessAbstract
Class imbalance occurs when the class distribution is not equal. Namely, one class is under-represented (minority class), and the other class has significantly more samples in the data (majority class). The class imbalance problem is prevalent in many real world applications. Generally, the under-represented minority class is the class of interest. The synthetic minority over-sampling technique (SMOTE) method is considered the most prominent method for handling unbalanced data. The SMOTE method generates new synthetic data patterns by performing linear interpolation between minority class samples and their K nearest neighbors. However, the SMOTE generated patterns do not necessarily conform to the original minority class distribution. This paper develops a novel theoretical analysis of the SMOTE method by deriving the probability distribution of the SMOTE generated samples. To the best of our knowledge, this is the first work deriving a mathematical formulation for the SMOTE patterns’ probability distribution. This allows us to compare the density of the generated samples with the true underlying class-conditional density, in order to assess how representative the generated samples are. The derived formula is verified by computing it on a number of densities versus densities computed and estimated empirically.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,585
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
Remarks on Some Nonparametric Estimates of a Density Function
Rosenblatt, M. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728190 · Cited by 4,547
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
A systematic study of the class imbalance problem in convolutional neural networks
Buda, M., Maki, A., & Mazurowski, M. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.011 · Cited by 3,088 · cited 1×
“…approaches for handling the class imbalance problem: the data level approach (Batista et al., 2004; Chawla et al., 2002; Guzmán-Ponce et al., 2021), the cost sensitive approach (Devi et al., 2022), and the algorithm level approach (Mullick et al., 2018; Buda et al., 2018; Ganaie et al., 2021).”
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
KNN Model-Based Approach in Classification
Guo, G., Wang, H., Bell, D., Bi, Y., & Greer, K. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39964-3_62 · Cited by 2,099
EXPERT SYSTEMS WITH APPLICATIONS
(2005) · Expert Systems with Applications · doi:10.1016/j.eswa.2004.10.010 · Cited by 1,656
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
Data imbalance in classification: Experimental evaluation
Thabtah, F., Hammoud, S., Kamalov, F., & Gonsalves, A. (2020) · Information Sciences · doi:10.1016/j.ins.2019.11.004 · Cited by 850
Self-citationElreedy, D., & Atiya, A. F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.07.070 · Cited by 756
Self-citationBorderline over-sampling for imbalanced data classification
Nguyen, H. M., Cooper, E. W., & Kamei, K. (2011) · International Journal of Knowledge Engineering and Soft Data Paradigms · doi:10.1504/ijkesdp.2011.039875 · Cited by 592
DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data
Dablain, D., Krawczyk, B., & Chawla, N. V. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136503 · Cited by 591
Strategies for learning in class imbalance problems
Barandela, R., Sánchez, J. S., Garcı́a, V, & Rangel, E. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00257-1 · Cited by 579
Learning decision tree classifiers
Quinlan, J. R. (1996) · ACM Computing Surveys · doi:10.1145/234313.234346 · Cited by 504
Evolutionary Undersampling for Classification with Imbalanced Datasets: Proposals and Taxonomy
García, S., & Herrera, F. (2009) · Evolutionary Computation · doi:10.1162/evco.2009.17.3.275 · Cited by 414
A comprehensive data level analysis for cancer diagnosis on imbalanced data
Fotouhi, S., Asadi, S., & Kattan, M. W. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.12.003 · Cited by 343
A Systematic Study of Online Class Imbalance Learning With Concept Drift
Wang, S., Minku, L. L., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2771290 · Cited by 331
Review of Classification Methods on Unbalanced Data Sets
Wang, L., Han, M., Li, X., Zhang, N., & Cheng, H. (2021) · IEEE Access · doi:10.1109/access.2021.3074243 · Cited by 307
Neighbourhood-based undersampling approach for handling imbalanced and overlapped data
Vuttipittayamongkol, P., & Elyan, E. (2020) · Information Sciences · doi:10.1016/j.ins.2019.08.062 · Cited by 286
MSMOTE: Improving Classification Performance When Training Data is Imbalanced
Hu, S., Liang, Y., Ma, L., & He, Y. (2009) · 2009 Second International Workshop on Computer Science and Engineering · doi:10.1109/wcse.2009.756 · Cited by 264
Variational autoencoder based synthetic data generation for imbalanced learning
Wan, Z., Zhang, Y., & He, H. (2017) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2017.8285168 · Cited by 248
Analysis of sampling techniques for imbalanced data: An n = 648 ADNI study
Dubey, R., Zhou, J., Wang, Y., Thompson, P. M., & Ye, J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.005 · Cited by 204
Luengo, J., Fernández, A., García, S., & Herrera, F. (2011) · Soft Computing · doi:10.1007/s00500-010-0625-8 · Cited by 191
Optimization of k nearest neighbor density estimates
Fukunaga, K., & Hostetler, L. (1973) · IEEE Transactions on Information Theory · doi:10.1109/tit.1973.1055003 · Cited by 188
Li, Z., Huang, M., Liu, G., & Jiang, C. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114750 · Cited by 175
LoRAS: an oversampling approach for imbalanced datasets
Bej, S., Davtyan, N., Wolfien, M., Nassar, M., & Wolkenhauer, O. (2021) · Machine Learning · doi:10.1007/s10994-020-05913-4 · Cited by 167
RWO-Sampling: A random walk over-sampling approach to imbalanced data classification
Zhang, H., & Li, M. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.12.003 · Cited by 166
Adaptive Learning-Based $k$ -Nearest Neighbor Classifiers With Resilience to Class Imbalance
Mullick, S. S., Datta, S., & Das, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2812279 · Cited by 137
Introduction to Probability and Random Variables
Wadsworth, G. P., Bryan, J. G., & Eringen, A. C. (1961) · Journal of Applied Mechanics · doi:10.1115/1.3641702 · Cited by 111
Elyan, E., Moreno‐García, C. F., & Jayne, C. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05130-z · Cited by 104
DBIG-US: A two-stage under-sampling algorithm to face the class imbalance problem
Guzmán-Ponce, A., Sánchez, J. S., Rosas, R. M. V., & Marcial‐Romero, J. R. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114301 · Cited by 97
Chen, S., & Wu, S. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01695-4 · Cited by 96
Learning with Class Skews and Small Disjuncts
Prati, R. C., Batista, G., & Monard, M. C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28645-5_30 · Cited by 71
Early and accurate prediction of diabetics based on FCBF feature selection and SMOTE
Kishor, A., & Chakraborty, C. (2021) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-021-01174-z · Cited by 68
PDFOS: PDF estimation based over-sampling for imbalanced two-class problems
Gao, M., Hong, X., Chen, S., Harris, C. J., & Khalaf, E. F. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.02.006 · Cited by 64
SMOTE Implementation on Phishing Data to Enhance Cybersecurity
Ahsan, M., Gomes, R., & Denton, A. M. (2018) · IEEE International Conference on Electro Information Technology · doi:10.1109/eit.2018.8500086 · Cited by 60
Two density-based sampling approaches for imbalanced and overlapping data
Mayabadi, S., & Saadatfar, H. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108217 · Cited by 59
LDAS: Local density-based adaptive sampling for imbalanced data classification
Yan, Y., Jiang, Y., Zheng, Z., Yu, C., Zhang, Y., & Zhang, Y. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116213 · Cited by 56
SMOTE-Based Homogeneous Ensemble Methods for Software Defect Prediction
Balogun, A. O., Lafenwa-Balogun, F. B., Mojeed, H. A., Adeyemo, V. E., Oluwatobi, A. N., Akintola, A. G., Bajeh, A. O., & Usman-Hamza, F. E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58817-5_45 · Cited by 52
Fuzzy least squares projection twin support vector machines for class imbalance learning
Ganaie, M. A., & Tanveer, M. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107933 · Cited by 40
No Free Lunch in imbalanced learning
Moniz, N., & Monteiro, H. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107222 · Cited by 38
Exploring the Performance of Resampling Strategies for the Class Imbalance Problem
García, V., Sánchez, J. S., & Mollineda, R. A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13022-9_54 · Cited by 34
Chennuru, V. K., & Timmappareddy, S. R. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02369-4 · Cited by 26
RB-CCR: Radial-Based Combined Cleaning and Resampling algorithm for imbalanced data classification
Koziarski, M., Bellinger, C., & Woźniak, M. (2021) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1007/s10994-021-06012-8 · Cited by 25
In-Depth Performance Analysis of SMOTE-Based Oversampling Algorithms in Binary Classification
Dudjak, M., & Martinović, G. (2020) · International journal of electrical and computer engineering systems · doi:10.32985/ijeces.11.1.2 · Cited by 14
Bolívar, A., García, V., Florencia, R., Alejo, R., Rivera, G., & Sánchez-Solís, J. P. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-07750-0_5 · Cited by 5
Cited by
Niu, Y., Chen, X., Fan, J., Liu, C., Fang, M., Liu, Z., Meng, X., Liu, Y., Lu, L., & Fan, H. (2025) · Scientific Reports · doi:10.1038/s41598-025-93579-0 · Cited by 26
Metadata
- Authors
- Elreedy, D., Atiya, A. F., & Kamalov, F.
- Venue
- Machine Learning
- Published
- 2023-01-05
- Volume
- 113
- Issue
- 7
- Pages
- 4903-4923
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W4313555233
- Cited by
- 388
- References
- 53
- FWCI
- 34.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.