The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
A Comparison of Undersampling, Oversampling, and SMOTE Methods for Dealing with Imbalanced Classification in Educational Data Mining
Open accessAbstract
Educational data mining is capable of producing useful data-driven applications (e.g., early warning systems in schools or the prediction of students’ academic achievement) based on predictive models. However, the class imbalance problem in educational datasets could hamper the accuracy of predictive models as many of these models are designed on the assumption that the predicted class is balanced. Although previous studies proposed several methods to deal with the imbalanced class problem, most of them focused on the technical details of how to improve each technique, while only a few focused on the application aspect, especially for the application of data with different imbalance ratios. In this study, we compared several sampling techniques to handle the different ratios of the class imbalance problem (i.e., moderately or extremely imbalanced classifications) using the High School Longitudinal Study of 2009 dataset. For our comparison, we used random oversampling (ROS), random undersampling (RUS), and the combination of the synthetic minority oversampling technique for nominal and continuous (SMOTE-NC) and RUS as a hybrid resampling technique. We used the Random Forest as our classification algorithm to evaluate the results of each sampling technique. Our results show that random oversampling for moderately imbalanced data and hybrid resampling for extremely imbalanced data seem to work best. The implications for educational data mining applications and suggestions for future research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01686 · Cited by 22,138
(2010) · University of Twente Research Information · Cited by 6,037
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Asymptotic Properties of Nearest Neighbor Rules Using Edited Data
Wilson, D. L. (1972) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1972.4309137 · Cited by 2,130
Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning
Lemaître, G., Nogueira, F., & Aridas, C. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.06570 · Cited by 1,514
Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE
Douzas, G., Bacao, F., & Last, F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.06.056 · Cited by 1,277
Clustering-based undersampling in class-imbalanced data
Lin, W.-C., Tsai, C.-F., Hu, Y.-H., & Jhang, J.-S. (2017) · Information Sciences · doi:10.1016/j.ins.2017.05.008 · Cited by 832
Training and assessing classification rules with imbalanced data
Menardi, G., & Torelli, N. (2014) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-012-0295-5 · Cited by 765
Mohammed, R., Rawashdeh, J., & Abdullah, M. (2020) · 2020 11th International Conference on Information and Communication Systems (ICICS) · doi:10.1109/icics49469.2020.239556 · Cited by 684
Santos, M. S., Soares, J. P., Abreu, P. H., Araujo, H., & Santos, J. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2866730 · Cited by 402
Bronfenbrenner's Ecological Systems Theory
Paquette, D., & Ryan, J. C. (2001) · Cited by 331
Kovács, G. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105662 · Cited by 289
Combating imbalance in network intrusion datasets
Cieslak, D. A., Chawla, N. V., & Striegel, A. (2006) · 2006 IEEE International Conference on Granular Computing · doi:10.1109/grc.2006.1635905 · Cited by 286
Explaining the Success of AdaBoost and Random Forests as Interpolating Classifiers
Wyner, A. J., Olson, M., Bleich, J., & Mease, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.07676 · Cited by 242
Márquez-Vera, C., Cano, A., Romero, C., & Ventura, S. (2013) · Applied Intelligence · doi:10.1007/s10489-012-0374-8 · Cited by 219
A Brief Survey on Random Forest Ensembles in Classification Model
Shaik, A. B., & Srinivasan, S. (2019) · Lecture Notes in Networks and Systems · doi:10.1007/978-981-13-2354-6_27 · Cited by 201
Smote-variants: A python implementation of 85 minority oversampling techniques
Kovács, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.100 · Cited by 197
Predicting Students Performance in Educational Data Mining
Guo, B., Zhang, R., Xu, G., Shi, C., & Yang, L. (2015) · 2015 International Symposium on Educational Technology (ISET) · doi:10.1109/iset.2015.33 · Cited by 167
A review on classification of imbalanced data for wireless sensor networks
Patel, H., Singh Rajput, D., Thippa Reddy, G., Iwendi, C., Kashif Bashir, A., & Jo, O. (2020) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147720916404 · Cited by 162
Kaur, P., & Gosain, A. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-6602-3_3 · Cited by 144
Early warning system as a predictor for student performance in higher education blended courses
Jokhan, A. D., Sharma, B. N., & Singh, S. (2018) · Studies in Higher Education · doi:10.1080/03075079.2018.1466872 · Cited by 94
Revisiting the Tinto's Theoretical Dropout Model
Nicoletti, M. D. C. (2019) · Higher Education Studies · doi:10.5539/hes.v9n3p52 · Cited by 91
Predictive Models for Imbalanced Data: A School Dropout Perspective
Barros, T. M., Neto, P. A. S., da Silva, I. M. D., & Guedes, L. A. (2019) · Education Sciences · doi:10.3390/educsci9040275 · Cited by 88
Grouped SMOTE With Noise Filtering Mechanism for Classifying Imbalanced Data
Ke, C., Zhang, C., Yu, H., et al. (2019) · IEEE Access · doi:10.1109/access.2019.2955086 · Cited by 78
Ramaswami, G. S., Sušnjak, T., Mathrani, A., Lim, J. B. P., & Garcia, P. (2019) · Information and Learning Sciences · doi:10.1108/ils-03-2019-0017 · Cited by 67
Bulut, O., Gorgun, G., Yildirim‐Erbasli, S. N., Wongvorachan, T., Daniels, L. M., Gao, Y., Lai, K. W., & Shin, J. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13276 · Cited by 61
Self-citationSun, Y., Li, Z., Li, X., & Zhang, J. (2021) · Applied Artificial Intelligence · doi:10.1080/08839514.2021.1877481 · Cited by 57
An empirical comparison of repetitive undersampling techniques
Hulse, J. V., Khoshgoftaar, T. M., & Napolitano, A. (2009) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2009.5211614 · Cited by 48
Hassan, H., Ahmad, N. B., & Anuar, S. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1529/5/052041 · Cited by 45
Data mining approaches to predict final grade by overcoming class imbalance problem
Rashu, R. I., Haq, N., & Rahman, R. M. (2014) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccitechn.2014.7073095 · Cited by 31
Let's shine together! a comparative study between learning analytics and educational data mining
Chen, G., Rolim, V., Mello, R. F., & Gašević, D. (2020) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3375462.3375500 · Cited by 27
Imbalanced educational data classification: An effective approach with resampling and random forest
Vo, C. T. N., & Phung, N. H. (2013) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf.2013.6719882 · Cited by 25
Chakravarthy, A. D., Bonthu, S., Chen, Z., & Zhu, Q. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00245 · Cited by 21
Cited by
Zhu, L., Liu, G., Lv, S., Chen, D., Chen, Z., & Li, X. (2023) · Information · doi:10.3390/info14060317 · Cited by 12
Enhancing machine learning algorithm performance for PCOS diagnosis using SMOTENC on imbalanced data
Dewi, R., Sri hayati, R., Saleh, A., Hakim Tanjung, D. Y., & Jinan, A. (2025) · JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer) · doi:10.33480/jitk.v11i1.6676 · Cited by 2
Metadata
- Authors
- Wongvorachan, T., He, S., & Bulut, O.
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2023-01-16
- Volume
- 14
- Issue
- 1
- Pages
- 54
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W4316469706
- Cited by
- 375
- References
- 37
- FWCI
- 32.86
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.