The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Comparing Different Resampling Methods in Predicting Students’ Performance Using Machine Learning Techniques
Open accessAbstract
In today's world, due to the advancement of technology, predicting the students' performance is among the most beneficial and essential research topics. Data Mining is extremely helpful in the field of education, especially for analyzing students' performance. It is a fact that predicting the students' performance has become a severe challenge because of the imbalanced datasets in this field, and there is not any comparison among different resampling methods. This paper attempts to compare various resampling techniques such as Borderline SMOTE, Random Over Sampler, SMOTE, SMOTE-ENN, SVM-SMOTE, and SMOTE-Tomek to handle the imbalanced data problem while predicting students' performance using two different datasets. Moreover, the difference between multiclass and binary classification, and structures of the features are examined. To be able to check the performance of the resampling methods better in solving the imbalanced problem, this paper uses various machine learning classifiers including Random Forest, K-Nearest-Neighbor, Artificial Neural Network, XG-boost, Support Vector Machine (Radial Basis Function), Decision Tree, Logistic Regression, and Naïve Bayes. Furthermore, the Random hold-out and Shuffle 5-fold cross-validation methods are used as model validation techniques. The achieved results using different evaluation metrics indicate that fewer numbers of classes and nominal features will lead models to better performance. Also, classifiers do not perform well with imbalanced data, so solving this problem is necessary. The performance of classifiers is improved using balanced datasets. Additionally, the results of the Friedman test, which is a statistical significance test, confirm that the SVM-SMOTE is more efficient than the other resampling methods. Moreover, The Random Forest classifier has achieved the best result among all other models while using SVM-SMOTE as a resampling method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Friedman, M. (1937) · Journal of the American Statistical Association · doi:10.1080/01621459.1937.10503522 · Cited by 7,005
Artificial neural networks: a tutorial
Jain, A. K., Mao, J., & Mohiuddin, K. M. (1996) · Computer · doi:10.1109/2.485891 · Cited by 4,946
On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown
Lilliefors, H. W. (1967) · Journal of the American Statistical Association · doi:10.2307/2283970 · Cited by 4,530
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
Forecasting with artificial neural networks:
Zhang, G., Eddy Patuwo, B., & Y. Hu, M. (1998) · International Journal of Forecasting · doi:10.1016/s0169-2070(97)00044-7 · Cited by 4,229
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
A survey of decision tree classifier methodology
Safavian, S. R., & Landgrebe, D. (1991) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.97458 · Cited by 3,808
Artificial neural networks: fundamentals, computing, design, and application
Basheer, I. A., & Hajmeer, M. (2000) · Journal of Microbiological Methods · doi:10.1016/s0167-7012(00)00201-3 · Cited by 3,231
An empirical study of the naive Bayes classifier
Rish, I. (2001) · Cited by 3,202
A Short Introduction to Boosting
Freund, Y., & Schapire, R. E. (1999) · Cited by 3,140
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794
A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings
Friedman, M. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731944 · Cited by 2,785
Exploratory Undersampling for Class-Imbalance Learning
Liu, X.-Y., Wu, J., & Zhou, Z.-H. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007853 · Cited by 2,465
Educational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251
Educational data mining: A survey from 1995 to 2005
Romero, C., & Ventura, S. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.04.005 · Cited by 1,482
The State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S. J. D., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554657 · Cited by 1,359
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
Handling imbalanced datasets: A review
Kotsiantis, S. B., Kanellopoulos, D. N., & Pintelas, P. (2006) · Cited by 920
Data Preprocessing For Supervised Leaning
Kotsiantis, S. B., Kanellopoulos, D. N., & Pintelas, P. (2007) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1082414 · Cited by 631
Using data mining to predict secondary school student performance
Cortez, P. C., & Silva, A. M. G. (2008) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 558
k-Nearest Neighbour Classifiers
Cunningham, P., & Delany, S. J. (2007) · Research Repository UCD (University College Dublin) · Cited by 542
Feature normalization and likelihood-based similarity measures for image retrieval
Aksoy, S., & Haralick, R. M. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(00)00112-4 · Cited by 457
Class Imbalance Problem in Data Mining Review
Longadge, R., & Dongre, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.1707 · Cited by 432
Ensemble boosted trees with synthetic features generation in application to bankruptcy prediction
Zięba, M., Tomczak, S. K., & Tomczak, J. M. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.001 · Cited by 418
Models for early prediction of at-risk students in a course using standards-based grading
Marbouti, F., Diefes-Dux, H. A., & Madhavan, K. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.09.005 · Cited by 360
Fernandes, E., Holanda, M., Victorino, M., Borges, V., Carvalho, R., & Erven, G. V. (2019) · Journal of Business Research · doi:10.1016/j.jbusres.2018.02.012 · Cited by 316
Predicting Student Performance by Using Data Mining Methods for Classification
Kabakchieva, D. (2013) · Cybernetics and Information Technologies · doi:10.2478/cait-2013-0006 · Cited by 299
An Application of Oversampling, Undersampling, Bagging and Boosting in Handling Imbalanced Datasets
Yap, B. W., Rani, K. A., Rahman, H. A. A., Fong, S., Khairudin, Z., & Abdullah, N. N. (2014) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-4585-18-7_2 · Cited by 283
Developing early warning systems to predict students’ online learning performance
Hu, Y.-H., Lo, C.-L., & Shih, S.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.002 · Cited by 278
Using machine learning to predict student difficulties from learning session data
Hussain, M., Zhu, W., Zhang, W., Abidi, S. M. R., & Ali, S. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-018-9620-8 · Cited by 249
Improving nearest neighbor rule with a simple adaptive distance measure
Wang, J., Neskovic, P., & Cooper, L. N. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.07.002 · Cited by 240
Preprocessing for image classification by convolutional neural networks
Pal, K. K., & Sudeep, K. S. (2016) · 2016 IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT) · doi:10.1109/rteict.2016.7808140 · Cited by 232
Data Mining: A prediction for Student's Performance Using Classification Method
Ahmed, A. B. E. D., & Elaraby, I. S. (2014) · World Journal of Computer Application and Technology · doi:10.13189/wjcat.2014.020203 · Cited by 220
Márquez-Vera, C., Cano, A., Romero, C., & Ventura, S. (2013) · Applied Intelligence · doi:10.1007/s10489-012-0374-8 · Cited by 219
Modeling and Predicting Students’ Academic Performance Using Data Mining Techniques
King Abdulaziz University, S. A., Mueen, A., Zafar, B., & Manzoor, U. (2016) · International Journal of Modern Education and Computer Science · doi:10.5815/ijmecs.2016.11.05 · Cited by 212
Early Prediction of Student Success: Mining Students Enrolment Data
J. Kovacic, Z. (2010) · InSITE Conference · doi:10.28945/1281 · Cited by 200
Thammasiri, D., Delen, D., Meesad, P., & Kasap, N. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.07.046 · Cited by 199
Mining educational data to improve students' performance: a case study
Tair, M. M. A., & El-Halees, A. M. (2012) · Cited by 196
Prediction of students performance using Educational Data Mining
Devasia, T., P, V. T., & Hegde, V. (2016) · 2016 International Conference on Data Mining and Advanced Computing (SAPIENCE) · doi:10.1109/sapience.2016.7684167 · Cited by 190
Naser, S. A., Zaqout, I., Ghosh, M. A., Atallah, R., & Alajrami, E. (2015) · International Journal of Hybrid Information Technology · doi:10.14257/ijhit.2015.8.2.20 · Cited by 159
Elhassan, A. T., Aljourf, M., Al-Mohanna, F. A., & Shoukri, M. (2016) · Global Journal of Technology and Optimization · doi:10.4172/2229-8711.s1111 · Cited by 146
Ouroboros: early identification of at-risk students without models based on legacy data
Hlosta, M., Zdráhal, Z., & Zendulka, J. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3027449 · Cited by 129
Adekitan, A. I., & Noma‐Osaghae, E. (2018) · Education and Information Technologies · doi:10.1007/s10639-018-9839-7 · Cited by 121
Early Prediction of Students Performance using Machine Learning Techniques
Acharya, A., & Sinha, D. (2014) · International Journal of Computer Applications · doi:10.5120/18717-9939 · Cited by 102
Li, H., Li, J., Chang, P., & Sun, J. (2013) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2013.06.006 · Cited by 39
Using neural networks to predict the future performance of students
de Albuquerque, R. M., Bezerra, A. A., de Souza, D. A., Nascimento, L. B. P., Sá, J. J. D. M., & do Nascimento, J. C. (2015) · International Symposium on Computers in Education · doi:10.1109/siie.2015.7451658 · Cited by 20
Comparison of Machine Learning Models in Student Result Prediction
Kumar, V., & Garg, M. L. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-2673-8_46 · Cited by 20
Cited by
A Systematic Literature Review of Student’ Performance Prediction Using Machine Learning Techniques
Albreiki, B., Zaki, N., & Alashwal, H. (2021) · Education Sciences · doi:10.3390/educsci11090552 · Cited by 427
Performance of Machine Learning Algorithms with Different K Values in K-fold CrossValidation
Department of Computer Science and Informatics, U. O. E. A. N. R., Nti, I. K., Nyarko-Boateng, O., & Aning, J. (2021) · International Journal of Information Technology and Computer Science · doi:10.5815/ijitcs.2021.06.05 · Cited by 270
AI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications
Chen, P., Wu, L., & Wang, L. (2023) · Applied Sciences · doi:10.3390/app131810258 · Cited by 155
Combining predictive and prescriptive techniques for optimizing electric vehicle fleet charging
Mahyari, E., Freeman, N., & Yavuz, M. (2023) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2023.104149 · Cited by 13
Machine learning approaches for skin neoplasm diagnosis
Asaduzzaman, A., Thompson, C. C., & Uddin, M. J. (2024) · ACS Omega · doi:10.1021/acsomega.4c03640 · Cited by 3
Metadata
- Authors
- Ghorbani, R., & Ghousi, R.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 67899-67911
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3015351929
- Cited by
- 289
- References
- 54
- FWCI
- 30.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.