Interpretable Deep Learning for University Dropout Prediction
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The early identification of college students at risk of dropout is of great interest and importance all over the world, since the early leaving of higher education is associated with considerable personal and social costs. In Hungary, especially in STEM undergraduate programs, the dropout rate is particularly high, much higher than the EU average. In this work, using advanced machine learning models such as deep neural networks and gradient boosted trees, we aim to predict the final academic performance of students at the Budapest University of Technology and Economics. The dropout prediction is based on the data that are available at the time of enrollment. In addition to the predictions, we also interpret our machine learning models with the help of state-of-the-art interpretable machine learning techniques such as permutation importance and SHAP values. The accuracy and AUC of the best-performing deep learning model are 72.4% and 0.771, respectively that slightly outperforms XGBoost, the cutting-edge benchmark model for tabular data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
Explaining prediction models and individual predictions with feature contributions
Štrumbelj, E., & Kononenko, I. (2014) · Knowledge and Information Systems · doi:10.1007/s10115-013-0679-x · Cited by 2,286 · cited 1×
“In machine learning settings, the players are the explanatory variables and the 𝑣 value function of a coalition corresponding to the given subset of variables is defined as follows [37].”
BackgroundSelf-Normalizing Neural Networks
Klambauer, G., Unterthiner, T., Mayr, A., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.02515 · Cited by 2,267 · cited 1×
“…with standard deviation 𝑠𝑡𝑑 = 2 /( # 𝑛𝑜𝑑𝑒𝑠 𝑖𝑛 + # 𝑛𝑜𝑑𝑒𝑠 𝑜𝑢𝑡 ) 4 Uniform distribution with limits ± (cid:112) 6 /( # 𝑛𝑜𝑑𝑒𝑠 𝑖𝑛 + # 𝑛𝑜𝑑𝑒𝑠 𝑜𝑢𝑡 ) by Klambauer et al. [18] who argue that the use of these methods can enhance the performance of feed-forward neural networks.”
Predictors of First-Year Student Retention in the Community College
Fike, D. S., & Fike, R. (2008) · Community College Review · doi:10.1177/0091552108320222 · Cited by 416 · cited 1×
“Understanding and identifying the factors affecting students’ university performance, and detecting at-risk students are in the focus of educational research for decades [1, 5, 11, 23, 32].”
BackgroundA Systematic Review of Deep Learning Approaches to Educational Data Mining
Hernández-Blanco, A., Herrera-Flores, B., Tomás, D., & Navarro-Colorado, B. (2019) · Complexity · doi:10.1155/2019/1306039 · Cited by 230 · cited 1×
“…the vast amount of data stored in educational administrative systems, a tremendous number of predictive analytical educational research papers and artificial intelligence-based decision support systems have been published in the last few years, for systematic reviews, we refer to [10, 13, 19, 33].”
Background
Cited by
Interpretable dropout prediction: towards XAI-based personalized intervention
Nagy, M., & Molontay, R. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00331-8 · Cited by 179
“This work can be considered as an extension of our previous conference papers (Baranyi et al., 2020; Nagy et al., 2019).”
Self-citationFahd, K., Venkatraman, S., Miah, S. J., & Ahmed, K. (2022) · Education and Information Technologies · doi:10.1007/s10639-021-10741-7 · Cited by 110
Student Dataset from Tecnologico de Monterrey in Mexico to Predict Dropout in Higher Education
Alvarado-Uribe, J., Mejía-Almada, P., Masetto Herrera, A. L., Molontay, R., Hilliger, I., Hegde, V., Montemayor Gallegos, J. E., Ramírez Díaz, R. A., & Ceballos, H. G. (2022) · Data · doi:10.3390/data7090119 · Cited by 55
Self-citation
Metadata
- Authors
- Baranyi, M., Nagy, M., & Molontay, R.
- Venue
- Proceedings of the 21st Annual Conference on Information Technology Education
- Publisher
- ACM
- Published
- 2020-10-07
- Pages
- 13-19
- OpenAlex
- W3092255774
- Cited by
- 70
- References
- 6
- FWCI
- 11.59
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.