Explainable AI in Education: Techniques and Qualitative Assessment
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Many of the articles on AI in education compare the performance and fairness of different models, but few specifically focus on quantitatively analyzing their explainability. To bridge this gap, we analyzed key evaluation metrics for two machine learning models—ANN and DT—with a focus on their performance and explainability in predicting student outcomes using the OULAD. The methodology involved evaluating the DT, an intrinsically explainable model, against the more complex ANN, which requires post hoc explainability techniques. The results show that, although the feature-based and structured decision-making process of the DT facilitates natural interpretability, it struggles to model complex data relationships, often leading to misclassification. In contrast, the ANN demonstrated higher accuracy and stability but lacked transparency. Crucially, the ANN showed great fidelity in result predictions when it used the LIME and SHAP methods. The results of the experiments verify that the ANN consistently outperformed the DT in prediction accuracy and stability, especially with the LIME method. However, improving the interpretability of ANN models remains a challenge for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842 · cited 4×
“In order to improve explainability and make sure that forecasts are transparent, comprehensible, and reliable, the majority of the work in the field of ML explanation research is concentrated on developing new methods and approaches [3].”
InfluentialA Review on Predicting Student's Performance Using Data Mining Techniques
Shahiri, A. M., Husain, W., & Rashid, N. A. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.12.157 · Cited by 840
Notions of explainability and evaluation approaches for explainable artificial intelligence
Vilone, G., & Longo, L. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.009 · Cited by 598 · cited 1×
“In order to appropriately assist decision-making processes, these explanations should also include useful and actionable information [20].”
Rokach, L., & Maimon, O. (2006) · Data Mining and Knowledge Discovery Handbook · doi:10.1007/0-387-25465-x_9 · Cited by 594
Open University Learning Analytics dataset
Kuzilek, J., Hlosta, M., & Zdrahal, Z. (2017) · Scientific Data · doi:10.1038/sdata.2017.171 · Cited by 549
DARPA's explainable artificial intelligence (XAI) program
Gunning, D. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3308446 · Cited by 546
Artificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X.-J. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 376
Ethical challenges and solutions of generative AI: an interdisciplinary perspective
Al-kfairy, M., Mustafa, D., Kshetri, N., Insiew, M., & Alfandi, O. (2024) · Informatics · doi:10.3390/informatics11030058 · Cited by 328 · cited 1×
“Ad-ditionally, as noted by Al-kfairy et al. [41], in order to use AI systems in education, it is essential that ethical concerns be addressed, such as ensuring accountability and fairness in explainable AI.”
The role of demographics in online learning; A decision tree based approach
Rizvi, S., Rienties, B., & Khoja, S. A. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.04.001 · Cited by 215
Vetter, M. A., Lucia, B., Jiang, J., & Othman, M. (2024) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2024.102831 · Cited by 192
Recent Applications of Explainable AI (XAI): A Systematic Literature Review
Saarela, M., & Podgorelec, V. (2024) · Applied Sciences · doi:10.3390/app14198884 · Cited by 183
Self-citationExplainable Student Performance Prediction Models: A Systematic Review
Alamri, R., & Alharbi, B. (2021) · IEEE Access · doi:10.1109/access.2021.3061368 · Cited by 165
Early prediction of learners at risk in self-paced education: A neural network approach
Waheed, H., Hassan, S., Nawaz, R., Aljohani, N. R., Chen, G., & Gašević, D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118868 · Cited by 126
A Time Series Classification Method for Behaviour-Based Dropout Prediction
Haiyang, L., Wang, Z., Benachour, P., & Tubman, P. (2018) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2018.00052 · Cited by 81
Explainable Student Agency Analytics
Saarela, M., Heilala, V., Jääskelä, P., Rantakaulio, A., & Kärkkäinen, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116664 · Cited by 59
Self-citationExplainable Artificial Intelligence for Human-Centric Data Analysis in Virtual Learning Environments
Alonso, J. M., & Casalino, G. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-31284-8_10 · Cited by 55
Queiroga, E. M., Machado, M. F. B., Rodés, V., Primo, T. T., & Cechinel, C. (2022) · Information · doi:10.3390/info13090401 · Cited by 54
Al-kfairy, M., Mustafa, D., Kshetri, N., Insiew, M., & Alfandi, O. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4833030 · Cited by 51
Gupta, A., Garg, D., & Kumar, P. (2022) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3197486 · Cited by 48
Artificial neural network model to predict student performance using nonpersonal information
Chavez, H., Chavez-Arias, B., Contreras-Rosas, S., Alvarez-Rodríguez, J. M., & Raymundo, C. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1106679 · Cited by 44
Malik, S., & Jothimani, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-12139-z · Cited by 37
Explainability in Educational Data Mining and Learning Analytics: An Umbrella Review
Gunasekara, S., & Saarela, M. (2024) · Jyväskylä University Digital Archive (University of Jyväskylä) · doi:10.5281/zenodo.12729986 · Cited by 37
Self-citationAn Interpretable Pipeline for Identifying At-Risk Students
Pei, B., & Xing, W. (2021) · Journal of Educational Computing Research · doi:10.1177/07356331211038168 · Cited by 36
Azizah, E. N., Pujianto, U., Nugraha, E., & Darusalam, D. (2018) · doi:10.1109/iceat.2018.8693928 · Cited by 31
Understanding Student Learning Behavior and Predicting Their Performance
Wasif, M., Waheed, H., Aljohani, N. R., & Hassan, S. (2019) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-9031-6.ch001 · Cited by 30
Student Success Prediction and the Trade-Off between Big Data and Data Minimization
Heuer, H., & Breiter, A. (2018) · DeLFI · Cited by 29
Swamy, V., Radmehr, B., Krčo, N., Marras, M., & Käser, T. (2022) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.5281/zenodo.6852963 · Cited by 29
On the relation of causality- versus correlation-based feature selection on model fairness
Saarela, M. (2024) · ACM Symposium on Applied Computing · doi:10.1145/3605098.3636018 · Cited by 27
Self-citationAn algorithm based on fuzzy ordinal classification to predict students’ academic performance
Gámez, J. C. V., Esteban, A., Rodriguez-Lozano, F. J., & Zafra, A. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04810-2 · Cited by 25
Interpretable and Adaptable Early Warning Learning Analytics Model
Sohail, S., Alvi, A., & Khanum, A. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.023560 · Cited by 24
Mining Learning Management System Data Using Interpretable Neural Networks
Matetić, M. (2019) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro.2019.8757113 · Cited by 17
Interpretive Analyses of Learner Dropout Prediction in Online STEM Courses
Lu, J., Mou, J., & Li, P. (2023) · International Conference on Computer Science and Technologies in Education (CSTE) · doi:10.1109/cste59648.2023.00020 · Cited by 13
An Educational Data Mining Model based on Auto Machine Learning and Interpretable Machine Learning
Rangone, G. N., Montejano, G. A., Garis, A. G., Pizarro, C. A., & Molina, W. R. (2022) · IEEE Global Conference on Computing, Power and Communication Technologies (GlobConPT) · doi:10.1109/globconpt57482.2022.9938243 · Cited by 11
Kondo, N., Matsuda, T., Hayashi, Y., Matsukawa, H., Tsubakimoto, M., Watanabe, Y., Tateishi, S., & Yamashita, H. (2020) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai50415.2020.00082 · Cited by 9
Masruroh, S., Rosyada, D., Zulkifli, Z., Sururin, & Vitalaya, N. A. R. (2021) · International Conference on Cyber and IT Service Management (CITSM) · doi:10.1109/citsm52892.2021.9588895 · Cited by 9
Neuro-Fuzzy Systems for Learning Analytics
Casalino, G., Castellano, G., & Zaza, G. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-030-96308-8_124 · Cited by 7
Incremental and Interpretable Learning Analytics Through Fuzzy Hoeffding Decision Trees
Casalino, G., Ducange, P., Fazzolari, M., & Pecori, R. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-29800-4_51 · Cited by 7
Explainable Prediction of Student Performance in Online Courses
Capuano, N., Rossi, D., Ströele, V., & Caballé, S. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-41637-8_52 · Cited by 6
Educational Data Mining in Prediction of Students’ Learning Performance: A Scoping Review
Li, C., Li, M., Huang, C. F., Tseng, Y.-T., Kim, S.-H., & Yeom, S. (2023) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-43393-1_33 · Cited by 6
Qin, A., & Boicu, M. (2023) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie58773.2023.10343186 · Cited by 4
Quantitative Assessment of Explainability in Machine Learning Models : A Study on the OULA Dataset
Gunasekara, S., & Saarela, M. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707815 · Cited by 2
Self-citationFuzzy Hoeffding Decision Trees for Learning Analytics
Casalino, G., Ducange, P., Fazzolari, M., & Pecori, R. (2022) · IRIS eCampus Telematic University (Università degli Studi eCampus) · doi:10.5281/zenodo.7040421 · Cited by 1
Cited by
Niu, T., Liu, T., Luo, Y. T., Pang, P. C., Huang, S., & Xiang, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-12514-5 · Cited by 87
Academic Performance Prediction Using Machine Learning Approaches: A Survey
Pan, J., Zhao, Z., & Han, D. (2025) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2025.3554174 · Cited by 59
Zhang, P., Li, Y., Huo, S., Lin, P., Fang, D., Hu, S., Li, B., Xu, Z., Qiu, X., Li, K., et al. (2025) · Water Research · doi:10.1016/j.watres.2025.124098 · Cited by 23
Systematic Literature Review on Explainable Learning Analytics and Educational Data Mining
Gunasekara, S., & Saarela, M. (2025) · IEEE Access · doi:10.1109/access.2025.3643645 · Cited by 25
Self-citationGunasekara, S., & Saarela, M. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107933 · Cited by 19
Self-citation
Metadata
- Authors
- Gunasekara, S., & Saarela, M.
- Affiliations
- University of Jyväskylä (FI)
- Corresponding author
- Gunasekara, Sachini
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2025-01-25
- Volume
- 15
- Issue
- 3
- Pages
- 1239
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W4406846419
- Cited by
- 53
- References
- 42
- Citations by year
- 2026: 41 · 2025: 12
- FWCI
- 21.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- Jyväskylä University Digital Archive (University of Jyväskylä) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Academy of Finland (356314)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- explainable AI, artificial intelligence in education, student outcome prediction, decision tree, artificial neural networks, post-hoc explanation, lime, SHAP, model interpretability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.