The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Predicting academic performance of students from VLE big data using deep learning models
Open accessAbstract
The abundance of accessible educational data, supported by the technology-enhanced learning platforms, provides opportunities to mine learning behavior of students, addressing their issues, optimizing the educational environment, and enabling data-driven decision making. Virtual learning environments complement the learning analytics paradigm by effectively providing datasets for analysing and reporting the learning process of students and its reflection and contribution in their respective performances. This study deploys a deep artificial neural network on a set of unique handcrafted features, extracted from the virtual learning environments clickstream data, to predict at-risk students providing measures for early intervention of such cases. The results show the proposed model to achieve a classification accuracy of 84%–93%. We show that a deep artificial neural network outperforms the baseline logistic regression and support vector machine models. While logistic regression achieves an accuracy of 79.82%–85.60%, the support vector machine achieves 79.95%–89.14%. Aligned with the existing studies - our findings demonstrate the inclusion of legacy data and assessment-related data to impact the model significantly. Students interested in accessing the content of the previous lectures are observed to demonstrate better performance. The study intends to assist institutes in formulating a necessary framework for pedagogical support, facilitating higher education decision-making process towards sustainable education.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Machine learning models such as deep neural networks predicting learning outcomes [23] and transformers facilitating student knowledge tracing [19] are deeply dependent on the availability of large amounts of data.”
From Federated Learning Analytics: Investigating the Privacy-Performance Trade-Off in Machine Learning for Educational Analytics (2024) · cites this paper as [23]
In the citing paper
“Since Waheed et al. [23] extensively describe the features they engineered, we were able to reproduce these features and use them as input for OULAD classification.”
From Federated Learning Analytics: Investigating the Privacy-Performance Trade-Off in Machine Learning for Educational Analytics (2024) · cites this paper as [23]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Principal component analysis: A review and recent developments
Jolliffe, I. T., & Cadima, J. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2015.0202 · Cited by 10,117
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
Educational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251
Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning
Poplin, R., Varadarajan, A. V., Blumer, K., Liu, Y., McConnell, M. V., Corrado, G. S., Peng, L., & Webster, D. R. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0195-0 · Cited by 1,865
Penetrating the Fog: Analytics in Learning and Education.
Siemens, G., & Long, P. (2011) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 1,752
Educational Data Mining and Learning Analytics
Baker, R. S., & Inventado, P. S. (2014) · Learning Analytics · doi:10.1007/978-1-4614-3305-7_4 · Cited by 1,029
Course signals at Purdue: using learning analytics to increase student success
Arnold, K. E., & Pistilli, M. D. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330666 · Cited by 987
A Review on Predicting Student's Performance Using Data Mining Techniques
Shahiri, A. M., Husain, W., & Rashid, N. A. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.12.157 · Cited by 840
The current landscape of learning analytics in higher education
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.027 · Cited by 766 · cited 1×
“The progression of the accumulated educational data has stimulated the emergence of several research communities, such as learning analytics to predict learners’ behavior and providing indicators for optimized policy formulations (Azcona & Smeaton, 2017; Viberg et al., 2018; Capuano & Toti 2019).”
BackgroundExploring the factors affecting MOOC retention: A survey study
Hone, K. S., & El Said, G. R. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.03.016 · Cited by 720
Proceedings of the 26th International Conference on World Wide Web - WWW '17
(2017) · doi:10.1145/3038912 · Cited by 555
Open University Learning Analytics dataset
Kuzilek, J., Hlosta, M., & Zdrahal, Z. (2017) · Scientific Data · doi:10.1038/sdata.2017.171 · Cited by 549
How do online course design features influence student performance?
Jaggars, S. S., & Xu, D. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.01.014 · Cited by 519
Learning Engagement and Persistence in Massive Open Online Courses (MOOCS)
Jung, Y., & Lee, J. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.02.013 · Cited by 514
Neural Networks and Deep Learning
(2016) · Computer Age Statistical Inference · doi:10.1017/cbo9781316576533.019 · Cited by 509
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.038 · Cited by 449
Costa, E. B., Fonseca, B., Santana, M. A., de Araújo, F. F., & Rego, J. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.01.047 · Cited by 418
Neural Networks and Deep Learning: A Textbook
Aggarwal, C. C. (2018) · doi:10.1007/978-3-319-94463-0 · Cited by 417
Hussain, M., Zhu, W., Zhang, W., & Abidi, S. M. R. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/6347186 · Cited by 382
da Silva, I. N., Spatti, D. H., Flauzino, R. A., Liboni, L. H. B., & Alves, S. F. D. R. (2016) · Springer eBooks · doi:10.1007/978-3-319-43162-8 · Cited by 371
Models for early prediction of at-risk students in a course using standards-based grading
Marbouti, F., Diefes-Dux, H. A., & Madhavan, K. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.09.005 · Cited by 360
MOOCs Completion Rates and Possible Methods to Improve Retention - A Literature Review
Khalil, H. H., & Ebner, M. (2014) · Cited by 339
(2012) · Cited by 311
Predicting Student Dropout in Higher EducationPreprint
Aulck, L. S., Velagapudi, N., Blumenstock, J. E., & West, J. D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.06364 · Cited by 299
Kaur, P., Singh, M., & Josan, G. S. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.07.372 · Cited by 289
Temporal Models for Predicting Student Dropout in Massive Open Online Courses
Fei, M., & Yeung, D.-Y. (2015) · 2015 IEEE International Conference on Data Mining Workshop (ICDMW) · doi:10.1109/icdmw.2015.174 · Cited by 276
Xing, W., Chen, X., Stein, J., & Marcinkowski, M. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.12.007 · Cited by 256
Learning Analytics in Higher Education—A Literature Review
Leitner, P., Khalil, M., & Ebner, M. (2017) · Studies in Systems, Decision and Control · doi:10.1007/978-3-319-52977-6_1 · Cited by 249
Xu, X., Wang, J., Peng, H., & Wu, R. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.015 · Cited by 248
Predicting Student Performance using Advanced Learning Analytics
Daud, A., Aljohani, N. R., Abbasi, R. A., Lytras, M. D., Abbas, F., & Alowibdi, J. S. (2017) · Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion · doi:10.1145/3041021.3054164 · Cited by 236
Self-citation(2016) · Developments in Environmental Modelling · doi:10.1016/b978-0-444-63623-2.00007-4 · Cited by 231
The role of demographics in online learning; A decision tree based approach
Rizvi, S., Rienties, B., & Khoja, S. A. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.04.001 · Cited by 215
Using Learning Analytics to improve teamwork assessment
Fidalgo-Blanco, Á., Sein-Echaluce, M. L., García-Peñalvo, F. J., & Conde, M. Á. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.11.050 · Cited by 195
Chui, K. T., Fung, D. C. L., Lytras, M. D., & Lam, T. M. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2018.06.032 · Cited by 195
Learning Analytics and Digital Badges: Potential Impact on Student Retention in Higher Education
Mah, D.-K. (2016) · Technology Knowledge and Learning · doi:10.1007/s10758-016-9286-8 · Cited by 181
A neural network approach for students' performance prediction
Okubo, F., Yamashita, T., Shimada, A., & Ogata, H. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3029479 · Cited by 177
Ouroboros: early identification of at-risk students without models based on legacy data
Hlosta, M., Zdráhal, Z., & Zendulka, J. (2017) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3027385.3027449 · Cited by 174
Open Learning Analytics: an integrated modularized platform
Siemens, G., Gašević, D., Haythornthwaite, C., Dawson, S., Shum, S. B., Ferguson, R., Duval, E., Verbert, K., & Baker, R. S. (2011) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 170
Predicting Students Performance in Educational Data Mining
Guo, B., Zhang, R., Xu, G., Shi, C., & Yang, L. (2015) · 2015 International Symposium on Educational Technology (ISET) · doi:10.1109/iset.2015.33 · Cited by 167
Prediction of Student Dropout in E-Learning Program Through the Use of Machine Learning Method
Tan, M., & Shao, P. (2015) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v10i1.4189 · Cited by 164
Shorfuzzaman, M., Hossain, M. S., Nazir, A., Muhammad, G., & Alamri, A. M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.002 · Cited by 157
How Much Does Student Engagement with Videos and Forums in a MOOC Affect Their Achievement?
Bonafini, F. C., Chae, C., Park, E., & Jablokow, K. (2017) · Online Learning · doi:10.24059/olj.v21i4.1270 · Cited by 155
Data Mining Applications: A comparative Study for Predicting Student's performancePreprint
Yadav, S. K., Bharadwaj, B., & Pal, S. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.4815 · Cited by 143
Deep Knowledge Tracing On Programming Exercises
Wang, L., Sy, A., Liu, L., & Piech, C. (2017) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3051457.3053985 · Cited by 125
Learning Analytics: Principles and Constraints
Khalil, M., & Ebner, M. (2015) · doi:10.13140/rg.2.1.1733.2083 · Cited by 116
Mayilvaganan, M., & Kalpanadevi, D. (2014) · doi:10.1109/cnt.2014.7062736 · Cited by 110
A bibliometric perspective of learning analytics research landscape
Waheed, H., Hassan, S., Aljohani, N. R., & Wasif, M. (2018) · Behaviour and Information Technology · doi:10.1080/0144929x.2018.1467967 · Cited by 107
Self-citationHassan, S.-U., Imran, M., Gillani, U., Aljohani, N. R., Bowman, T. D., & Didegah, F. (2017) · Scientometrics · doi:10.1007/s11192-017-2512-x · Cited by 100
Self-citationAn integrated framework for course adapted student learning analytics dashboard
Aljohani, N. R., Daud, A. Y., Abbasi, R. A., Alowibdi, J. S., Basheri, M., & Aslam, M. A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.03.035 · Cited by 100
Self-citation2017 Intelligent Systems Conference (IntelliSys)
(2017) · doi:10.1109/intellisys39997.2017 · Cited by 100
Piety, P. J., Hickey, D. T., & Bishop, M. J. (2014) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2567574.2567582 · Cited by 98
Virtual learning environment to predict withdrawal by leveraging deep learning
Hassan, S., Waheed, H., Aljohani, N. R., Ali, M., Ventura, S., & Herrera, F. (2019) · International Journal of Intelligent Systems · doi:10.1002/int.22129 · Cited by 96
Self-citationBig Data and Learning Analytics in Higher Education
Daniel, B. K. (2016) · Springer eBooks · doi:10.1007/978-3-319-06520-5 · Cited by 92
Learning Analytics: Fundaments, Applications, and Trends
Sergis, S., & Sampson, D. G. (2017) · Studies in systems, decision and control · doi:10.1007/978-3-319-52977-6 · Cited by 90
Data Mining in Higher Education : University Student Dropout Case Study
Abu-Oda, G. S., & El-Halees, A. M. (2015) · International Journal of Data Mining & Knowledge Management Process · doi:10.5121/ijdkp.2015.5102 · Cited by 77
Identification of research hypotheses and new knowledge from scientific literature
Shardlow, M., Batista-Navarro, R., Thompson, P., Nawaz, R., McNaught, J., & Ananiadou, S. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0639-1 · Cited by 73
Self-citationModelling Engineering Student Academic Performance Using Academic Analytics
Palmer, S. R. (2013) · Deakin Research Online (Deakin University) · Cited by 70
Data-driven unsupervised clustering of online learner behaviour
Peach, R. L., Yaliraki, S. N., Lefevre, D., & Barahona, M. (2019) · npj Science of Learning · doi:10.1038/s41539-019-0054-0 · Cited by 68
Casquero, O., Ovelar, R., Romo, J., Benito, M., & Alberdi, M. (2013) · Interactive Learning Environments · doi:10.1080/10494820.2013.817441 · Cited by 66
Tucker, C. S., Pursel, B. K., & Divinsky, A. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--22840 · Cited by 66
Proceedings of the Fourth International Conference on Learning Analytics And Knowledge
Pistilli, M., USA, L. '. L. A. A. K. C. 2. 2. I. I., & Association for Computing Machinery-Digital Library (2014) · doi:10.1145/2567574 · Cited by 64
Big Data in Higher Education: The Big Picture
Daniel, B. K. (2016) · Springer eBooks · doi:10.1007/978-3-319-06520-5_3 · Cited by 61
Negated bio-events: analysis and identification
Nawaz, R., Thompson, P., & Ananiadou, S. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-14 · Cited by 57
Self-citationA Time Series Classification Method for Behaviour-Based Dropout Prediction
Haiyang, L., Wang, Z., Benachour, P., & Tubman, P. (2018) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2018.00052 · Cited by 57
Predicting Students' Progression in Higher Education by Using the Random Forest Algorithm
Hardman, J., Paucar‐Caceres, A., & Fielding, A. H. (2012) · Systems Research and Behavioral Science · doi:10.1002/sres.2130 · Cited by 56
Self-citationCoelho, O. B., & Silveira, I. F. (2017) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/cbie.sbie.2017.143 · Cited by 52
Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale
(2017) · doi:10.1145/3051457 · Cited by 48
Aljohani, N. R., & Davis, H. (2013) · International Conference on Next Generation Mobile Applications, Services and Technologies (NGMAST) · doi:10.1109/ngmast.2013.54 · Cited by 44
Self-citationEnhancing Search: Events and Their Discourse Context
Ananiadou, S., Thompson, P., & Nawaz, R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37256-8_27 · Cited by 42
Self-citationEnriching news events with meta-knowledge information
Thompson, P., Nawaz, R., McNaught, J., & Ananiadou, S. (2016) · Language Resources and Evaluation · doi:10.1007/s10579-016-9344-9 · Cited by 40
Self-citationWang, X., Rak, R., Restificar, A. C., Nobata, C., Rupp, C., Batista-Navarro, R., Nawaz, R., & Ananiadou, S. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-s8-s11 · Cited by 37
Self-citationAzizah, E. N., Pujianto, U., Nugraha, E., & Darusalam, D. (2018) · doi:10.1109/iceat.2018.8693928 · Cited by 31
Treasure-Jones, T., Sarigianni, C., Maier, R. K., Santos, P., & Dewey, R. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.039 · Cited by 30
Understanding Student Learning Behavior and Predicting Their Performance
Wasif, M., Waheed, H., Aljohani, N. R., & Hassan, S. (2019) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-9031-6.ch001 · Cited by 30
Self-citationCorrigan, O., & Smeaton, A. F. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66610-5_59 · Cited by 28
Azcona, D., & Smeaton, A. F. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66610-5_27 · Cited by 27
Multi-stream Deep Learning Framework for Automated Presentation Assessment
Li, J., Wong, Y., & Kankanhalli, M. (2016) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2016.0051 · Cited by 19
Student Drop-out Modelling Using Virtual Learning Environment Behaviour Data
Kuzilek, J., Vaclavek, J., Fuglík, V., & Zdráhal, Z. (2018) · European Conference on Technology Enhanced Learning · doi:10.1007/978-3-319-98572-5_13 · Cited by 18
A handwriting recognition system for the classroom
Gross, E. M., Wshah, S., Simmons, I., & Skinner, G. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723601 · Cited by 14
2016 International Symposium on Educational Technology (ISET)
(2016) · doi:10.1109/iset38810.2016 · Cited by 14
Research works printed but not linked: 3
- Capuano, 2019, Experimentation of a smart learning system for law based on knowledge discovery and cognitive computing, Computers in Human Behavior, 92, 459, 10.1016/j.chb.2018.03.034 · doi:10.1016/j.chb.2018.03.034
- Elakia, 2014, Application of data mining in educational database for predicting behavioural patterns of the students, Elakia et al,/(IJCSIT) International Journal of Computer Science and Information Technologies, 5, 4649
- Marbouti, 2015, Building course-specific regression-based models to identify at-risk students, Age, 26, 1
Cited by
Artificial Intelligence in Education: A Systematic Literature Review
Wang, S., Wang, F., Zhu, Z., Wang, J., Tran, T., & Du, Z. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124167 · Cited by 977
Yağcı, M. (2022) · Smart Learning Environments · doi:10.1186/s40561-022-00192-z · Cited by 698
Ouyang, F., Wu, M., Zheng, L., Zhang, L., & Jiao, P. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-022-00372-4 · Cited by 387
Dimitriadou, E., & Lanitis, A. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00231-3 · Cited by 370
Proactive and reactive engagement of artificial intelligence methods for education: a review
Mallik, S., & Gangopadhyay, A. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1151391 · Cited by 139
“For example, [264] used deep feed-forward neural networks and split the problem of predicting student grade into multiple binary classification problems viz., Pass-Fail, Distinction-Pass, Distinction-Fail, Withdrawn-Pass.”
Metadata
- Authors
- Waheed, H., Hassan, S.-U., Aljohani, N. R., Hardman, J., Alelyani, S., & Nawaz, R.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2020-03
- Volume
- 104
- Pages
- 106189
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W2983382509
- Cited by
- 573
- References
- 85
- FWCI
- 47.65
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- King Khalid University (239)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.