A Systematic Review of Deep Learning Approaches to Educational Data Mining
Open accessThe DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
Educational Data Mining (EDM) is a research field that focuses on the application of data mining, machine learning, and statistical methods to detect patterns in large collections of educational data. Different machine learning techniques have been applied in this field over the years, but it has been recently that Deep Learning has gained increasing attention in the educational domain. Deep Learning is a machine learning method based on neural network architectures with multiple layers of processing units, which has been successfully applied to a broad set of problems in the areas of image recognition and natural language processing. This paper surveys the research carried out in Deep Learning techniques applied to EDM, from its origins to the present day. The main goals of this study are to identify the EDM tasks that have benefited from Deep Learning and those that are pending to be explored, to describe the main datasets used, to provide an overview of the key concepts, main architectures, and configurations of Deep Learning and its applications to EDM, and to discuss current state‐of‐the‐art and future directions on this area of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Similarly, deep learning approaches are also being used in the context of educational data mining (Hernández-Blanco et al., 2019) across educational levels (Winje & Løndal, 2020) to enrich the educational process through the provision of personalized material, recommendations, tasks, and feedback (Perrotta & Selwyn, 2020).”
From A systematic review of literature reviews on artificial intelligence in education (AIED): a roadmap to a future research agenda (2024) · cites this paper as Hernández-Blanco et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 5×
“The architectures include MLP (Multilayer Perceptron), LSTM (Long Short-Term Memory), WE (Word Embeddings), CNN (Convolutional Neural Networks) and variants (VGG16 and AlexNet), FNN (Feedforward Neural Networks), RNN (Recurrent Neural Networks), autoencoder, BLSTM (Bidirectional LSTM), andMN (MemoryNetworks).”
BackgroundMethodInfluentialImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“LSTMs are a special type of RNN that has grown in popularity in recent years [79].”
BackgroundAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“Other works used Adam [25, 38], an efficient gradient descent algorithm [92].”
MethodGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“CNNs are multilayer neural networks particularly useful in image-processing applications [68].”
Background(2014) · Cited by 33,419
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“Transfer learning [95] was used in [36] to initialize CNNs with weights pretrained on ImageNet.”
MethodNeural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“RNNs address this problem by implementing a feedback loop that allows for information to persist [74].”
BackgroundDeep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 1×
“In addition to image processing [70], this type of networks has been applied to video recognition [71], game playing [72], and different natural language processing tasks [73].”
MethodApproximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883 · cited 1×
“Whereas shallow neural networks (with a single hidden layer) can in theory approximate any function (according to the universal approximation theorem [93])many empirical results in different tasks and domains demonstrate that adding more hidden layers improves the performance of the network.”
BackgroundAdvances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280 · cited 1×
“Perceptrons are the simplest kind of neural network [62].”
BackgroundSpeech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“RNNs have been successfully applied to a variety of problems such as speech recognition [75], language modeling [76], andmachine translation [77].”
MethodReinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099 · cited 1×
“Recently, a simplification of LSTM called Gated Recurrent Unit (GRU) has been introduced [80].”
Background3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962 · cited 1×
“In addition to image processing [70], this type of networks has been applied to video recognition [71], game playing [72], and different natural language processing tasks [73].”
MethodA Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601 · cited 1×
“RNNs have been successfully applied to a variety of problems such as speech recognition [75], language modeling [76], andmachine translation [77].”
MethodA few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“This process is difficult and time-consuming since the correct choice of features is fundamental to the performance of the system [57].”
BackgroundGenerating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894 · cited 1×
“Several tasks can be added to the list of tasks previously mentioned for RNNs: text generation [81], question answering [82] and action recognition in video sequences [83], among others.”
BackgroundWhy Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Bengio, S. (2010) · Journal of Machine Learning Research · Cited by 2,631
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259 · cited 1×
“Initially, the weights of each neuron can be assigned randomly, or follow some initialization strategy, including unsupervised pretraining [60].”
Educational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251 · cited 2×
“The first EDM survey identified in the literature was developed in 2007 by Romero and Ventura [3], which was further improved in 2010 [4] and 2013 [5].”
BackgroundEducational data mining: A survey from 1995 to 2005
Romero, C., & Ventura, S. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.04.005 · Cited by 1,482
The State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S. J. D., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554657 · Cited by 1,359 · cited 1×
“In 2009, a new EDM survey was presented by Baker and Yacef [6].”
MethodSequence to Sequence -- Video to Text
Venugopalan, S., Rohrbach, M., Donahue, J., Mooney, R., Darrell, T., & Saenko, K. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.515 · Cited by 1,352 · cited 1×
“In conjunction with CNNs, LSTMs have been used to produce image [84] and video [85] captioning: the CNN implements the image/video processingwhereas the LSTMconverts CNN output into natural language.”
MethodThe State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554658 · Cited by 1,296
Introduction to the Theory of Neural Computation
Hertz, J., Krogh, A., Palmer, R. G., & Horner, H. (1991) · Physics Today · doi:10.1063/1.2810360 · Cited by 1,079
Hinton, G. (2009) · Scholarpedia · doi:10.4249/scholarpedia.5947 · Cited by 885 · cited 1×
“In the unsupervised phase, each RBM is trained to reconstruct its input using the previous hidden layer output [87].”
MethodRomero, C., & Ventura, S. (2013) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1075 · Cited by 869 · cited 1×
“The first EDM survey identified in the literature was developed in 2007 by Romero and Ventura [3], which was further improved in 2010 [4] and 2013 [5].”
BackgroundAction Recognition in Video Sequences using Deep Bi-Directional LSTM With CNN Features
Ullah, A., Ahmad, J., Muhammad, K., Sajjad, M., & Baik, S. W. (2018) · IEEE Access · doi:10.1109/access.2017.2778011 · Cited by 756 · cited 1×
“Several tasks can be added to the list of tasks previously mentioned for RNNs: text generation [81], question answering [82] and action recognition in video sequences [83], among others.”
BackgroundNeural Computing - An Introduction
Beale, R., & Jackson, T. (1990) · Taylor & Francis eBooks · doi:10.1201/9781420050431 · Cited by 684 · cited 1×
“FNNs are applicable to many areas where classical machine learning techniques have been applied, although major success have been achieved in computer vision [63] and speech recognition applications [64].”
Educational data mining: A survey and a data mining-based analysis of recent works
Peña-Ayala, A. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.042 · Cited by 660
A Survey of Deep Learning: Platforms, Applications and Emerging Research Trends
Hatcher, W. G., & Yu, W. (2018) · IEEE Access · doi:10.1109/access.2018.2830661 · Cited by 654 · cited 1×
“Different DL architectures have been developed and successfully applied to different supervised and unsupervised tasks in the broad fields of natural language processing and computer vision [55].”
MethodQuestion Answering with Subgraph Embeddings
Bordes, A., Chopra, S., & Weston, J. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1067 · Cited by 635
Deep Captioning with Multimodal Recurrent Neural Networks (m-RNN)
Mao, J., Xu, W., Yang, Y., Wang, J., Huang, Z., & Yuille, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6632 · Cited by 620 · cited 1×
“In conjunction with CNNs, LSTMs have been used to produce image [84] and video [85] captioning: the CNN implements the image/video processingwhereas the LSTMconverts CNN output into natural language.”
MethodHeffernan, N. T., & Heffernan, C. L. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0024-x · Cited by 616
Handbook of Educational Data Mining
(2010) · CRC Press eBooks · doi:10.1201/b10274 · Cited by 571
Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2019.01.007 · Cited by 564
“A neural approach to automated essay scoring,”
Taghipour, K., & Ng, H. T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1193 · Cited by 537 · cited 9×
“1 to 6 layers: 1 hidden layer [10, 13, 14, 17–19, 24, 32, 49, 50, 53], 2 hidden layers [11, 15, 20, 21, 34, 44], 3 hidden layers [22], 4 hidden layers [23, 26, 27, 37, 40, 41], 5 hidden layers [25, 31], and 6 hidden layers [30, 38].”
BackgroundMethodInfluentialAddressing the assessment challenge with an online system that tutors as it assesses
Feng, M., Heffernan, N., & Koedinger, K. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9063-7 · Cited by 502
Liou, C.-Y., Cheng, W.-C., Liou, J.-W., & Liou, D.-R. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.09.055 · Cited by 467 · cited 1×
“Another type of FNN is autoencoders [65].”
A Long Short-Term Memory Model for Answer Sentence Selection in Question Answering
Wang, D., & Nyberg, E. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.3115/v1/p15-2116 · Cited by 353 · cited 1×
“Several tasks can be added to the list of tasks previously mentioned for RNNs: text generation [81], question answering [82] and action recognition in video sequences [83], among others.”
BackgroundNeural Computing: An Introduction
Beale, R., & Jackson, T. (1990) · Institute of Physics eBooks · doi:10.1887/0852742622 · Cited by 344
Addressing two problems in deep knowledge tracing via prediction-consistent regularization
Yeung, C.-K., & Yeung, D.-Y. (2018) · Proceedings of the Fifth Annual ACM Conference on Learning at Scale · doi:10.1145/3231644.3231647 · Cited by 330 · cited 5×
“Instead, they present comparisons of different DL architectures [19, 29, 35, 45, 50], comparisons of different hyperparameters for the same DL architecture [31, 46], or proposals not evaluated yet [39].”
BackgroundMethodInfluentialDropout Prediction in MOOCs: Using Deep Learning for Personalized Intervention
Xing, W., & Du, D. (2019) · Journal of Educational Computing Research · doi:10.1177/0735633118757015 · Cited by 321
Feedforward Neural Network Methodology
Rao, M. B. (2000) · Technometrics · doi:10.1080/00401706.2000.10485725 · Cited by 279
Educational data mining applications and tasks: A survey of the last 10 years
Bakhshinategh, B., Zaiane, O. R., ElAtia, S., & Ipperciel, D. (2018) · Education and Information Technologies · doi:10.1007/s10639-017-9616-z · Cited by 270 · cited 2×
“Based on the taxonomy of EDM applications defined by [8], the papers reviewed on the present study were categorized according to the problem addressed.”
MethodZhong, G., Wang, L.-N., Ling, X., & Dong, J. (2016) · The Journal of Finance and Data Science · doi:10.1016/j.jfds.2017.05.001 · Cited by 207
A neural network approach for students' performance prediction
Okubo, F., Yamashita, T., Shimada, A., & Ogata, H. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3029479 · Cited by 177 · cited 4×
“Reference [24] presented a specific dataset for predicting final grades of students, including information about reports, quiz answers, and logbooks of lectures of 108 students attending an Information Science course.”
BackgroundMethodInfluentialDeep Model for Dropout Prediction in MOOCs
Wang, W., Yu, H., & Miao, C. (2017) · Proceedings of the 2nd International Conference on Crowd Science and Engineering · doi:10.1145/3126973.3126990 · Cited by 155 · cited 8×
“1 to 6 layers: 1 hidden layer [10, 13, 14, 17–19, 24, 32, 49, 50, 53], 2 hidden layers [11, 15, 20, 21, 34, 44], 3 hidden layers [22], 4 hidden layers [23, 26, 27, 37, 40, 41], 5 hidden layers [25, 31], and 6 hidden layers [30, 38].”
BackgroundMethodInfluentialFeedforward Neural Network Methodology
Rao, M. B., & Fine, T. L. (2000) · Technometrics · doi:10.2307/1270962 · Cited by 135
Incorporating Rich Features into Deep Knowledge Tracing
Zhang, L., Xiong, X., Zhao, S., Botelho, A. F., & Heffernan, N. T. (2017) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3051457.3053976 · Cited by 130 · cited 5×
“, 2017 [49] ASSISment and OLI datasets General”
BackgroundMethodInfluentialDeep Knowledge Tracing On Programming Exercises
Wang, L., Sy, A., Liu, L., & Piech, C. (2017) · Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale · doi:10.1145/3051457.3053985 · Cited by 115 · cited 3×
“, 2017 [12] Code course dataset Specific”
Method(2010) · Handbook of Educational Data Mining · doi:10.1201/b10274-6 · Cited by 107 · cited 1×
“Reference [17] presented a large dataset combining different resources: the ASSISTments 2009-2010 dataset, a synthetic dataset developed by [10], a dataset of 578,726 trials from 182 middle-school students practicing Spanish exercises (translations and simple skills such as verb conjugation), and a dataset from a coll…”
BackgroundDeep Learning vs. Bayesian Knowledge Tracing: Student Models for Interventions
Ye, M., Lin, C., & Chi, M. (2018) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554691 · Cited by 91 · cited 4×
“, 2018 [15] LSTM BKT, IBKT RMSE, Accuracy, Recall, F-measure, AUC =”
BackgroundInfluentialGritNet: Student Performance Prediction with Deep LearningPreprint
Kim, B., Vizitei, E., & Ganapathi, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.07405 · Cited by 91 · cited 6×
“1 to 6 layers: 1 hidden layer [10, 13, 14, 17–19, 24, 32, 49, 50, 53], 2 hidden layers [11, 15, 20, 21, 34, 44], 3 hidden layers [22], 4 hidden layers [23, 26, 27, 37, 40, 41], 5 hidden layers [25, 31], and 6 hidden layers [30, 38].”
BackgroundMethodInfluentialYang, J., Wang, K., Peng, X., & Qiao, Y. (2018) · Proceedings of the 20th ACM International Conference on Multimodal Interaction · doi:10.1145/3242969.3264981 · Cited by 79
A Memory-Augmented Neural Model for Automated Grading
Zhao, S., Zhang, Y., Xiong, X., Botelho, A., & Heffernan, N. (2017) · Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale · doi:10.1145/3051457.3053982 · Cited by 65 · cited 7×
“1 to 6 layers: 1 hidden layer [10, 13, 14, 17–19, 24, 32, 49, 50, 53], 2 hidden layers [11, 15, 20, 21, 34, 44], 3 hidden layers [22], 4 hidden layers [23, 26, 27, 37, 40, 41], 5 hidden layers [25, 31], and 6 hidden layers [30, 38].”
BackgroundMethodInfluentialDeep Neural Networks and How They Apply to Sequential Education Data
Tang, S., Peterson, J. C., & Pardos, Z. A. (2016) · Proceedings of the Third (2016) ACM Conference on Learning @ Scale · doi:10.1145/2876034.2893444 · Cited by 49 · cited 9×
“1 to 6 layers: 1 hidden layer [10, 13, 14, 17–19, 24, 32, 49, 50, 53], 2 hidden layers [11, 15, 20, 21, 34, 44], 3 hidden layers [22], 4 hidden layers [23, 26, 27, 37, 40, 41], 5 hidden layers [25, 31], and 6 hidden layers [30, 38].”
BackgroundMethodInfluentialDelving Deeper into MOOC Student Dropout PredictionPreprint
Whitehill, J., Mohan, K., Seaton, D. T., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.06404 · Cited by 49 · cited 8×
“1 to 6 layers: 1 hidden layer [10, 13, 14, 17–19, 24, 32, 49, 50, 53], 2 hidden layers [11, 15, 20, 21, 34, 44], 3 hidden layers [22], 4 hidden layers [23, 26, 27, 37, 40, 41], 5 hidden layers [25, 31], and 6 hidden layers [30, 38].”
BackgroundMethodInfluentialA Comparisons of BKT, RNN and LSTM for Learning Gain Prediction
Lin, C., & Chi, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-61425-0_58 · Cited by 27 · cited 7×
“1 to 6 layers: 1 hidden layer [10, 13, 14, 17–19, 24, 32, 49, 50, 53], 2 hidden layers [11, 15, 20, 21, 34, 44], 3 hidden layers [22], 4 hidden layers [23, 26, 27, 37, 40, 41], 5 hidden layers [25, 31], and 6 hidden layers [30, 38].”
BackgroundMethodInfluentialHarnessing Label Uncertainty to Improve Modeling: An Application to Student Engagement Recognition
Aung, A. M., & Whitehill, J. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00033 · Cited by 19
Sequence Based Course Recommender for Personalized Curriculum Planning
Wong, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_100 · Cited by 14 · cited 5×
“In another work, [39] focused on the less investigated problem of curriculum planning for students, providing a novel approach to this domain based on two components: a DL approach to sequential recommendations and a recommender to provide a personalized pathway to completion using sequence, constraint, and contextual…”
BackgroundMethodInfluentialCo-embeddings for Student Modeling in Virtual Learning Environments
Teruel, M., & Alemany, L. A. (2018) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3209219.3209227 · Cited by 13 · cited 22×
“Finally, as an alternative to backpropagation in the training process, some studies used BPTT to train RNNs [28, 29, 34].”
BackgroundMethodInfluentialCastro, S. J., Jácome, L., Concha, A. G., Vásquez, J., Londa, G., Córdova, L., Vintimilla, B. X., Abad, C. L., Puga, M. F. M., & Pilay, M. D. L. (2018) · Computer Science Education Research Conference · doi:10.1145/3289406.3289407 · Cited by 3
Addressing Two Problems in Deep Knowledge Tracing via Prediction-Consistent RegularizationPreprint
Yeung, C.-K., & Yeung, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02180 · Cited by 1 · cited 5×
“Instead, they present comparisons of different DL architectures [19, 29, 35, 45, 50], comparisons of different hyperparameters for the same DL architecture [31, 46], or proposals not evaluated yet [39].”
BackgroundMethodInfluentialWeston, J., Chopra, S., & Bordes, A. (2014) · arXiv · doi:10.48550/arxiv.1410.3916 · cited 1×
“MN are a new class of models designed to address the problem of learning long-term dependencies in sequential data, including a long-term memory component that can be read and written to provide an explicit memory representation for each token in the sequence [88].”
Background
Research works printed but not linked: 39
- I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning, MIT Press, Cambridge, Mass, USA, 2016.
- C. Piech, J. Bassen, J. Huang et al., "Deep knowledge tracing, " in Annual Conference on Neural Information Processing Systems (NIPS), C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, Eds., pp. 505-513, Curran Associates, Inc., 2015.
- PiechC. BassenJ. HuangJ. GanguliS. SahamiM. GuibasL. J. andSohl-DicksteinJ. CortesC. LawrenceN. D. LeeD. D. SugiyamaM. andGarnettR. Deep knowledge tracing Annual Conference on Neural Information Processing Systems (NIPS) 2015 Curran Associates Inc. 505–513.
- S. Montero, A. Arora, S. Kelly, B. Milne, and M. Mozer, "Does deep knowledge tracing model interactions among skills?" in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
- A. Lalwani and S. Agrawal, "Few hundred parameters out- perform few hundred thousand?" in Proceedings of the 10th International Conference on Educational Data Mining, 2017.
- K. H. Wilson, X. Xiong, M. Khajah et al., "Estimating student proficiency: Deep learning is not the panacea, " in Neural Information Processing Systems, Workshop on Machine Learning for Education, pp. 1-8, 2016.
- M. Khajah, R. V. Lindsey, and M. Mozer, "How deep is knowledge tracing?" in Proceedings of the 9th International Conference on Educational Data Mining, 2016.
- X. Xiong, S. Zhao, E. V. Inwegen, and J. Beck, "Going deeper with deep knowledge tracing, " in Proceedings of the 9th Inter- national Conference on Educational Data Mining, pp. 545-550, 2016.
- P. P. Bendangnuksung, "Students' performance prediction using deep neural network, " International Journal of Applied Engineer- ing Research, vol. 13, no. 2, pp. 1171-1176, 2018.
- N. Sharada, M. Shashi, and X. Xiong, "Modeling student knowledge retention using deep learning and random forests, " Journal of Engineering and Applied Sciences, vol. 13, no. 6, pp. 1347-1353, 2018.
- B. Guo, R. Zhang, G. Xu, C. Shi, and L. Yang, "Predicting students performance in educational data mining, " in Proceed- ings of the International Symposium on Educational Technology, (ISET '15), pp. 125-128, China, July 2015.
- M. M. Alam, M. K. Islam, K. Mohiuddin, M. S. Kaonain, A. K. Das, and M. H. Ali, "A reduced feature based neural network approach to classify the category of students, " in Proceedings of the 2nd International Conference on Innovation in Artificial Intelligence, (ICIAI '18), pp. 28-32, China, March 2018.
- B. Kim, E. Vizitei, and V. Ganapathi, "Gritnet 2: Real-time student performance prediction with domain adaptation, " 2018, https://arxiv.org/abs/1809.06686. · arXiv
- M. Fei and D.-Y. Yeung, "Temporal models for predicting student dropout in massive open online courses, " in Proceedings of the IEEE International Conference on Data Mining Workshop (ICDMW '15), pp. 256-263, IEEE Computer Society, Washing- ton, DC., USA, November 2015.
- W. Min, J. B. Wiggins, L. Pezzullo et al., "Predicting dialogue acts for intelligent virtual agents with multimodal student inter- action data, " in Proceedings of the 9th International Conference on Educational Data Mining, pp. 454-459, 2016.
- A. Sharma, A. Biswas, A. Gandhi, S. Patil, and O. Deshmukh, "LIVELINET: A multimodal deep recurrent neural network to predict liveliness in educational videos, " in Proceedings of the 9th International Conference on Educational Data Mining, pp. 215- 222, 2016.
- A. A. N. Tato, R. Nkambou, and A. Dufresne, "Convolutional neural network for automatic detection of sociomoral reasoning level, " in Proceedings of the 10th International Conference on Educational Data Mining, 2017.
- K. Abhinav, V. Subramanian, A. Dubey, P. Bhat, and A. D. Venkat, "Lecore: A framework for modeling learner's prefer- ence, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
- Y. Zhang, R. Shah, and M. Chi, "Deep learning + student mod- eling + clustering: a recipe for effective automatic short answer grading, " in Proceedings of the 9th International Conference on Educational Data Mining, pp. 562-567, 2016.
- J. G. Alvarado, H. A. Ghavidel, A. Zouaq, J. Jovanovic, and J. McDonald, "A comparison of features for the automatic labeling of student answers to open-ended questions, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
- B. Akram, W. Min, E. N. Wiebe, B. W. Mott, K. Boyer, and J. C. Lester, "Improving stealth assessment in game-based learning with lstm-based analytics, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
- H. Choi, Z. Wang, C. Brooks, K. Collins-Thompson, B. G. Reed, and D. Fitch, "Social work in the classroom? A tool to evaluate topical relevance in student writing, " in Proceedings of the 10th International Conference on Educational Data Mining, 2017.
- A. Sales, A. Botelho, T. Patikorn, and N. T. Heffernan, "Using big data to sharpen design-based inference in A/B tests, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
- K. H. Wilson, Y. Karklin, B. Han, and C. Ekanadham, "Back to the basics: Bayesian extensions of IRT outperform neural net- works for proficiency estimation, " 2016, https://arxiv.org/abs/ 1604.02336.
- J. Stamper, A. Niculescu-Mizil, S. Ritter, G. J. Gordon, and K. R. Koedinger, "Algebra I 2005-2006. Challenge data set from KDD Cup 2010 Educational Data Mining Challenge, " 2010, http://pslcdatashop.web.cmu.edu/KDDCup/downloads.jsp.
- L. Wang, A. Sy, L. Liu, and C. Piech, "Learning to represent student knowledge on programming exercises using deep learning, " in Proceedings of the 10th International Conference on Educational Data Mining, pp. 201-204, Cambridge, Mass, USA, April 2017. · DOI · Paper page
- H. Singh, S. K. Saini, R. Chaudhry, and P. Dogga, "Modeling hint-taking behavior and knowledge state of students with multi-task learning, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
- S. Chandar, S. Lauly, H. Larochelle et al., "An autoen- coder approach to learning bilingual word representations, " in Advances in Neural formation Processing Systems, Z. Ghahra- mani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, Eds., pp. 1853-1861, Curran Associates, Inc., 2014.
- J. Nagi, F. Ducatelle, G. A. Di Caro et al., "Max-pooling convolutional neural networks for vision-based hand gesture recognition, " in Proceedings of the IEEE International Conference on Signal and Image Processing Applications (ICSIPA'11), pp. 342-347, Malaysia, November 2011.
- K. Cho, B. Van Merriënboer, C. Gulcehre et al., "Learning phrase representations using RNN encoder-decoder for statis- tical machine translation, " in Proceedings of the Conference on Empirical Methods in Natural Language Processing, (EMNLP '14), pp. 1724-1734, Qatar, October 2014.
- M. C. Mozer, "A focused backpropagation algorithm for tempo- ral pattern recognition, " in Backpropagation, vol. 3, pp. 137-169, L. Erlbaum Associates Inc., Hillsdale, NJ, USA, 1995.
- S. Venugopalan, M. Rohrbach, J. Donahue, R. Mooney, T. Darrell, and K. Saenko, "Sequence to sequence -Video to text, " in Proceedings of the 15th IEEE International Conference on Computer Vision, ICCV 2015, pp. 4534-4542, December 2015.
- P. Smolensky, "Information processing in dynamical systems: Foundations of harmony theory, " in Parallel Distributed Process- ing: Explorations in the Microstructure of Cognition, vol. 1, pp. 194-281, MIT Press, Cambridge, MA, USA, 1986.
- J. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl, "Algorithms for hyper-parameter optimization, " in Proceedings of the 24th Inter- national Conference on Neural Information Processing Systems, pp. 2546-2554, USA, 2011.
- Q. V. Le, J. Ngiam, A. Coates, A. Lahiri, B. Prochnow, and A. Y. Ng, "On optimization methods for deep learning, " in Proceedings of the 28th International Conference on Machine Learning (ICML'11), pp. 265-272, Omnipress, USA, 2011.
- I. Sutskever, J. Martens, G. Dahl, and G. Hinton, "On the importance of initialization and momentum in deep learning, " in Proceedings of the 30th International Conference on Machine Learning, ICML'13, pp. 1139-1147, 2013.
- T. Chen, I. J. Goodfellow, and J. Shlens, "Net2net: Accelerating learning via knowledge transfer, " 2015, https://arxiv.org/abs/ 1511.05641.
- T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean, "Distributed representations of words and phrases and their compositionality, " in Proceedings of the 26th International Con- ference on Neural Information Processing Systems (NIPS'13), pp. 3111-3119, Curran Associates Inc., USA, 2013.
- I. Goodfellow, J. Pouget-Abadie, M. Mirza et al., "Generative adversarial nets, " in Advances in Neural formation Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, Eds., pp. 2672-2680, Curran Associates, Inc., 2014.
Cited by
Educational data mining and learning analytics: An updated survey
Romero, C., & Ventura, S. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1355 · Cited by 1,120
A Systematic Literature Review of Student’ Performance Prediction Using Machine Learning Techniques
Albreiki, B., Zaki, N., & Alashwal, H. (2021) · Education Sciences · doi:10.3390/educsci11090552 · Cited by 427
“These platforms utilize intelligent tools that collect valuable user information such as; frequency of a student’s access to the e-learning system, the accuracy of the student’s answers to questions, and the number of hours spent reading texts and watching video tutorials [2].”
MethodBozkurt, A., Karadeniz, A., Baneres, D., Guerrero-Roldán, A. E., & Rodríguez, M. E. (2021) · Sustainability · doi:10.3390/su13020800 · Cited by 362
“Accordingly, educational data mining is a trending issue and, in addition to many statistical approaches, deep learning and machine learning are generally used, especially for online learning [47] to profile learners and predict their behaviors to generate recommendations [48].”
BackgroundPrediction of groundwater quality using efficient machine learning technique
Singha, S., Pasupuleti, S., Singha, S. S., Singh, R., & Kumar, S. (2021) · Chemosphere · doi:10.1016/j.chemosphere.2021.130265 · Cited by 383
Hariyanto, H., Kristianingsih, F. X. D., & Maharani, R. (2025) · Discover Education · doi:10.1007/s44217-025-00908-6 · Cited by 330
Metadata
- Authors
- Hernández-Blanco, A., Herrera-Flores, B., Tomás, D., & Navarro-Colorado, B.
- Affiliations
- Universidad Técnica del Norte (EC)
- Central University of Ecuador (EC)
- University of Alicante (ES)
- Corresponding author
- Hernández-Blanco, Antonio
- Venue
- Complexity
- Publisher
- Wiley
- Published
- 2019-01
- Volume
- 2019
- Issue
- 1
- ISSN
- 1076-2787 (ISSN-L)
- 1099-0526
- OpenAlex
- W2944162469
- Cited by
- 230
- References
- 60
- Citations by year
- 2026: 13 · 2025: 43 · 2024: 36 · 2023: 51 · 2022: 41 · 2021: 23 · 2020: 20 · 2019: 3
- FWCI
- 5.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Complexity (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- RUA, Repositorio Institucional de la Universidad de Alicante (Universidad de Alicante) (submittedVersion, cc-by)
- Greater South Information System
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Educational Technology and Pedagogy
- Keywords
- educational data mining, deep learning, artificial neural networks, educational data, deep learning architectures, future research directions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.