CoChat

A Systematic Review of Deep Learning Approaches to Educational Data Mining

Open access

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.

Abstract

Educational Data Mining (EDM) is a research field that focuses on the application of data mining, machine learning, and statistical methods to detect patterns in large collections of educational data. Different machine learning techniques have been applied in this field over the years, but it has been recently that Deep Learning has gained increasing attention in the educational domain. Deep Learning is a machine learning method based on neural network architectures with multiple layers of processing units, which has been successfully applied to a broad set of problems in the areas of image recognition and natural language processing. This paper surveys the research carried out in Deep Learning techniques applied to EDM, from its origins to the present day. The main goals of this study are to identify the EDM tasks that have benefited from Deep Learning and those that are pending to be explored, to describe the main datasets used, to provide an overview of the key concepts, main architectures, and configurations of Deep Learning and its applications to EDM, and to discuss current state‐of‐the‐art and future directions on this area of research.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1155/2019/1306039

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Number of papers published per year.
Figure 1 Number of papers published per year.CC-BY · From the PDF
Figure 2 Choropleth map showing the density of researchers per country in the papers reviewed based on their affiliation.
Figure 2 Choropleth map showing the density of researchers per country in the papers reviewed based on their affiliation.CC-BY · From the PDF
Figure 3 Simple artificial neuron.
Figure 3 Simple artificial neuron.CC-BY · From the PDF
Figure 4 Basic structure of a neural network. Each circular node represents a neuron. Arrows represent connections from the output of one neuron to the input of another.
Figure 4 Basic structure of a neural network. Each circular node represents a neuron. Arrows represent connections from the output of one neuron to the input of another.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 39

  1. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning, MIT Press, Cambridge, Mass, USA, 2016.
  2. C. Piech, J. Bassen, J. Huang et al., "Deep knowledge tracing, " in Annual Conference on Neural Information Processing Systems (NIPS), C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, Eds., pp. 505-513, Curran Associates, Inc., 2015.
  3. PiechC. BassenJ. HuangJ. GanguliS. SahamiM. GuibasL. J. andSohl-DicksteinJ. CortesC. LawrenceN. D. LeeD. D. SugiyamaM. andGarnettR. Deep knowledge tracing Annual Conference on Neural Information Processing Systems (NIPS) 2015 Curran Associates Inc. 505–513.
  4. S. Montero, A. Arora, S. Kelly, B. Milne, and M. Mozer, "Does deep knowledge tracing model interactions among skills?" in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
  5. A. Lalwani and S. Agrawal, "Few hundred parameters out- perform few hundred thousand?" in Proceedings of the 10th International Conference on Educational Data Mining, 2017.
  6. K. H. Wilson, X. Xiong, M. Khajah et al., "Estimating student proficiency: Deep learning is not the panacea, " in Neural Information Processing Systems, Workshop on Machine Learning for Education, pp. 1-8, 2016.
  7. M. Khajah, R. V. Lindsey, and M. Mozer, "How deep is knowledge tracing?" in Proceedings of the 9th International Conference on Educational Data Mining, 2016.
  8. X. Xiong, S. Zhao, E. V. Inwegen, and J. Beck, "Going deeper with deep knowledge tracing, " in Proceedings of the 9th Inter- national Conference on Educational Data Mining, pp. 545-550, 2016.
  9. P. P. Bendangnuksung, "Students' performance prediction using deep neural network, " International Journal of Applied Engineer- ing Research, vol. 13, no. 2, pp. 1171-1176, 2018.
  10. N. Sharada, M. Shashi, and X. Xiong, "Modeling student knowledge retention using deep learning and random forests, " Journal of Engineering and Applied Sciences, vol. 13, no. 6, pp. 1347-1353, 2018.
  11. B. Guo, R. Zhang, G. Xu, C. Shi, and L. Yang, "Predicting students performance in educational data mining, " in Proceed- ings of the International Symposium on Educational Technology, (ISET '15), pp. 125-128, China, July 2015.
  12. M. M. Alam, M. K. Islam, K. Mohiuddin, M. S. Kaonain, A. K. Das, and M. H. Ali, "A reduced feature based neural network approach to classify the category of students, " in Proceedings of the 2nd International Conference on Innovation in Artificial Intelligence, (ICIAI '18), pp. 28-32, China, March 2018.
  13. B. Kim, E. Vizitei, and V. Ganapathi, "Gritnet 2: Real-time student performance prediction with domain adaptation, " 2018, https://arxiv.org/abs/1809.06686. · arXiv
  14. M. Fei and D.-Y. Yeung, "Temporal models for predicting student dropout in massive open online courses, " in Proceedings of the IEEE International Conference on Data Mining Workshop (ICDMW '15), pp. 256-263, IEEE Computer Society, Washing- ton, DC., USA, November 2015.
  15. W. Min, J. B. Wiggins, L. Pezzullo et al., "Predicting dialogue acts for intelligent virtual agents with multimodal student inter- action data, " in Proceedings of the 9th International Conference on Educational Data Mining, pp. 454-459, 2016.
  16. A. Sharma, A. Biswas, A. Gandhi, S. Patil, and O. Deshmukh, "LIVELINET: A multimodal deep recurrent neural network to predict liveliness in educational videos, " in Proceedings of the 9th International Conference on Educational Data Mining, pp. 215- 222, 2016.
  17. A. A. N. Tato, R. Nkambou, and A. Dufresne, "Convolutional neural network for automatic detection of sociomoral reasoning level, " in Proceedings of the 10th International Conference on Educational Data Mining, 2017.
  18. K. Abhinav, V. Subramanian, A. Dubey, P. Bhat, and A. D. Venkat, "Lecore: A framework for modeling learner's prefer- ence, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
  19. Y. Zhang, R. Shah, and M. Chi, "Deep learning + student mod- eling + clustering: a recipe for effective automatic short answer grading, " in Proceedings of the 9th International Conference on Educational Data Mining, pp. 562-567, 2016.
  20. J. G. Alvarado, H. A. Ghavidel, A. Zouaq, J. Jovanovic, and J. McDonald, "A comparison of features for the automatic labeling of student answers to open-ended questions, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
  21. B. Akram, W. Min, E. N. Wiebe, B. W. Mott, K. Boyer, and J. C. Lester, "Improving stealth assessment in game-based learning with lstm-based analytics, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
  22. H. Choi, Z. Wang, C. Brooks, K. Collins-Thompson, B. G. Reed, and D. Fitch, "Social work in the classroom? A tool to evaluate topical relevance in student writing, " in Proceedings of the 10th International Conference on Educational Data Mining, 2017.
  23. A. Sales, A. Botelho, T. Patikorn, and N. T. Heffernan, "Using big data to sharpen design-based inference in A/B tests, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
  24. K. H. Wilson, Y. Karklin, B. Han, and C. Ekanadham, "Back to the basics: Bayesian extensions of IRT outperform neural net- works for proficiency estimation, " 2016, https://arxiv.org/abs/ 1604.02336.
  25. J. Stamper, A. Niculescu-Mizil, S. Ritter, G. J. Gordon, and K. R. Koedinger, "Algebra I 2005-2006. Challenge data set from KDD Cup 2010 Educational Data Mining Challenge, " 2010, http://pslcdatashop.web.cmu.edu/KDDCup/downloads.jsp.
  26. L. Wang, A. Sy, L. Liu, and C. Piech, "Learning to represent student knowledge on programming exercises using deep learning, " in Proceedings of the 10th International Conference on Educational Data Mining, pp. 201-204, Cambridge, Mass, USA, April 2017. · DOI · Paper page
  27. H. Singh, S. K. Saini, R. Chaudhry, and P. Dogga, "Modeling hint-taking behavior and knowledge state of students with multi-task learning, " in Proceedings of the 11th International Conference on Educational Data Mining, 2018.
  28. S. Chandar, S. Lauly, H. Larochelle et al., "An autoen- coder approach to learning bilingual word representations, " in Advances in Neural formation Processing Systems, Z. Ghahra- mani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, Eds., pp. 1853-1861, Curran Associates, Inc., 2014.
  29. J. Nagi, F. Ducatelle, G. A. Di Caro et al., "Max-pooling convolutional neural networks for vision-based hand gesture recognition, " in Proceedings of the IEEE International Conference on Signal and Image Processing Applications (ICSIPA'11), pp. 342-347, Malaysia, November 2011.
  30. K. Cho, B. Van Merriënboer, C. Gulcehre et al., "Learning phrase representations using RNN encoder-decoder for statis- tical machine translation, " in Proceedings of the Conference on Empirical Methods in Natural Language Processing, (EMNLP '14), pp. 1724-1734, Qatar, October 2014.
  31. M. C. Mozer, "A focused backpropagation algorithm for tempo- ral pattern recognition, " in Backpropagation, vol. 3, pp. 137-169, L. Erlbaum Associates Inc., Hillsdale, NJ, USA, 1995.
  32. S. Venugopalan, M. Rohrbach, J. Donahue, R. Mooney, T. Darrell, and K. Saenko, "Sequence to sequence -Video to text, " in Proceedings of the 15th IEEE International Conference on Computer Vision, ICCV 2015, pp. 4534-4542, December 2015.
  33. P. Smolensky, "Information processing in dynamical systems: Foundations of harmony theory, " in Parallel Distributed Process- ing: Explorations in the Microstructure of Cognition, vol. 1, pp. 194-281, MIT Press, Cambridge, MA, USA, 1986.
  34. J. Bergstra, R. Bardenet, Y. Bengio, and B. Kégl, "Algorithms for hyper-parameter optimization, " in Proceedings of the 24th Inter- national Conference on Neural Information Processing Systems, pp. 2546-2554, USA, 2011.
  35. Q. V. Le, J. Ngiam, A. Coates, A. Lahiri, B. Prochnow, and A. Y. Ng, "On optimization methods for deep learning, " in Proceedings of the 28th International Conference on Machine Learning (ICML'11), pp. 265-272, Omnipress, USA, 2011.
  36. I. Sutskever, J. Martens, G. Dahl, and G. Hinton, "On the importance of initialization and momentum in deep learning, " in Proceedings of the 30th International Conference on Machine Learning, ICML'13, pp. 1139-1147, 2013.
  37. T. Chen, I. J. Goodfellow, and J. Shlens, "Net2net: Accelerating learning via knowledge transfer, " 2015, https://arxiv.org/abs/ 1511.05641.
  38. T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean, "Distributed representations of words and phrases and their compositionality, " in Proceedings of the 26th International Con- ference on Neural Information Processing Systems (NIPS'13), pp. 3111-3119, Curran Associates Inc., USA, 2013.
  39. I. Goodfellow, J. Pouget-Abadie, M. Mirza et al., "Generative adversarial nets, " in Advances in Neural formation Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, Eds., pp. 2672-2680, Curran Associates, Inc., 2014.

Cited by

See all 260

Metadata

Authors
Hernández-Blanco, A., Herrera-Flores, B., Tomás, D., & Navarro-Colorado, B.
Affiliations
  • Universidad Técnica del Norte (EC)
  • Central University of Ecuador (EC)
  • University of Alicante (ES)
Corresponding author
Hernández-Blanco, Antonio
Venue
Complexity
Publisher
Wiley
Published
2019-01
Volume
2019
Issue
1
ISSN
  • 1076-2787 (ISSN-L)
  • 1099-0526
OpenAlex
W2944162469
Cited by
230
References
60
Citations by year
2026: 13 · 2025: 43 · 2024: 36 · 2023: 51 · 2022: 41 · 2021: 23 · 2020: 20 · 2019: 3
FWCI
5.44
Type
journal article
Language
en
Open access
Locations
  • Complexity (publishedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • RUA, Repositorio Institucional de la Universidad de Alicante (Universidad de Alicante) (submittedVersion, cc-by)
  • Greater South Information System
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Education › Educational Technology and Pedagogy
Keywords
educational data mining, deep learning, artificial neural networks, educational data, deep learning architectures, future research directions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.