The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Knowledge Tracing: A Survey
Open accessAbstract
Humans’ ability to transfer knowledge through teaching is one of the essential aspects for human intelligence. A human teacher can track the knowledge of students to customize the teaching on students’ needs. With the rise of online education platforms, there is a similar need for machines to track the knowledge of students and tailor their learning experience. This is known as the Knowledge Tracing (KT) problem in the literature. Effectively solving the KT problem would unlock the potential of computer-aided education applications such as intelligent tutoring systems, curriculum learning, and learning materials’ recommendation. Moreover, from a more general viewpoint, a student may represent any kind of intelligent agents including both human and artificial agents. Thus, the potential of KT can be extended to any machine teaching application scenarios which seek for customizing the learning experience for a student agent (i.e., a machine learning model). In this paper, we provide a comprehensive survey for the KT literature. We cover a broad range of methods starting from the early attempts to the recent state-of-the-art methods using deep learning, while highlighting the theoretical aspects of models and the characteristics of benchmark datasets. Besides these, we shed light on key modelling differences between closely related methods and summarize them in an easy-to-understand format. Finally, we discuss current research gaps in the KT literature and possible future research and application directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
The graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Probabilistic Models for Some Intelligence and Attainment Tests
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,939
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
The probabilistic relevance framework: BM25 and beyond
Robertson, S., & Zaragoza, H. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000019 · Cited by 3,374
Bobadilla, J., Ortega, F., Hernando, A., & Gutiérrez, A. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.03.012 · Cited by 3,158
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Memory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324
Spectra of some self-exciting and mutually exciting point processes
HAWKES, A. G. (1971) · Biometrika · doi:10.1093/biomet/58.1.83 · Cited by 2,252
Reading and understanding multivariate statistics
Grimm, L. G., & Yarnold, P. R. (1995) · Cited by 2,234
A Critical Review of Recurrent Neural Networks for Sequence Learning
Lipton, Z. C., Berkowitz, J. A., & Elkan, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.00019 · Cited by 1,996
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
Grondman, I., Busoniu, L., Lopes, G. A. D., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2218595 · Cited by 1,042
Replication and Analysis of Ebbinghaus’ Forgetting Curve
Murre, J. M. J., & Dros, J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0120644 · Cited by 777 · cited 1×
“From an experimental psychology perspective, Hermann Ebbinghaus [29, 78] studied forces that affect memory retention, leading to formulate what is currently known as the learning curve theory [77].”
BackgroundEmbretson, S. E., & Reise, S. P. (2013) · Psychology Press eBooks · doi:10.4324/9781410605269 · Cited by 761
Cognitive modeling and intelligent tutoring
Anderson, J. R., Boyle, C. F., Corbett, A. T., & Lewis, M. W. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90093-f · Cited by 534
EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction
Liu, Q., Huang, Z., Yin, Y., Chen, E., Xiong, H., Su, Y., & Hu, G. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2924374 · Cited by 516
Addressing the assessment challenge with an online system that tutors as it assesses
Feng, M., Heffernan, N., & Koedinger, K. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9063-7 · Cited by 502
Intelligent tutoring systems : lessons learned
Psotka, J., Massey, L., & Mutter, S. A. (1988) · Lawrence Erlbaum Associates eBooks · Cited by 457
A Survey of Knowledge Tracing: Models, Variants, and Applications
Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., & Chen, E. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3383325 · Cited by 364
A Data Repository for the EDM Community: The PSLC DataShop
(2010) · Handbook of Educational Data Mining · doi:10.1201/b10274-10 · Cited by 322
Pavlik, P. I., & Anderson, J. R. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_14 · Cited by 311
Towards an Appropriate Query, Key, and Value Computation for Knowledge Tracing
Choi, Y., Lee, Y., Cho, J., Baek, J., Kim, B., Cha, Y., Shin, D., Bae, C., & Heo, J. (2020) · Proceedings of the Seventh ACM Conference on Learning @ Scale · doi:10.1145/3386527.3405945 · Cited by 260
Dynamic Bayesian Networks for Student Modeling
Kaser, T., Klingler, S., Schwing, A. G., & Gross, M. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2689017 · Cited by 210
GIKT: A Graph-Based Interaction Model for Knowledge Tracing
Yang, Y., Shen, J., Qu, Y., Liu, Y., Wang, K., Zhu, Y., Zhang, W., & Yu, Y. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-67658-2_18 · Cited by 193
Pardos, Z. A., Baker, R. S. J. D., San Pedro, M., Gowda, S. M., & Gowda, S. M. (2014) · Journal of Learning Analytics · doi:10.18608/jla.2014.11.6 · Cited by 190
Application of Deep Learning on Student Engagement in e-learning environments
Bhardwaj, P., Gupta, P. K., Panwar, H., Siddiqui, M. K., Morales-Menendez, R., & Bhaik, A. (2021) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2021.107277 · Cited by 182
AN UPPER ASYMPTOTE FOR THE THREE‐PARAMETER LOGISTIC ITEM‐RESPONSE MODEL*
Barton, M. A., & Lord, F. M. (1981) · ETS Research Report Series · doi:10.1002/j.2333-8504.1981.tb01255.x · Cited by 175
Self-supervised Pretraining of Visual Features in the Wild
Goyal, P., Caron, M., Lefaudeux, B., Xu, M., Wang, P., Pai, V., Singh, M., Liptchinsky, V., Misra, I., Joulin, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.01988 · Cited by 141
Saint+: Integrating temporal features for ednet correctness prediction
Shin, D., Shim, Y., Yu, H., Lee, S., Kim, B., & Choi, Y. (2021) · LAK21: 11th International Learning Analytics and Knowledge Conference · doi:10.1145/3448139.3448188 · Cited by 141
Temporal Cross-Effects in Knowledge Tracing
Wang, C., Ma, W., Zhang, M., Lv, C., Wan, F., Lin, H., Tang, T., Liu, Y., & Ma, S. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441802 · Cited by 136
Learning or Forgetting? A Dynamic Approach for Tracking the Knowledge Proficiency of Students
Huang, Z., Liu, Q., Chen, Y., Wu, L., Xiao, K., Chen, E., Ma, H., & Hu, G. (2020) · ACM Transactions on Information Systems · doi:10.1145/3379507 · Cited by 126
Hawlitschek, A., & Joeckel, S. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.01.040 · Cited by 119
Vanneste, P., Jose Oramas, M., Verelst, T., Tuytelaars, T., Raes, A., Depaepe, F., & Noortgate, W. V. D. (2021) · Mathematics · doi:10.3390/math9030287 · Cited by 84
An Individual's Rate of Forgetting Is Stable Over Time but Differs Across Materials
Sense, F., Behrens, F., Meijer, R. R., & van Rijn, H. (2016) · Topics in Cognitive Science · doi:10.1111/tops.12183 · Cited by 82
Statistical theory for logistic mental test models with a prior distribution of ability
Birnbaum, A. (1969) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(69)90005-4 · Cited by 80
Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing
Abdelrahman, G. M., & Wang, Q. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3206447 · Cited by 77
Self-citationFully Adaptive Framework: Neural Computerized Adaptive Testing for Online Education
Zhuang, Y., Liu, Q., Huang, Z., Li, Z., Shen, S., & Ma, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20399 · Cited by 68
Gan, W., Sun, Y., Peng, X., & Sun, Y. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01756-7 · Cited by 62
Educational Game and Intelligent Tutoring System: A Classroom Study and Comparative Design Analysis
Long, Y., & Aleven, V. A. W. M. M. (2017) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3057889 · Cited by 56
Review of Item Response Theory Practices in Organizational Research
Foster, G. C., Min, H., & Zickar, M. J. (2017) · Organizational Research Methods · doi:10.1177/1094428116689708 · Cited by 51
Effect of Mobile Gaming on Mathematical Achievement among 4th Graders
Alkhateeb, M. A. (2019) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v14i07.10315 · Cited by 37
Cognitive Modelling and Intelligent Tutoring
Anderson, J. R., Boyle, C. F., Corbett, A. T., & Lewis, M. W. (1986) · doi:10.21236/ada165981 · Cited by 37
GameDKT: Deep knowledge tracing in educational games
Hooshyar, D., Huang, Y., & Yang, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116670 · Cited by 35
Cui, Y., Chu, M.-W., & Fu, C. (2019) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554751 · Cited by 31
Learning data teaching strategies via knowledge tracing
Abdelrahman, G. M., & Wang, Q. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110511 · Cited by 22
Self-citation
Cited by
AI-based personalized E-learning systems: Issues, challenges, and solutions
Murtaza, M., Ahmed, Y., Shamsi, J. A., Sherwani, F., & Usman, M. (2022) · IEEE Access · doi:10.1109/access.2022.3193938 · Cited by 386
A Survey of Knowledge Tracing: Models, Variants, and Applications
Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., & Chen, E. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3383325 · Cited by 364
Proactive and reactive engagement of artificial intelligence methods for education: a review
Mallik, S., & Gangopadhyay, A. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1151391 · Cited by 139
Metadata
- Authors
- Abdelrahman, G., Wang, Q., & Nunes, B.
- Venue
- ACM Computing Surveys
- Published
- 2023-02-09
- Volume
- 55
- Issue
- 11
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4307561542
- Cited by
- 468
- References
- 54
- FWCI
- 24.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.