The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Context-Aware Attentive Knowledge Tracing
Open accessAbstract
Knowledge tracing (KT) refers to the problem of predicting future learner performance given their past performance in educational applications. Recent developments in KT using flexible deep neural network-based models excel at this task. However, these models often offer limited interpretability, thus making them insufficient for personalized learning, which requires using interpretable feedback and actionable recommendations to help learners achieve better learning outcomes. In this paper, we propose attentive knowledge tracing (AKT), which couples flexible attention-based neural network models with a series of novel, interpretable model components inspired by cognitive and psychometric models. AKT uses a novel monotonic attention mechanism that relates a learner's future responses to assessment questions to their past responses; attention weights are computed using exponential decay and a context-aware relative distance measure, in addition to the similarity between questions. Moreover, we use the Rasch model to regularize the concept and question embeddings; these embeddings are able to capture individual differences among questions on the same concept without using an excessive number of parameters. We conduct experiments on several real-world benchmark datasets and show that AKT outperforms existing KT methods (by up to $6%$ in AUC in some cases) on predicting future learner responses. We also conduct several case studies and show that AKT exhibits excellent interpretability and thus has potential for automated feedback and personalization in real-world educational settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
(2010) · Cited by 14,134
(2016) · Cited by 11,679
Applications of Item Response Theory To Practical Testing Problems
Lord, F. M. (2012) · Routledge eBooks · doi:10.4324/9780203056615 · Cited by 5,007
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324
Accelerating t-SNE using tree-based algorithms
van der Maaten, L. (2014) · doi:10.5555/2627435.2697068 · Cited by 2,226
Building Intelligent Interactive Tutors : student-centered strategies for revolutionizing e-learning
Woolf, B. P. (2009) · HAL · Cited by 1,376
Dynamic Key-Value Memory Networks for Knowledge Tracing
Zhang, J., Shi, X., King, I., & Yeung, D.-Y. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052580 · Cited by 862
“Learning factors analysis-a general method for cognitive model evaluation and improvement,”
Cen, H., Koedinger, K., & Junker, B. (2006) · Lecture notes in computer science · doi:10.1007/11774303_17 · Cited by 572
Individualized Bayesian Knowledge Tracing Models
Yudelson, M. V., Koedinger, K. R., & Gordon, G. J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39112-5_18 · Cited by 483
Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing
Pardos, Z. A., & Heffernan, N. T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13470-8_24 · Cited by 354
Self-citationAddressing two problems in deep knowledge tracing via prediction-consistent regularization
Yeung, C.-K., & Yeung, D.-Y. (2018) · Proceedings of the Fifth Annual ACM Conference on Learning at Scale · doi:10.1145/3231644.3231647 · Cited by 330
How deep is knowledge tracing?Preprint
Khajah, M. M., Lindsey, R., & Mozer, M. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.02416 · Cited by 219
Improving Students’ Long-Term Knowledge Retention Through Personalized Review
Lindsey, R. V., Shroyer, J. D., Pashler, H., & Mozer, M. C. (2014) · Psychological Science · doi:10.1177/0956797613504302 · Cited by 216
Knowledge Tracing Machines: Factorization Machines for Knowledge Tracing
Vie, J.-J., & Kashima, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301750 · Cited by 176
Going Deeper with Deep Knowledge Tracing.
Xiong, X., Zhao, S., Inwegen, E. G. V., & Beck, J. E. (2016) · Educational Data Mining · Cited by 155
Bridging Viterbi and posterior decoding
Lember, J., & Koloydenko, A. A. (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2627436 · Cited by 137
Probabilistic Models for Some Intelligence and Attainment Tests
Karabatsos, G. (2022) · Sage eBooks · doi:10.4135/9781071812082.n468 · Cited by 127
Integrating Knowledge Tracing and Item Response Theory: A Tale of Two Frameworks
Khajah, M. M., Huang, Y., González-Brenes, J. P., Mozer, M. C., & Brusilovsky, P. L. (2014) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 66
Unbounded Human Learning: Optimal Scheduling for Spaced Repetition
Reddy, S., Labutov, I., Banerjee, S., & Joachims, T. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939850 · Cited by 65
Time-varying learning and content analytics via sparse factor analysis
Lan, A., Studer, C., & Baraniuk, R. G. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623631 · Cited by 64
Self-citationA Contextual Bandits Framework for Personalized Learning Action Selection.
Lan, A., & Baraniuk, R. G. (2016) · Educational Data Mining · Cited by 60
Self-citationDealbreaker: A Nonlinear Latent Variable Model for Educational Data
Lan, A., Goldstein, T., Baraniuk, R. G., & Studer, C. (2016) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000461384 · Cited by 7
Self-citationPiech, C., Spencer, J., Huang, J., Ganguli, S., Sahami, M., Guibas, L., & Sohl-Dickstein, J. (2015) · arXiv · doi:10.48550/arxiv.1506.05908
A self-attentive model for knowledge tracing
Pandey, S., & Karypis, G. (2019) · arXiv · doi:10.48550/arxiv.1907.06837
Cited by
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
AI-based personalized E-learning systems: Issues, challenges, and solutions
Murtaza, M., Ahmed, Y., Shamsi, J. A., Sherwani, F., & Usman, M. (2022) · IEEE Access · doi:10.1109/access.2022.3193938 · Cited by 386
A Survey of Knowledge Tracing: Models, Variants, and Applications
Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., & Chen, E. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3383325 · Cited by 364
Personalized Education in the Artificial Intelligence Era: What to Expect Next
Maghsudi, S., Lan, A., Xu, J., & van der Schaar, M. (2021) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3055032 · Cited by 341
Self-citationSaint+: Integrating temporal features for ednet correctness prediction
Shin, D., Shim, Y., Yu, H., Lee, S., Kim, B., & Choi, Y. (2021) · LAK21: 11th International Learning Analytics and Knowledge Conference · doi:10.1145/3448139.3448188 · Cited by 141
Metadata
- Authors
- Ghosh, A., Heffernan, N., & Lan, A. S.
- Venue
- Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2020-08-20
- Pages
- 2330-2339
- OpenAlex
- W3043869244
- Cited by
- 580
- References
- 30
- FWCI
- 16.73
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.