The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Dynamic Key-Value Memory Networks for Knowledge Tracing
Open accessAbstract
Knowledge Tracing (KT) is a task of tracing evolving knowledge state of students with respect to one or more concepts as they engage in a sequence of learning activities. One important purpose of KT is to personalize the practice sequence to help students learn knowledge concepts efficiently. However, existing methods such as Bayesian Knowledge Tracing and Deep Knowledge Tracing either model knowledge state for each predefined concept separately or fail to pinpoint exactly which concepts a student is good at or unfamiliar with. To solve these problems, this work introduces a new model called Dynamic Key-Value Memory Networks (DKVMN) that can exploit the relationships between underlying concepts and directly output a student's mastery level of each concept. Unlike standard memory-augmented neural networks that facilitate a single memory matrix or two static memory matrices, our model has one static matrix called key, which stores the knowledge concepts and the other dynamic matrix called value, which stores and updates the mastery levels of corresponding concepts. Experiments show that our model consistently outperforms the state-of-the-art model in a range of KT datasets. Moreover, the DKVMN model can automatically discover underlying concepts of exercises typically performed by human annotations and depict the changing knowledge state of a student.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2008) · Journal of Machine Learning Research · Cited by 33,051
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“This study was the first attempt to integrate deep learning models [14, 25], which have achieved significant success in other areas, including computer vision [13] and natural language processing [16]”
BackgroundDeep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Proceedings of the 23rd international conference on Machine learning
Cohen, W. W., & Moore, A. (2006) · Cited by 2,647
Alignment by Maximization of Mutual Information
Viola, P., & Wells III, W. M. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007958904918 · Cited by 2,610
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213 · cited 1×
“yesian models by a large margin regarding prediction accuracy. This is the rst attempt to integrate deep learning models [14, 26], which has achieved great success in other areas like computer vision [15, 13] and natural language processing [3, 17], into knowledge tracing. 2.2 Memory-Augmented Neural Networks Inspired…”
BackgroundInfluentialNeural Networks: Tricks of the Trade: Second Edition
(2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8 · Cited by 2,116 · cited 1×
“and testing dataset had the same size. 20% of the training set was split to form a validation set, which was used to select the optimal model architecture, hyperparameters, and perform early-stopping [19]. The parameters were initialized randomly from a Gaussian distribution with zero mean and standard deviation ˙. Th…”
MethodMXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., & Zhang, Z. (2015) · arXiv · doi:10.48550/arxiv.1512.01274 · Cited by 1,819
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058 · cited 7×
“In the write process, we first erase unnecessary contents in the memory using the erase signal et and the write weight wt , and then add vt into the memory using the add signal at [6].”
BackgroundMethodInfluential(2016) · doi:10.18653/v1/d16-1147 · Cited by 1,035
Matching Networks for One Shot Learning
Vinyals, O., Blundell, C., Lillicrap, T., Kavukcuoglu, K., & Wierstra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04080 · Cited by 854
Neural Networks: Tricks of the Trade
(1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8 · Cited by 810
Addressing the assessment challenge with an online system that tutors as it assesses
Feng, M., Heffernan, N., & Koedinger, K. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9063-7 · Cited by 502
Individualized Bayesian Knowledge Tracing Models
Yudelson, M. V., Koedinger, K. R., & Gordon, G. J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39112-5_18 · Cited by 483
Baker, R. S. J. D., Corbett, A. T., & Aleven, V. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-69132-7_44 · Cited by 442
Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing
Pardos, Z. A., & Heffernan, N. T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-13470-8_24 · Cited by 354
Learning to Transduce with Unbounded MemoryPreprint
Grefenstette, E., Hermann, K. M., Suleyman, M., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02516 · Cited by 305
How deep is knowledge tracing?Preprint
Khajah, M. M., Lindsey, R., & Mozer, M. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.02416 · Cited by 219
KT-IDEM: introducing item difficulty to the knowledge tracing model
Pardos, Z. A., & Heffernan, N. T. (2011) · International Conference on User Modeling, Adaptation, and Personalization · doi:10.5555/2021855.2021877 · Cited by 206
Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets
Joulin, A., & Mikolov, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.01007 · Cited by 165
Going Deeper with Deep Knowledge Tracing.
Xiong, X., Zhao, S., Inwegen, E. G. V., & Beck, J. E. (2016) · Educational Data Mining · Cited by 155
Student Modelling Based on Belief Networks
Reye, J. (2004) · International Journal of Artificial Intelligence in Education · doi:10.3233/irg-2004-14(1)04 · Cited by 143
Cristóbal Romero, S. V. (2010) · CRC Press eBooks · doi:10.1201/b10274-6 · Cited by 112
Cited by
Context-Aware Attentive Knowledge Tracing
Ghosh, A., Heffernan, N., & Lan, A. S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403282 · Cited by 580
EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction
Liu, Q., Huang, Z., Yin, Y., Chen, E., Xiong, H., Su, Y., & Hu, G. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2924374 · Cited by 516
Sequential Recommendation with User Memory Networks
Chen, X., Xu, H., Zhang, Y., Tang, J., Cao, Y., Qin, Z., & Zha, H. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159668 · Cited by 498
AI-based personalized E-learning systems: Issues, challenges, and solutions
Murtaza, M., Ahmed, Y., Shamsi, J. A., Sherwani, F., & Usman, M. (2022) · IEEE Access · doi:10.1109/access.2022.3193938 · Cited by 386
A Survey of Knowledge Tracing: Models, Variants, and Applications
Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., & Chen, E. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3383325 · Cited by 364
Metadata
- Authors
- Zhang, J., Shi, X., King, I., & Yeung, D.-Y.
- Venue
- Proceedings of the 26th International Conference on World Wide Web
- Published
- 2017-04-03
- Pages
- 765-774
- OpenAlex
- W2559094423
- Cited by
- 862
- References
- 33
- FWCI
- 12.83
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.