The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
EKT: Exercise-Aware Knowledge Tracing for Student Performance Prediction
Open accessAbstract
For offering proactive services (e.g., personalized exercise recommendation) to the students in computer supported intelligent education, one of the fundamental tasks is predicting student performance (e.g., scores) on future exercises, where it is necessary to track the change of each student's knowledge acquisition during her exercising activities. Unfortunately, to the best of our knowledge, existing approaches can only exploit the exercising records of students, and the problem of extracting rich information existed in the materials (e.g., knowledge concepts, exercise content) of exercises to achieve both more precise prediction of student performance and more interpretable analysis of knowledge acquisition remains underexplored. To this end, in this paper, we present a holistic study of student performance prediction. To directly achieve the primary goal of performance prediction, we first propose a general Exercise-Enhanced Recurrent Neural Network (EERNN) framework by exploring both student's exercising records and the text content of corresponding exercises. In EERNN, we simply summarize each student's state into an integrated vector and trace it with a recurrent neural network, where we design a bidirectional LSTM to learn the encoding of each exercise from its content. For making final predictions, we design two implementations on the basis of EERNN with different prediction strategies, i.e., EERNNM with Markov property and EERNNA with Attention mechanism. Then, to explicitly track student's knowledge acquisition on multiple knowledge concepts, we extend EERNN to an explainable Exercise-aware Knowledge Tracing (EKT) framework by incorporating the knowledge concept information, where the student's integrated state vector is now extended to a knowledge state matrix. In EKT, we further develop a memory network for quantifying how much each exercise can affect the mastery of students on multiple knowledge concepts during the exercising process. Finally, we conduct extensive experiments and evaluate both EERNN and EKT frameworks on a large-scale real-world data. The results in both general and cold-start scenarios clearly demonstrate the effectiveness of two frameworks in student performance prediction as well as the superior interpretability of EKT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
An introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412
The State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S. J. D., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554657 · Cited by 1,359
Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
Cui, P., Wang, X., Pei, J., & Zhu, W. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2849727 · Cited by 1,274
word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method
Goldberg, Y., & Levy, O. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.3722 · Cited by 1,245
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
Kumar, A., Irsoy, O., Ondruska, P., Iyyer, M., Bradbury, J., Gulrajani, I., Zhong, V., Paulus, R., & Socher, R. (2015) · arXiv · doi:10.48550/arxiv.1506.07285 · Cited by 1,020
The transfer of training: what really matters
Grossman, R., & Salas, E. (2011) · International Journal of Training and Development · doi:10.1111/j.1468-2419.2011.00373.x · Cited by 886
Dynamic Key-Value Memory Networks for Knowledge Tracing
Zhang, J., Shi, X., King, I., & Yeung, D.-Y. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052580 · Cited by 862
Neural Networks: Tricks of the Trade
(1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8 · Cited by 810
Embretson, S. E., & Reise, S. P. (2013) · Psychology Press eBooks · doi:10.4324/9781410605269 · Cited by 761
DINA Model and Parameter Estimation: A Didactic
de la Torre, J. (2009) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998607309474 · Cited by 671
Dynamic Memory Networks for Visual and Textual Question Answering
Xiong, C., Merity, S., & Socher, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01417 · Cited by 603
“Learning factors analysis-a general method for cognitive model evaluation and improvement,”
Cen, H., Koedinger, K., & Junker, B. (2006) · Lecture notes in computer science · doi:10.1007/11774303_17 · Cited by 572
Engaging with massive online courses
Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2568042 · Cited by 500
Individualized Bayesian Knowledge Tracing Models
Yudelson, M. V., Koedinger, K. R., & Gordon, G. J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39112-5_18 · Cited by 483
LSTM-based Deep Learning Models for Non-factoid Answer Selection
Tan, M., dos Santos, C., Xiang, B., & Zhou, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.04108 · Cited by 370
Recommender system for predicting student performance
Thai-Nghe, N., Drumond, L., Krohn-Grimberghe, A., & Schmidt-Thieme, L. (2010) · Procedia Computer Science · doi:10.1016/j.procs.2010.08.006 · Cited by 306
31A Review of Cognitively Diagnostic Assessment and a Summary of Psychometric Models
DiBello, L. V., Roussos, L. A., & Stout, W. (2006) · Handbook of Statistics · doi:10.1016/s0169-7161(06)26031-0 · Cited by 251
Exercise-Enhanced Sequential Modeling for Student Performance Prediction
Su, Y., Liu, Q., Liu, Q., Huang, Z., Yin, Y., Chen, E., Ding, C., Wei, S., & Hu, G. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11864 · Cited by 248
Self-citationKT-IDEM: introducing item difficulty to the knowledge tracing model
Pardos, Z. A., & Heffernan, N. T. (2011) · International Conference on User Modeling, Adaptation, and Personalization · doi:10.5555/2021855.2021877 · Cited by 206
Fuzzy Cognitive Diagnosis for Modelling Examinee Performance
Liu, Q., Wu, R., Chen, E., Xu, G., Su, Y., Chen, Z., & Hu, G. (2018) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3168361 · Cited by 175
Self-citationKT-IDEM: Introducing Item Difficulty to the Knowledge Tracing Model
Pardos, Z. A., & Heffernan, N. T. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-22362-4_21 · Cited by 174
Prerequisite-Driven Deep Knowledge Tracing
Chen, P., Lu, Y., Zheng, V. W., & Pian, Y. (2018) · 2018 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2018.00019 · Cited by 163
Stable Prediction across Unknown Environments
Kuang, K., Cui, P., Athey, S., Xiong, R., & Li, B. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220082 · Cited by 159
A Cocktail Approach for Travel Package Recommendation
Liu, Q., Chen, E., Xiong, H., Ge, Y., Li, Z., & Wu, X. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.233 · Cited by 151
Self-citationFactorization Techniques for Predicting Student Performance
Thai-Nghe, N., Drumond, L., Horváth, T., Krohn-Grimberghe, A., Νανόπουλος, Α., & Schmidt-Thieme, L. (2011) · IGI Global eBooks · doi:10.4018/978-1-61350-489-5.ch006 · Cited by 135
Deep Variational Network Embedding in Wasserstein Space
Zhu, D., Cui, P., Wang, D., & Zhu, W. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220052 · Cited by 132
Fogarty, J. A., Baker, R. S., & Hudson, S. E. (2005) · Graphics Interface · Cited by 120
Question Difficulty Prediction for READING Problems in Standard Tests
Huang, Z., Liu, Q., Chen, E., Zhao, H., Gao, M., Wei, S., Su, Y., & Hu, G. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10740 · Cited by 118
Self-citationTracking Knowledge Proficiency of Students with Educational Priors
Chen, Y., Liu, Q., Huang, Z., Wu, L., Chen, E., Wu, R., Su, Y., & Hu, G. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132929 · Cited by 103
Self-citationHierarchical Lifelong Learning by Sharing Representations and Integrating Hypothesis
Zhang, T., Su, G., Qing, C., Xu, X., Cai, B., & Xing, X. (2019) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2018.2884996 · Cited by 98
Multi-Behavioral Sequential Prediction with Recurrent Log-Bilinear Model
Liu, Q., Wu, S., & Wang, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2661760 · Cited by 87
Self-citationGeneral Knowledge Embedded Image Representation Learning
Cui, P., Liu, S., & Zhu, W. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2724843 · Cited by 74
Exploring Hierarchical Structures for Recommender Systems
Wang, S., Tang, J., Wang, Y., & Liu, H. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2789443 · Cited by 69
Automatically Learning Topics and Difficulty Levels of Problems in Online Judge Systems
Zhao, W. X., Zhang, W., He, Y., Xie, X., & Wen, J.-R. (2018) · ACM Transactions on Information Systems · doi:10.1145/3158670 · Cited by 67
Time-varying learning and content analytics via sparse factor analysis
Lan, A., Studer, C., & Baraniuk, R. G. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623631 · Cited by 64
Voice of Charity: Prospecting the Donation Recurrence & Donor Retention in Crowdfunding
Zhao, H., Jin, B., Liu, Q., Ge, Y., Chen, E., Zhang, X., & Xu, T. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2906199 · Cited by 55
Self-citationA Sequential Approach to Market State Modeling and Analysis in Online P2P Lending
Zhao, H., Liu, Q., Zhu, H., Ge, Y., Chen, E., Zhu, Y., & Du, J. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2665038 · Cited by 47
Self-citationUsing Logistic Regression to Trace Multiple Sub-skills in a Dynamic Bayes Net.
Xu, Y., & Mostow, J. (2011) · Cited by 30
Transcribing Content from Structural Images with Spotlight Mechanism
Yin, Y., Huang, Z., Chen, E., Liu, Q., Zhang, F., Xie, X., & Hu, G. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219962 · Cited by 23
Self-citationKnowledge or Gaming? Cognitive Modelling Based on Multiple-Attempt Response
Wu, R., Xu, G., Chen, E., Liu, Q., & Ng, W. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3054156 · Cited by 19
Self-citationCADEN: A Context-Aware Deep Embedding Network for Financial Opinions Mining
Zhang, L., Xiao, K., Zhu, H., Liu, C., Yang, J., & Jin, B. (2018) · Proceedings · doi:10.1109/icdm.2018.00091 · Cited by 19
Piech, C., Spencer, J., Huang, J., Ganguli, S., Sahami, M., Guibas, L., & Sohl-Dickstein, J. (2015) · arXiv · doi:10.48550/arxiv.1506.05908
Cited by
Abdelrahman, G., Wang, Q., & Nunes, B. (2023) · ACM Computing Surveys · doi:10.1145/3569576 · Cited by 468
Wu, L., He, X., Wang, X., Zhang, K., & Wang, M. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3145690 · Cited by 413
AI-based personalized E-learning systems: Issues, challenges, and solutions
Murtaza, M., Ahmed, Y., Shamsi, J. A., Sherwani, F., & Usman, M. (2022) · IEEE Access · doi:10.1109/access.2022.3193938 · Cited by 386
A Survey of Knowledge Tracing: Models, Variants, and Applications
Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., & Chen, E. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3383325 · Cited by 364
Self-citationNeural Cognitive Diagnosis for Intelligent Education Systems
Wang, F., Liu, Q., Chen, E., Huang, Z., Chen, Y., Yin, Y., Huang, Z., & Wang, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6080 · Cited by 314
Self-citation
Metadata
- Authors
- Liu, Q., Huang, Z., Yin, Y., Chen, E., Xiong, H., Su, Y., & Hu, G.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2021-01-01
- Volume
- 33
- Issue
- 1
- Pages
- 100-115
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W2955931418
- Cited by
- 516
- References
- 52
- FWCI
- 19.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.