The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Open-ended Knowledge Tracing for Computer Science Education
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“KTMFF and OKT are known for their strong performance in leveraging rich embeddings of code submissions and capturing the structural properties of code blocks.”
From Knowledge Tracing in Programming Education Integrating Students’ Questions (2025) · cites this paper as Liu et al., 2022
In the citing paper
“Liu et al. (2022) developed an approach that considers the multi-skill nature of programming exercises by learning features from student code that reflect multiple skills.”
From Knowledge Tracing in Programming Education Integrating Students’ Questions (2025) · cites this paper as Liu et al. (2022)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Knowledge tracing: Modeling the acquisition of procedural knowledge
Corbett, A. T., & Anderson, J. R. (1995) · User Modelling and User-Adapted Interaction · doi:10.1007/bf01099821 · Cited by 2,324
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
Competition-level code generation with AlphaCode
Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Dal Lago, A., et al. (2022) · Science · doi:10.1126/science.abq1158 · Cited by 1,043
Competition-Level Code Generation with AlphaCode
Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Lago, A. D., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.07814 · Cited by 1,043
Training Verifiers to Solve Math Word Problems
Cobbe, K., Kosaraju, V., Bavarian, M., Chen, M., Jun, H., Kaiser, L., Plappert, M., Tworek, J., Hilton, J., Nakano, R., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.14168 · Cited by 575
“Learning factors analysis-a general method for cognitive model evaluation and improvement,”
Cen, H., Koedinger, K., & Junker, B. (2006) · Lecture notes in computer science · doi:10.1007/11774303_17 · Cited by 572
Measuring Mathematical Problem Solving With the MATH Dataset
Hendrycks, D., Burns, C., Kadavath, S., Arora, A., Basart, S., Tang, E., Song, D., & Steinhardt, J. (2021) · arXiv · doi:10.48550/arxiv.2103.03874 · Cited by 306
Mapping Language to Code in Programmatic Context
Iyer, S., Konstas, I., Cheung, A., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1192 · Cited by 180
Measuring Coding Challenge Competence With APPS
Hendrycks, D., Basart, S., Kadavath, S., Mazeika, M., Arora, A., Guo, E., Burns, C., Puranik, S., He, H., Song, D., et al. (2021) · arXiv · doi:10.48550/arxiv.2105.09938 · Cited by 142
Research works printed but not linked: 41
- Uri Alon, Meital Zilberstein, Omer Levy, and Eran Yahav. 2019. code2vec: Learning distributed rep- resentations of code. Proc. ACM Program. Lang., 3(POPL):1-29.
- John R Anderson and Robin Jeffries. 1985. Novice lisp errors: Undetected losses of information from work- ing memory. Human-Computer Interact., 1(2):107- 131.
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Ben- gio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. · arXiv
- John Seely Brown and Richard R Burton. 1978. Diag- nostic models for procedural bugs in basic mathemat- ical skills. Cogn. sci., 2(2):155-192.
- Benoît Choffin, Fabrice Popineau, Yolaine Bourda, and Jill-Jênn Vie. 2019. DAS3H: Modeling student learning and forgetting for pptimally scheduling dis- tributed practice of skills. In Proc. Int. Conf. Educ. Data Mining, pages 29-38.
- Youngduck Choi, Youngnam Lee, Dongmin Shin, Junghyun Cho, Seoyon Park, Seewoo Lee, Jineon Baek, Chan Bae, Byungsoo Kim, and Jaewe Heo. 2020. Ednet: A large-scale hierarchical dataset in education. In Int. Conf. Artif. Intell. Educ., pages 69-73. Springer.
- Aditya Desai, Sumit Gulwani, Vineet Hingorani, Nidhi Jain, Amey Karkare, Mark Marron, and Subhajit Roy. 2016. Program synthesis using natural language. In Proc. 38th Int. Conf. Softw. Eng., pages 345-356.
- Molly Q Feldman, Ji Yong Cho, Monica Ong, Sumit Gulwani, Zoran Popović, and Erik Andersen. 2018. Automatic diagnosis of students' misconceptions in K-8 mathematics. In Proc. CHI Conf. Human Fac- tors Comput. Syst., pages 1-12.
- Junchen Feng, Bo Zhang, Yuchen Li, and Qiushi Xu. 2019. Bayesian diagnosis tracing: Application of procedural misconceptions in knowledge tracing. In Proc. Int. Conf. Artif. Intell. Educ., pages 84-88. Springer.
- Aritra Ghosh, Neil Heffernan, and Andrew S Lan. 2020. Context-aware attentive knowledge tracing. In Proc. ACM SIGKDD, pages 2330-2339.
- Aritra Ghosh, Jay Raspat, and Andrew Lan. 2021. Op- tion tracing: Beyond correctness analysis in knowl- edge tracing. In Int. Conf. Artif. Intell. Educ., pages 137-149. Springer.
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Comput., 9(8):1735- 1780.
- MM Khajah, Y Huang, JP González-Brenes, MC Mozer, and P Brusilovsky. 2014. Integrating knowledge trac- ing and item response theory: A tale of two frame- works. In Proc. Int. Workshop Personalization Ap- proaches Learn. Environ., volume 1181, pages 7-15.
- Alexander LeClair and Collin McMillan. 2019. Recom- mendations for datasets for source code summariza- tion. arXiv preprint arXiv:1904.02660. · arXiv
- Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016. A diversity-promoting objec- tive function for neural conversation models. In Proc. Conf. North Amer. Chapter Assoc. Comput. Linguis- tics Human Lang. Technol., pages 110-119.
- Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, and Guoping Hu. 2019. Ekt: Exercise- aware knowledge tracing for student performance pre- diction. IEEE Trans. Knowl. Data Eng., 33(1):100- 115.
- Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, Duyu Tang, et al. 2021. Codexglue: A machine learning benchmark dataset for code understanding and generation. arXiv preprint arXiv:2102.04664. · arXiv
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Cor- rado, and Jeff Dean. 2013. Distributed representa- tions of words and phrases and their compositionality. In Proc. NeurIPS, pages 3111-3119.
- Shalini Pandey and Jaideep Srivastava. 2020. Rkt: Relation-aware self-attention for knowledge tracing. arXiv preprint arXiv:2008.12736. · arXiv
- Zach A Pardos and Neil T Heffernan. 2010. Modeling individualization in a Bayesian networks implemen- tation of knowledge tracing. In Proc. Int. Conf. User Model. Adaptation Personalization, pages 255-266.
- Philip Pavlik Jr, Hao Cen, and Kenneth Koedinger. 2009. Performance factors analysis-A new alternative to knowledge tracing. In Proc. Int. Conf. Artif. Intell. Educ.
- Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. 2015a. Deep knowledge trac- ing. In Proc. NeurIPS, pages 505-513.
- Chris Piech, Mehran Sahami, Jonathan Huang, and Leonidas Guibas. 2015b. Autonomously generat- ing hints by inferring problem solving policies. In Proc. ACM conf. learn. Scale, pages 195-204.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9.
- Shuo Ren, Daya Guo, Shuai Lu, Long Zhou, Shujie Liu, Duyu Tang, Neel Sundaresan, Ming Zhou, Ambrosio Blanco, and Shuai Ma. 2020. CodeBLEU: a Method for Automatic Evaluation of Code Synthesis. arXiv preprint arXiv:2009.10297. · arXiv
- Steven Ritter, John R Anderson, Kenneth R Koedinger, and Albert Corbett. 2007. Cognitive tutor: Applied research in mathematics education. Psychonomic Bulletin & Review, 14(2):249-255.
- Kelly Rivers and Kenneth R Koedinger. 2017. Data- driven hint generation in vast solution spaces: a self- improving python programming tutor. Int. J. Artif. Intell. Educ., 27(1):37-64.
- David Saxton, Edward Grefenstette, Felix Hill, and Pushmeet Kohli. 2019. Analysing mathematical rea- soning abilities of neural models. arXiv preprint arXiv:1904.01557. · arXiv
- Dongmin Shin, Yugeun Shim, Hangyeol Yu, Seewoo Lee, Byungsoo Kim, and Youngduck Choi. 2021. Saint+: Integrating temporal features for ednet cor- rectness prediction. In 11th Int. Learn. Analytics Knowl. Conf., pages 490-496.
- Adish Singla and Nikitas Theodoropoulos. 2022. From {Solution Synthesis} to {Student Attempt Synthesis} for block-based visual programming tasks. arXiv preprint arXiv:2205.01265. · arXiv
- John P Smith III, Andrea A DiSessa, and Jeremy Roschelle. 1994. Misconceptions reconceived: A constructivist analysis of knowledge in transition. j. learn. sci., 3(2):115-163.
- W. J. van der Linden and R. K. Hambleton. 2013. Hand- book of Modern Item Response Theory. Springer Science & Business Media.
- Laurens van der Maaten and Geoffrey Hinton. 2008. Vi- sualizing data using t-sne. JMLR, 9(86):2579-2605.
- Kurt VanLehn. 1982. Bugs are not enough: Empirical studies of bugs, impasses and repairs in procedural skills. J. Math. Behavior.
- Tianqi Wang, Fenglong Ma, Yaqing Wang, Tang Tang, Longfei Zhang, and Jing Gao. 2021. Towards learn- ing outcome prediction via modeling question expla- nations and student responses. In Proc. SIAM Int. Conf. Data Mining, pages 693-701. SIAM.
- Yutao Wang and Neil Heffernan. 2013. Extending knowledge tracing to allow partial credit: Using con- tinuous versus binary nodes. In Int. conf. artif. intell. educ., pages 181-188. Springer.
- Yang Yang, Jian Shen, Yanru Qu, Yunfei Liu, Kerong Wang, Yaoming Zhu, Weinan Zhang, and Yong Yu. 2020. Gikt: A graph-based interaction model for knowledge tracing. In Proc. Joint Eur. Conf. Mach. Learn. Knowl. Discovery Databases.
- Michael V Yudelson, Kenneth R Koedinger, and Geof- frey J Gordon. 2013. Individualized bayesian knowl- edge tracing models. In Int. Conf. artif. intell. educ., pages 171-180. Springer.
- Jian Zhang, Xu Wang, Hongyu Zhang, Hailong Sun, Kaixuan Wang, and Xudong Liu. 2019. A novel neural source code representation based on abstract syntax tree. In IEEE/ACM 41st Int. Conf. Software Eng., pages 783-794. IEEE.
- Jiani Zhang, Xingjian Shi, Irwin King, and Dit-Yan Yeung. 2017. Dynamic key-value memory networks for knowledge tracing. In Proc. Int. Conf. World Wide Web, pages 765-774.
- Renyu Zhu, Dongxiang Zhang, Chengcheng Han, Ming Gao, Xuesong Lu, Weining Qian, and Aoying Zhou. 2021. Programming knowledge tracing: A compre- hensive dataset and a new model. arXiv preprint arXiv:2112.08273. · arXiv
Cited by
Sonkar, S., Liu, N., Mallick, D., & Baraniuk, R. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.130 · Cited by 35
Self-citationArtificial intelligence in computer programming education: A systematic literature review
Manorat, P., Tuarob, S., & Pongpaichet, S. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100403 · Cited by 27
Knowledge Tracing in Programming Education Integrating Students’ Questions
Kim, D., Kim, S., & Jo, Y. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1343 · Cited by 9
Metadata
- Authors
- Liu, N., Wang, Z., Baraniuk, R., & Lan, A.
- Venue
- Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
- Published
- 2022
- Pages
- 3849-3862
- Cited by
- 34
- References
- 10
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Open-ended Knowledge Tracing for Computer Science Education. https://app.cochat.ai/papers/10.18653/v1/2022.emnlp-main.254
- The paper
- Liu, N., Wang, Z., Baraniuk, R., & Lan, A. (2022). Open-ended Knowledge Tracing for Computer Science Education. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. https://doi.org/10.18653/v1/2022.emnlp-main.254
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.