CoChat

Improving Knowledge Tracing with Collaborative Information

Long, Ting, Qin, Jiarui, Shen, Jian, Zhang, Weinan, Xia, Wei, Tang, Ruiming, He, Xiuqiang, Yu, Yong · 2022 · Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining
Cited by 53

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Abstract

Knowledge tracing, which estimates students' knowledge states by predicting the probability that they correctly answer questions, is an essential task for online learning platforms. It has gained much attention in the decades due to its importance to downstream tasks like learning material arrangement, etc. The previous deep learning-based methods trace students' knowledge states with the explicitly intra-student information, i.e., they only consider the historical information of individuals to make predictions. However, they neglect the inter-student information, which contains the response correctness of other students who have similar question-answering experiences, may offer some valuable clues. Based on this consideration, we propose a method called Collaborative Knowledge Tracing (CoKT) in this paper, which sufficiently exploits the inter-student information in knowledge tracing. It retrieves the sequences of peer students who have similar question-answering experiences to obtain the inter-student information, and integrates the inter-student information with the intra-student information to trace students' knowledge states and predict their correctness in answering questions. We validate the effectiveness of our method on four real-world datasets and compare it with 11 baselines. The experimental results reveal that CoKT achieves the best performance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3488560.3498374

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 1 references

Research works printed but not linked: 42

  1. 10.1145/3331184.3331195 · DOI · Paper page
  2. 10.1198/000313002146 · doi:10.1198/000313002146
  3. 10.1109/ICDM.2018.00019 · DOI · Paper page
  4. Kyunghyun Cho, Bart Van Merriënboer, Dzmitry Bahdanau, and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259 (2014). · arXiv
  5. 10.1145/3386527.3405945 · DOI · Paper page
  6. 10.1007/978-3-030-52240-7_13 · DOI · Paper page
  7. Albert T Corbett and John R Anderson. 1994. Knowledge tracing: Modeling the acquisition of procedural knowledge. User modeling and user-adapted interaction , Vol. 4, 4 (1994), 253--278.
  8. Paul De Boeck and Mark Wilson. 2004. Explanatory item response models: A generalized linear and nonlinear approach .Springer Science & Business Media.
  9. 10.1007/s10639-017-9637-7 · DOI · Paper page
  10. 10.1007/s11257-009-9063-7 · DOI · Paper page
  11. 10.1145/3394486.3403282 · DOI · Paper page
  12. Alex Graves, Greg Wayne, Malcolm Reynolds, Tim Harley, Ivo Danihelka, Agnieszka Grabska-Barwi'nska, Sergio Gómez Colmenarejo, Edward Grefenstette, Tiago Ramalho, John Agapiou, et al. 2016. Hybrid computing using a neural network with dynamic external memory. Nature , Vol. 538, 7626 (2016), 471--476.
  13. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation , Vol. 9, 8 (1997), 1735--1780.
  14. Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, Guoping Hu, et al. 2019. Ekt: Exercise-aware knowledge tracing for student performance prediction. IEEE Transactions on Knowledge and Data Engineering (2019).
  15. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
  16. 10.1145/3292500.3330922 · DOI
  17. 10.24963/ijcai.2020/219 · DOI
  18. Simon J Mason and Nicholas E Graham. 2002. Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. Quarterly Journal of the Royal Meteorological Society: A journal of the atmospheric sciences applied meteorology and physical oceanography Vol. 128 584 (2002) 2145--2166. · DOI · Paper page
  19. 10.1145/3308558.3313565 · DOI · Paper page
  20. Hiromi Nakagawa, Yusuke Iwasawa, and Yutaka Matsuo. 2019. Graph-based Knowledge Tracing: Modeling Student Proficiency Using Graph Neural Network. In 2019 IEEE/WIC/ACM International Conference on Web Intelligence (WI). IEEE, 156--163.
  21. Shalini Pandey and George Karypis. 2019. A Self-Attentive model for Knowledge Tracing. arXiv preprint arXiv:1907.06837 (2019). · arXiv
  22. 10.1145/3340531.3411994 · DOI · Paper page
  23. Chris Piech Jonathan Bassen Jonathan Huang Surya Ganguli Mehran Sahami Leonidas J Guibas and Jascha Sohl-Dickstein. 2015. Deep knowledge tracing. In Advances in neural information processing systems. 505--513.
  24. 10.1145/3447548.3467216 · DOI
  25. 10.1145/3397271.3401440 · DOI
  26. 10.1145/3331184.3331230 · DOI
  27. Stephen Robertson and Hugo Zaragoza. 2009. The probabilistic relevance framework: BM25 and beyond .Now Publishers Inc.
  28. 10.1145/3397271.3401288 · DOI
  29. : Integrating temporal features for ednet correctness prediction. In LAK21: 11th International Learning Analytics and Knowledge Conference . 490--496.
  30. 10.1609/aaai.v32i1.11864 · DOI · Paper page
  31. Hanshuang Tong, Yun Zhou, and Zhen Wang. 2020 b. HGKT: Introducing Problem Schema with Hierarchical Exercise Graph for Knowledge Tracing. arXiv preprint arXiv:2006.16915 (2020). · arXiv
  32. Shiwei Tong, Qi Liu, Wei Huang, Zhenya Huang, Enhong Chen, Chuanren Liu, Haiping Ma, and Shijin Wang. 2020 a. Structure-based Knowledge Tracing: An Influence Propagation View. In 2020 IEEE International Conference on Data Mining (ICDM). IEEE, 541--550.
  33. Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Łukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008.
  34. 10.1609/aaai.v33i01.3301750 · DOI · Paper page
  35. 10.1145/3437963.3441802 · DOI
  36. 10.1609/aaai.v34i04.6080 · DOI · Paper page
  37. Tianqi Wang, Fenglong Ma, and Jing Gao. 2019 a. Deep hierarchical knowledge tracing. In Proceedings of the 12th International Conference on Educational Data Mining .
  38. Jason Weston, Sumit Chopra, and Antoine Bordes. 2014. Memory networks. arXiv preprint arXiv:1410.3916 (2014). · arXiv
  39. Kevin H Wilson, Yan Karklin, Bojian Han, and Chaitanya Ekanadham. 2016a. Back to the basics: Bayesian extensions of IRT outperform neural networks for proficiency estimation. arXiv preprint arXiv:1604.02336 (2016). · arXiv
  40. Kevin H Wilson, Xiaolu Xiong, Mohammad Khajah, Robert V Lindsey, Siyuan Zhao, Yan Karklin, Eric G Van Inwegen, Bojian Han, Chaitanya Ekanadham, Joseph E Beck, et al. 2016b. Estimating student proficiency: Deep learning is not the panacea. In In Neural Information Processing Systems, Workshop on Machine Learning for Education . 3.
  41. 10.1007/978-3-642-39112-5_18 · DOI · Paper page
  42. 10.1145/3038912.3052580 · DOI · Paper page

Cited by

See all 53

Metadata

Authors
Long, T., Qin, J., Shen, J., Zhang, W., Xia, W., Tang, R., He, X., & Yu, Y.
Affiliations
  • Shanghai Jiao Tong University, Shanghai, China
  • Huawei Noah's Ark Lab, Shenzhen, China
Venue
Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining
Publisher
ACM
Published
2022-02-11
Pages
599-607
Cited by
53
References
1
Funders
National Natural Science Foundation of China (61772333)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Improving Knowledge Tracing with Collaborative Information. https://app.cochat.ai/papers/10.1145/3488560.3498374
The paper
Long, T., Qin, J., Shen, J., Zhang, W., Xia, W., Tang, R., He, X., & Yu, Y. (2022). Improving Knowledge Tracing with Collaborative Information. Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. https://doi.org/10.1145/3488560.3498374

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.