The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Data-Driven Hint Generation in Vast Solution Spaces: a Self-Improving Python Programming Tutor
Open accessAbstract
To provide personalized help to students who are working on code-writing problems, we introduce a data-driven tutoring system, ITAP (Intelligent Teaching Assistant for Programming). ITAP uses state abstraction, path construction, and state reification to automatically generate personalized hints for students, even when given states that have not occurred in the data before. We provide a detailed description of the system’s implementation and perform a technical evaluation on a small set of data to determine the effectiveness of the component algorithms and ITAP’s potential for self-improvement. The results show that ITAP is capable of producing hints for almost any given state after being given only a single reference solution, and that it can improve its performance by collecting data over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Anderson, J. R., Boyle, C. F., & Reiser, B. J. (1985) · Science · doi:10.1126/science.228.4698.456 · Cited by 3,119
The Behavior of Tutoring Systems
VanLehn, K. (2006) · International Journal of Artificial Intelligence in Education · doi:10.3233/irg-2006-16(3)02 · Cited by 749
Skill Acquisition and the LISP Tutor
Anderson, J. R., Conrad, F. G., & Corbett, A. T. (1989) · Cognitive Science · doi:10.1207/s15516709cog1304_1 · Cited by 386
Automated feedback generation for introductory programming assignments
Singh, R., Gulwani, S., & Solar-Lezama, A. (2013) · Proceedings of the 34th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2491956.2462195 · Cited by 383
Corbett, A. T., & Anderson, J. R. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365111 · Cited by 280
37 Million Compilations: Investigating Novice Programming Mistakes in Large-Scale Student Data
Altadmri, A., & Brown, N. C. C. (2015) · Proceedings of the 46th ACM Technical Symposium on Computer Science Education · doi:10.1145/2676723.2677258 · Cited by 261
Corbett, A. T., Koedinger, K. R., & Anderson, J. R. (1997) · Handbook of Human-Computer Interaction · doi:10.1016/b978-044481862-1.50103-5 · Cited by 210
Self-citationToward Automatic Hint Generation for Logic Proof Tutoring Using Historical Student Data
Barnes, T. M., & Stamper, J. C. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69132-7_41 · Cited by 147
Autonomously Generating Hints by Inferring Problem Solving Policies
Piech, C., Sahami, M., Huang, J., & Guibas, L. J. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2724668 · Cited by 139
A Response-Time Model for Bottom-Out Hints as Worked Examples
Shih, B., Koedinger, K. R., & Scheines, R. (2010) · Chapman & Hall/CRC data mining and knowledge discovery series · doi:10.1201/b10274-17 · Cited by 124
Self-citation
Cited by
Students’ Misconceptions and Other Difficulties in Introductory Programming: A Literature Review
Qian, Y., & Lehman, J. (2018) · ACM Transactions on Computing Education · doi:10.1145/3077618 · Cited by 529
Introductory programming: a systematic literature review
Luxton-Reilly, A., Simon, Albluwi, I., Becker, B. A., Giannakos, M., Kumar, A. N., Ott, L., Paterson, J., Scott, M. J., Sheard, J., et al. (2018) · Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/3293881.3295779 · Cited by 485
Hinojo-Lucena, F.-J., Aznar-Díaz, I., Cáceres-Reche, M.-P., & Romero-Rodríguez, J.-M. (2019) · Education Sciences · doi:10.3390/educsci9010051 · Cited by 400
A systematic literature review of automated feedback generation for programming exercises
Keuning, H., Jeuring, J., & Heeren, B. (2019) · ACM Transactions on Computing Education · doi:10.1145/3231711 · Cited by 370
Intelligent tutoring systems for programming education: a systematic review
Crow, T., Luxton-Reilly, A., & Wuensche, B. (2018) · Proceedings of the 20th Australasian Computing Education Conference · doi:10.1145/3160489.3160492 · Cited by 166
Metadata
- Authors
- Rivers, K., & Koedinger, K. R.
- Venue
- International Journal of Artificial Intelligence in Education
- Published
- 2015-10-22
- Volume
- 27
- Issue
- 1
- Pages
- 37-64
- ISSN
- 1560-4292 (ISSN-L)
- 1560-4306
- OpenAlex
- W2246775628
- Cited by
- 258
- References
- 31
- FWCI
- 17.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Data-Driven Hint Generation in Vast Solution Spaces: a Self-Improving Python Programming Tutor. https://app.cochat.ai/papers/10.1007/s40593-015-0070-z
- The paper
- Rivers, K., & Koedinger, K. R. (2017). Data-Driven Hint Generation in Vast Solution Spaces: a Self-Improving Python Programming Tutor. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-015-0070-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.