Cited by 55Teaching and Learning ProgrammingSoftware Engineering ResearchSoftware Testing and Debugging Techniques

Deep Reinforcement Learning for Syntactic Error Repair in Student Programs

Open access
Gupta, Rahul, Kanade, Aditya, Shevade, Shirish·2019·Proceedings of the AAAI Conference on Artificial Intelligence

Abstract

Novice programmers often struggle with the formal syntax of programming languages. In the traditional classroom setting, they can make progress with the help of real time feedback from their instructors which is often impossible to get in the massive open online course (MOOC) setting. Syntactic error repair techniques have huge potential to assist them at scale. Towards this, we design a novel programming language correction framework amenable to reinforcement learning. The framework allows an agent to mimic human actions for text navigation and editing. We demonstrate that the agent can be trained through self-exploration directly from the raw input, that is, program text itself, without either supervision or any prior knowledge of the formal syntax of the programming language. We evaluate our technique on a publicly available dataset containing 6975 erroneous C programs with typographic errors, written by students during an introductory programming course. Our technique fixes 1699 (24.4%) programs completely and 1310 (18.8%) program partially, outperforming DeepFix, a state-of-the-art syntactic error repair technique, which uses a fully supervised neural machine translation approach.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1609/aaai.v33i01.3301930

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Artificial intelligence and machine learning approaches have been used for finding and repairing errors in programs, but only very fundamental approaches have been applied to researching programming error messages.

    “Artificial intelligence and machine learning approaches have been used for finding and repairing errors in programs [1,20,21] but only very fundamental approaches have been applied to researching PEMs [11].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 31 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. Ahmed, U. Z.; Kumar, P.; Karkare, A.; Kar, P.; and Gulwani, S. 2018. Compilation error repair: for the student programs, from the student programs. In Proceedings of the 40th International Con- ference on Software Engineering: Software Engineering Education and Training, 78-87.
  2. Hochreiter, S., and Schmidhuber, J. 1997. Long short-term mem- ory. Neural computation 9(8):1735-1780.

Cited by

Sorted by citations

Authors
Gupta, R., Kanade, A., & Shevade, S.
Affiliations
Indian Institute of Science Bangalore (IN)
Venue
Proceedings of the AAAI Conference on Artificial Intelligence
Published
2019-07-17
Volume
33
Issue
01
Pages
930-937
ISSN
  • 2159-5399 (ISSN-L)
  • 2374-3468
OpenAlex
W2905087861
Cited by
54
References
31
Citations by year
2026: 2 · 2025: 6 · 2024: 5 · 2023: 16 · 2022: 10 · 2021: 8 · 2020: 6 · 2019: 1
FWCI
7.23
Type
conference paper
Language
en
Open access
Locations
  • Proceedings of the AAAI Conference on Artificial Intelligence (publishedVersion)
  • NOT FOUND REPOSITORY (Indian Institute of Science Bangalore) (acceptedVersion)
  • AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
Keywords
deep reinforcement learning, novice programmers, student programming, C programs, typographical errors, self-exploration, MOOCs

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review