The DOI matches its Crossref record; the references it cites are not checked yet.
Effectiveness of Feedback Based on Log File Analysis in Introductory Programming Courses
Abstract
Especially in large courses, feedback is often given only on the final results; less attention is paid to the programming process. Today, however, some programming environments, e.g., Thonny, log activities during programming and have the functionality of replaying the programming process. This information can be used to provide feedback, and this knowledge can be integrated into practical sessions in the classroom. This study aimed to analyse how feedback based on logs affects exam results, task completion time, the number of runs, error messages, and pastes (of the whole group and beginners and non-beginners separately). An experiment was conducted in 2020 and 2021 in the course “Introduction to Programming”. Some groups received additional feedback on homework throughout the course based on log information; the remaining groups worked as usual. Based on the information received from the logs, general recommendations were also offered in the practical sessions. Our study showed that feedback based on logs improved mainly exam test results and programming task solving time among beginners. Therefore, it would be a good method to use, especially in beginner groups.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
The citation lists haven’t been fetched yet
References 54 · Cited by 13
Research works printed but not linked: 56
- 10.1145/2787622.2787717 · DOI
- 10.1145/1067445.1067472 · DOI
- Alam L. S., 2004, Beyond the comfort zone: Proceedings of the 21st ASCILITE conference, 48
- 10.1145/2676723.2677258 · DOI
- 10.1145/2828959.2828969 · DOI
- 10.1145/2557833.2557842 · DOI
- 10.1145/3324888 · DOI
- 10.1145/2090116.2090132 · DOI
- 10.1145/3011286.3011301 · DOI
- 10.1145/377435.377467 · DOI
- Costa E. B., Fonseca B., Santana M. A., de Araújo F. F., Rego J. (2017). Evaluating the effectiveness of educational data mining techniques for early prediction of students’ academic failure in introductory programming courses. Computers in human behavior, 73, 247–256. https://doi.org/10.1016/j.chb.2017.01.047 · DOI
- 10.1145/3017680.3017792 · DOI
- 10.1145/1028174.971310 · DOI
- Davis G. J. (1991). An introduction to computer programming for students with no programming experience. In Proceedings Frontiers in Education Twenty-First Annual Conference. Engineering Education in a New World Order, West Lafayette, IN, USA, 21-24 Sept 1991. (pp. 748–752). IEEE. https://doi.org/10.1109/fie.1991.187592 · DOI
- 10.1145/3441636.3442313 · DOI
- 10.1145/2325296.2325318 · DOI · Paper page
- 10.1145/1999747.1999807 · DOI · Paper page
- Dorodchi M., Fallahian M., Al-Hossami E., Benedict A., Benedict A. (2020). Custom “caring IDE” for online offering of CS1. In Sixth SPLICE workshop at L@S 2020 “building an infrastructure for computer science education research and practice at scale” SPLICE’20, Toronto, Canada, 11 Aug 2019
- 10.1109/EDUCON.2017.7942823 · DOI
- 10.1145/3362789.3362925 · DOI
- Hagan D., Markham S. (2000). Does it help to have some programming experience before beginning a computing degree program? In Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education, Helsinki, Finland, 11–13 Jun 2000. (pp. 25–28) · DOI
- 10.1145/947121.947131 · DOI
- Hosseini R., Vihavainen A., Brusilovsky P. (2014). Exploring problem solving paths in a Java programming course. In Proceedings of psychology of programming interest group annual conference, Brighton, UK. (pp. 25–27). 25-27 June 2014
- 10.1145/792548.611956 · DOI
- 10.1109/ICBDSC.2019.8645608 · DOI
- 10.1145/2839509.2844612 · DOI · Paper page
- 10.19173/irrodl.v19i4.3639 · DOI
- 10.1145/3293881.3295779 · DOI
- 10.1145/1953163.1953308 · DOI
- 10.1145/3372782.3406264 · DOI
- 10.1145/2462476.2462493 · DOI
- 10.1145/3335814 · DOI
- 10.1145/563340.563353 · DOI
- 10.1109/TE.2018.2864133 · DOI
- 10.1109/EDUCON45650.2020.9125134 · DOI
- 10.1145/3373165.3373185 · DOI
- 10.1145/3059009.3059026 · DOI
- 10.1080/02602930301677 · DOI
- 10.53761/1.16.5.4 · DOI
- 10.1145/3077618 · DOI · Paper page
- 10.1145/3279720.3279725 · DOI
- 10.1145/2445196.2445388 · DOI
- 10.1145/3511861.3511867 · DOI · Paper page
- 10.1109/ICICI.2017.8365371 · DOI
- 10.1145/3287324.3287394 · DOI
- 10.1177/0735633117707695 · DOI
- 10.1109/ICALT.2013.161 · DOI
- 10.1145/2674683.2674692 · DOI
- 10.1145/2656450.2656473 · DOI
- 10.1145/3192366.3192384 · DOI
- 10.1145/2591708.2591749 · DOI · Paper page
- 10.1109/ICALT.2013.99 · DOI
- 10.1007/978-3-642-39112-5_127 · DOI
- 10.1145/3287324.3287483 · DOI
- Zhang X., 2013, Journal of Information Systems Education, 24, 147
- Zhi R., Marwan S., Dong Y., Lytle N., Price T. W., Barnes T. (2019). Toward data-driven example feedback for novice programming. In Proceedings of the 12th international conference on educational data mining, Montreal, Canada, 2–5 Jul 2019. (pp. 218–227).
Metadata
- Authors
- Meier, H., & Lepp, M.
- Affiliations
- University of Tartu (EE)
- Corresponding author
- Meier, Heidi
- Venue
- Journal of Educational Computing Research
- Publisher
- SAGE Publications
- Published
- 2022-10-25
- Volume
- 61
- Issue
- 3
- Pages
- 696-719
- ISSN
- 0735-6331 (ISSN-L)
- 1541-4140
- OpenAlex
- W4307561552
- Cited by
- 13
- References
- 54
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 5 · 2023: 1
- FWCI
- 1.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational Computing Research (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- log analysis, introductory programming, programming education, exam performance, novice programmers, homework feedback, coding errors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effectiveness of Feedback Based on Log File Analysis in Introductory Programming Courses. https://app.cochat.ai/papers/10.1177/07356331221132651
- The paper
- Meier, H., & Lepp, M. (2023). Effectiveness of Feedback Based on Log File Analysis in Introductory Programming Courses. Journal of Educational Computing Research. https://doi.org/10.1177/07356331221132651
