Personifying programming tool feedback improves novice programmers' learning
The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Abstract
Many novice programmers view programming tools as all-knowing, infallible authorities about what is right and wrong about code. This misconception is particularly detrimental to beginners, who may view the cold, terse, and often judgmental errors from compilers as a sign of personal failure. It is possible, however, that attributing this failure to the computer, rather than the learner, may improve learners' motivation to program. To test this hypothesis, we present Gidget, a game where the eponymous robot protagonist is cast as a fallible character that blames itself for not being able to correctly write code to complete its missions. Players learn programming by working with Gidget to debug its problematic code. In a two-condition controlled experiment, we manipulated Gidget's level of personification in: communication style, sound effects, and image. We tested our game with 116 self-described novice programmers recruited on Amazon's Mechanical Turk and found that, when given the option to quit at any time, those in the experimental condition (with a personable Gidget) completed significantly more levels in a similar amount of time. Participants in the control and experimental groups played the game for an average time of 39.4 minutes (SD=34.3) and 50.1 minutes (SD=42.6) respectively. These finding suggest that how programming tool feedback is portrayed to learners can have a significant impact on motivation to program and learning success.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
(1985) · Medical Entomology and Zoology · Cited by 19,180
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
(1980) · Medical Entomology and Zoology · Cited by 7,534
(1999) · Cited by 6,308
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
The Scratch Programming Language and Environment
Maloney, J., Resnick, M., Rusk, N., Silverman, B., & Eastmond, E. (2010) · ACM Transactions on Computing Education · doi:10.1145/1868358.1868363 · Cited by 1,410
Who are the crowdworkers?: shifting demographics in mechanical turk
Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., & Tomlinson, B. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1753873 · Cited by 1,004
Kelleher, C., & Pausch, R. (2005) · ACM Computing Surveys · doi:10.1145/1089733.1089734 · Cited by 886
Research works printed but not linked: 5
- Begel A., 1996, MIT.
- Harel I., 1991, N.J.
- 10.5555/795687.797801 · doi:10.5555/795687.797801
- 10.1037/0033-2909.109.2.297 · doi:10.1037/0033-2909.109.2.297 · Paper page
- Tanimoto S., 1986, Play: an iconic programming system for children. Visual Programming Environments, 367--377
Cited by
Items 101–160 of 160
Wordplay: Accessible, Multilingual, Interactive Typography
Ko, A. J., Lira, C. A., & Amaya, I. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713196 · Cited by 5
Self-citationMeasuring SES-related traits relating to technology usage: Two validated surveys
Chikezie, C., Chanpaisaeng, P., Agarwal, P., Afroz, S., Madhwani, B., Choudhuri, R., Anderson, A. W., Velhal, P., Morreale, P. A., Bogart, C., et al. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10683-5 · Cited by 5
Learning Personality Modeling for Regulating Learning Feedback
Shun, M. C. Y., Yan, M. C., Shen, Z., & An, B. (2015) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2015.118 · Cited by 5
Multimedia System for Self-learning C/C++ Programming Language
Galindo, J., Galindo, P., & Corral, J. M. R. (2019) · Learning and analytics in intelligent systems · doi:10.1007/978-3-030-36778-7_7 · Cited by 4
Engineering Adaptive Serious Games Using Machine Learning
Miljanovic, M. A., & Bradbury, J. S. (2023) · Springer eBooks · doi:10.1007/978-3-031-33338-5_6 · Cited by 3
An automatic feedback model for learning programming via block‐based programming platforms
Çakıroğlu, Ü., & Mumcu, S. (2023) · Computer Applications in Engineering Education · doi:10.1002/cae.22652 · Cited by 3
Hillon-Salgado, D. F., Fierro, W. A. G., & Mosquera, J. J. M. (2022) · Academic Journal of Interdisciplinary Studies · doi:10.36941/ajis-2022-0064 · Cited by 3
Using Program Visualization to Illuminate the Notional Machine.
Juett, J. A. (2016) · Deep Blue (University of Michigan) · Cited by 3
Beyond Automated Assessment: Building Metacognitive Awareness in Novice Programmers in CS1
Prather, J. E. (2018) · NSUWorks (Nova Southeastern University) · Cited by 3
TEACHING COMPUTER PROGRAMMING FOR INDUSTRIAL ENGINEERING WITHOUT TEACHER
Galindo, J., & Galindo, P. (2019) · doi:10.20472/tec.2019.007.005 · Cited by 2
Hainey, T., Soflano, M., & Connolly, T. M. (2015) · IGI Global eBooks · doi:10.4018/978-1-4666-8200-9.ch068 · Cited by 2
Visual debugging technology with pencil code: Position paper
Boss, A., Stenson, C., & Ruten, J. (2015) · IEEE Blocks and Beyond Workshop (B&B) · doi:10.1109/blocks.2015.7369017 · Cited by 2
Strengthening Computer and Mathematical Sciences Engagement and Learning
Bhattacharya, S., Okunbor, D. I., Sarami, C., Gillespie, P., & Nickolov, R. Z. (2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-78743-405-920191015 · Cited by 2
Foster, S. R. (2015) · eScholarship (California Digital Library) · Cited by 2
Construção e uso de ambiente visual para o ensino de programação introdutória
Ribeiro, R. D. S. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.45.2019.tde-09102019-165810 · Cited by 2
MatlabTA: A Style Critiquer For Novice Engineering Students
Walther, M. L. (2020) · Digital Commons - Michigan Tech (Michigan Technological University) · doi:10.37099/mtu.dc.etdr/981 · Cited by 2
Raab, M. (2017) · reposiTUm (TU Wien) · doi:10.34726/hss.2017.48840 · Cited by 2
Bruckman Vargas, H. F. (2021) · NSUWorks (Nova Southeastern University) · Cited by 2
HAWK/KW: An Online System for Studying Dyslexic Children’s Reading, Writing, and Programming
Thompson, R. H. (2019) · ResearchWorks at the University of Washington (University of Washington) · Cited by 2
Adaptive serious games for computer science education
Miljanovic, M. A. (2020) · e-scholar@UOIT (University of Ontario Institute of Technology) · Cited by 2
The Impact of Guidance and Feedback in Game-Based Computational Thinking Environments
Manske, S., Feier, A., Frese, P., Hölzel, P., Rodriguez, M. I., Körner, J., Lichte, A., de Mentock, L. O. L. O., Kocak, M., Szymczyk, N., et al. (2021) · Universitätsbibliographie, Universität Duisburg-Essen · Cited by 1
Qian, Y., & Wu, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3454643 · Cited by 1
النعاس, ا. ا. ا., زيدان, ع. ي., Nnass, I., & Zaydan, A. Y. (2025) · Sebha University Conference Proceedings · doi:10.51984/sucp.v4i3.4280 · Cited by 1
Social debugging game for learning & engagement
Lee, M. J. (2012) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2012.6344526 · Cited by 1
Self-citationScott, M. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502209 · Cited by 1
Using Music Notation for Teaching Computer Programming
Ko, E., & Lee, K. (2013) · International Conference on Computers in Education · doi:10.58459/icce.2013.513 · Cited by 1
A feasibility study on using clustering algorithms in programming education research
Ahmadzadeh, M., & Mahmoudabadi, E. (2012) · Conference on Information Technology Education · doi:10.1145/2380552.2380596 · Cited by 1
Hainey, T., Soflano, M., & Connolly, T. M. (2013) · Advances in game-based learning book series · doi:10.4018/978-1-4666-4773-2.ch013 · Cited by 1
Teaching C/C ++ programming using a multimedia system with videos
Galindo, J. Á., Galindo, P., & Corral, J. M. R. (2019) · Institutional Repository of the University of Granada (University of Granada) · Cited by 1
A Game-Changing Instructor Tool to Reinforce Coding Concepts
Kletenik, D., & Sturm, D. (2020) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3328778.3372610 · Cited by 1
Mind the Error Message: An Inverted Quiz Format to Direct Learner's Attention to Error Messages
Tsunoda, K., Masuhara, H., & Cong, Y. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3587102.3588823 · Cited by 1
Watanabe, K., Kücük, H. K., Gonzales, S., Vargo, A. W., Kise, K., & Ishimaru, S. (2023) · Asian HCI Symposium · doi:10.1145/3604571.3604575 · Cited by 1
Tabarsi, B. T., Reichert, H., Qualls, R., Price, T., & Barnes, T. M. (2023) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc57772.2023.00029 · Cited by 1
Self-beliefs in the introductory programming lab and game-based fantasy role-play
Scott, M. (2015) · Falmouth University Research Repository (FURR) (Falmouth University) · Cited by 1
Waheed, L. (2018) · eSpace (Curtin University) · Cited by 1
Day, N. M. (2019) · Bucks New University Repository (Bucks New University) · Cited by 1
Suh, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.00464 · Cited by 1
Idea garden tuning and generalization
Bahmani, F. (2013) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2013.6645272
Extracting Student Motivation Factors in Education with Contextual Inquiry
Takahashi, W., Harada, F., Shimakawa, H., & Koyama, T. (2013) · Journal of Automation and Control Engineering · doi:10.12720/joace.1.3.208-212
Building Compiler-Student Friendship
Liu, Z., & Barnes, T. M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_129
Ghaed, Z. (2017) · VTechWorks (Virginia Tech)
Vahldick, A. (2018) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Making Python easier to learn with improved syntax error reporting
Briasco-Stewart, S. (2018) · DSpace@MIT (Massachusetts Institute of Technology)
Understanding the doer effect for computational subjects with MOOCs
Maiyuran, J. (2018) · DSpace@MIT (Massachusetts Institute of Technology)
Syntaksivirheilmoitusten koettu hyödyllisyys MySQL- ja PostgreSQL-tietokannanhallintajärjestelmissä
Kadenius, T. (2020) · Jyväskylä University Digital Archive (University of Jyväskylä)
Multi-Touch Mobile Devices as Toys - Creating and Prototyping a Digital Tool for Play
Campos, F. C. D. A. (2012) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/q1zr-rk08
openHTML: assessing barriers and designing tools for learning web development
Park, T. H., & Forte, A. (2014) · iDEA - Drexel University Institutional Repository · doi:10.17918/etd-6098
Rice, M. F. (2022) · Online Learning · doi:10.24059/olj.v26i2.3442
Javora - A Serious Game about the Fundamentals of Java Programming
Ahmed, R., Eichhorn, C., & Plecher, D. A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92578-8_18
Generate elaborative feedback for novices’ programming exercises based on interaction data
Tolzmann, J. (2023) · RWTH Publications (RWTH Aachen) · doi:10.18154/rwth-2023-10933
Error Injection in specification-based configurations
Zronek, M. (2020) · reposiTUm (TU Wien) · doi:10.34726/hss.2020.59100
Nnass, I. (2020) · Acquire (CQUniversity) · doi:10.25946/13406825
Suárez, C. A. P. (2014) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Aguasanta Regalado, M. E., & Fernández, I. M. G. (2020) · Repository of Digital Objects for Teaching Research and Culture (University of Valencia)
Ohjelmoinnin opiskelu verkossa
Peltonen, S. (2017) · Jyväskylä University Digital Archive (University of Jyväskylä)
KHIN THET MON (2024) · Institutional Repositories DataBase (IRDB) · doi:10.18926/67129
Functional Interruption Management Systems
Sheth, C. (2025) · MacSphere (McMaster University) · doi:10.71548/13679
Leveraging a Large Language Model to Enhance Motivation in Learning Programming Languages
Ichimura, E., & Kamba, T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13184-3_22
Art Card Game (ACG): Embedding Illustration in Gameplay to Mitigate Artist Self-Criticism
Mullings, C. A., & Bernstein, M. S. (2026) · Creativity and Cognition · doi:10.1145/3803784.3807547
"It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers
Prather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., & Santos, E. A. (2023) · arXiv
“Novices tend to view feedback in programming contexts to be the truth and the systems generating it to be infallible [46].”
Background
Metadata
- Authors
- Lee, M. J., & Ko, A. J.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the seventh international workshop on Computing education research
- Publisher
- ACM
- Published
- 2011-08-08
- Pages
- 109-116
- OpenAlex
- W2146496290
- Cited by
- 125
- References
- 48
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 5 · 2023: 8 · 2022: 9 · 2021: 9 · 2020: 8 · 2019: 14 · 2018: 7 · 2017: 16 · 2016: 7 · 2015: 13 · 2014: 11 · 2013: 8 · 2012: 4
- FWCI
- 6.14
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on International Computing Education Research (ICER) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- personification, novice programmers, game-based learning, developer motivation, compiler error messages, failure attribution, programming education, game design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.