Personifying programming tool feedback improves novice programmers' learning
The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Abstract
Many novice programmers view programming tools as all-knowing, infallible authorities about what is right and wrong about code. This misconception is particularly detrimental to beginners, who may view the cold, terse, and often judgmental errors from compilers as a sign of personal failure. It is possible, however, that attributing this failure to the computer, rather than the learner, may improve learners' motivation to program. To test this hypothesis, we present Gidget, a game where the eponymous robot protagonist is cast as a fallible character that blames itself for not being able to correctly write code to complete its missions. Players learn programming by working with Gidget to debug its problematic code. In a two-condition controlled experiment, we manipulated Gidget's level of personification in: communication style, sound effects, and image. We tested our game with 116 self-described novice programmers recruited on Amazon's Mechanical Turk and found that, when given the option to quit at any time, those in the experimental condition (with a personable Gidget) completed significantly more levels in a similar amount of time. Participants in the control and experimental groups played the game for an average time of 39.4 minutes (SD=34.3) and 50.1 minutes (SD=42.6) respectively. These finding suggest that how programming tool feedback is portrayed to learners can have a significant impact on motivation to program and learning success.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
(1985) · Medical Entomology and Zoology · Cited by 19,180
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
(1980) · Medical Entomology and Zoology · Cited by 7,534
(1999) · Cited by 6,308
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
The Scratch Programming Language and Environment
Maloney, J., Resnick, M., Rusk, N., Silverman, B., & Eastmond, E. (2010) · ACM Transactions on Computing Education · doi:10.1145/1868358.1868363 · Cited by 1,410
Who are the crowdworkers?: shifting demographics in mechanical turk
Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., & Tomlinson, B. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1753873 · Cited by 1,004
Kelleher, C., & Pausch, R. (2005) · ACM Computing Surveys · doi:10.1145/1089733.1089734 · Cited by 886
Amazon Mechanical Turk: Gold Mine or Coal Mine?
Fort, K., Adda, G., & Cohen, K. B. (2011) · Computational Linguistics · doi:10.1162/coli_a_00057 · Cited by 761
Six Learning Barriers in End-User Programming Systems
Ko, A. J., Myers, B. A., & Aung, H. H. (2004) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.47 · Cited by 549
Self-citationNass, C., Fogg, B. J., & Moon, Y. (1996) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1996.0073 · Cited by 536
Storytelling alice motivates middle school girls to learn computer programming
Kelleher, C., Pausch, R., & Kiesler, S. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240844 · Cited by 505
Are your participants gaming the system?: screening mechanical turk workers
Downs, J. S., Holbrook, M. B., Sheng, S., & Cranor, L. F. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753688 · Cited by 418
Children, Computers, and Powerful Ideas.
Bull, G. L. (2005) · Contemporary issues in technology and teacher education · Cited by 395
The effects of pair-programming on performance in an introductory programming course
McDowell, C., Werner, L., Bullock, H., & Fernald, J. (2002) · Proceedings of the 33rd SIGCSE technical symposium on Computer science education · doi:10.1145/563340.563353 · Cited by 352
Programmable Bricks: Toys to think with
Resnick, M., Martin, F., Sargent, R., & Silverman, B. (1996) · IBM Systems Journal · doi:10.1147/sj.353.0443 · Cited by 332
Moose crossing: construction, community, and learning in a networked virtual world for kids
Bruckman, A. S., & Resnick, M. (1997) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 322
The Development and Validation of the Feedback Orientation Scale (FOS)
Linderbaum, B. A., & Levy, P. E. (2010) · Journal of Management · doi:10.1177/0149206310373145 · Cited by 283
Gender and the influence of evaluations on self-assessments in achievement settings.
Roberts, T.-A. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.109.2.297 · Cited by 256
Debugging: finding, fixing and flailing, a multi-institutional study of novice debuggers
Fitzgerald, S., Lewandowski, G., McCauley, R., Murphy, L., Simon, B., Thomas, L., & Zander, C. (2008) · Computer Science Education · doi:10.1080/08993400802114508 · Cited by 206
Papert, S. (1982) · Birkhäuser Basel eBooks · doi:10.1007/978-3-0348-5357-6 · Cited by 203
Extreme apprenticeship method in teaching programming for beginners
Vihavainen, A., Paksula, M., & Luukkainen, M. (2011) · Proceedings of the 42nd ACM technical symposium on Computer science education · doi:10.1145/1953163.1953196 · Cited by 176
Gershenfeld, N. (1991) · University of Michigan Library Repository · Cited by 176
Experiencing programming assignments in CS1: the emotional toll
Kinnunen, P., & Simon, B. (2010) · Proceedings of the Sixth international workshop on Computing education research · doi:10.1145/1839594.1839609 · Cited by 156 · cited 2×
“While all of these forms of feedback are essential to helping a beginner understand what programs are and how computers interpret them, the experience can be quite discouraging [28,29] and emotional [25].”
BackgroundHow users reciprocate to computers: an experiment that demonstrates behavior change
Fogg, B., & Nass, C. (1997) · CHI '97 extended abstracts on Human factors in computing systems looking to the future - CHI '97 · doi:10.1145/1120212.1120419 · Cited by 131
Using HCI techniques to design a more usable programming system
Pane, J. F., Myers, B. A., & Miller, L. (2003) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/hcc.2002.1046372 · Cited by 131
Programming by example: novice programming comes of age
Smith, D. C., Cypher, A., & Tesler, L. (2000) · Communications of the ACM · doi:10.1145/330534.330544 · Cited by 102
Game2Learn: building CS1 learning games for retention
Barnes, T. M., Richter, H., Powell, E., Chaffin, A., & Godwin, A. (2007) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1268784.1268821 · Cited by 98
LogoBlocks: A Graphical Programming Language for Interacting with the World
Begel, A., & Resnick, M. (2000) · Cited by 89
Dangers of a fixed mindset: implications of self-theories research for computer science education
Murphy, L., & Thomas, L. (2008) · Proceedings of the 13th annual conference on Innovation and technology in computer science education · doi:10.1145/1384271.1384344 · Cited by 79
This computer responds to user frustration
Klein, J., Moon, Y., & Picard, R. W. (1999) · CHI '99 extended abstracts on Human factors in computing systems - CHI '99 · doi:10.1145/632716.632866 · Cited by 75
Why pay?: exploring how financial incentives are used for question & answer
Hsieh, G., Kraut, R. E., & Hudson, S. E. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753373 · Cited by 73
The effects of pair-programming on individual programming skill
Braught, G., Eby, L. M., & Wahls, T. (2008) · Proceedings of the 39th SIGCSE technical symposium on Computer science education · doi:10.1145/1352135.1352207 · Cited by 64
"Georgia computes!": improving the computing education pipeline
Bruckman, A., Biggers, M., Ericson, B., McKlin, T., Dimond, J., DiSalvo, B., Hewner, M., Ni, L., & Yardi, S. (2009) · Proceedings of the 40th ACM technical symposium on Computer science education · doi:10.1145/1508865.1508899 · Cited by 64
The effects of sensitivity to criticism on motivation and performance in music students
Atlas, G. D., Taggart, T., & Goodell, D. J. (2004) · British Journal of Music Education · doi:10.1017/s0265051703005540 · Cited by 53
Playground: an object-oriented simulation system with agent rules for children of all ages
Fenton, J., & Beck, K. E. (1989) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/74877.74891 · Cited by 43
Non-programmers identifying functionality in unfamiliar code: strategies and barriers
Gross, P., & Kelleher, C. L. (2010) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2010.08.002 · Cited by 36
Toque: designing a cooking-based programming language for and with children
Tarkan, S., Sazawal, V., Druin, A., Golub, E., Bonsignore, E. M., Walsh, G., & Atrash, Z. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753692 · Cited by 35
Pair debugging: a transactive discourse analysis
Murphy, L., Fitzgerald, S., Hanks, B., & McCauley, R. (2010) · Proceedings of the Sixth international workshop on Computing education research · doi:10.1145/1839594.1839604 · Cited by 34
Lessons from a course on serious games research and prototyping
Chaffin, A., & Barnes, T. M. (2010) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/1822348.1822353 · Cited by 34
BeadLoom Game: using game elements to increase motivation and learning
Boyce, A., & Barnes, T. M. (2010) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/1822348.1822352 · Cited by 28
Reasoning about many-to-many requirement relationships in spreadsheets
Beckwith, L., Burnett, M., & Cook, C. (2003) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/hcc.2002.1046367 · Cited by 19
Attitudes and self-efficacy in young adults' computing autobiographies
Ko, A. J. (2009) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2009.5295297 · Cited by 19
Self-citationApproximate Learning for Structured Prediction Problems
Kulesza, A. (2009) · Cited by 5
Thomas, A. R. (2007) · Journal of Educational Administration · doi:10.1108/jea.2007.07445eaa.001 · Cited by 1
Research works printed but not linked: 5
- Begel A., 1996, MIT.
- Harel I., 1991, N.J.
- 10.5555/795687.797801 · doi:10.5555/795687.797801
- 10.1037/0033-2909.109.2.297 · doi:10.1037/0033-2909.109.2.297 · Paper page
- Tanimoto S., 1986, Play: an iconic programming system for children. Visual Programming Environments, 367--377
Cited by
GenderMag: A Method for Evaluating Software's Gender Inclusiveness
Burnett, M., Stumpf, S., Macbeth, J., Makri, S., Beckwith, L., Kwan, I., Peters, A., & Jernigan, W. (2016) · Interacting with Computers · doi:10.1093/iwc/iwv046 · Cited by 293
Prather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., & Santos, E. A. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3617367 · Cited by 256
“Novices tend to view feedback in programming contexts to be the truth and the systems generating it to be infallible [46].”
BackgroundLearner-Centered Design of Computing Education: Research on Computing for Everyone
Guzdial, M. (2015) · Synthesis lectures on human-centered informatics · doi:10.2200/s00684ed1v01y201511hci033 · Cited by 244
Becker, B. A., Denny, P., Pettit, R., Bouchard, D., Bouvier, D. J., Harrington, B., Kamil, A., Karkare, A., McDonald, C., Osera, P.-M., et al. (2019) · Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3344429.3372508 · Cited by 199
An application of adaptive games-based learning based on learning style to teach SQL
Soflano, M., Connolly, T. M., & Hainey, T. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.03.015 · Cited by 191
Metadata
- Authors
- Lee, M. J., & Ko, A. J.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the seventh international workshop on Computing education research
- Publisher
- ACM
- Published
- 2011-08-08
- Pages
- 109-116
- OpenAlex
- W2146496290
- Cited by
- 125
- References
- 48
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 5 · 2023: 8 · 2022: 9 · 2021: 9 · 2020: 8 · 2019: 14 · 2018: 7 · 2017: 16 · 2016: 7 · 2015: 13 · 2014: 11 · 2013: 8 · 2012: 4
- FWCI
- 6.14
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on International Computing Education Research (ICER) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- personification, novice programmers, game-based learning, developer motivation, compiler error messages, failure attribution, programming education, game design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.