Personifying programming tool feedback improves novice programmers' learning
The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Abstract
Many novice programmers view programming tools as all-knowing, infallible authorities about what is right and wrong about code. This misconception is particularly detrimental to beginners, who may view the cold, terse, and often judgmental errors from compilers as a sign of personal failure. It is possible, however, that attributing this failure to the computer, rather than the learner, may improve learners' motivation to program. To test this hypothesis, we present Gidget, a game where the eponymous robot protagonist is cast as a fallible character that blames itself for not being able to correctly write code to complete its missions. Players learn programming by working with Gidget to debug its problematic code. In a two-condition controlled experiment, we manipulated Gidget's level of personification in: communication style, sound effects, and image. We tested our game with 116 self-described novice programmers recruited on Amazon's Mechanical Turk and found that, when given the option to quit at any time, those in the experimental condition (with a personable Gidget) completed significantly more levels in a similar amount of time. Participants in the control and experimental groups played the game for an average time of 39.4 minutes (SD=34.3) and 50.1 minutes (SD=42.6) respectively. These finding suggest that how programming tool feedback is portrayed to learners can have a significant impact on motivation to program and learning success.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
(1985) · Medical Entomology and Zoology · Cited by 19,180
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
(1980) · Medical Entomology and Zoology · Cited by 7,534
(1999) · Cited by 6,308
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
The Scratch Programming Language and Environment
Maloney, J., Resnick, M., Rusk, N., Silverman, B., & Eastmond, E. (2010) · ACM Transactions on Computing Education · doi:10.1145/1868358.1868363 · Cited by 1,410
Who are the crowdworkers?: shifting demographics in mechanical turk
Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., & Tomlinson, B. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1753873 · Cited by 1,004
Kelleher, C., & Pausch, R. (2005) · ACM Computing Surveys · doi:10.1145/1089733.1089734 · Cited by 886
Research works printed but not linked: 5
- Begel A., 1996, MIT.
- Harel I., 1991, N.J.
- 10.5555/795687.797801 · doi:10.5555/795687.797801
- 10.1037/0033-2909.109.2.297 · doi:10.1037/0033-2909.109.2.297 · Paper page
- Tanimoto S., 1986, Play: an iconic programming system for children. Visual Programming Environments, 367--377
Cited by
GenderMag: A Method for Evaluating Software's Gender Inclusiveness
Burnett, M., Stumpf, S., Macbeth, J., Makri, S., Beckwith, L., Kwan, I., Peters, A., & Jernigan, W. (2016) · Interacting with Computers · doi:10.1093/iwc/iwv046 · Cited by 293
Prather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., & Santos, E. A. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3617367 · Cited by 256
“Novices tend to view feedback in programming contexts to be the truth and the systems generating it to be infallible [46].”
BackgroundLearner-Centered Design of Computing Education: Research on Computing for Everyone
Guzdial, M. (2015) · Synthesis lectures on human-centered informatics · doi:10.2200/s00684ed1v01y201511hci033 · Cited by 244
Becker, B. A., Denny, P., Pettit, R., Bouchard, D., Bouvier, D. J., Harrington, B., Kamil, A., Karkare, A., McDonald, C., Osera, P.-M., et al. (2019) · Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3344429.3372508 · Cited by 199
An application of adaptive games-based learning based on learning style to teach SQL
Soflano, M., Connolly, T. M., & Hainey, T. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.03.015 · Cited by 191
Lindberg, R. S. N., Laine, T. H., & Haaranen, L. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12685 · Cited by 140
Metacognitive Difficulties Faced by Novice Programmers in Automated Assessment Tools
Prather, J., Pettit, R., McMurry, K., Peters, A., Homer, J., & Cohen, M. (2018) · Proceedings of the 2018 ACM Conference on International Computing Education Research · doi:10.1145/3230977.3230981 · Cited by 129
Teaching Problem Solving Skills using an Educational Game in a Computer Programming Course
MATHEW, R., MALIK, S. I., & TAWAFAK, R. M. (2019) · Informatics in Education · doi:10.15388/infedu.2019.17 · Cited by 129
Principles of a debugging-first puzzle game for computing education
Lee, M. J., Bahmani, F., Kwan, I., LaFerte, J., Charters, P., Horvath, A., Luor, F., Cao, J., Law, C., Beswetherick, M., et al. (2014) · 2014 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2014.6883023 · Cited by 117
Self-citationMarwan, S., Gao, G., Fisk, S., Price, T. W., & Barnes, T. (2020) · Proceedings of the 2020 ACM Conference on International Computing Education Research · doi:10.1145/3372782.3406264 · Cited by 114
From Gender Biases to Gender-Inclusive Design: An Empirical Investigation
Vorvoreanu, M., Zhang, L., Huang, Y.-H., Hilderbrand, C., Steine-Hanson, Z., & Burnett, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300283 · Cited by 113
In-game assessments increase novice programmers' engagement and level completion speed
Lee, M. J., Ko, A. J., & Kwan, I. (2013) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2493394.2493410 · Cited by 110
Self-citationComparing the Effectiveness of Online Learning Approaches on CS1 Learning Outcomes
Lee, M. J., & Ko, A. J. (2015) · Proceedings of the eleventh annual International Conference on International Computing Education Research · doi:10.1145/2787622.2787709 · Cited by 109
Self-citationDruga, S., & Ko, A. J. (2021) · Interaction Design and Children · doi:10.1145/3459990.3460712 · Cited by 108
Self-citationFinding Gender-Inclusiveness Software Issues with GenderMag: A Field Investigation
Burnett, M., Peters, A., Hill, C., & Elarief, N. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858274 · Cited by 101
A Pedagogical Analysis of Online Coding Tutorials
Kim, A. S., & Ko, A. J. (2017) · Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education · doi:10.1145/3017680.3017728 · Cited by 98
Self-citationA review of games designed to improve introductory computer programming competencies
Vahldick, A., Mendes, A. J., & Marcelino, M. J. (2014) · 2014 IEEE Frontiers in Education Conference (FIE) Proceedings · doi:10.1109/fie.2014.7044114 · Cited by 94
Master Maker: Understanding Gaming Skill Through Practice and Habit From Gameplay Behavior
Huang, J. J. S., Yan, E., Cheung, G. K., Nagappan, N., & Zimmermann, T. (2017) · Topics in Cognitive Science · doi:10.1111/tops.12251 · Cited by 82
Charters, P., Lee, M. J., Ko, A. J., & Loksa, D. (2014) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2538862.2538938 · Cited by 78
Self-citationProgramming Paradigms and Beyond
Krishnamurthi, S., & Fisler, K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.014 · Cited by 75
On Novices' Interaction with Compiler Error Messages: A Human Factors Approach
Prather, J., Pettit, R., McMurry, K. H., Peters, A., Homer, J., Simone, N., & Cohen, M. (2017) · Proceedings of the 2017 ACM Conference on International Computing Education Research · doi:10.1145/3105726.3106169 · Cited by 72
Designing Educational Games for Computer Programming: A Holistic Framework.
Malliarakis, C., Satratzemi, M., & Xinogalos, S. (2014) · The Electronic Journal of e-Learning · Cited by 68
How Beginning Programmers and Code LLMs (Mis)read Each Other
Nguyen, S., Babe, H. M., Zi, Y., Guha, A., Anderson, C. J., & Feldman, M. Q. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642706 · Cited by 66
Investigating the role of purposeful goals on novices' engagement in a programming game
Lee, M. J., & Ko, A. J. (2012) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2012.6344507 · Cited by 66
Self-citationKazimoglu, C. (2020) · IEEE Access · doi:10.1109/access.2020.3043278 · Cited by 62
“The findings obtained from this study are complementary to the results of the previous work [34], [62], [76] that is a) game-play can be used to enhance students’ motivation for learning programming [41], [91] and b) game-play can inspire students’ confidence and learning experience of CT skills…”
BackgroundResultOn Designing Programming Error Messages for Novices: Readability and its Constituent Factors
Denny, P., Prather, J., Becker, B. A., Mooney, C., Homer, J., Albrecht, Z. C., & Powell, G. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445696 · Cited by 60
“Student frustration is exacerbated because such feedback is provided regardless of whether an instructor is present and comes from a machine that many novices see as infallible [36].”
BackgroundCodepourri: Creating visual coding tutorials using a volunteer crowd of learners
Gordon, M., & Guo, P. J. (2015) · 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2015.7357193 · Cited by 60
Learning style analysis in adaptive GBL application to teach SQL
Soflano, M., Connolly, T. M., & Hainey, T. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.02.009 · Cited by 56
Game Development for Computer Science Education
Johnson, C., McGill, M. M., Bouchard, D., Bradshaw, M. K., Bucheli, V., Merkle, L. D., Scott, M., Sweedyk, Z., Velázquez‐Iturbide, J. Á., Xiao, Z., et al. (2016) · doi:10.1145/3024906.3024908 · Cited by 52
Using collaborative learning scenarios to teach programming to non‐CS majors
Echeverría, L., Cobos, R., Villegas, L. E. M., & Claros, I. D. (2017) · Computer Applications in Engineering Education · doi:10.1002/cae.21832 · Cited by 51
Non-Expert Programmers in the Generative AI Future
Feldman, M. Q., & Anderson, C. J. (2024) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3663384.3663393 · Cited by 51
Trials and Tribulations of Novices Working with the Arduino
DesPortes, K., & DiSalvo, B. J. (2019) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3291279.3339427 · Cited by 50
Educational Games for Teaching Computer Programming
Malliarakis, C., Satratzemi, M., & Xinogalos, S. (2014) · Springer eBooks · doi:10.1007/978-1-4614-6501-0_7 · Cited by 47
Mastering the art of war: how patterns of gameplay influence skill in Halo
Huang, J., Zimmermann, T., Nagapan, N., Harrison, C. L., & Phillips, B. C. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470753 · Cited by 44
Evaluation of a Frame-based Programming Editor
Price, T., Brown, N. C. C., Lipovac, D., Barnes, T. M., & Kölling, M. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960319 · Cited by 44
Student affect in CS1: insights from an easy data collection tool
Haden, P., Parsons, D., Wood, K., & Gasson, J. (2017) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3141880.3141881 · Cited by 42
How Scientists Use Large Language Models to Program
O’Brien, G. E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713668 · Cited by 42
A Game-Based Approach for Teaching Algorithms and Data Structures using Visualizations
Su, S. M., Zhang, E., Denny, P. C., & Giacaman, N. (2021) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3408877.3432520 · Cited by 39
Elucidating STEM Concepts through Generative AI: A Multi-modal Exploration of Analogical ReasoningPreprint
Cao, C., Ding, Z., Lee, G.-G., Jiao, J., Lin, J., & Zhaı, X. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.10454 · Cited by 38
CodeMage: Educational programming environment for beginners
Whittall, S. J., Prashandi, W. A. C., Himasha, G. L. S., Silva, D. I. D., & Suriyawansa, T. K. (2017) · International Conference on Knowledge and Smart Technology · doi:10.1109/kst.2017.7886101 · Cited by 35
Suárez, C. A. P., & Porras, R. E. S. (2015) · Revista Mexicana de Investigación Educativa · Cited by 35
Hint systems may negatively impact performance in educational games
O'Rourke, E., Ballweber, C., & Popovi, Z. (2014) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2556325.2566248 · Cited by 34
CodeSpells: bridging educational language features with industry-standard languages
Esper, S., Foster, S. R., Griswold, W. G., Herrera, C., & Snyder, W. (2014) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2674683.2674684 · Cited by 34
Pensieve: Feedback on Coding Process for Novices
Yan, L., Hu, A., & Piech, C. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287483 · Cited by 32
Toledo, J. A. J., Collazos, C. A., & Sánchez, Ó. R. (2019) · TecnoLógicas · doi:10.22430/22565337.1520 · Cited by 31
Examination of adaptation components in serious games: a systematic review study
Aydın, M., Karal, H., & Nabiyev, V. V. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11462-1 · Cited by 30
Decoding Debugging Instruction: A Systematic Literature Review of Debugging Interventions
Yang, S., Baird, M., O’Rourke, E., Brennan, K., & Schneider, B. (2024) · ACM Transactions on Computing Education · doi:10.1145/3690652 · Cited by 29
Gidget: An online debugging game for learning and engagement in computing education
Lee, M. J. (2014) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2014.6883051 · Cited by 29
Self-citationA principled evaluation for a principled idea garden
Jernigan, W., Horvath, A., Lee, M., Burnett, M., Cuilty, T., Kuttal, S., Peters, A., Kwan, I., Bahmani, F., & Ko, A. (2015) · 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2015.7357222 · Cited by 28
“As Table I shows, P4-Personality and P7-InterruptionStyle have already been isolated for summative investigation in other end-user programming research [25, 33].”
BackgroundMethodSelf-citationTaipalus, T., Grahn, H., & Ghanbari, H. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111034 · Cited by 27
Telescope: Fine-Tuned Discovery of Interactive Web UI Feature Implementation
Hibschman, J., & Zhang, H. (2016) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2984511.2984570 · Cited by 25
Towards a new massive multiplayer online role playing game for introductory programming
Malliarakis, C., Satratzemi, M., & Xinogalos, S. (2013) · Balkan Conference in Informatics · doi:10.1145/2490257.2490284 · Cited by 25
Error messages are classifiers: a process to design and evaluate error messages
Wrenn, J., & Krishnamurthi, S. (2017) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/3133850.3133862 · Cited by 25
Model Driven Software Engineering in Education: A Multi-Case Study on Perception of Tools and UML
Liebel, G., Badreddin, O. B., & Heldal, R. (2017) · IEEE International Conference on Software Engineering Education and Training (CSEE&T) · doi:10.1109/cseet.2017.29 · Cited by 23
Toward an Actionable Socioeconomic-Aware HCIPreprint
Burnett, M., Fallatah, A., Hu, C., Perdriau, C., Mendez, C., Gao, C. X., & Sarma, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.13477 · Cited by 23
Idea Garden: Situated Support for Problem Solving by End-User Programmers
Cao, J., Fleming, S. D., Burnett, M., & Scaffidi, C. (2015) · Interacting with Computers · doi:10.1093/iwc/iwu022 · Cited by 22
Understanding the Effects of Lecturer Intervention on Computer Science Student Behaviour
Szabo, C., Falkner, N., Knutas, A., & Dorodchi, M. (2018) · ITiCSE-WGR · doi:10.1145/3174781.3174787 · Cited by 22
SimTube: Simulating Audience Feedback on Videos using Generative AI and User Personas
Hung, Y., Huang, Y.-C., Su, T.-Y., Lin, Y.-T. R., Cheng, L.-P., Wang, B. K., & Sun, S.-H. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712146 · Cited by 21
Comparison of Learning Programming Between Interactive Computer Tutors and Human Teachers
Shen, R., Wohn, D. Y., & Lee, M. J. (2019) · ACM Global Computing Education Conference (CompEd) · doi:10.1145/3300115.3309506 · Cited by 21
Self-citationLearning Outside the Classroom
Begel, A., & Ko, A. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.027 · Cited by 20
Self-citationGidgetML: an adaptive serious game for enhancing first year programming labs
Miljanovic, M. A., & Bradbury, J. S. (2020) · IEEE/ACM International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) · doi:10.1145/3377814.3381716 · Cited by 20
Predicting abandonment in online coding tutorials
Yan, A., Lee, M. J., & Ko, A. J. (2017) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2017.8103467 · Cited by 19
Self-citationAn Analysis of Middle Grade Teachers' Debugging Pedagogical Content Knowledge
Tsan, J., Weintrop, D., & Franklin, D. M. (2022) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3502718.3524770 · Cited by 18
General principles for a Generalized Idea Garden
Jernigan, W., Horvath, A., Lee, M. J., Burnett, M., Cuilty, T., Kuttal, S. K., Peters, A. N., Kwan, I., Bahmani, F., Ko, A. J., et al. (2017) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2017.04.005 · Cited by 16
Self-citationHow can a social debugging game effectively teach computer programming concepts?
Lee, M. J. (2013) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2493394.2493424 · Cited by 16
Self-citationTowards Assessing the Readability of Programming Error Messages
Becker, B. A., Denny, P. C., Prather, J. E., Pettit, R., Nix, R., & Mooney, C. (2021) · Australasian Computing Education Conference · doi:10.1145/3441636.3442320 · Cited by 15
How Scientists Use Large Language Models to Program
O'Brien, G. (2025) · arXiv · doi:10.48550/arxiv.2502.17348 · Cited by 14
Vasilopoulos, I., & van Schaik, P. (2018) · Journal of Educational Computing Research · doi:10.1177/0735633118781776 · Cited by 14
Designing Intentional Bugs for Learning
Griffin, J. M. (2019) · doi:10.1145/3351287.3351289 · Cited by 13
Immediate Data-Driven Positive Feedback Increases Engagement on Programming Homework for Novices.
Marwan, S., Price, T., Chi, M., & Barnes, T. M. (2020) · Cited by 13
Sensor-Based Interactive Worksheets to Support Guided Scientific Inquiry
Cao, J., Chan, S., Garbett, D., Denny, P. C., Nassani, A., Scholl, P., & Nanayakkara, S. C. (2021) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3459990.3460716 · Cited by 13
Exploring Non-Expert Robot Programming Through Crowdsourcing
van Waveren, S., Carter, E. J., Örnberg, O., & Leite, I. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.646002 · Cited by 13
Lessons Learned From Four Computing Education Crowdsourcing Systems
Pirttinen, N., Denny, P. C., Hellas, A., & Leinonen, J. (2023) · IEEE Access · doi:10.1109/access.2023.3253642 · Cited by 12
Crowdsourcing in Computing Education Research: Case Amazon MTurk
Hellas, A., Zavgorodniaia, A., & Sorva, J. (2020) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3428029.3428062 · Cited by 12
Designing a community to support long-term interest in programming for middle school children
Harms, K. J., Kerr, J. H., Ichinco, M., Santolucito, M., Chuck, A., Koscik, T., Chou, M., & Kelleher, C. L. (2012) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/2307096.2307152 · Cited by 12
Novice programmer errors : analysis and diagnostics
McCall, D. (2016) · Kent Academic Repository (University of Kent) · Cited by 12
Effect of Feedback with Video-based Peer Modeling on Learning and Self-efficacy
Eghterafi, W., Tucker, M. C., Zhang, I., & Son, J. Y. (2022) · Online Learning · doi:10.24059/olj.v26i2.2732 · Cited by 11
How software works: Computational thinking and ethics before CS1
Scott, A., & Barlowe, S. (2016) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2016.7757436 · Cited by 11
McGill, M. M., Johnson, C., Atlas, J., Bouchard, D., Messom, C. H., Pollock, I., & Scott, M. (2018) · doi:10.1145/3174781.3174783 · Cited by 11
Hibschman, J., Gergle, D., O’Rourke, E., & Zhang, H. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3310274 · Cited by 11
Assessment of Computational Thinking – A Croatian Evidence-Centered Design model
Bubica, N., & Boljat, I. (2021) · Informatics in Education · doi:10.15388/infedu.2022.17 · Cited by 11
Value Trace Problems for Code Reading Study in C Programming
Lu, X., Funabiki, N., Kyaw, H. H. S., Htet, E. E., Aung, S. L., & Dim, N. K. (2022) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj070103 · Cited by 11
Towards Understanding Successful Novice Example Use in Blocks-Based Programming
Ichinco, M., Harms, K., & Kelleher, C. (2017) · Journal of Visual Languages and Sentient Systems · doi:10.18293/vlss2017-012 · Cited by 10
Teaching Programming Error Message Understanding
Bouvier, D. J., Lovellette, E., Santos, E. A., Becker, B. A., Dasigi, V. G., Forden, J., Glebova, O., Joshi, S., Kurkovsky, S., & Russell, S. (2024) · doi:10.1145/3598579.3689377 · Cited by 10
A Serious Game to Teach Computing Concepts
Kletenik, D., Salinas, F., Shulman, C., Bergeron, C., & Sturm, D. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-58753-0_23 · Cited by 9
How software users recommend tools to each other
Brown, C., Middleton, J., Sharma, E., & Murphy-Hill, E. R. (2017) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2017.8103460 · Cited by 9
Nnass, I., أ.كاولينج, م., & هادجرافت, ر. (2022) · Journal of Pure & Applied Sciences · doi:10.51984/jopas.v21i4.2258 · Cited by 8
A demonstration of gidget, a debugging game for computing education
Lee, M. J., & Ko, A. J. (2014) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2014.6883060 · Cited by 8
Self-citationSocioEconomicMag Meets a Platform for SES-Diverse College Students: A Case StudyPreprint
Agarwal, P., Prem, D., Bogart, C., Fallatah, A., Castro-Guzman, A. A., Chanpaisaeng, P., Doehring, S., Burnett, M., & Sarma, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.04873 · Cited by 8
Fischer, B., Birk, F. T., Iwer, E.-M., Panitz, S. E., & Dörner, R. (2023) · International Conference on Education Technology and Computer · doi:10.1145/3629296.3629297 · Cited by 7
115 Ways Not to Say Hello, World! Syntax Errors Observed in a Large-Scale Online CS0 Python Course
Jeffries, B., Lee, J. A., & Koprinska, I. (2022) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3502718.3524809 · Cited by 7
Value Trace Problems for Code Reading Study of JavaScript Programming
Mon, K. T., Wai, K. H., Funabiki, N., & Kyaw, H. H. S. (2022) · International Journal of Information and Education Technology · doi:10.18178/ijiet.2022.12.5.1637 · Cited by 7
SIG: Gender-Inclusive Software: What We Know About Building It
Burnett, M., Churchill, E. F., & Lee, M. J. (2015) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2702613.2727689 · Cited by 7
Self-citationToward Theory-Based End-User Software Engineering
Burnett, M., Kulesza, T., Oleson, A., Ernst, S., Beckwith, L., Cao, J., Jernigan, W., & Grigoreanu, V. (2017) · Springer eBooks · doi:10.1007/978-3-319-60291-2_10 · Cited by 7
A Study of Value Trace Problems for Code Reading Study of C Programming
Lu, X., Funabiki, N., Kyaw, H. H. S., Aung, S. L., & Dim, N. K. (2020) · International Symposium on Computing and Networking Workshops (CANDARW) · doi:10.1109/candarw51189.2020.00093 · Cited by 6
Identifying problem solving strategies of programming novices in a serious game
Gamper, P., Heinemann, B., Ehlenz, M., & Schroeder, U. (2021) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt52272.2021.00035 · Cited by 6
Williams, J. S. (2014) · UWM Digital Commons (University of Wisconsin–Milwaukee) · Cited by 6
Annamalai, S., & Salam, S. N. A. (2017) · AIP conference proceedings · doi:10.1063/1.5005362 · Cited by 6
Robo3: A Puzzle Game to Learn Coding
Agalbato, F., & Loiacono, D. (2018) · IEEE Games, Entertainment, Media Conference (GEM) · doi:10.1109/gem.2018.8516515 · Cited by 6
Kanaparan, G. (2016) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17014580 · Cited by 6
Metadata
- Authors
- Lee, M. J., & Ko, A. J.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the seventh international workshop on Computing education research
- Publisher
- ACM
- Published
- 2011-08-08
- Pages
- 109-116
- OpenAlex
- W2146496290
- Cited by
- 125
- References
- 48
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 5 · 2023: 8 · 2022: 9 · 2021: 9 · 2020: 8 · 2019: 14 · 2018: 7 · 2017: 16 · 2016: 7 · 2015: 13 · 2014: 11 · 2013: 8 · 2012: 4
- FWCI
- 6.14
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on International Computing Education Research (ICER) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- personification, novice programmers, game-based learning, developer motivation, compiler error messages, failure attribution, programming education, game design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.