The DOI matches its Crossref record; 127 of the 127 references it cites were found in a registry or an index.
A Review of Generic Program Visualization Systems for Introductory Programming Education
Abstract
This article is a survey of program visualization systems intended for teaching beginners about the runtime behavior of computer programs. Our focus is on generic systems that are capable of illustrating many kinds of programs and behaviors. We inclusively describe such systems from the last three decades and review findings from their empirical evaluations. A comparable review on the topic does not previously exist; ours is intended to serve as a reference for the creators, evaluators, and users of educational program visualization systems. Moreover, we revisit the issue of learner engagement which has been identified as a potentially key factor in the success of educational software visualization and summarize what little is known about engagement in the context of the generic program visualization systems for beginners that we have reviewed; a proposed refinement of the frameworks previously used by computing education researchers to rank types of learner engagement is a side product of this effort. Overall, our review illustrates that program visualization systems for beginners are often short-lived research prototypes that support the user-controlled viewing of program animations; a recent trend is to support more engaging modes of user interaction. The results of evaluations largely support the use of program visualization in introductory programming education, but research to date is insufficient for drawing more nuanced conclusions with respect to learner engagement. On the basis of our review, we identify interesting questions to answer for future research in relation to themes such as engagement, the authenticity of learning tasks, cognitive load, and the integration of program visualization into introductory programming pedagogy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2001) · Cited by 13,930
Mayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
(1980) · Medical Entomology and Zoology · Cited by 7,534
The Cambridge handbook of multimedia learning
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5643 · Cited by 2,313
Department of Computer Science
(1993) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(93)90083-n · Cited by 1,210
Watch what I do: programming by demonstration
Cypher, A., Halbert, D. C., Kurlander, D., Lieberman, H. A., Maulsby, D., Myers, B. A., & Turransky, A. (1993) · Medical Entomology and Zoology · Cited by 1,027
Kelleher, C., & Pausch, R. (2005) · ACM Computing Surveys · doi:10.1145/1089733.1089734 · Cited by 886
A study of the difficulties of novice programmers
Lahtinen, E., Ala-Mutka, K., & Järvinen, H.-M. (2005) · Proceedings of the 10th annual SIGCSE conference on Innovation and technology in computer science education · doi:10.1145/1067445.1067453 · Cited by 827
A Meta-Study of Algorithm Visualization Effectiveness
HUNDHAUSEN, C. D., DOUGLAS, S. A., & STASKO, J. T. (2002) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.2002.0237 · Cited by 719
Some Difficulties of Learning to Program
Du Boulay, B. (1986) · Journal of Educational Computing Research · doi:10.2190/3lfx-9rrf-67t8-uvk9 · Cited by 648
Exploring the role of visualization and engagement in computer science education
Naps, T. L., Rößling, G., Almstrum, V., Dann, W., Fleischer, R., Hundhausen, C., Korhonen, A., Malmi, L., McNally, M., Rodger, S., et al. (2003) · ACM SIGCSE Bulletin · doi:10.1145/782941.782998 · Cited by 641
Self-citationConstructivism in computer science education
Ben-Ari, M. (1998) · ACM SIGCSE Bulletin · doi:10.1145/274790.274308 · Cited by 629
(2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511844744 · Cited by 575
A multi-national study of reading and tracing skills in novice programmers
Lister, R., Adams, E. S., Fitzgerald, S., Fone, W., Hamer, J., Lindholm, M., McCartney, R., Moström, J. E., Sanders, K., Seppälä, O., et al. (2004) · ACM SIGCSE Bulletin · doi:10.1145/1041624.1041673 · Cited by 575
ELM-ART: An Adaptive Versatile System for Web-Based Instruction
Weber, G., & Brusilovsky, P. L. (2001) · Cited by 542
Why looking isn't always seeing: readership skills and graphical programming
Petre, M. (1995) · Communications of the ACM · doi:10.1145/203241.203251 · Cited by 537
Taxonomies of visual programming and program visualization
Myers, B. A. (1990) · Journal of Visual Languages & Computing · doi:10.1016/s1045-926x(05)80036-9 · Cited by 482
A survey of literature on the teaching of introductory programming
Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., & Paterson, J. (2007) · ACM SIGCSE Bulletin · doi:10.1145/1345375.1345441 · Cited by 481
Self-citationA Principled Taxonomy of Software Visualization
Price, B. A., Baecker, R. M., & Small, I. S. (1993) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.1993.1015 · Cited by 476
The Psychology of How Novices Learn Computer Programming
Mayer, R. E. (1981) · ACM Computing Surveys · doi:10.1145/356835.356841 · Cited by 450
A study of the difficulties of novice programmers
Lahtinen, E., Ala-Mutka, K., & Järvinen, H.-M. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1151954.1067453 · Cited by 446
Online python tutor: embeddable web-based program visualization for cs education
Guo, P. J. (2013) · Proceeding of the 44th ACM technical symposium on Computer science education · doi:10.1145/2445196.2445368 · Cited by 396
Educational psychologist: (537492009-017)
(2005) · PsycEXTRA Dataset · doi:10.1037/e537492009-017 · Cited by 359
Mindstorms: Children, Computers and Powerful Ideas
Winn, B. (2018) · Journal of Educational Thought / Revue de la Pensée Educative · doi:10.55016/ojs/jet.v18i1.44128 · Cited by 356
DrScheme: a programming environment for Scheme
FINDLER, R. B., CLEMENTS, J., FLANAGAN, C., FLATT, M., KRISHNAMURTHI, S., STECKLER, P., & FELLEISEN, M. (2002) · Journal of Functional Programming · doi:10.1017/s0956796801004208 · Cited by 341
Notional machines and introductory programming education
Sorva, J. (2013) · ACM Transactions on Computing Education · doi:10.1145/2483710.2483713 · Cited by 319
Self-citationLanguage-Independent Conceptual “Bugs” in Novice Programming
Pea, R. D. (1986) · Journal of Educational Computing Research · doi:10.2190/689t-1r2a-x4w4-29j2 · Cited by 317
Difficulties in Learning and Teaching Programming—Views of Students and Tutors
Milne, I., & Rowe, G. (2002) · Education and Information Technologies · doi:10.1023/a:1015362608943 · Cited by 298
Studying the language and structure in non-programmers' solutions to programming problems
PANE, J. F., RATANAMAHATANA, C. “., & MYERS, B. A. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2000.0410 · Cited by 289
The black box inside the glass box: presenting computing concepts to novices
DU BOULAY, B., O'SHEA, T., & MONK, J. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1981.0309 · Cited by 274
Conditions of Learning in Novice Programmers
Perkins, D. N., Hancock, C., Hobbs, R., Martin, F., & Simmons, R. (1986) · Journal of Educational Computing Research · doi:10.2190/gujt-jcbj-q6qu-q9pl · Cited by 262
Visualizing programs with Jeliot 3
Moreno, A., Myller, N., Sutinen, E., & Ben-Ari, M. (2004) · Proceedings of the working conference on Advanced visual interfaces · doi:10.1145/989863.989928 · Cited by 256
Mayer, R. E. (1975) · Journal of Educational Psychology · doi:10.1037/0022-0663.67.6.725 · Cited by 253
The black box inside the glass box: presenting computing concepts to novices
Boulay, B. D., O'Shea, T., & Monk, J. (1981) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(81)80056-9 · Cited by 235
Constructivism in education : opinions and second opinions on controversial issues
Phillips, D. C., & Early, M. (2000) · Medical Entomology and Zoology · Cited by 234
Learning to program: A phenomenographic perspective
Booth, S. (1992) · Gothenburg University Publications Electronic Archive (Gothenburg University) · Cited by 232
Debugging: finding, fixing and flailing, a multi-institutional study of novice debuggers
Fitzgerald, S., Lewandowski, G., McCauley, R., Murphy, L., Simon, B., Thomas, L., & Zander, C. (2008) · Computer Science Education · doi:10.1080/08993400802114508 · Cited by 206
Larochelle, M., Bednarz, N., & Garrison, J. W. (2009) · Cited by 204
Principles of Educational Multimedia User Interface Design
Najjar, L. J. (1998) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779480505 · Cited by 189
Mayer, R. E. (1976) · Journal of Educational Psychology · doi:10.1037/0022-0663.68.2.143 · Cited by 186
What do teachers teach in introductory programming?
Schulte, C., & Bennedsen, J. (2006) · Proceedings of the second international workshop on Computing education research · doi:10.1145/1151588.1151593 · Cited by 181
Natural language programming: Styles, strategies, and contrasts
Miller, L. A. (1981) · IBM Systems Journal · doi:10.1147/sj.202.0184 · Cited by 178
A long-term investigation of the comprehension of OOP concepts by novices
Ragonis, N., & Ben-Ari, M. (2005) · Computer Science Education · doi:10.1080/08993400500224310 · Cited by 171
Novice Java programmers' conceptions of "object" and "class", and variation theory
Eckerdal, A., & Thuné, M. (2005) · Proceedings of the 10th annual SIGCSE conference on Innovation and technology in computer science education · doi:10.1145/1067445.1067473 · Cited by 161
Department of Mathematics and Computer Science
Kuhr, S. (2002) · Cited by 159
Antagonism Between Achievement and Enjoyment in ATI Studies
Clark, R. E. (1982) · Educational Psychologist · doi:10.1080/00461528209529247 · Cited by 157
A taxonomy of program visualization systems
Roman, G.-C., & Cox, K. C. (1993) · Computer · doi:10.1109/2.247643 · Cited by 151
Goldman, K., Gross, P., Heeren, C., Herman, G. L., Kaczmarczyk, L. C., Loui, M. C., & Zilles, C. B. (2008) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1352135.1352226 · Cited by 128
Sorva, J., & Sirkiä, T. (2010) · Koli Calling International Conference on Computing Education Research · doi:10.1145/1930464.1930471 · Cited by 121
Self-citationAn Experiment on Using Roles of Variables in Teaching Introductory Programming
Sajaniemi, J., & Kuittinen, M. (2005) · Computer Science Education · doi:10.1080/08993400500056563 · Cited by 120
Extending the Engagement Taxonomy: Software Visualization and Collaborative Learning
Myller, N., Bednarik, R., Sutinen, E., & Ben‐Ari, M. (2009) · ACM Transactions on Computing Education · doi:10.1145/1513593.1513600 · Cited by 119
Investigating and improving the models of programming concepts held by novice programmers
Ma, L., Ferguson, J., Roper, M., & Wood, M. (2011) · Computer Science Education · doi:10.1080/08993408.2011.554722 · Cited by 112
What do novices learn during program comprehension?
Corritore, C. L., & Wiedenbeck, S. (1991) · International Journal of Human-Computer Interaction · doi:10.1080/10447319109526004 · Cited by 112
Pascal and High School Students: A Study of Errors
Sleeman, D. H., Putnam, R. T., Baxter, J. A., & Kuspa, L. K. (1986) · Journal of Educational Computing Research · doi:10.2190/2xpp-ltyh-98nq-bu77 · Cited by 110
A decade of research and development on program animation: The Jeliot experience
Ben‐Ari, M., Bednarik, R., Levy, R. B.-B., Ebel, G., Moreno, A., Myller, N., & Sutinen, E. (2011) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2011.04.004 · Cited by 108
Exploring programming misconceptions
Sirkiä, T., & Sorva, J. (2012) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2401796.2401799 · Cited by 99
Self-citationMaking the abstract concrete: Visualizing mathematical solution procedures
Scheiter, K., Gerjets, P. H., & Catrambone, R. (2005) · Computers in Human Behavior · doi:10.1016/j.chb.2005.01.009 · Cited by 95
Novice Java programmers' conceptions of "object" and "class", and variation theory
Eckerdal, A., & Thuné, M. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1151954.1067473 · Cited by 91
Moons, J., & de Backer, C. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.08.009 · Cited by 88
Effectiveness of Program Visualization: A Case Study with the ViLLE Tool
Rajala, T., Laakso, M., Kaila, E., & Salakoski, T. (2008) · Journal of Information Technology Education Innovations in Practice · doi:10.28945/195 · Cited by 86
Reflections on threshold concepts in computer programming and beyond
Sorva, J. (2010) · Koli Calling International Conference on Computing Education Research · doi:10.1145/1930464.1930467 · Cited by 85
Self-citationIntelligent Tutor, Environment and Manual for Introductory Programming
Brusilovsky, P. L. (1992) · Programmed Learning and Educational Technology · doi:10.1080/0954730920290104 · Cited by 72
Proceedings - 10th IEEE International Conference on Advanced Learning Technologies, ICALT 2010
Mendoza, M., & Becerra, C. (2010) · Cited by 67
Factors in novice programmers' poor tracing skills
Vainio, V., & Sajaniemi, J. (2007) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1268784.1268853 · Cited by 65
Understanding and characterizing software visualization systems
Stasko, J., & Patterson, C. R. (2003) · IEEE Workshop on Visual Languages (VL) · doi:10.1109/wvl.1992.275790 · Cited by 65
Trace-based teaching in early programming courses
Hertz, M., & Jump, M. (2013) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2445196.2445364 · Cited by 63
Allen, E., Cartwright, R., & Stoler, B. (2002) · ACM SIGCSE Bulletin · doi:10.1145/563517.563395 · Cited by 63
Program animation based on the roles of variables
Sajaniemi, J., & Kuittinen, M. (2003) · doi:10.1145/774833.774835 · Cited by 60
Scaffolding with object diagrams in first year programming classes: some unexpected results
Thomas, L., Ratcliffe, M., & Thomasson, B. (2004) · ACM SIGCSE Bulletin · doi:10.1145/1028174.971390 · Cited by 57
Jype - a program visualization and programming exercise tool for Python
Helminen, J., & Malmi, L. (2010) · doi:10.1145/1879211.1879234 · Cited by 56
Self-citationSajaniemi, J., Kuittinen, M., & Tikansalo, T. (2008) · Journal on Educational Resources in Computing · doi:10.1145/1316450.1316453 · Cited by 56
Laakso, M., Myller, N., & Korhonen, A. (2009) · Cited by 49
Gračanin, D., Matković, K., & Eltoweissy, M. (2005) · Innovations in Systems and Software Engineering · doi:10.1007/s11334-005-0019-8 · Cited by 47
Factors in novice programmers' poor tracing skills
Vainio, V., & Sajaniemi, J. (2007) · ACM SIGCSE Bulletin · doi:10.1145/1269900.1268853 · Cited by 43
Results from the evaluation of the effectiveness of an online tutor on expression evaluation
Kumar, A. N. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1047124.1047422 · Cited by 39
Students’ ways of experiencing visual program simulation
Sorva, J., Lönnberg, J., & Malmi, L. (2013) · Computer Science Education · doi:10.1080/08993408.2013.807962 · Cited by 38
Self-citationSimon (2011) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2094131.2094134 · Cited by 37
Effectiveness of Program Visualization in Learning Java: a Case Study with Jeliot 3
Čisar, S. M., Pintér, R., & Radosav, D. (2011) · International Journal of Computers Communications & Control · doi:10.15837/ijccc.2011.4.2094 · Cited by 36
Using BlueJ to Introduce Programming
Kölling, M. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-77934-6_9 · Cited by 35
Dancing with DynaLab: endearing the science of computing to students
Boroni, C. M., Eneboe, T. J., Goosey, F. W., Ross, J. A., & Ross, R. J. (1996) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/236452.236526 · Cited by 35
Affective effects of program visualization
Ebel, G., & Ben‐Ari, M. (2006) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/1151588.1151590 · Cited by 33
Habitable 3D Learning Environments for Situated Learning
Bares, W. H., Zettlemoyer, L., & Lester, J. C. (1998) · Lecture notes in computer science · doi:10.1007/3-540-68716-5_13 · Cited by 30
A principled approach to teaching OO first
Gries, D. J. (2008) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1352135.1352149 · Cited by 30
BlueJ Visual Debugger for Learning the Execution of Object-Oriented Programs?
Bennedsen, J., & Schulte, C. (2010) · ACM Transactions on Computing Education · doi:10.1145/1789934.1789938 · Cited by 30
Analyzing engagement taxonomy in collaborative algorithm visualization
Myller, N., Laakso, M., & Korhonen, A. (2007) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1268784.1268857 · Cited by 26
Ma, L., Ferguson, J., Roper, M., Ross, I., & Wood, M. (2009) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1562877.1562931 · Cited by 26
Effects, Experiences and Feedback from Studies of a Program Visualization Tool
Kaila, E., Rajala, T., Laakso, M., & Salakoski, T. (2009) · Informatics in Education · doi:10.15388/infedu.2009.02 · Cited by 25
Effects of course-long use of a program visualization tool
Kaila, E., Rajala, T., Laakso, M., & Salakoski, T. (2010) · doi:10.5555/1862219.1862234 · Cited by 25
Brusilovsky, P. L., & Loboda, T. D. (2006) · ACM SIGCSE Bulletin · doi:10.1145/1140123.1140140 · Cited by 24
VISUALIZATION OF OBJECT-ORIENTED (JAVA) PROGRAMS
Huizing, C., Kuiper, R., Luijten, C., et al. (2012) · International Conference on Computer Supported Education · doi:10.5220/0003924000650072 · Cited by 23
Visualizations in Preparing for Programming Exercise Sessions
Ahoniemi, T., & Lahtinen, E. (2007) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2007.01.043 · Cited by 22
OGRE: Three-Dimensional Program Visualization for Novice Programmers
Milne, I., & Rowe, G. (2004) · Education and Information Technologies · doi:10.1023/b:eait.0000042041.04999.17 · Cited by 20
Program working storage: a beginner's model
Vagianou, E. (2006) · Koli Calling International Conference on Computing Education Research · doi:10.1145/1315803.1315816 · Cited by 19
Learner interaction with algorithm visualizations
Lauer, T. (2006) · ACM SIGCSE Bulletin · doi:10.1145/1140123.1140179 · Cited by 19
Targeting program visualizations
Lahtinen, E., Järvinen, H.-M., & Melakoski-Vistbacka, S. (2007) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1268784.1268858 · Cited by 19
mJeliot: a tool for enhanced interactivity in programming instruction
Pears, A., & Rogalli, M. (2011) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2094131.2094135 · Cited by 19
EROSI—visualising recursion and discovering new errors
George, C. E. (2000) · ACM SIGCSE Bulletin · doi:10.1145/331795.331875 · Cited by 19
Murphy, C., Kim, E. H., Kaiser, G. E., et al. (2008) · ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1352135.1352193 · Cited by 17
Ramadhan, H. A., Deek, F. P., & Shihab, K. (2001) · Artificial Intelligence Review · doi:10.1023/a:1011078011415 · Cited by 16
Isohanni, E., & Knobelsdorf, M. (2010) · doi:10.1145/1839594.1839610 · Cited by 16
A visualisation tool as a demonstration aid
Lattu, M., Meisalo, V. P., & Tarhio, J. (2003) · Computers & Education · doi:10.1016/s0360-1315(03)00032-0 · Cited by 15
Developing Mental Models of Computer Programming Interactively Via the Web
Bruce-Lockhart, M. P., & Norvell, T. S. (2007) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2007.4418051 · Cited by 15
Short-Term Effects of Graphical versus Textual Visualisation of Variables on Program Perception
Nevalainen, S., & Sajaniemi, J. (2005) · PPIG · Cited by 13
Helping students build a mental model of computation
Kollmansberger, S. (2010) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1822090.1822127 · Cited by 13
THE IMPACT OF PRIOR EXPERIENCE IN USING A VISUALIZATION TOOL ON LEARNING TO PROGRAM
Laakso, M., Rajala, T., Kaila, E., & Salakoski, T. (2008) · Cognition and Exploratory Learning in Digital Age · Cited by 13
Role‐play virtual worlds for teaching object‐oriented design: the ViRPlay development experience
Jiménez-Díaz, G., Gonzalez-Calero, P. A., & Gómez-Albarrán, M. (2011) · Software Practice and Experience · doi:10.1002/spe.1071 · Cited by 11
Wang, P., Bednarik, R., & Moreno, A. (2012) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2401796.2401808 · Cited by 11
Software behaviour understanding Supported by dynamic visualization and role-play
Jiménez-Díaz, G., Gómez-Albarrán, M., Gómez-Martín, M. A., & Gonzalez-Calero, P. A. (2005) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1067445.1067464 · Cited by 10
A model computer simulation as an epistemic game
Sherry, L. (1995) · ACM SIGCSE Bulletin · doi:10.1145/201998.202016 · Cited by 10
An Empirical Evaluation of Visual Metaphors in the Animation of Roles of Variables
Stützle, T., & Sajaniemi, J. (2005) · Informing Science and IT Education Conference · doi:10.28945/2886 · Cited by 10
Murphy, C., Kim, E. H., Kaiser, G. E., et al. (2008) · ACM SIGCSE Bulletin · doi:10.1145/1352322.1352193 · Cited by 10
Students' long-term engagement with the visualization tool VIP
Isohanni, E., & Knobelsdorf, M. (2011) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2094131.2094138 · Cited by 8
mJeliot: ICT support for interactive teaching of programming
Pears, A., & Rogalli, M. (2011) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2011.6143119 · Cited by 8
An Empirical Evaluation of Visual Metaphors in the Animation of Roles of Variables
Stützle, T., & Sajaniemi, J. (2005) · Informing Science The International Journal of an Emerging Transdiscipline · doi:10.28945/489 · Cited by 8
Analyzing engagement taxonomy in collaborative algorithm visualization
Myller, N., Laakso, M., & Korhonen, A. (2007) · ACM SIGCSE Bulletin · doi:10.1145/1269900.1268857 · Cited by 8
Olascuaga-Cabrera, J. G., Méndez-Vázquez, A., & López-Mellado, E. (2010) · conference · Cited by 8
Automatic assessment of program visualization exercises
Kaila, E., Rajala, T., Laakso, M., & Salakoski, T. (2008) · Koli Calling International Conference on Computing Education Research · doi:10.1145/1595356.1595376 · Cited by 7
Progranimate - A Web Enabled Algorithmic Problem Solving Application.
Scott, A., Watkins, M. M., & McPhee, D. (2008) · CSREA EEE · Cited by 6
Dynamic Binding Is the Name of the Game
Gómez-Martín, M. A., Gómez-Martín, P. P., & Gonzalez-Calero, P. A. (2006) · Lecture notes in computer science · doi:10.1007/11872320_27 · Cited by 6
Conceptual models of programming environments: how learners use the glass box
Jones, A. C. (1993) · Instructional Science · doi:10.1007/bf00118559 · Cited by 6
An Experiment on the Short-Term Effects of Engagement and Representation in Program Animation
Nevalainen, S., & Sajaniemi, J. (2008) · Journal of Educational Computing Research · doi:10.2190/ec.39.4.e · Cited by 6
Targeting program visualizations
Lahtinen, E., Järvinen, H.-M., & Melakoski-Vistbacka, S. (2007) · ACM SIGCSE Bulletin · doi:10.1145/1269900.1268858 · Cited by 6
Korhonen, A., Laakso, M., & Myller, N. (2009) · International Conference on Web Information Systems and Technologies · doi:10.5220/0001825104790488 · Cited by 5
Comparing the effectiveness of different educational uses of program animations
Urquiza‐Fuentes, J., & Velázquez‐Iturbide, J. Á. (2012) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2325296.2325340 · Cited by 5
Software behaviour understanding Supported by dynamic visualization and role-play
Jiménez-Díaz, G., Gómez-Albarrán, M., Gómez-Martín, M. A., & Gonzalez-Calero, P. A. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1151954.1067464 · Cited by 2
Cited by
Students’ Misconceptions and Other Difficulties in Introductory Programming: A Literature Review
Qian, Y., & Lehman, J. (2018) · ACM Transactions on Computing Education · doi:10.1145/3077618 · Cited by 529
Introductory programming: a systematic literature review
Luxton-Reilly, A., Simon, Albluwi, I., Becker, B. A., Giannakos, M., Kumar, A. N., Ott, L., Paterson, J., Scott, M. J., Sheard, J., et al. (2018) · Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/3293881.3295779 · Cited by 485
A Systematic Literature Review on Teaching and Learning Introductory Programming in Higher Education
Medeiros, R. P., Ramalho, G. L., & Falcao, T. P. (2019) · IEEE Transactions on Education · doi:10.1109/te.2018.2864133 · Cited by 384
A systematic literature review of automated feedback generation for programming exercises
Keuning, H., Jeuring, J., & Heeren, B. (2019) · ACM Transactions on Computing Education · doi:10.1145/3231711 · Cited by 370
Notional machines and introductory programming education
Sorva, J. (2013) · ACM Transactions on Computing Education · doi:10.1145/2483710.2483713 · Cited by 319
Self-citation
Metadata
- Authors
- Sorva, J., Karavirta, V., & Malmi, L.
- Venue
- ACM Transactions on Computing Education
- Published
- 2013-11
- Volume
- 13
- Issue
- 4
- Pages
- 1-64
- ISSN
- 1946-6226 (ISSN-L)
- OpenAlex
- W2167759247
- Cited by
- 366
- References
- 127
- FWCI
- 33.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.