The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
A survey of literature on the teaching of introductory programming
Open accessAbstract
Three decades of active research on the teaching of introductory programming has had limited effect on classroom practice. Although relevant research exists across several disciplines including education and cognitive science, disciplinary differences have made this material inaccessible to many computing educators. Furthermore, computer science instructors have not had access to a comprehensive survey of research in this area. This paper collects and classifies this literature, identifies important work and mediates it to computing educators and professional bodies. We identify research that gives well-supported advice to computing academics teaching introductory programming. Limitations and areas of incomplete coverage of existing research efforts are also identified. The analysis applies publication and research quality metrics developed by a previous ITiCSE working group [74].
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scholarship Reconsidered: Priorities of the Professoriate
Poston, L., & Boyer, E. L. (1992) · Academe · doi:10.2307/40250362 · Cited by 6,829
An axiomatic basis for computer programming
Hoare, C. A. R. (1969) · Communications of the ACM · doi:10.1145/363235.363259 · Cited by 4,002
Learning and Teaching Programming: A Review and Discussion
Robins, A., Rountree, J., & Rountree, N. (2003) · Computer Science Education · doi:10.1076/csed.13.2.137.14200 · Cited by 1,736
Scholarship reconsidered : priorities of the professoriate
Boyer, E. L., Moser, D., Ream, T. C., & Braxton, J. M. (2016) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 1,655
Meyer, J. H. F., & Land, R. (2005) · Higher Education · doi:10.1007/s10734-004-6779-5 · Cited by 1,537
Structure and Interpretation of Computer Programs
Abelson, H., Sussman, G. J., & Sussman, J. (1985) · Cited by 1,435
What the Student Does: teaching for enhanced learning
Biggs, J. (1999) · Higher Education Research & Development · doi:10.1080/0729436990180105 · Cited by 1,332
Relations between teachers' approaches to teaching and students' approaches to learning
Trigwell, K., Prosser, M., & Waterhouse, F. (1999) · Higher Education · doi:10.1023/a:1003548313194 · Cited by 1,306
Usability Analysis of Visual Programming Environments: A ‘Cognitive Dimensions’ Framework
Green, T. R. G., & Petre, M. (1996) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.1996.0009 · Cited by 1,251
Letters to the editor: go to statement considered harmful
Dijkstra, E. W. (1968) · Communications of the ACM · doi:10.1145/362929.362947 · Cited by 1,026
Professional development and reform in science education: The role of teachers' practical knowledge
van Driel, J. H., Beijaard, D., & Verloop, N. (2001) · Journal of Research in Science Teaching · doi:10.1002/1098-2736(200102)38:2<137::aid-tea1001>3.0.co;2-u · Cited by 949
Kelleher, C., & Pausch, R. (2005) · ACM Computing Surveys · doi:10.1145/1089733.1089734 · Cited by 886
A Meta-Study of Algorithm Visualization Effectiveness
HUNDHAUSEN, C. D., DOUGLAS, S. A., & STASKO, J. T. (2002) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.2002.0237 · Cited by 719
Exploring the role of visualization and engagement in computer science education
Naps, T. L., Rößling, G., Almstrum, V., Dann, W., Fleischer, R., Hundhausen, C., Korhonen, A., Malmi, L., McNally, M., Rodger, S., et al. (2003) · ACM SIGCSE Bulletin · doi:10.1145/782941.782998 · Cited by 641
Self-citationConstructivism in computer science education
Ben-Ari, M. (1998) · ACM SIGCSE Bulletin · doi:10.1145/274790.274308 · Cited by 629
Development and Use of the Approaches to Teaching Inventory
Trigwell, K., & Prosser, M. (2004) · Educational Psychology Review · doi:10.1007/s10648-004-0007-9 · Cited by 621
Learning to program = learning to construct mechanisms and explanations
Soloway, E. (1986) · Communications of the ACM · doi:10.1145/6592.6594 · Cited by 567
A Survey of Automated Assessment Approaches for Programming Assignments
Ala-Mutka, K. M. (2005) · Computer Science Education · doi:10.1080/08993400500150747 · Cited by 546
ELM-ART: An Adaptive Versatile System for Web-Based Instruction
Weber, G., & Brusilovsky, P. L. (2001) · Cited by 542
Tango: a framework and system for algorithm animation
Stasko, J. T. (1990) · Computer · doi:10.1109/2.58216 · Cited by 506
The BlueJ System and its Pedagogy
Kölling, M., Quig, B., Patterson, A., & Rosenberg, J. (2003) · Computer Science Education · doi:10.1076/csed.13.4.249.17496 · Cited by 484
A Principled Taxonomy of Software Visualization
Price, B. A., Baecker, R. M., & Small, I. S. (1993) · Journal of Visual Languages & Computing · doi:10.1006/jvlc.1993.1015 · Cited by 476
Is abstraction the key to computing?
Kramer, J. (2007) · Communications of the ACM · doi:10.1145/1232743.1232745 · Cited by 452
Constructivism in computer science education
Ben-Ari, M. (1998) · Proceedings of the twenty-ninth SIGCSE technical symposium on Computer science education · doi:10.1145/273133.274308 · Cited by 417
Automatic test-based assessment of programming: A review
Douce, C., Livingstone, D., & Orwell, J. (2005) · Journal on Educational Resources in Computing · doi:10.1145/1163405.1163409 · Cited by 416
Structure and interpretation of computer programs
Forbus, K. D. (1985) · Artificial Intelligence · doi:10.1016/0004-3702(85)90087-6 · Cited by 395
Computing Curricula 2005: The Overview Report
Shackelford, R., McGettrick, A., Sloan, R., Topi, H., Davies, G., Kamali, R., Cross, J., Impagliazzo, J., LeBlanc, R., & Lunt, B. (2006) · Proceedings of the 37th SIGCSE technical symposium on Computer science education · doi:10.1145/1121341.1121482 · Cited by 358
Karel the Robot: A Gentle Introduction to the Art of Programming
Pattis, R. E., Roberts, J., & Stehlik, M. (1994) · Cumulative Index of Computer Aided Architectural Design · Cited by 353
The case for case studies of programming problems
Linn, M. C., & Clancy, M. J. (1992) · Communications of the ACM · doi:10.1145/131295.131301 · Cited by 300
The boss online submission and assessment system
Joy, M., Griffiths, N., & Boyatt, R. (2005) · Journal on Educational Resources in Computing · doi:10.1145/1163405.1163407 · Cited by 282
Visualizing programs with Jeliot 3
Moreno, A., Myller, N., Sutinen, E., & Ben-Ari, M. (2004) · Proceedings of the working conference on Advanced visual interfaces · doi:10.1145/989863.989928 · Cited by 256
Forte, A., & Guzdial, M. (2005) · IEEE Transactions on Education · doi:10.1109/te.2004.842924 · Cited by 235
Go to Statement Considered Harmful
Dijkstra, E. W. (2002) · Software Pioneers · doi:10.1007/978-3-642-59412-0_21 · Cited by 233
The automated tutoring of introductory computer programming
Anderson, J. R., & Skwarecki, E. (1986) · Communications of the ACM · doi:10.1145/6592.6593 · Cited by 225
Exploring the role of visualization and engagement in computer science education
Naps, T. L., Rößling, G., Almstrum, V., Dann, W., Fleischer, R., Hundhausen, C., Korhonen, A., Malmi, L., McNally, M., Rodger, S., et al. (2002) · Working group reports from ITiCSE on Innovation and technology in computer science education · doi:10.1145/960568.782998 · Cited by 220
Self-citationUsing student-built algorithm animations as learning aids
Stasko, J. T. (1997) · Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education · doi:10.1145/268084.268091 · Cited by 214
Visual Algorithm Simulation Exercise System with Automatic Assessment: TRAKLA2
MALMI, L., KARAVIRTA, V., KORHONEN, A., NIKANDER, J., SEPPÄLÄ, O., & SILVASTI, P. (2004) · Informatics in Education · doi:10.15388/infedu.2004.19 · Cited by 204
Self-citationProgramming Language/Problem-Solving Research: A Review of Relevant Issues
Palumbo, D. B. (1990) · Review of Educational Research · doi:10.2307/1170225 · Cited by 199
What University Teachers Teach and How they Teach It
Martin, E., Prosser, M., Trigwell, K., Ramsden, P., & Benjamin, J. (2002) · Springer eBooks · doi:10.1007/978-94-010-0593-7_6 · Cited by 191
Improving student performance by evaluating how well students test their own programs
Edwards, S. H. (2003) · Journal on Educational Resources in Computing · doi:10.1145/1029994.1029995 · Cited by 179
Automated assessment and experiences of teaching programming
Higgins, C. A., Gray, G., Symeonidis, P., & Tsintsifas, A. (2005) · Journal on Educational Resources in Computing · doi:10.1145/1163405.1163410 · Cited by 163
CS educational research: a meta-analysis of SIGCSE technical symposium proceedings
Valentine, D. W. (2004) · ACM SIGCSE Bulletin · doi:10.1145/1028174.971391 · Cited by 161
Fully automatic assessment of programming exercises
Saikkonen, R., Malmi, L., & Korhonen, A. (2001) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/377435.377666 · Cited by 152
Self-citationWhat about a simple language? Analyzing the difficulties in learning to program
Mannila, L., Peltomäki, M., & Salakoski, T. (2006) · Computer Science Education · doi:10.1080/08993400600912384 · Cited by 151
Self-citationA debate on teaching computing science
Denning, P. J. (1989) · Communications of the ACM · doi:10.1145/76380.76381 · Cited by 144
Karel++: A Gentle Introduction to the Art of Object-Oriented Programming
Bergin, J., Roberts, J., Pattis, R. E., & Stehlik, M. (1996) · CERN Document Server (European Organization for Nuclear Research) · Cited by 120
Powers, K. D., Ecott, S., & Hirshfield, L. (2007) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1227310.1227386 · Cited by 116
Constructing a core literature for computing education research
Pears, A., Seidman, S. B., Eney, C., Kinnunen, P., & Malmi, L. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1113847.1113893 · Cited by 108
Self-citationCS educational research: a meta-analysis of SIGCSE technical symposium proceedings
Valentine, D. W. (2004) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/971300.971391 · Cited by 105
What does it take to learn 'programming thinking'?
Eckerdal, A., Thuné, M., & Berglund, A. (2005) · doi:10.1145/1089786.1089799 · Cited by 98
The TeachScheme! Project: Computing and Programming for Every Student
Felleisen, M., Findler, R. B., Flatt, M., & Krishnamurthi, S. (2003) · Computer Science Education · doi:10.1076/csed.14.1.55.23499 · Cited by 97
Evaluating assessments of novice programming environments
Gross, P., & Powers, K. D. (2005) · doi:10.1145/1089786.1089796 · Cited by 97
Buck, D., & Stucki, D. J. (2001) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/364447.364529 · Cited by 92
Henriksen, P., & Kölling, M. (2004) · Companion to the ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA Companion) · doi:10.1145/1028664.1028701 · Cited by 89
On understanding the statics and dynamics of object-oriented programs
Ragonis, N., & Ben‐Ari, M. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1047124.1047425 · Cited by 83
Seven deadly sins of introductory programming language design
McIver, L., & Conway, D. (2002) · International Conference on Software Engineering: Education and Practice (SEEP) · doi:10.1109/seep.1996.534015 · Cited by 82
Reges, S. (2006) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1121341.1121432 · Cited by 79
What should we teach in an introductory programming course?
Gries, D. (1974) · ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/800183.810447 · Cited by 77
An introduction to object-oriented programming with a didactic microworld: objectKarel
Xinogalos, S., Satratzemi, M., & Dagdilelis, V. (2004) · Computers & Education · doi:10.1016/j.compedu.2004.09.005 · Cited by 69
CHALLENGING THE COMPUTATIONAL METAPHOR: IMPLICATIONS FOR HOW WE THINK
Stein, L. A. (1999) · Cybernetics & Systems · doi:10.1080/019697299125073 · Cited by 68
Green, T. R. G. (2000) · Working Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/345513.345233 · Cited by 68
Teaching roles of variables in elementary programming courses
Kuittinen, M., & Sajaniemi, J. (2004) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1007996.1008014 · Cited by 68
Allen, E., Cartwright, R., & Stoler, B. (2002) · ACM SIGCSE Bulletin · doi:10.1145/563517.563395 · Cited by 63
Developing intelligent programming tutors for novice programmers
Pillay, N. (2003) · ACM SIGCSE Bulletin · doi:10.1145/782941.782986 · Cited by 60
Experimental evaluation of animated-verifying object viewers for Java
Jain, J., Cross, J. H., Hendrix, T. D., & Barowski, L. A. (2006) · doi:10.1145/1148493.1148497 · Cited by 41
Bierre, K. J., Ventura, P., Phelps, A. M., & Egert, C. A. (2006) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1121341.1121452 · Cited by 40
On understanding the statics and dynamics of object-oriented programs
Ragonis, N., & Ben‐Ari, M. (2005) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1047344.1047425 · Cited by 39
The “procedures early” approach in CS 1
Pattis, R. E. (1993) · ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/169070.169362 · Cited by 36
CS1 programming language options
Giangrande, J. E. (2007) · Journal of computing sciences in colleges · doi:10.5555/1181849.1181881 · Cited by 31
A computing perspective on the Bologna process
Fuller, U., Pears, A., Amillo, J., Avram, C. P., & Mannila, L. (2006) · ACM SIGCSE Bulletin · doi:10.1145/1189136.1189181 · Cited by 17
Self-citationHundhausen, C. D., & Douglas, S. A. (2002) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl.2000.874355 · Cited by 17
A Language and System for Constructing and Presenting Low Fidelity Algorithm Visualizations
Hundhausen, C. D., & Douglas, S. A. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45875-1_18 · Cited by 11
Cited by
Introductory programming: a systematic literature review
Luxton-Reilly, A., Simon, Albluwi, I., Becker, B. A., Giannakos, M., Kumar, A. N., Ott, L., Paterson, J., Scott, M. J., Sheard, J., et al. (2018) · Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/3293881.3295779 · Cited by 485
Self-citationA Systematic Literature Review on Teaching and Learning Introductory Programming in Higher Education
Medeiros, R. P., Ramalho, G. L., & Falcao, T. P. (2019) · IEEE Transactions on Education · doi:10.1109/te.2018.2864133 · Cited by 384
A Review of Generic Program Visualization Systems for Introductory Programming Education
Sorva, J., Karavirta, V., & Malmi, L. (2013) · ACM Transactions on Computing Education · doi:10.1145/2490822 · Cited by 366
Self-citationA systematic literature review of automated feedback generation for programming exercises
Keuning, H., Jeuring, J., & Heeren, B. (2019) · ACM Transactions on Computing Education · doi:10.1145/3231711 · Cited by 370
Learning edge momentum: a new account of outcomes in CS1
Robins, A. (2010) · Computer Science Education · doi:10.1080/08993401003612167 · Cited by 286
Metadata
- Authors
- Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., & Paterson, J.
- Venue
- ACM SIGCSE Bulletin
- Published
- 2007-12
- Volume
- 39
- Issue
- 4
- Pages
- 204-223
- ISSN
- 0097-8418 (ISSN-L)
- OpenAlex
- W2050525049
- Cited by
- 481
- References
- 72
- FWCI
- 24.48
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.