The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
A Systematic Literature Review on Teaching and Learning Introductory Programming in Higher Education
Abstract
Contribution: This paper adds to the results of previous systematic literature reviews by addressing a more contemporary context of introductory programming. It proposes a categorization of introductory programming challenges, and highlights key issues for a research roadmap on introductory programming learning and teaching in higher education. Background: Despite the advances in methods and tools for teaching and learning introductory programming, dropout and failure rates are still high. Published surveys and reviews either cover papers only up to 2007, or focus on methods and tools for teaching introductory programming. Research Questions: 1) What previous skills and background knowledge are key for a novice student to learn programming? 2) What difficulties do novice students encounter in learning how to program? 3) What challenges do teachers encounter in teaching introductory programming? Methodology: Following a formal protocol, automatic and manual searches were performed for work from 2010 to 2016. Of 100 papers selected for data extraction, 89 were retained after quality assessment. Findings: The most frequently cited skills necessary for learning programming were related to problem solving and mathematical ability. Problem solving was also cited as a learning challenge, followed by motivation and engagement, and difficulties in learning the syntax of programming languages. The main teaching challenges concern the lack of appropriate methods and tools, as well as scaling and personalized teaching.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
Student engagement literature review
Trowler, V. (2010) · Cited by 1,809
Learning and Teaching Programming: A Review and Discussion
Robins, A., Rountree, J., & Rountree, N. (2003) · Computer Science Education · doi:10.1076/csed.13.2.137.14200 · Cited by 1,736
A study of the difficulties of novice programmers
Lahtinen, E., Ala-Mutka, K., & Järvinen, H.-M. (2005) · Proceedings of the 10th annual SIGCSE conference on Innovation and technology in computer science education · doi:10.1145/1067445.1067453 · Cited by 827
Failure rates in introductory programming revisited
Watson, C., & Li, F. W. B. (2014) · Proceedings of the 2014 conference on Innovation & technology in computer science education - ITiCSE '14 · doi:10.1145/2591708.2591749 · Cited by 639
Failure rates in introductory programming
Bennedsen, J., & Caspersen, M. E. (2007) · ACM SIGCSE Bulletin · doi:10.1145/1272848.1272879 · Cited by 627
A survey of literature on the teaching of introductory programming
Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., & Paterson, J. (2007) · ACM SIGCSE Bulletin · doi:10.1145/1345375.1345441 · Cited by 481
A study of the difficulties of novice programmers
Lahtinen, E., Ala-Mutka, K., & Järvinen, H.-M. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1151954.1067453 · Cited by 446
A Review of Generic Program Visualization Systems for Introductory Programming Education
Sorva, J., Karavirta, V., & Malmi, L. (2013) · ACM Transactions on Computing Education · doi:10.1145/2490822 · Cited by 366
Computational Thinking: What and Why?
Wing, J. M. (2010) · Cited by 291
Learning edge momentum: a new account of outcomes in CS1
Robins, A. (2010) · Computer Science Education · doi:10.1080/08993401003612167 · Cited by 286
Vihavainen, A., Airaksinen, J., & Watson, C. (2014) · Proceedings of the tenth annual conference on International computing education research · doi:10.1145/2632320.2632349 · Cited by 223
Algorithmic Thinking: The Key for Understanding Computer Science
Futschek, G. (2006) · Lecture Notes in Computer Science · doi:10.1007/11915355_15 · Cited by 206
Lishinski, A., Yadav, A., Good, J., & Enbody, R. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960329 · Cited by 199
A survey of literature on the teaching of introductory programming
Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., & Paterson, J. (2007) · Working group reports on ITiCSE on Innovation and technology in computer science education · doi:10.1145/1345443.1345441 · Cited by 198
Extreme apprenticeship method in teaching programming for beginners
Vihavainen, A., Paksula, M., & Luukkainen, M. (2011) · Proceedings of the 42nd ACM technical symposium on Computer science education · doi:10.1145/1953163.1953196 · Cited by 176
Retaining nearly one-third more majors with a trio of instructional best practices in CS1
Porter, L., & Simon, B. (2013) · Proceeding of the 44th ACM technical symposium on Computer science education · doi:10.1145/2445196.2445248 · Cited by 164
Luxton-Reilly, A. (2016) · Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/2899415.2899432 · Cited by 159
Reducing the dropout rate in an introductory programming course
Yadin, A. (2011) · ACM Inroads · doi:10.1145/2038876.2038894 · Cited by 146
Ability-training-oriented automated assessment in introductory programming course
Wang, T., Su, X., Ma, P., Wang, Y., & Wang, K. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.08.003 · Cited by 138
Understanding the syntax barrier for novices
Denny, P., Luxton-Reilly, A., Tempero, E., & Hendrickx, J. (2011) · Proceedings of the 16th annual joint conference on Innovation and technology in computer science education · doi:10.1145/1999747.1999807 · Cited by 133
Students Perceptions of Using Educational Games to Learn Introductory Programming
Ibrahim, R., Yusoff, R. C. M., Omar, H. M., & Jaafar, A. (2010) · Computer and Information Science · doi:10.5539/cis.v4n1p205 · Cited by 131
Developing a Computer Science Concept Inventory for Introductory Programming
Caceffo, R., Wolfman, S., Booth, K. S., & Azevedo, R. (2016) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2839509.2844559 · Cited by 129
How we teach impacts student learning: peer instruction vs. lecture in CS0
Simon, B., Parris, J. L., & Spacco, J. W. (2013) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2445196.2445215 · Cited by 123
Translating Principles of Effective Feedback for Students into the CS1 Context
Ott, C., Robins, A. V., & Shephard, K. L. (2016) · ACM Transactions on Computing Education · doi:10.1145/2737596 · Cited by 123
CS majors' self-efficacy perceptions in CS1: results in light of social cognitive theory
Kinnunen, P., & Simon, B. (2011) · Proceedings of the seventh international workshop on Computing education research · doi:10.1145/2016911.2016917 · Cited by 116
Revisiting why students drop CS1
Petersen, A., Craig, M., Campbell, J., & Tafliovich, A. (2016) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2999541.2999552 · Cited by 115
Hawi, N. S. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.10.020 · Cited by 114
Investigating and improving the models of programming concepts held by novice programmers
Ma, L., Ferguson, J., Roper, M., & Wood, M. (2011) · Computer Science Education · doi:10.1080/08993408.2011.554722 · Cited by 112
Piteira, M., & Costa, C. J. D. C. (2013) · International Conference on Information Systems and Design of Communication (ISDOC) · doi:10.1145/2503859.2503871 · Cited by 104
Meaningful categorisation of novice programmer errors
McCall, D., & Kölling, M. (2014) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2014.7044420 · Cited by 103
Effective compiler error message enhancement for novice programming students
Becker, B. A., Glanville, G., Iwashima, R., McDonnell, C., Goslin, K., & Mooney, C. (2016) · Computer Science Education · doi:10.1080/08993408.2016.1225464 · Cited by 101
Exploring programming misconceptions
Sirkiä, T., & Sorva, J. (2012) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2401796.2401799 · Cited by 99
Do we know how difficult the rainfall problem is?
Seppälä, O., Ihantola, P., Isohanni, E., Sorva, J., & Vihavainen, A. (2015) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2828959.2828963 · Cited by 93
Simon, B., Kinnunen, P., Porter, L., & Zazkis, D. (2010) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1822090.1822151 · Cited by 90
A Motivation Guided Holistic Rehabilitation of the First Programming Course
Nikula, U., Gotel, O. C. Z., & Kasurinen, J. (2011) · ACM Transactions on Computing Education · doi:10.1145/2048931.2048935 · Cited by 81
Debugging From the Student Perspective
Fitzgerald, S., McCauley, R. A., Hanks, B., Murphy, L., Simon, B., & Zander, C. (2009) · IEEE Transactions on Education · doi:10.1109/te.2009.2025266 · Cited by 75
Importance of early performance in CS1: two conflicting assessment stories
Porter, L., & Zingaro, D. (2014) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2538862.2538912 · Cited by 74
Students' Initial Course Motivation and Their Achievement and Retention in College CS1 Courses
Shell, D. F., Soh, L., Flanigan, A. E., & Peteranetz, M. S. (2016) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2839509.2844606 · Cited by 74
Repenning, A., Basawapatna, A. R., & Escherle, N. A. (2016) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2016.7739688 · Cited by 71
Designing and deploying programming courses: Strategies, tools, difficulties and pedagogy
Xinogalos, S. (2014) · Education and Information Technologies · doi:10.1007/s10639-014-9341-9 · Cited by 69
Trace-based teaching in early programming courses
Hertz, M., & Jump, M. (2013) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2445196.2445364 · Cited by 63
Bati, T. B., Gelderblom, H., & van Biljon, J. A. (2014) · Computer Science Education · doi:10.1080/08993408.2014.897850 · Cited by 62
Cooperative learning instructional methods for CS1: Design, implementation, and evaluation
Beck, L., & Chizhik, A. (2013) · ACM Transactions on Computing Education · doi:10.1145/2492686 · Cited by 60
Measuring and Improving Student Performance in an Introductory Programming Course
Alturki, R. (2016) · Informatics in Education · doi:10.15388/infedu.2016.10 · Cited by 56
Drop, Fail, Pass, Continue: Persistence in CS1 and Beyond in Traditional and Inverted Delivery
Horton, D., & Craig, M. (2015) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2676723.2677273 · Cited by 55
A student perspective on prior experience in CS1
Tafliovich, A., Campbell, J., & Petersen, A. (2013) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2445196.2445270 · Cited by 55
Sung, K., Hillyard, C., Angotti, R., Panitz, M., Goldstein, D. S., & Nordlinger, J. (2010) · IEEE Transactions on Education · doi:10.1109/te.2010.2064315 · Cited by 54
Ott, C., Robins, A. V., Haden, P., & Shephard, K. L. (2015) · Computer Science Education · doi:10.1080/08993408.2015.1033129 · Cited by 53
Lishinski, A., Yadav, A. K., Enbody, R. J., & Good, J. (2016) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2839509.2844596 · Cited by 53
Teague, D., & Lister, R. (2014) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2591708.2591712 · Cited by 52
Pedagogy of introductory computer programming : a people-first approach
Teague, M. M. (2011) · Cited by 44
Instructor perspectives of multiple-choice questions in summative assessment for novice programmers
Shuhidan, S. M., Hamilton, M., & D’Souza, D. (2010) · Computer Science Education · doi:10.1080/08993408.2010.509097 · Cited by 44
Assessment frequency in introductory computer programming disciplines
Brito, M. A., & de Sá-Soares, F. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.07.044 · Cited by 41
New perspectives on the pedagogy of programming in a developing country context
Apiola, M., & Tedre, M. (2012) · Computer Science Education · doi:10.1080/08993408.2012.726871 · Cited by 39
Management, structures and tools to scale up personal advising in large programming courses
Kurhila, J., & Vihavainen, A. (2011) · Conference on Information Technology Education · doi:10.1145/2047594.2047596 · Cited by 39
On study habits on an introductory course on programming
Willman, S., Lindén, R., Kaila, E., Rajala, T., Laakso, M., & Salakoski, T. (2015) · Computer Science Education · doi:10.1080/08993408.2015.1073829 · Cited by 38
C++ or Python? Which One to Begin with: A Learner's Perspective
Ateeq, M., Habib, H., Umer, A., & Rehman, M. U. (2014) · International Conference on Learning and Teaching in Computing and Engineering (LaTICE) · doi:10.1109/latice.2014.20 · Cited by 38
Identifying cognitive abilities to improve CS1 outcome
Ambrosio, A. P., Costa, F. M., Almeida, L. S., Franco, A., & Macedo, J. (2011) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2011.6142824 · Cited by 36
Shell, D. F., Hazley, M. P., Soh, L., Miller, L. D., Chiriacescu, V., & Ingraham, E. (2014) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2014.7044489 · Cited by 35
Introductory programming and the didactic triangle
Berglund, A., & Lister, R. (2010) · UTS ePRESS (University of Technology Sydney) · doi:10.5555/1862219.1862227 · Cited by 35
On the Bimodality in an Introductory Programming Course: An Analysis of Student Performance Factors
Höök, L. J., & Eckerdal, A. (2015) · International Conference on Learning and Teaching in Computing and Engineering (LaTICE) · doi:10.1109/latice.2015.25 · Cited by 34
How can software metrics help novice programmers
Cardell‐Oliver, R. (2011) · UWA Profiles and Research Repository (UWA) · Cited by 33
Teaching the novice programmer: A study of instructional sequences and perception
Kranch, D. A. (2011) · Education and Information Technologies · doi:10.1007/s10639-011-9158-8 · Cited by 32
Kinnunen, P. (2009) · Aaltodoc (Aalto University) · Cited by 31
Teaching programming by emphasizing self-direction
Isomöttönen, V., & Tirronen, V. (2013) · ACM Transactions on Computing Education · doi:10.1145/2483710.2483711 · Cited by 29
Uysal, M. P. (2014) · Contemporary Educational Technology · doi:10.30935/cedtech/6125 · Cited by 29
Silva-Maceda, G., Arjona-Villicaña, P. D., & Castillo-Barrera, F. E. (2016) · IEEE Transactions on Education · doi:10.1109/te.2016.2535207 · Cited by 29
Attributes of students engagement in fundamental programming learning
Eltegani, N., & Butgereit, L. L. (2015) · International Conference on Computing, Control, Networking, Electronics and Embedded Systems Engineering (ICCNEEE) · doi:10.1109/iccneee.2015.7381438 · Cited by 28
Giraffa, L. M. M., Moraes, M. C., & Uden, L. (2013) · Springer proceedings in complexity · doi:10.1007/978-94-007-7308-0_2 · Cited by 25
Learning Programming Languages through Corrective Feedback and Concept Visualisation
Watson, C., Li, F. W. B., & Lau, R. W. H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25813-8_2 · Cited by 25
Pedagogical architectures to support the process of teaching and learning of computer programming
Tavares, O. D. L., de Menezes, C. S., & de Nevado, R. A. (2012) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2012.6462427 · Cited by 25
Conditions for Successful Learning of Programming Skills
Holvikivi, J. (2010) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-3-642-15378-5_15 · Cited by 23
CSI with games and an emphasis on TDD and unit testing: piling a trend upon a trend
Isomöttönen, V., & Lappalainen, V. (2012) · ACM Inroads · doi:10.1145/2339055.2339073 · Cited by 23
Mirolo, C. (2010) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1822090.1822136 · Cited by 19
ARCS-based tactics to improve students' motivation in computer programming course
Alhazbi, S. (2015) · International Conference on Computer Science & Education (ICCSE) · doi:10.1109/iccse.2015.7250263 · Cited by 16
Study Habits of CS 1 Students: What Do They Say They Do?
Sheard, J., Carbone, A., Chinn, D. D., & Laakso, M. (2013) · International Conference on Learning and Teaching in Computing and Engineering (LaTICE) · doi:10.1109/latice.2013.46 · Cited by 16
Can computing academics assess the difficulty of programming examination questions?
Simon, D’Souza, D., Sheard, J., Harland, J., Carbone, A., & Laakso, M. (2012) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2401796.2401822 · Cited by 15
Intelligent assistant for helping students to learn programming
Konecki, M., Kadoić, N., & Piltaver, R. (2015) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro.2015.7160406 · Cited by 14
Persistence of elementary programming skills
Bennedsen, J., & Caspersen, M. E. (2012) · Computer Science Education · doi:10.1080/08993408.2012.692911 · Cited by 14
The novice problem in computer science
Matthíasdóttir, Á., & Geirsson, H. J. (2011) · International Conference on Computer Systems and Technologies (CompSysTech) · doi:10.1145/2023607.2023702 · Cited by 14
Program comprehension levels of abstraction for novices
Al-Shargabi, A. A., Aljunid, S. A., Annamalai, M., Shuhidan, S. M., & Zın, A. M. (2015) · International Conference on Computer, Communications, and Control Technology (I4CT) · doi:10.1109/i4ct.2015.7219568 · Cited by 12
Studies and proposals about initial programming learning
Gomes, A., & Mendes, A. J. (2010) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2010.5673426 · Cited by 11
Assessment of self-regulated attitudes and behaviors of introductory programming students
Ambrosio, A. P., Almeida, L. S., Franco, A., Martins, S. W., & Georges, F. J. (2012) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2012.6462314 · Cited by 11
A Practice for Providing Additional Support in CS1
Haatainen, S., Lakanen, A.-J., Isomöttönen, V., & Lappalainen, V. (2013) · International Conference on Learning and Teaching in Computing and Engineering (LaTICE) · doi:10.1109/latice.2013.39 · Cited by 11
Hosack, B. J., Lim, B. B. L., & Vogt, W. P. (2012) · Journal of the Association for Information Systems · Cited by 10
The impact of real-world topic labs on student performance in CS1
Reilly, C. F., & Mora, N. D. L. (2012) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2012.6462329 · Cited by 7
Results from an action research approach for designing CS1 learning environments in Tanzania
Apiola, M., Moisseinen, N., & Tedre, M. (2012) · 2022 IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2012.6462321 · Cited by 6
Novice Programming Students' Perception of Learning Object
Matthews, R., Hin, H. S., & Koo, A. C. (2013) · International Conference on Informatics and Creative Multimedia (ICICM) · doi:10.1109/icicm.2013.67 · Cited by 6
Optimizing Instruction for Learning Computer Programming – A Novel Approach
Yousoof, M., & Sapiyan, M. (2015) · Communications in computer and information science · doi:10.1007/978-3-662-46742-8_12 · Cited by 5
Hartanto, B. (2015) · Communications in computer and information science · doi:10.1007/978-3-662-46742-8_45 · Cited by 5
String formatting considered harmful for novice programmers
Hughes, M. C., Jadud, M. C., & Rodrigo, M. M. T. (2010) · Computer Science Education · doi:10.1080/08993408.2010.507335 · Cited by 4
Cited by
Chatbots applications in education: A systematic review
Okonkwo, C. W., & Ade-Ibijola, A. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100033 · Cited by 879
Introductory programming: a systematic literature review
Luxton-Reilly, A., Simon, Albluwi, I., Becker, B. A., Giannakos, M., Kumar, A. N., Ott, L., Paterson, J., Scott, M. J., Sheard, J., et al. (2018) · Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/3293881.3295779 · Cited by 485
Becker, B. A., Denny, P., Pettit, R., Bouchard, D., Bouvier, D. J., Harrington, B., Kamil, A., Karkare, A., McDonald, C., Osera, P.-M., et al. (2019) · Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3344429.3372508 · Cited by 199
Yang, T.-C., Hsu, Y.-C., & Wu, J.-Y. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2450659 · Cited by 80
Boguslawski, S., Deer, R., & Dawson, M. G. (2025) · Information and Learning Sciences · doi:10.1108/ils-10-2023-0163 · Cited by 66
Metadata
- Authors
- Medeiros, R. P., Ramalho, G. L., & Falcao, T. P.
- Venue
- IEEE Transactions on Education
- Published
- 2019-05
- Volume
- 62
- Issue
- 2
- Pages
- 77-90
- ISSN
- 0018-9359 (ISSN-L)
- 1557-9638
- OpenAlex
- W2889140186
- Cited by
- 384
- References
- 93
- FWCI
- 4.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.