Typing Exercises as Interactive Worked Examples for Deliberate Practice in CS Courses
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Solving complex Computer Science problems require students to utilize both higher level skills like problem translation, decomposition, and implementation, and lower level skills such as implementing solution patterns and debugging. However, novices often struggle with with these lower level skills, preventing them from moving forward. As a consequence, they risk developing a shallow understanding of code concepts and fail to practice crucial higher-level skills. We assert that if students were given the ability to practice these lower level skills outside of traditional programming exercises, they would be more apt to recognize and resolve them. For this we present our analysis of TYPOS, a platform for low-level skill practice using interactive worked examples as typing exercises. In this work we analyzed self-selected students based on their platform usage and the differences in course performance and behavior between groups. We found that students in a college level CS course that regularly completed typing exercises earned higher course grades and higher learning gains than those who worked irregularly or not at all. Students who actively used the system and completed typing exercises made fewer compilation errors on graded projects. Students did not, however, use the tool while working on their projects but engaged in deliberate practice sessions prior to lecture. We argue this model provides students with the benefits (although with marginal significance) that accrue from worked examples as well as deliberate practice on a key area of struggle for novice students.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 2×
“Aworked example is a full or partial solution to a problem for the purpose of instruction [3, 9, 51].”
BackgroundThe role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564 · cited 4×
“Drilling techniques are used inmany technical skills, such as cooking, music [18], sports [19], chess [11], and even medical diagnosis [16].”
BackgroundInfluentialMindset: The New Psychology of Success
(2006) · Choice Reviews Online · doi:10.5860/choice.44-2397 · Cited by 7,804
Metropolis, N., & Ulam, S. (1949) · Journal of the American Statistical Association · doi:10.1080/01621459.1949.10483310 · Cited by 6,474 · cited 1×
“For example, to implement the Monte Carlo algorithm [34] for”
MethodCategorization and Representation of Physics Problems by Experts and Novices*
Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981) · Cognitive Science · doi:10.1207/s15516709cog0502_2 · Cited by 5,248 · cited 3×
“[12, 33]), we require students to re-enter the example themselves.”
BackgroundMethodProblem-Based Learning: What and How Do Students Learn?
Hmelo-Silver, C. E. (2004) · Educational Psychology Review · doi:10.1023/b:edpr.0000034022.16470.f3 · Cited by 5,212
Cognitive load theory, learning difficulty, and instructional design
Sweller, J. (1994) · Learning and Instruction · doi:10.1016/0959-4752(94)90003-5 · Cited by 3,801 · cited 1×
“Moreover, as noted by Sweller, "it cannot be assumed that all worked examples under all circumstances will have beneficial consequences" [52].”
BackgroundThe ICAP framework: Linking cognitive engagement to active learning outcomes
Chi, M. T. H., & Wylie, R. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.965823 · Cited by 2,911
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Unlocking the clubhouse: women in computing
(2002) · Choice Reviews Online · doi:10.5860/choice.39-5237 · Cited by 1,958
Moreno, R., & Mayer, R. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9047-2 · Cited by 1,666
Learning from Examples: Instructional Principles from the Worked Examples Research
Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000) · Review of Educational Research · doi:10.2307/1170661 · Cited by 1,029
Empirical Studies of Programming Knowledge
Soloway, E., & Ehrlich, K. (1984) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1984.5010283 · Cited by 877
A study of the difficulties of novice programmers
Lahtinen, E., Ala-Mutka, K., & Järvinen, H.-M. (2005) · Proceedings of the 10th annual SIGCSE conference on Innovation and technology in computer science education · doi:10.1145/1067445.1067453 · Cited by 827
(2007) · PubMed · Cited by 685
Rittle-Johnson, B., & Star, J. R. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.3.561 · Cited by 536
Deliberate practice: Is that all it takes to become an expert?
Hambrick, D. Z., Oswald, F. L., Altmann, E. M., Meinz, E. J., Gobet, F., & Campitelli, G. (2014) · Intelligence · doi:10.1016/j.intell.2013.04.001 · Cited by 370
Relationships between reading, tracing and writing skills in introductory programming
Lopez, M., Whalley, J., Robbins, P., & Lister, R. (2008) · Proceedings of the Fourth international Workshop on Computing Education Research · doi:10.1145/1404520.1404531 · Cited by 363
Example-centric programming: integrating web search into the development environment
Brandt, J., Dontcheva, M., Weskamp, M., & Klemmer, S. R. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753402 · Cited by 324 · cited 1×
“Aworked example is a full or partial solution to a problem for the purpose of instruction [3, 9, 51].”
BackgroundUnlocking the clubhouse women in computing
Margolis, J., & Fisher, A. L. (n.d.) · Cited by 320
The role of deliberate practice in chess expertise
Charness, N., Tuffiash, M., Krampe, R., Reingold, E., & Vasyukova, E. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1106 · Cited by 306
37 Million Compilations: Investigating Novice Programming Mistakes in Large-Scale Student Data
Altadmri, A., & Brown, N. C. C. (2015) · Proceedings of the 46th ACM Technical Symposium on Computer Science Education · doi:10.1145/2676723.2677258 · Cited by 261
The role of deliberate practice in the acquisition of clinical skills
Duvivier, R. J., van Dalen, J., Muijtjens, A. M., Moulaert, V. R., van der Vleuten, C. P., & Scherpbier, A. J. (2011) · BMC Medical Education · doi:10.1186/1472-6920-11-101 · Cited by 223 · cited 1×
“Drilling techniques are used inmany technical skills, such as cooking, music [18], sports [19], chess [11], and even medical diagnosis [16].”
BackgroundTowards a theory of the cognitive processes in computer programming
Brooks, R. (1977) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(77)80039-4 · Cited by 222
Evaluating a new exam question: Parsons problems
Denny, P., Luxton-Reilly, A., & Simon, B. (2008) · Proceedings of the Fourth international Workshop on Computing Education Research · doi:10.1145/1404520.1404532 · Cited by 203
Gerjets, P., Scheiter, K., & Catrambone, R. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.02.007 · Cited by 178
Wheel-Spinning: Students Who Fail to Master a Skill
Beck, J. E., & Gong, Y. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39112-5_44 · Cited by 161
Youngs, E. A. (1974) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(74)80027-1 · Cited by 134
Atkinson, R. K., & Renkl, A. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9055-2 · Cited by 128
Characteristics of the mental representations of novice and expert programmers: an empirical study
Wiedenbeck, S., Fix, V., & Scholtz, J. C. (1993) · International Journal of Man-Machine Studies · doi:10.1006/imms.1993.1084 · Cited by 110
Uncovering principles of novice programming
Bonar, J., & Soloway, E. (1983) · Proceedings of the 10th ACM SIGACT-SIGPLAN symposium on Principles of programming languages - POPL '83 · doi:10.1145/567067.567069 · Cited by 84
Exploring the Impact of Worked Examples in a Novice Programming Environment
Zhi, R., Price, T. W., Marwan, S., Milliken, A., Barnes, T., & Chi, M. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287385 · Cited by 75 · cited 3×
“Comparing example solutions has been shown to help students form more abstractmentalmodels in STEMdomains such asmathematics, physics, and block-based computer programming [12, 41, 57].”
BackgroundMethodWhen Is It Best to Learn with All Worked Examples?
McLaren, B. M., & Isotani, S. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21869-9_30 · Cited by 73
Learning Curve Analysis for Programming: Which Concepts do Students Struggle With?
Rivers, K., Harpstead, E., & Koedinger, K. R. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960333 · Cited by 72
Sargent, J. F. (2013) · University of North Texas Digital Library (University of North Texas) · Cited by 70
Evidence That Computer Science Grades Are Not Bimodal
Patitsas, E., Berlin, J., Craig, M., & Easterbrook, S. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960312 · Cited by 62
Finkenbinder, E. O. (1913) · The American Journal of Psychology · doi:10.2307/1413271 · Cited by 52
Accessible AST-Based Programming for Visually-Impaired Programmers
Schanzer, E., Bahram, S., & Krishnamurthi, S. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287499 · Cited by 47
The introductory computer programming course is first and foremost a language course
Portnoff, S. R. (2018) · ACM Inroads · doi:10.1145/3152433 · Cited by 43
Educational Experiences of Blind Programmers
Baker, C. M., Bennett, C. L., & Ladner, R. E. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287410 · Cited by 41 · cited 1×
“One additional limitation that was brought to our attention by prior discussion at SIGCSE is the lack of support for students with visual impairments or other limitations [5, 45, 50].”
BackgroundComputer Science Principles for Teachers of Blind and Visually Impaired Students
Stefik, A., Ladner, R. E., Allee, W., & Mealin, S. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287453 · Cited by 39 · cited 1×
“One additional limitation that was brought to our attention by prior discussion at SIGCSE is the lack of support for students with visual impairments or other limitations [5, 45, 50].”
BackgroundFrequency distribution of error messages
Pritchard, D. (2015) · Proceedings of the 6th Workshop on Evaluation and Usability of Programming Languages and Tools · doi:10.1145/2846680.2846681 · Cited by 32
Shaw, Z. A. (2017) · Cited by 31
Exploring the Applicability of Simple Syntax Writing Practice for Learning Programming
Leinonen, A., Nygren, H., Pirttinen, N., Hellas, A., & Leinonen, J. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287378 · Cited by 27 · cited 2×
“There has been recent research into the effectiveness of typing exercises [30].”
BackgroundDifferent Perceptions of Computer Science
Funke, A., Berges, M., & Hubwieser, P. (2016) · International Conference on Learning and Teaching in Computing and Engineering (LaTICE) · doi:10.1109/latice.2016.1 · Cited by 25
Evaluation of Source Code with Item Response Theory
Berges, M., & Hubwieser, P. (2015) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2729094.2742619 · Cited by 21
Falling Behind Early and Staying Behind When Learning to Program
Ahadi, A., Lister, R., & Teague, D. (2014) · UTS ePRESS (University of Technology Sydney) · Cited by 19
Giving Students Canned Code using Typing Exercises
Gaweda, A. M., & Lynch, C. F. (2019) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3287324.3293836 · Cited by 1
Self-citation
Research works printed but not linked: 8
- Allan Fisher , Jane Margolis , and Faye Miller . Undergraduate women in computer science: experience, motivation and culture . In ACM SIGCSE Bulletin , volume 29 , pages 106 -- 110 . ACM , 1997 . Allan Fisher, Jane Margolis, and Faye Miller. Undergraduate women in computer science: experience, motivation and culture. In ACM SIGCSE Bulletin, volume 29, pages 106--110. ACM, 1997.
- Steven Henn . Why women stopped coding , 2014 . Steven Henn. Why women stopped coding, 2014.
- 10.5555/2038043 · doi:10.5555/2038043
- Roxana Moreno and Richard Mayer . Interactive multimodal learning environments. Educational psychology review, 19(3):309--326 , 2007 . Roxana Moreno and Richard Mayer. Interactive multimodal learning environments. Educational psychology review, 19(3):309--326, 2007.
- Dale Parsons and Patricia Haden . Parson's programming puzzles : A fun and effective learning tool for first programming courses . In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 , ACE '06, pages 157 -- 163 , Darlinghurst, Australia, Australia , 2006 . Australian Computer Society, Inc. Dale Parsons and Patricia Haden. Parson's programming puzzles: A fun and effective learning tool for first programming courses. In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52, ACE '06, pages 157--163, Darlinghurst, Australia, Australia, 2006. Australian Computer Society, Inc.
- M. Poppendieck . Deliberate practice in software development. a , 2009 . M. Poppendieck. Deliberate practice in software development. a, 2009.
- Eric Roberts . A history of capacity challenges in computer science , 2016 . Eric Roberts. A history of capacity challenges in computer science, 2016.
- Adithya Sheshadri , Niki Gitinabard , Collin F Lynch , Tiffany Barnes , and Sarah Heckman . Predicting student performance based on online study habits: a study of blended courses. arXiv preprint arXiv:1904.07331 , 2019 . Adithya Sheshadri, Niki Gitinabard, Collin F Lynch, Tiffany Barnes, and Sarah Heckman. Predicting student performance based on online study habits: a study of blended courses. arXiv preprint arXiv:1904.07331, 2019. · arXiv
Cited by
Prather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., & Santos, E. A. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3617367 · Cited by 256
“This form of typing practice has pedagogical benefits for learners and researchers have explored similar typing exercises, in which learners must type out code examples, as a way to help novice students practice low-level implementation skills [35, 47].”
BackgroundKazemitabaar, M., Huang, O., Suh, S., Henley, A. Z., & Grossman, T. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712104 · Cited by 92
Edwards, J., Ditton, J., Trninić, D., Swanson, H., Sullivan, S., & Mano, C. D. (2020) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3372782.3406259 · Cited by 49
Analysis of Novices' Web-Based Help-Seeking Behavior While Programming
Skripchuk, J., Bennett, N., Zhang, J., Li, E., & Price, T. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569852 · Cited by 22
Student Attitudes Toward Syntax Exercises in CS1
Sullivan, S., Swanson, H., & Edwards, J. (2021) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3408877.3432399 · Cited by 9
Metadata
- Authors
- Gaweda, A. M., Lynch, C. F., Seamon, N., Silva de Oliveira, G., & Deliwa, A.
- Affiliations
- North Carolina State University (US)
- North Carolina State University, Raleigh, North Carolina, U.S.A.
- Venue
- Proceedings of the Twenty-Second Australasian Computing Education Conference
- Publisher
- ACM
- Published
- 2020-02-03
- Pages
- 105-113
- OpenAlex
- W3000789961
- Cited by
- 21
- References
- 48
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 2 · 2023: 7 · 2021: 3 · 2020: 3
- FWCI
- 3.77
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Australasian Computing Education Conference (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Keywords
- deliberate practice, novice programmers, debugging, compilation errors, computer science education, learning gains, course performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.