Solving parsons problems versus fixing and writing code
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Prior research has shown that Parsons problems are an engaging type of code completion problem that can be used to teach syntactic and semantic language constructs. They can also be used in summative assessments to reduce marking time and grading variability compared to code writing problems. In a Parsons problem the correct code is provided, but is broken into mixed-up code blocks that must be assembled in the correct order. Two-dimensional Parsons problems also require the code blocks to be indented correctly. Parsons problems can contain extra code blocks, called distractors, which are not needed in a correct solution. We present a study that compared the efficiency, effectiveness, and cognitive load of learning from solving two-dimensional Parsons problems with distractors, versus fixing code with the same errors as the distractors, versus writing the equivalent code. We found that solving two-dimensional Parsons problems with distractors took significantly less time than fixing code with errors or than writing the equivalent code. Additionally, there was no statistically significant difference in the learning performance, or in student retention of the knowledge one week later.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recently, Ericson et al. found that interleaving WEs with Parsons problems can improve programming learning efficiency compared to WEs paired with writing code or fixing code [3].”
From Exploring the Impact of Worked Examples in a Novice Programming Environment (2019) · cites this paper as [3]
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
(2000) · Cited by 2,779
Ericsson, K. A. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.038 · Cited by 1,629
Active‐Constructive‐Interactive: A Conceptual Framework for Differentiating Learning Activities
Chi, M. T. H. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01005.x · Cited by 1,597
Statistics for behavioral sciences
Gravetter, F. J., & Wallnau, L. B. (1985) · Cited by 1,104
Development of an instrument for measuring different types of cognitive load
Leppink, J., Paas, F., Van der Vleuten, C. P. M., Van Gog, T., & Van Merriënboer, J. J. G. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0334-1 · Cited by 1,066
Learning from Examples: Instructional Principles from the Worked Examples Research
Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000) · Review of Educational Research · doi:10.2307/1170661 · Cited by 1,029
Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning
van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_2 · Cited by 857
(2011) · Cited by 725
Research works printed but not linked: 6
- 10.3102/00346543070002181 · doi:10.3102/00346543070002181 · Paper page
- John D. Bransford , Ann L. Brown and Rodney R . Cocking How People Learn. NATIONAL ACADEMY PRESS , 2000 . John D. Bransford, Ann L. Brown and Rodney R. Cocking How People Learn. NATIONAL ACADEMY PRESS, 2000.
- 10.1037/0096-3445.127.4.355 · doi:10.1037/0096-3445.127.4.355 · Paper page
- Barbara Ericson Java Review Book for the AP CS A exam https://runestone.academy/runestone/static/JavaReview/index.html Barbara Ericson Java Review Book for the AP CS A exam https://runestone.academy/runestone/static/JavaReview/index.html
- William MK Trochim and James P Donnelly Research methods knowledge base ( 3 rd ed). Atomic Dog , Cincinnati, OH , 2006 . William MK Trochim and James P Donnelly Research methods knowledge base (3rd ed). Atomic Dog, Cincinnati, OH, 2006.
- Barry J. Wadsworth Piaget's Theory of Cognitive and Affective Development - Fourth Edition. Longman , New York 1989 . Barry J. Wadsworth Piaget's Theory of Cognitive and Affective Development - Fourth Edition. Longman, New York 1989.
Cited by
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241
Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming
Kazemitabaar, M., Chow, J., Ma, C. K. T., Ericson, B. J., Weintrop, D., & Grossman, T. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580919 · Cited by 366
“Learner’s typically complete Parsons problems significantly more quickly than fixing or writing code and have similar learning gains [24, 25, 94].”
Self-citationIzu, C., Schulte, C., Aggarwal, A., Cutts, Q., Duran, R., Gutica, M., Heinemann, B., Kraemer, E., Lonati, V., Mirolo, C., et al. (2019) · Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3344429.3372501 · Cited by 97
Cognitive Load Theory in Computing Education Research: A Review
Duran, R., Zavgorodniaia, A., & Sorva, J. (2022) · ACM Transactions on Computing Education · doi:10.1145/3483843 · Cited by 92
“— Ericson et al. [20] compared the effects of two forms of practice—Parsons problems and program writing—on learning outcomes, efficiency, and cognitive load.”
BackgroundKazemitabaar, M., Huang, O., Suh, S., Henley, A. Z., & Grossman, T. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712104 · Cited by 92
Exploring the Impact of Worked Examples in a Novice Programming Environment
Zhi, R., Price, T. W., Marwan, S., Milliken, A., Barnes, T., & Chi, M. (2019) · Proceedings of the 50th ACM Technical Symposium on Computer Science Education · doi:10.1145/3287324.3287385 · Cited by 75
Evaluating the Efficiency and Effectiveness of Adaptive Parsons Problems
Ericson, B. J., Foley, J. D., & Rick, J. (2018) · Proceedings of the 2018 ACM Conference on International Computing Education Research · doi:10.1145/3230977.3231000 · Cited by 70
Self-citationA Review of Research on Parsons Problems
Du, Y., Luxton-Reilly, A., & Denny, P. (2020) · Proceedings of the Twenty-Second Australasian Computing Education Conference · doi:10.1145/3373165.3373187 · Cited by 66
Grover, S., Broll, B., & Babb, D. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569750 · Cited by 64
Improving Engagement in Program Construction Examples for Learning Python Programming
Hosseini, R., Akhüseyinoğlu, K., Brusilovsky, P. L., Malmi, L., Pollari-Malmi, K., Schunn, C. D., & Sirkiä, T. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00197-0 · Cited by 63
Improving Instruction of Programming Patterns with Faded Parsons Problems
Weinman, N., Fox, A., & Hearst, M. A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445228 · Cited by 60
Reeves, B., Sarsa, S., Prather, J., Denny, P., Becker, B. A., Hellas, A., Kimmel, B., Powell, G., & Leinonen, J. (2023) · Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 · doi:10.1145/3587102.3588805 · Cited by 56
“…been studied in motivating students to practice [34]; as summative assessments [5]; as a bridge between code tracing and code writing activities [12]; to catalog common student errors when problem-solving [21]; in helping students learn programming in block-based environments [43]; and even to…”
BackgroundMethodParsons Problems and Beyond: Systematic Literature Review and Empirical Study Designs
Ericson, B. J., Denny, P., Prather, J., Duran, R., Hellas, A., Leinonen, J., Miller, C. S., Morrison, B. B., Pearce, J. L., & Rodger, S. H. (2022) · Proceedings of the 2022 Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3571785.3574127 · Cited by 56
Self-citationA Review of Worked Examples in Programming Activities
Müldner, K., Jennings, J., & Chiarelli, V. (2022) · ACM Transactions on Computing Education · doi:10.1145/3560266 · Cited by 56
Hou, I., Man, O., Mettille, S., Gutierrez, S., Angelikas, K., & MacNeil, S. (2024) · Australasian Computing Education Conference · doi:10.1145/3636243.3636247 · Cited by 47
Runestone: A Platform for Free, On-line, and Interactive Ebooks
Ericson, B. J., & Miller, B. (2020) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3328778.3366950 · Cited by 45
Self-citationEvaluating the Effectiveness of Parsons Problems for Block-based Programming
Zhi, R., Chi, M., Barnes, T., & Price, T. W. (2019) · Proceedings of the 2019 ACM Conference on International Computing Education Research · doi:10.1145/3291279.3339419 · Cited by 42
“This is consistent with previous studies that Parsons problems improve students learning efficiency [6, 8, 13].”
BackgroundResultInfluentialGrover, S. (2021) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3408877.3432460 · Cited by 42
Haynes-Magyar, C., & Ericson, B. J. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445292 · Cited by 40
Self-citationCrescendo: Engaging Students to Self-Paced Programming Practices
Wang, W., Zhi, R., Milliken, A., Lytle, N., & Price, T. (2020) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3328778.3366919 · Cited by 38
Using Adaptive Parsons Problems to Scaffold Write-Code Problems
Hou, X., Ericson, B. J., & Wang, X. (2022) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3501385.3543977 · Cited by 38
Self-citationGane, B. D., Israel, M., Elagha, N., Yan, W., Luo, F., & Pellegrino, J. W. (2021) · Computer Science Education · doi:10.1080/08993408.2021.1874221 · Cited by 37
Investigating the Affect and Effect of Adaptive Parsons Problems
Ericson, B. J., McCall, A., & Cunningham, K. I. (2019) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3364510.3364524 · Cited by 36
Self-citationEpplets: A Tool for Solving Parsons Puzzles
Kumar, A. N. (2018) · Proceedings of the 49th ACM Technical Symposium on Computer Science Education · doi:10.1145/3159450.3159576 · Cited by 35
Predicting Cognitive Load in Future Code Puzzles
Kelleher, C. L., & Hnin, W. Y. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300487 · Cited by 35
Seeing Beyond Expert Blind Spots: Online Learning Design for Scale and Quality
Wang, X., Rosé, C. P., & Koedinger, K. R. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445045 · Cited by 32
Proof Blocks: Autogradable Scaffolding Activities for Learning to Write Proofs
Poulsen, S., Viswanathan, M., Herman, G. L., & West, M. (2022) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3502718.3524774 · Cited by 31
When Wrong is Right: The Instructional Power of Multiple Conceptions
Margulieux, L. E., Denny, P. C., Cunningham, K. I., Deutsch, M., & Shapiro, B. R. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469750 · Cited by 30
Self-citationThorgeirsson, S., Weidmann, T. B., Weidmann, K.-H., & Su, Z. (2024) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3626252.3630808 · Cited by 26
Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor
Fabic, G. V. F., Mitrović, A., & Neshatian, K. (2019) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-019-00184-0 · Cited by 26
Hou, X., Ericson, B. J., & Wang, X. (2023) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3631802.3631832 · Cited by 25
Self-citationAdaptive Problem Selection in a Mobile Python Tutor
Fabic, G. V. F., Mitrović, A., & Neshatian, K. (2018) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3213586.3225235 · Cited by 24
Broll, B., & Grover, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.26898 · Cited by 23
Stochastic Tree-Based Generation of Program-Tracing Practice Questions
Thomas, A., Stopera, T., Frank-Bolton, P., & Simha, R. (2019) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3287324.3287492 · Cited by 23
Discovering, Autogenerating, and Evaluating Distractors for Python Parsons Problems in CS1
Smith, D. H., & Zilles, C. B. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569801 · Cited by 23
Efficiency of Learning from Proof Blocks Versus Writing Proofs
Poulsen, S., Gertner, Y., Cosman, B., West, M., & Herman, G. L. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569797 · Cited by 21
Automating Personalized Parsons Problems with Customized Contexts and Concepts
Gutierrez, A. D. C., Denny, P. C., & Luxton-Reilly, A. (2024) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3649217.3653568 · Cited by 21
The Relationship Between Voluntary Practice of Short Programming Exercises and Exam Performance
Edwards, S. H., Murali, K. P., & Kazerouni, A. M. (2019) · ACM Global Computing Education Conference (CompEd) · doi:10.1145/3300115.3309525 · Cited by 20
Fostering Responsible AI Use Through Negative Expertise: A Contextualized Autocompletion Quiz
MacNeil, S., Prather, J. E., Nabid, R. A., Gutierrez, S., Carvalho, S., Shrestha, S., Denny, P. C., Reeves, B. N., Leinonen, J., & Rossetti, R. L. (2025) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3724363.3729067 · Cited by 19
Goletti, O., Mens, K., & Hermans, F. (2021) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3430665.3456348 · Cited by 18
Lehtinen, T., Haaranen, L., & Leinonen, J. (2023) · Proceedings of the 25th Australasian Computing Education Conference · doi:10.1145/3576123.3576129 · Cited by 17
Measuring the Cognitive Load of Learning to Program: A Replication Study
Zavgorodniaia, A., Duran, R., Hellas, A., Seppälä, O., & Sorva, J. (2020) · doi:10.1145/3416465.3416468 · Cited by 17
Another Victim of COVID-19: Computer Science Education
YeckehZaare, I., Grot, G., Dimovski, I., Pollock, K., & Fox, E. (2022) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3478431.3499313 · Cited by 17
Exploring the Difficulty of Faded Parsons Problems for Programming Education
Fromont, F., Jayamanne, H., & Denny, P. C. (2023) · Australasian Computing Education Conference · doi:10.1145/3576123.3576136 · Cited by 17
Evaluating Proof Blocks Problems as Exam Questions
Poulsen, S., Viswanathan, M., Herman, G. L., & West, M. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469741 · Cited by 17
Multi-Institutional Multi-National Studies of Parsons Problems
Ericson, B. J., Pearce, J. L., Rodger, S. H., Csizmadia, A. P., Garcia, R., Gutiérrez, F. J., Liaskos, K. B., Padiyath, A., Scott, M., Smith, D. H., et al. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3623762.3633498 · Cited by 15
Self-citationExploring Challenging Variations of Parsons Problems
Weinman, N., Fox, A., & Hearst, M. A. (2020) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3328778.3372639 · Cited by 15
Investigating the Role and Impact of Distractors on Parsons Problems in CS1 Assessments
Smith, D. H., Fowler, M., & Zilles, C. B. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3587102.3588819 · Cited by 14
Helping Students Solve Parsons Puzzles Better
Kumar, A. N. (2019) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3304221.3319735 · Cited by 14
Integrating Parsons puzzles within Scratch enables efficient computational thinking learning
Bender, J., Zhao, B., Dziena, A., & Kaiser, G. E. (2022) · Research and Practice in Technology Enhanced Learning · doi:10.58459/rptel.2023.18022 · Cited by 13
Milicic, G., Wetzel, S., & Ludwig, M. (2020) · Future Internet · doi:10.3390/fi12090152 · Cited by 13
Adaptive Parsons Problems as Active Learning Activities During Lecture
Ericson, B. J., & Haynes-Magyar, C. (2022) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3502718.3524808 · Cited by 13
Self-citationComparing learning ecologies of primary graphical programming: create or fix?
Neutens, T., Barbion, E., Coolsaet, K., & wyffels, F. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12570 · Cited by 12
Using Context-Free Grammars to Scaffold and Automate Feedback in Precise Mathematical Writing
Xia, J., & Zilles, C. B. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569728 · Cited by 12
An Electroencephalography Study on Cognitive Load in Visual and Textual Programming
Thorgeirsson, S., Zhang, C., Weidmann, T. B., Weidmann, K.-H., & Su, Z. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632620.3671124 · Cited by 12
Bender, J., Zhao, B., Dziena, A., & Kaiser, G. E. (2022) · Australasian Computing Education Conference · doi:10.1145/3511861.3511869 · Cited by 12
Teaching Test-Writing As a Variably-Scaffolded Programming Pattern
Lojo, N., & Fox, A. (2022) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3502718.3524789 · Cited by 12
The Impact of Solving Adaptive Parsons Problems with Common and Uncommon Solutions
Haynes-Magyar, C., & Ericson, B. J. (2022) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3564721.3564736 · Cited by 12
Self-citationSpeed and Studying: Gendered Pathways to Success
YeckehZaare, I., & Resnick, P. (2019) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3287324.3287417 · Cited by 11
Incentivized Spacing and Gender in Computer Science Education
YeckehZaare, I., Fox, E., Grot, G., Chen, S., Walkosak, C., Kwon, K., Hofmann, A., Steir, J., McGeough, O., & Silverstein, N. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469760 · Cited by 11
Using Micro Parsons Problems to Scaffold the Learning of Regular Expressions
Wu, Z., Ericson, B. J., & Brooks, C. A. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3587102.3588853 · Cited by 11
Self-citationCodeTree: A System for Learnersourcing Subgoal Hierarchies in Code Examples
Jin, H., & Kim, J. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637308 · Cited by 10
Smith, D. H., Poulsen, S., Emeka, C., Wu, Z., Haynes-Magyar, C., & Zilles, C. B. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632620.3671114 · Cited by 10
Peer Instruction in Software Engineering - Findings from Fine-grained Clicker Data
Gopal, B., & Cooper, S. (2021) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3408877.3432405 · Cited by 10
Detecting Struggling Students from Interactive Ebook Data
Ericson, B. J., Maeda, H., & Dhillon, P. S. (2022) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3478431.3499354 · Cited by 10
Self-citationMnemonic Variable Names in Parsons Puzzles
Kumar, A. N. (2019) · ACM Global Computing Education Conference (CompEd) · doi:10.1145/3300115.3309509 · Cited by 10
E-Assessment in Programming Courses: Towards a Digital Ecosystem Supporting Diverse Needs?
Chirumamilla, A., & Sindre, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29374-1_47 · Cited by 10
Should Explanations of Program Code Use Audio, Text, or Both? A Replication Study
Zavgorodniaia, A., Hellas, A., Seppälä, O., & Sorva, J. (2020) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3428029.3428050 · Cited by 10
An online platform for teaching upper secondary school computer science
Waite, J., Franceschini, A., Sentance, S., Patterson, M., & Sharkey, J. P. (2021) · doi:10.1145/3481282.3481287 · Cited by 9
CSAwesome: AP CSA curriculum and professional development (practical report)
Ericson, B. J., Hoffman, B., & Rosato, J. (2020) · Workshop in Primary and Secondary Computing Education · doi:10.1145/3421590.3421593 · Cited by 9
Self-citationWrong Answers for Wrong Reasons: The Risks of Ad Hoc Instruments
Chiodini, L., & Hauswirth, M. (2021) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3488042.3488045 · Cited by 9
Evaluating proof blocks problems as exam questions
Poulsen, S., Viswanathan, M., Herman, G. L., & West, M. (2022) · ACM Inroads · doi:10.1145/3514213 · Cited by 9
Goletti, O., Mens, K., & Hermans, F. (2022) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3564721.3565951 · Cited by 8
Regex Parsons: Using Horizontal Parsons Problems to Scaffold Learning Regex
Wu, Z., Ericson, B. J., & Brooks, C. A. (2021) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3488042.3489968 · Cited by 8
Self-citationCodespec: A Computer Programming Practice Environment
Haynes-Magyar, C., & Haynes-Magyar, N. J. (2022) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3501709.3544278 · Cited by 8
Smith, D. H., Poulsen, S., Fowler, M., & Zilles, C. B. (2023) · ACM Global Computing Education Conference (CompEd) · doi:10.1145/3576882.3617927 · Cited by 8
Work in Progress: Parsons Problems as a Tool in the First-Year Engineering Classroom
Morin, B., Kecskemety, K., Harper, K., & Clingan, P. A. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--35675 · Cited by 7
Disentangling the Learning Gains from Reading a Book Chapter and Completing Proof Blocks Problems
Poulsen, S., Gertner, Y., Chen, H., Cosman, B., West, M., & Herman, G. L. (2024) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3626252.3630831 · Cited by 6
Using Bugs in Student Code to Predict Need for Help
Malysheva, Y., & Kelleher, C. L. (2020) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc50065.2020.9127252 · Cited by 6
Code Writing vs Code Completion Puzzles: Analyzing Questions in an E-exam
Sindre, G. (2020) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie44824.2020.9273919 · Cited by 6
Measuring the Impact of Distractors on Student Learning Gains while Using Proof Blocks
Poulsen, S., Chen, H., Gertner, Y., Cosman, B., West, M., & Herman, G. L. (2025) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3641554.3701787 · Cited by 6
Investigating the Effectiveness of Variations of Micro Parsons Problems
Wu, Z. (2023) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3568812.3603447 · Cited by 6
Representing and Evaluating Strategies for Solving Parsons Puzzles
Kumar, A. N. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22244-4_24 · Cited by 6
Schantong, B., Gorgosch, D., & Siegmund, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.01709 · Cited by 6
Structuring Collaboration in Programming Through Personal-Spaces
Hayatpur, D., Helfenbaum, T., Xia, H., Stuerzlinger, W., & Gries, P. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585630 · Cited by 5
Conducting Multi-Institutional Studies of Parsons Problems
Ericson, B. J., Pearce, J. L., Rodger, S. H., Csizmadia, A. P., Garcia, R., Gutiérrez, F. J., Liaskos, K. B., Padiyath, A., Scott, M., Smith, D. H., et al. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3587103.3594211 · Cited by 5
Self-citationThe Landscape of Computer Science Education Courses: A Syllabi Analysis
Cunningham, K. I., Parker, M. C., & Zhang, J. (2023) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3631802.3631831 · Cited by 5
Split-Paper Testing: A Novel Approach to Evaluate Programming Performance
Nakayama, Y., Kuno, Y., & Kakuda, H. (2020) · Journal of Information Processing · doi:10.2197/ipsjjip.28.733 · Cited by 5
Bari, A. T. M. G., Gaspar, A., Wiegand, R. P., Vitel, D., Tan, K. C., & Kozakoff, S. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--33142 · Cited by 5
Fading Strategies for Parsons Problems in Intermediate Classrooms
Caraco, S., Lojo, N., & Fox, A. (2025) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3724363.3729062 · Cited by 4
Parsons problems and computing education learning theories
Szabo, C., Sheard, J., Malmi, L., & Kinnunen, P. (2025) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3769994.3770032 · Cited by 4
Jocius, R., Albert, J. L., O’Byrne, W. I., Joshi, D., Robinson, R., & Blanton, M. (2023) · Computer Science Education · doi:10.1080/08993408.2023.2210458 · Cited by 4
Generating Multi-Part Autogradable Faded Parsons Problems From Code-Writing Exercises
Caraco, S., Lojo, N., VERDICCHIO, M. P., & Fox, A. (2024) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3626252.3630786 · Cited by 4
Ten quick tips for delivering programming lessons
Wilson, G. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007433 · Cited by 4
Goletti, O. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469776 · Cited by 3
Tabarsi, B. T., Reichert, H., Lytle, N., Cateté, V., & Barnes, T. M. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632620.3671110 · Cited by 3
Parsons Problems for Equivalence Proofs in Logic
van den Berg, M., Heeren, B. J., & Rahimi, E. (2024) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3699538.3699551 · Cited by 3
Collaborative Parsons Problems in a Remote-learning First-year Engineering Classroom
Morin, B., & Kecskemety, K. (2021) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--36809 · Cited by 3
Goletti, O., de Pierpont, F., Mens, K., & DidaSTIC, D. 9. –. (2022) · HAL · Cited by 3
Metadata
- Authors
- Ericson, B. J., Margulieux, L. E., & Rick, J.
- Affiliations
- Georgia Institute of Technology (US)
- Georgia State University (US)
- Venue
- Proceedings of the 17th Koli Calling International Conference on Computing Education Research
- Publisher
- ACM
- Published
- 2017-11-16
- Pages
- 20-29
- OpenAlex
- W2766230222
- Semantic Scholar
- 2f1b7c75a3cc2f33fc34575bbe77eeb1f336debc
- Cited by
- 121
- References
- 56
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 13 · 2023: 21 · 2022: 18 · 2021: 19 · 2020: 18 · 2019: 14 · 2018: 3
- FWCI
- 8.82
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Koli Calling International Conference on Computing Education Research (publishedVersion)
- Funders
- National Science Foundation (1432300 and 1138378)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Education › Educational Robotics and Engineering
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- Parsons problems, distractors, code completion, writing software, programming education, cognitive load, learning efficiency, knowledge retention, summative assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.