The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Solving parsons problems versus fixing and writing code
Abstract
Prior research has shown that Parsons problems are an engaging type of code completion problem that can be used to teach syntactic and semantic language constructs. They can also be used in summative assessments to reduce marking time and grading variability compared to code writing problems. In a Parsons problem the correct code is provided, but is broken into mixed-up code blocks that must be assembled in the correct order. Two-dimensional Parsons problems also require the code blocks to be indented correctly. Parsons problems can contain extra code blocks, called distractors, which are not needed in a correct solution. We present a study that compared the efficiency, effectiveness, and cognitive load of learning from solving two-dimensional Parsons problems with distractors, versus fixing code with the same errors as the distractors, versus writing the equivalent code. We found that solving two-dimensional Parsons problems with distractors took significantly less time than fixing code with errors or than writing the equivalent code. Additionally, there was no statistically significant difference in the learning performance, or in student retention of the knowledge one week later.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recently, Ericson et al. found that interleaving WEs with Parsons problems can improve programming learning efficiency compared to WEs paired with writing code or fixing code [3].”
From Exploring the Impact of Worked Examples in a Novice Programming Environment (2019) · cites this paper as [3]
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
(2000) · Cited by 2,779
Ericsson, K. A. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.038 · Cited by 1,629
Active‐Constructive‐Interactive: A Conceptual Framework for Differentiating Learning Activities
Chi, M. T. H. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01005.x · Cited by 1,597
Statistics for behavioral sciences
Gravetter, F. J., & Wallnau, L. B. (1985) · Cited by 1,104
Development of an instrument for measuring different types of cognitive load
Leppink, J., Paas, F., Van der Vleuten, C. P. M., Van Gog, T., & Van Merriënboer, J. J. G. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0334-1 · Cited by 1,066
Learning from Examples: Instructional Principles from the Worked Examples Research
Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000) · Review of Educational Research · doi:10.2307/1170661 · Cited by 1,029
Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning
van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_2 · Cited by 857
(2011) · Cited by 725
Research works printed but not linked: 7
- 10.3102/00346543070002181 · doi:10.3102/00346543070002181 · Paper page
- John D. Bransford , Ann L. Brown and Rodney R . Cocking How People Learn. NATIONAL ACADEMY PRESS , 2000 . John D. Bransford, Ann L. Brown and Rodney R. Cocking How People Learn. NATIONAL ACADEMY PRESS, 2000.
- 10.1037/0096-3445.127.4.355 · doi:10.1037/0096-3445.127.4.355 · Paper page
- Barbara Ericson Java Review Book for the AP CS A exam https://runestone.academy/runestone/static/JavaReview/index.html Barbara Ericson Java Review Book for the AP CS A exam https://runestone.academy/runestone/static/JavaReview/index.html
- 10.1207/s15516709cog1202_4 · doi:10.1207/s15516709cog1202_4 · Paper page
- William MK Trochim and James P Donnelly Research methods knowledge base ( 3 rd ed). Atomic Dog , Cincinnati, OH , 2006 . William MK Trochim and James P Donnelly Research methods knowledge base (3rd ed). Atomic Dog, Cincinnati, OH, 2006.
- Barry J. Wadsworth Piaget's Theory of Cognitive and Affective Development - Fourth Edition. Longman , New York 1989 . Barry J. Wadsworth Piaget's Theory of Cognitive and Affective Development - Fourth Edition. Longman, New York 1989.
Cited by
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241
Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming
Kazemitabaar, M., Chow, J., Ma, C. K. T., Ericson, B. J., Weintrop, D., & Grossman, T. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580919 · Cited by 366
“Learner’s typically complete Parsons problems significantly more quickly than fixing or writing code and have similar learning gains [24, 25, 94].”
Self-citationCognitive Load Theory in Computing Education Research: A Review
Duran, R., Zavgorodniaia, A., & Sorva, J. (2022) · ACM Transactions on Computing Education · doi:10.1145/3483843 · Cited by 92
Evaluating the Efficiency and Effectiveness of Adaptive Parsons Problems
Ericson, B. J., Foley, J. D., & Rick, J. (2018) · Proceedings of the 2018 ACM Conference on International Computing Education Research · doi:10.1145/3230977.3231000 · Cited by 70
Self-citationReeves, B., Sarsa, S., Prather, J., Denny, P., Becker, B. A., Hellas, A., Kimmel, B., Powell, G., & Leinonen, J. (2023) · Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 · doi:10.1145/3587102.3588805 · Cited by 56
Metadata
- Authors
- Ericson, B. J., Margulieux, L. E., & Rick, J.
- Affiliations
- Georgia Institute of Technology (US)
- Georgia State University (US)
- Venue
- Proceedings of the 17th Koli Calling International Conference on Computing Education Research
- Publisher
- ACM
- Published
- 2017-11-16
- Pages
- 20-29
- OpenAlex
- W2766230222
- Semantic Scholar
- 2f1b7c75a3cc2f33fc34575bbe77eeb1f336debc
- Cited by
- 121
- References
- 56
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 13 · 2023: 21 · 2022: 18 · 2021: 19 · 2020: 18 · 2019: 14 · 2018: 3
- FWCI
- 8.82
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Koli Calling International Conference on Computing Education Research (publishedVersion)
- Funders
- National Science Foundation (1432300 and 1138378)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Education › Educational Robotics and Engineering
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- Parsons problems, distractors, code completion, writing software, programming education, cognitive load, learning efficiency, knowledge retention, summative assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Solving parsons problems versus fixing and writing code. https://app.cochat.ai/papers/10.1145/3141880.3141895
- The paper
- Ericson, B. J., Margulieux, L. E., & Rick, J. (2017). Solving parsons problems versus fixing and writing code. Proceedings of the 17th Koli Calling International Conference on Computing Education Research. https://doi.org/10.1145/3141880.3141895
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.