Using Tracing and Sketching to Solve Programming Problems: Replicating and Extending an Analysis of What Students Draw
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Sketching out a code trace is a cognitive assistance for programmers, student and professional. Previous research (Lister et al. 2004) showed that students who sketch a trace on paper had greater success on code 'reading' problems involving loops, arrays, and conditionals. We replicated this finding, and developed further categories of student sketching strategies. Our results support previous findings that students who don't sketch on code reading problems have a lower success rate than students who do sketch. We found that students who sketch incomplete traces also have a low success rate, similar to students who don't sketch at all. We categorized sketching strategies on new problem types (code writing, code ordering, and code fixing) and find that different types of sketching are used on these problems, not always with increased success. We ground our results in a theory of sketching as a method for distributing cognition and as a demonstration of the process of the notional machine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Categorization and Representation of Physics Problems by Experts and Novices*
Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981) · Cognitive Science · doi:10.1207/s15516709cog0502_2 · Cited by 5,248 · cited 1×
“Examples include structured long division calculations in elementary mathematics [12], the pushing electron formalism in organic chemistry [6], and force body diagrams in introductory physics [4].”
BackgroundCognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 1×
“Students frequently re-wrote pieces of code from questions on their scratch sheets, perhaps to manage issues related to the split attention effect [2].”
BackgroundHow a Cockpit Remembers Its Speeds
Hutchins, E. (1995) · Cognitive Science · doi:10.1207/s15516709cog1903_1 · Cited by 1,880 · cited 2×
“However, from the perspective of distributed cognition , cognitive processes occur in a socio-technical system composed of humans, artifacts, and their interactions [10]. sketch and the sketcher can be viewed as part of a distributed system that is performing cognition about programming.”
BackgroundChi, M. T. H., Siler, S. A., Jeong, H., Yamauchi, T., & Hausmann, R. G. (2001) · Cognitive Science · doi:10.1207/s15516709cog2504_1 · Cited by 855
Some Difficulties of Learning to Program
Du Boulay, B. (1986) · Journal of Educational Computing Research · doi:10.2190/3lfx-9rrf-67t8-uvk9 · Cited by 648 · cited 1×
“idea of the notional machine was first proposed in 1986 [5], yet recent work [22] has made the notional machine a key framework for viewing how students understand computing. notional machine is an abstraction of how the computer processes code, based in a particular language or paradigm.”
BackgroundA multi-national study of reading and tracing skills in novice programmers
Lister, R., Adams, E. S., Fitzgerald, S., Fone, W., Hamer, J., Lindholm, M., McCartney, R., Moström, J. E., Sanders, K., Seppälä, O., et al. (2004) · ACM SIGCSE Bulletin · doi:10.1145/1041624.1041673 · Cited by 575 · cited 2×
“Many students reach the end of CS1 without being able to read and understand short pieces of code [14, 24].”
BackgroundSubgoals, Context, and Worked Examples in Learning Computing Problem Solving
Morrison, B. B., Margulieux, L. E., & Guzdial, M. (2015) · Proceedings of the eleventh annual International Conference on International Computing Education Research · doi:10.1145/2787622.2787733 · Cited by 174 · cited 1×
“978-1-4503-4968-0/17/08... $15.00 DOI: http://dx.doi.org/10.1145/3105726.3106190 other fields [18].”
InfluentialSelf-citation
Cited by
Introductory programming: a systematic literature review
Luxton-Reilly, A., Simon, Albluwi, I., Becker, B. A., Giannakos, M., Kumar, A. N., Ott, L., Paterson, J., Scott, M. J., Sheard, J., et al. (2018) · Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/3293881.3295779 · Cited by 485
A theory of instruction for introductory programming skills
Xie, B., Loksa, D., Nelson, G. L., Davidson, M. J., Dong, D., Kwik, H., Tan, A. H., Hwa, L., Li, M., & Ko, A. J. (2019) · Computer Science Education · doi:10.1080/08993408.2019.1565235 · Cited by 191
Solving parsons problems versus fixing and writing code
Ericson, B. J., Margulieux, L. E., & Rick, J. (2017) · Proceedings of the 17th Koli Calling International Conference on Computing Education Research · doi:10.1145/3141880.3141895 · Cited by 121
Self-citationEngage Against the Machine: Rise of the Notional Machines as Effective Pedagogical Devices
Dickson, P. E., Brown, N. C. C., & Becker, B. A. (2020) · Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education · doi:10.1145/3341525.3387404 · Cited by 32
Utilizing programming traces to explore and model the dimensions of novices' code‐writing skill
Zhang, Y., Paquette, L., Pinto, J. D., & Fan, A. X. (2023) · Computer Applications in Engineering Education · doi:10.1002/cae.22622 · Cited by 14
“For instance, the tracing skill is necessary for reading code correctly [17], and both tracing and explaining skills are strong predictors of performance on code writing tasks [39, 42, 63].”
Background
Metadata
- Authors
- Cunningham, K., Blanchard, S., Ericson, B., & Guzdial, M.
- Venue
- Proceedings of the 2017 ACM Conference on International Computing Education Research
- Publisher
- ACM
- Published
- 2017-08-14
- Pages
- 164-172
- OpenAlex
- W2748908871
- Cited by
- 77
- References
- 8
- FWCI
- 7.34
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Tracing and Sketching to Solve Programming Problems: Replicating and Extending an Analysis of What Students Draw. https://app.cochat.ai/papers/10.1145/3105726.3106190
- The paper
- Cunningham, K., Blanchard, S., Ericson, B., & Guzdial, M. (2017). Using Tracing and Sketching to Solve Programming Problems: Replicating and Extending an Analysis of What Students Draw. Proceedings of the 2017 ACM Conference on International Computing Education Research. https://doi.org/10.1145/3105726.3106190
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.