The DOI matches its Crossref record; 72 of the 73 references it cites were found in a registry or an index.
Using Commutative Assessments to Compare Conceptual Understanding in Blocks-based and Text-based Programs
Abstract
Blocks-based programming environments are becoming increasingly common in introductory programming courses, but to date, little comparative work has been done to understand if and how this approach affects students' emerging understanding of fundamental programming concepts. In an effort to understand how tools like Scratch and Blockly differ from more conventional text-based introductory programming languages with respect to conceptual understanding, we developed a set of "commutative" assessments. Each multiple-choice question on the assessment includes a short program that can be displayed in either a blocks- based or text-based form. The set of potential answers for each question includes the correct answer along with choices informed by prior research on novice programming misconceptions. In this paper we introduce the Commutative Assessment, discuss the theoretical and practical motivations for the assessment, and present findings from a study that used the assessment. The study had 90 high school students take the assessment at three points over the course of the first ten weeks of an introduction to programming course, alternating the modality (blocks vs. text) for each question over the course of the three administrations of the assessment. Our analysis reveals differences on performance between blocks-based and text-based questions as well as differences in the frequency of misconceptions based on the modality. Future work, potential implications, and limitations of…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The pre-test, and isomorphic post-test1 and post-test2, were adapted from the block-based version of the Commutative Assessments [25], with 16 multiple-choice questions on variables, loops, procedures, and conditionals.”
From Exploring the Impact of Worked Examples in a Novice Programming Environment (2019) · cites this paper as [25]
Citations
Cites
(1978) · Medical Entomology and Zoology · Cited by 53,488
Vygotsky, L. S. (1964) · Bulletin of the Orton Society · doi:10.1007/bf02928399 · Cited by 20,704
The origins of intelligence in children.
Piaget, J. (1952) · doi:10.1037/11494-000 · Cited by 10,687
Ong, W. J. (1982) · Taylor & Francis eBooks · doi:10.4324/9780203328064 · Cited by 7,079
Cognition in Practice: Mind, Mathematics and Culture in Everyday Life
Lave, J. (1988) · doi:10.1017/cbo9780511609268 · Cited by 5,148
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., et al. (2009) · Communications of the ACM · doi:10.1145/1592761.1592779 · Cited by 3,333
Mind in Society: Development of Higher Psychological Processes
VYGOTSKY, L. S. (1980) · doi:10.2307/j.ctvjf9vz4 · Cited by 3,123
Language, Thought, and Reality: Selected Writings of Benjamin Lee Whorf
Miller, G. A., & Carroll, J. B. (1957) · The American Journal of Psychology · doi:10.2307/1419256 · Cited by 2,748
Voices of the Mind: A Sociocultural Approach to Mediated Action
Baker‐Sennett, J., Rogoff, B., Bell, N. J., & Wertsch, J. V. (1992) · The American Journal of Psychology · doi:10.2307/1423207 · Cited by 1,505
van Deursen, A., Klint, P., & Visser, J. (2000) · ACM SIGPLAN Notices · doi:10.1145/352029.352035 · Cited by 1,303
Research works printed but not linked: 14
- Begel A. and Klopfer E. 2007. Starlogo TNG: An introduction to game development. Journal of E-Learning. (2007). Begel A. and Klopfer E. 2007. Starlogo TNG: An introduction to game development. Journal of E-Learning. (2007).
- 10.5555/364133.364161 · DOI
- Dijkstra E. W., How do we tell truths that might hurt? Selected Writings on Computing: A Personal Perspective
- 10.5555/335023 · DOI
- Doukakis D., 2007, Proc. of the 8th HERCMA Conference
- Harvey B., Proc. of Constructionism 2010
- Luria A. R., Language and cognition. Winston
- Palmer S. E., Fundamental aspects of cognitive representation. Cognition and categorization
- Parsons D., 2007, Proc.of The 12th Annual NACCQ Conference
- Slany W., 2014, Proc. of Constructionism 2014
- Wagh A., 2012, Proc. of Constructionism 2012 (Athens
- Weintrop D., 2012, Proc. of Constructionism 2012 (Athens
- Weintrop D., 2014, Proc. of Constructionism 2014
- Wilensky U., 2010, Proc. of Constructionism 2010
Cited by
Sorted by citations
Román-González, ., Pérez-González, J. C., & Fernández, C. J. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.08.047 · Cited by 867
Students’ Misconceptions and Other Difficulties in Introductory Programming: A Literature Review
Qian, Y., & Lehman, J. (2018) · ACM Transactions on Computing Education · doi:10.1145/3077618 · Cited by 529
Comparing Block-Based and Text-Based Programming in High School Computer Science Classrooms
Weintrop, D., & Wilensky, U. J. (2017) · ACM Transactions on Computing Education · doi:10.1145/3089799 · Cited by 338
Self-citationReplication, Validation, and Use of a Language Independent CS1 Knowledge Assessment
Parker, M. C., Guzdial, M., & Engelman, S. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960316 · Cited by 185
Combining Assessment Tools for a Comprehensive Evaluation of Computational Thinking Interventions
Román-González, ., Moreno-León, J., & Robles, G. (2019) · Springer eBooks · doi:10.1007/978-981-13-6528-7_6 · Cited by 184
Metadata
- Authors
- Weintrop, D., & Wilensky, U.
- Affiliations
- Northwestern University (US)
- Venue
- Proceedings of the eleventh annual International Conference on International Computing Education Research
- Publisher
- ACM
- Published
- 2015-08-09
- Pages
- 101-110
- OpenAlex
- W2016385238
- Cited by
- 198
- References
- 73
- Citations by year
- 2026: 6 · 2025: 4 · 2024: 6 · 2023: 13 · 2022: 19 · 2021: 20 · 2020: 24 · 2019: 59 · 2018: 12 · 2017: 20 · 2016: 10 · 2015: 5
- FWCI
- 11.21
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on International Computing Education Research (ICER) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Educational Robotics and Engineering
- Keywords
- text-based programming, introductory programming, conceptual understanding, Scratch, Blockly, high school students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review