The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
A meta-analysis of teaching and learning computer programming: Effective instructional approaches and conditions
Open accessAbstract
This meta-analysis maps the evidence on the effectiveness of instructional approaches and conditions for learning computer programming under three study conditions: (a) Studies focusing on the effectiveness of programming interventions per se, (b) studies focusing on the effectiveness of visualization and physicality, and (c) studies focusing on the effectiveness of dominant instructional approaches. Utilizing the data from 139 interventions and 375 effect sizes, we found (a) a strong effect of learning computer programming per se (Hedges’ g‾ = 0.81, 95% CI [0.42, 1.21]), (b) moderate to large effect sizes of visualization (g‾ = 0.44, 95% CI [0.29, 0.58]) and physicality interventions (g‾ = 0.72, 95% CI [0.23, 1.21]), and (c) moderate to large effect sizes for studies focusing on dominant instructional approaches (g‾s = 0.49–1.02). Moderator analyses indicated that the effect sizes differed only marginally between the instructional approaches and conditions—however, collaboration in metacognition instruction, problem solving instruction outside of regular lessons, short-term interventions focusing on physicality, and interventions focusing on visualization through Scratch were especially effective. Our meta-analysis synthesizes the existing research evidence on the effectiveness of computer programming instruction and, ultimately, provides references with which the effects of future studies could be compared.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wing, J. M. (2006) · Communications of the ACM · doi:10.1145/1118178.1118215 · Cited by 8,102
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949 · cited 1×
“Besides the analysis of publication bias, we identified influential effect sizes using Viechtbauer and Cheung ’ s (2010) diagnostics using the R package ‘metafor ’ .”
MethodThe role of google scholar in evidence reviews and its applicability to grey literature searching
Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138237 · Cited by 2,387
Estimating effect sizes from pretest-posttest-control group designs
Morris, S. B. (2008) · Organizational Research Methods · doi:10.1177/1094428106291059 · Cited by 2,133
Springer, L., Stanne, M. E., & Donovan, S. S. (1999) · Review of Educational Research · doi:10.3102/00346543069001021 · Cited by 1,943 · cited 1×
“Although this evidence base largely supports the effectiveness of collaborative practices, some evidence suggests that the effects may between domains, gender, and the composition of the samples (Springer, Stanne, & Donovan, 1999).”
BackgroundLearning and Teaching Programming: A Review and Discussion
Robins, A., Rountree, J., & Rountree, N. (2003) · Computer Science Education · doi:10.1076/csed.13.2.137.14200 · Cited by 1,736 · cited 1×
“Based on this assumption that programming knowledge and skills can be taught effectively, several instructional approaches have been proposed and evaluated over the last decades — yet, with varying foci and degrees of success (Grover & Pea, 2013; Robins, Rountree, & Rountree, 2003).”
BackgroundBias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 1×
“…for a baseline model with random effects should not only be based on the significance tests of variances and heterogeneity tests only, but relies mainly on the substantive assumptions on whether the effect sizes may or may not vary within or between studies (Cheung, 2015; Viechtbauer, 2005).”
BackgroundSung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.11.008 · Cited by 1,574 · cited 1×
“Sung, Chang, and Liu (2016) expected the duration of interventions that examined the effects of integrating mobile devices on students ’ learning to be positive — however, the authors did not find any significant moderation effect of intervention length in their meta-analysis.”
BackgroundP-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500 · cited 1×
“Third, we examined the p -curve underlying the all intervention effects on computer programming in the data set (Simonsohn, Nelson, & Simmons, 2014).”
MethodDemystifying computational thinking
Shute, V. J., Sun, C., & Asbell-Clarke, J. (2017) · Educational Research Review · doi:10.1016/j.edurev.2017.09.003 · Cited by 1,466
Cited by
Sanders, T., Noetel, M., Parker, P., Del Pozo Cruz, B., Biddle, S., Ronto, R., Hulteen, R., Parker, R., Thomas, G., De Cocker, K., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01712-8 · Cited by 148
The cognitive effects of computational thinking: a systematic review and meta-analytic study
Montuori, C., Gambarota, F., Altoé, G., & Arfé, B. (2024) · Computers & Education · doi:10.1016/j.compedu.2023.104961 · Cited by 76
Zhang, L., Jiang, Q., Xiong, W., & Zhao, W. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251333874 · Cited by 15
Wu, M., & Ouyang, F. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10211-x
Metadata
- Authors
- Scherer, R., Siddiq, F., & Sánchez Viveros, B.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2020-08
- Volume
- 109
- Pages
- 106349
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W3013431833
- Cited by
- 164
- References
- 28
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A meta-analysis of teaching and learning computer programming: Effective instructional approaches and conditions. https://app.cochat.ai/papers/10.1016/j.chb.2020.106349
- The paper
- Scherer, R., Siddiq, F., & Sánchez Viveros, B. (2020). A meta-analysis of teaching and learning computer programming: Effective instructional approaches and conditions. Computers in Human Behavior. https://doi.org/10.1016/j.chb.2020.106349
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.