The cognitive benefits of learning computer programming: A meta-analysis of transfer effects.
Open accessThe DOI matches its Crossref record; 194 of the 198 references it cites were found in a registry or an index.
Abstract
Does computer programming teach students how to think? Learning to program computers has gained considerable popularity, and educational systems around the world are encouraging students in schools and even children in kindergartens to engage in programming activities. This popularity is based on the claim that learning computer programming improves cognitive skills, including creativity, reasoning, and mathematical skills. In this meta-analysis, we tested this claim performing a 3-level, random-effects meta-analysis on a sample of 105 studies and 539 effect sizes. We found evidence for a moderate, overall transfer effect (g = 0.49, 95% CI [0.37, 0.61]) and identified a strong effect for near transfer (g = 0.75, 95% CI [0.39, 1.11]) and a moderate effect for far transfer (g = 0.47, 95% CI [0.35, 0.59]). Positive transfer to situations that required creative thinking, mathematical skills, and metacognition, followed by spatial skills and reasoning existed. School achievement and literacy, however, benefited the least from learning to program. Moderator analyses revealed significantly larger transfer effects for studies with untreated control groups than those with treated (active) control groups. Moreover, published studies exhibited larger effects than gray literature. These findings shed light on the cognitive benefits associated with learning computer programming and contribute to the current debate surrounding the conceptualization of computer programming as a form of problem solving.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · cited 1×
“To test the robustness of the obtained transfer effects, we conducted several analyses of publication bias: First, we examined the funnel plot and performed trim-and-fill-analyses (Duval & Tweedie, 2000).”
MethodMultilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,775
Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry
Flavell, J. H. (1979) · American Psychologist · doi:10.1037/0003-066x.34.10.906 · Cited by 11,282 · cited 1×
“Metacognition referred to the processes underlying the monitoring, adaptation, evaluation, and planning of thinking and behavior (Flavell, 1979) and was mostly assessed in conjunction with certain problem-solving tasks.”
BackgroundBorenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
(2000) · Cited by 9,198
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Wing, J. M. (2006) · Communications of the ACM · doi:10.1145/1118178.1118215 · Cited by 8,102
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Learning Theories: An Educational Perspective
Schunk, D. H. (1991) · Cited by 3,725
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949
Computational Thinking in K–12: A Review of the State of the Field
Grover, S., & Pea, R. (2013) · Educational Researcher · doi:10.3102/0013189x12463051 · Cited by 2,513
Estimating effect sizes from pretest-posttest-control group designs
Morris, S. B. (2008) · Organizational Research Methods · doi:10.1177/1094428106291059 · Cited by 2,133
When and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 4×
“Although the existence of far transfer was often denied (Barnett & Ceci, 2002; Denning, 2017), several studies provided evidence for far transfer, yet to varying degrees (Bransford & Schwartz, 1999).”
BackgroundInfluentialThe malleability of spatial skills: A meta-analysis of training studies.
Uttal, D. H., Meadow, N. G., Tipton, E., Hand, L. L., Alden, A. R., Warren, C., & Newcombe, N. S. (2013) · Psychological Bulletin · doi:10.1037/a0028446 · Cited by 1,899
Barr, V., & Stephenson, C. (2011) · ACM Inroads · doi:10.1145/1929887.1929905 · Cited by 1,692
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685 · cited 1×
“Existing simulation studies indicate that, although both methods may not differ in the estimation of intercepts (i.e., overall effect sizes; Snijders & Bosker, 2012), REML creates less biased between-study variance estimates of random-effects models than ML does (Veroniki et al., 2016).”
MethodSung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.11.008 · Cited by 1,574
P-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500 · cited 2×
“.0001; continuous test for a right-skewed curve; Simonsohn et al., 2014) and that the p -curve was right-skewed (see Figure 2b).”
BackgroundMethodHennessey, B. A., & Amabile, T. M. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100416 · Cited by 1,475
Demystifying computational thinking
Shute, V. J., Sun, C., & Asbell-Clarke, J. (2017) · Educational Research Review · doi:10.1016/j.edurev.2017.09.003 · Cited by 1,466
Lye, S. Y., & Koh, J. H. L. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.09.012 · Cited by 1,421 · cited 6×
“…a way of teaching and learning computational thinking (Flórez et al., 2017), a way of assessing computational thinking (Grover & Pea, 2013), and a way of exposing students to computational thinking by creating computational artifacts, such as source code or computer programs (Lye & Koh, 2014).”
BackgroundResultInfluentialMcGrew, K. S. (2009) · Intelligence · doi:10.1016/j.intell.2008.08.004 · Cited by 1,354
Cheung, M. W.-L. (2014) · Psychological Methods · doi:10.1037/a0032968 · Cited by 1,342
(2011) · Cited by 1,303
Rosenberg, M. S. (2005) · Evolution · doi:10.1111/j.0014-3820.2005.tb01004.x · Cited by 1,285 · cited 1×
“Fourth, we performed a fail-safe N analysis on the basis of Rosenberg’s weighted procedure (Rosenberg, 2005).”
MethodThe influence of improvement in one mental function upon the efficiency of other functions. (I).
Woodworth, R. S., & Thorndike, E. L. (1901) · Psychological Review · doi:10.1037/h0074898 · Cited by 1,223
The Effectiveness of Creativity Training: A Quantitative Review
Scott, G., Leritz, L. E., & Mumford, M. D. (2004) · Creativity Research Journal · doi:10.1080/10400410409534549 · Cited by 1,132 · cited 1×
“.05; Ma, 2009; Scott, Leritz, & Mumford, 2004), the effects we extracted from programming interventions were comparable in size ( g (cid:2) 0.73).”
MethodInfluentialThree-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130
Estimation of effect size from a series of independent experiments.
Hedges, L. V. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.490 · Cited by 1,062
Adams, R. J., Smart, P., & Huff, A. S. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12102 · Cited by 995
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635612 · Cited by 983 · cited 10×
“Melby-Lervåg, Redick, and Hulme (2016) supported this finding by their meta-analysis of working memory training, and so did Sala, Tatlidil, and Gobet (2018) in their meta-analysis of video gaming.”
InfluentialChapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications
BRANSFORD, J. D., & SCHWARTZ, D. L. (1999) · Review of Research in Education · doi:10.3102/0091732x024001061 · Cited by 881 · cited 4×
“Although the existence of far transfer was often denied (Barnett & Ceci, 2002; Denning, 2017), several studies provided evidence for far transfer, yet to varying degrees (Bransford & Schwartz, 1999).”
BackgroundInfluentialRomán-González, M., Pérez-González, J.-C., & Jiménez-Fernández, C. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.08.047 · Cited by 859
Meta-analysis of action video game impact on perceptual, attentional, and cognitive skills.
Bediou, B., Adams, D. M., Mayer, R. E., Tipton, E., Green, C. S., & Bavelier, D. (2018) · Psychological Bulletin · doi:10.1037/bul0000130 · Cited by 807 · cited 4×
“Our classification of these subskills resonated with that proposed by Sala, Tatlidil, and Gobet (2018) and Bediou et al. (2018) in their articles on transfer effects of video gaming.”
BackgroundMethodInfluentialEffects of schema acquisition and rule automation on mathematical problem-solving transfer.
Cooper, G., & Sweller, J. (1987) · Journal of Educational Psychology · doi:10.1037/0022-0663.79.4.347 · Cited by 688 · cited 1×
“…and Schwartz (1999) pointed out that prior knowledge forms an additional prerequisite for successful transfer, in particular the knowledge about structure of a problem situation, the variables involved, and solution strategies (e.g., Bassok, 1990; Chen & Klahr, 2008; Cooper & Sweller, 1987).”
BackgroundmetaSEM: an R package for meta-analysis using structural equation modeling
Cheung, M. W.-L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01521 · Cited by 685
Little, T. D., Jorgensen, T. D., Lang, K. M., & Moore, E. W. G. (2014) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jst048 · Cited by 666
Is bilingualism associated with enhanced executive functioning in adults? A meta-analytic review.
Lehtonen, M., Soveri, A., Laine, A., Järvenpää, J., de Bruin, A., & Antfolk, J. (2018) · Psychological Bulletin · doi:10.1037/bul0000142 · Cited by 632
The structure of common emotion regulation strategies: A meta-analytic examination
Naragon-Gainey, K., McMahon, T. P., & Chacko, T. P. (2017) · Psychological Bulletin · doi:10.1037/bul0000093 · Cited by 588
A Meta-analysis of the Effects of Computer Technology on School Students’ Mathematics Learning
Li, Q., & Ma, X. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9125-8 · Cited by 558
On the cognitive effects of learning computer programming
Pea, R. D., & Kurland, D. M. (1984) · New Ideas in Psychology · doi:10.1016/0732-118x(84)90018-7 · Cited by 544
Kazakoff, E. R., Sullivan, A., & Bers, M. U. (2013) · Early Childhood Education Journal · doi:10.1007/s10643-012-0554-5 · Cited by 433
Remaining trouble spots with computational thinking
Denning, P. J. (2017) · Communications of the ACM · doi:10.1145/2998438 · Cited by 433
A General Linear Model for Estimating Effect Size in the Presence of Publication Bias
Vevea, J. L., & Hedges, L. V. (1995) · Psychometrika · doi:10.1007/bf02294384 · Cited by 413
Teaching objects-first in introductory computer science
Cooper, S., Dann, W., & Pausch, R. (2003) · Proceedings of the 34th SIGCSE technical symposium on Computer science education · doi:10.1145/611892.611966 · Cited by 397
Constructionist Gaming: Understanding the Benefits of Making Games for Learning
Kafai, Y. B., & Burke, Q. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1124022 · Cited by 383
The Effectiveness of Direct Instruction Curricula: A Meta-Analysis of a Half Century of Research
Stockard, J., Wood, T. W., Coughlin, C., & Rasplica Khoury, C. (2018) · Review of Educational Research · doi:10.3102/0034654317751919 · Cited by 371 · cited 1×
“.05; Jacobse & Harskamp, 2011; Stockard, Wood, Coughlin, & Khoury, 2018).”
Robotics as Means to Increase Achievement Scores in an Informal Learning Environment
Barker, B. S., & Ansorge, J. (2007) · Journal of Research on Technology in Education · doi:10.1080/15391523.2007.10782481 · Cited by 361
Effects of computer programming on young children's cognition.
Clements, D. H., & Gullo, D. F. (1984) · Journal of Educational Psychology · doi:10.1037//0022-0663.76.6.1051 · Cited by 356
Changing a Generation’s Way of Thinking: Teaching Computational Thinking Through Programming
Buitrago Flórez, F., Casallas, R., Hernández, M., Reyes, A., Restrepo, S., & Danies, G. (2017) · Review of Educational Research · doi:10.3102/0034654317710096 · Cited by 349
Lobato, J. (2006) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1504_1 · Cited by 330
Does Far Transfer Exist? Negative Evidence From Chess, Music, and Working Memory Training
Sala, G., & Gobet, F. (2017) · Current Directions in Psychological Science · doi:10.1177/0963721417712760 · Cited by 309 · cited 8×
“Sala and Gobet (2017b) obtained a similar result while studying effects of music education on literacy ( d (cid:2) (cid:4) 0.07).”
BackgroundResultInfluentialImpact of Robotics and Geospatial Technology Interventions on Youth STEM Learning and Attitudes
Nugent, G., Barker, B., Grandgenett, N., & Adamchuk, V. I. (2010) · Journal of Research on Technology in Education · doi:10.1080/15391523.2010.10782557 · Cited by 279
Moeyaert, M., Ugille, M., Natasha Beretvas, S., Ferron, J., Bunuan, R., & Van den Noortgate, W. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2016.1252189 · Cited by 274 · cited 1×
“The latter is particularly suitable for situations, in which the degree of dependence or covariance among multiple outcome variables is unknown (M. W.-L. Cheung, 2014) and returns unbiased estimates of fixed effects (Moeyaert et al., 2017).”
BackgroundDebugging: a review of the literature from an educational perspective
McCauley, R., Fitzgerald, S., Lewandowski, G., Murphy, L., Simon, B., Thomas, L., & Zander, C. (2008) · Computer Science Education · doi:10.1080/08993400802114581 · Cited by 267
Video game training does not enhance cognitive ability: A comprehensive meta-analytic investigation
Sala, G., Tatlidil, K. S., & Gobet, F. (2018) · Psychological Bulletin · doi:10.1037/bul0000139 · Cited by 257 · cited 5×
“Focusing on the same domain, Sala et al. (2018) (2016) found an even broader range of effects from g (cid:2) 0.01 to g (cid:2) 1.88 for a variety of cognitive skills measures.”
BackgroundMethodResultInfluentialDo the benefits of chess instruction transfer to academic and cognitive skills? A meta-analysis
Sala, G., & Gobet, F. R. (2016) · Educational Research Review · doi:10.1016/j.edurev.2016.02.002 · Cited by 245
Learning Theories and Education: Toward a Decade of Synergy
Bransford, J., Stevens, R., Schwartz, D., Meltzoff, A., Pea, R., Roschelle, J., Vye, N., Kuhl, P., Bell, P., Barron, B., et al. (2015) · Handbook of Educational Psychology · doi:10.4324/9780203874790.ch10 · Cited by 245
Estimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016) · Review of Educational Research · doi:10.3102/0034654315582067 · Cited by 234
Schmucker, C. M., Blümle, A., Schell, L. K., Schwarzer, G., Oeller, P., Cabrera, L., von Elm, E., Briel, M., Meerpohl, J. J., & on behalf of the OPEN consortium (2017) · PLOS ONE · doi:10.1371/journal.pone.0176210 · Cited by 227
Vihavainen, A., Airaksinen, J., & Watson, C. (2014) · Proceedings of the tenth annual conference on International computing education research · doi:10.1145/2632320.2632349 · Cited by 223
The Effect Size of Variables Associated With Creativity: A Meta-Analysis
Ma, H.-H. (2009) · Creativity Research Journal · doi:10.1080/10400410802633400 · Cited by 222
Transfer of domain-specific problem-solving procedures.
Bassok, M. (1990) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.16.3.522 · Cited by 214
Programming in a robotics context in the kindergarten classroom: The impact on sequencing skills.
Kazakoff, E. R., & Bers, M. U. (2012) · Journal of educational multimedia and hypermedia · Cited by 205
Impact of experimental design on effect size: Findings from the research literature on training.
Carlson, K. D., & Schmidt, F. L. (1999) · Journal of Applied Psychology · doi:10.1037//0021-9010.84.6.851 · Cited by 202
A Study of the Development of Programming Ability and Thinking Skills in High School Students
Kurland, D. M., Pea, R. D., Clement, C., & Mawby, R. (1986) · Journal of Educational Computing Research · doi:10.2190/bkml-b1qv-kdn4-8ulh · Cited by 202
Ma, H.-H. (2006) · Creativity Research Journal · doi:10.1207/s15326934crj1804_3 · Cited by 202
Sala, G., & Gobet, F. (2017) · Educational Research Review · doi:10.1016/j.edurev.2016.11.005 · Cited by 200
Programming Language/Problem-Solving Research: A Review of Relevant Issues
Palumbo, D. B. (1990) · Review of Educational Research · doi:10.2307/1170225 · Cited by 199
Connected code: why children need to learn programming
(2015) · Choice Reviews Online · doi:10.5860/choice.187390 · Cited by 188
Domain-general problem solving skills and education in the 21st century
Greiff, S., Wüstenberg, S., Csapó, B., Demetriou, A., Hautamäki, J., Graesser, A. C., & Martin, R. (2014) · Educational Research Review · doi:10.1016/j.edurev.2014.10.002 · Cited by 188
Psycharis, S., & Kallia, M. (2017) · Instructional Science · doi:10.1007/s11251-017-9421-5 · Cited by 188
Meta-Analysis: A Structural Equation Modeling Approach
Cheung, M. W. ‐. (2015) · Cited by 166
Transfer of Cognitive Skills from Programming: When and How?
Salomon, G., & Perkins, D. N. (1987) · Journal of Educational Computing Research · doi:10.2190/6f4q-7861-qwa5-8pl1 · Cited by 165
The effect of computer-mediated collaborative learning on solving III-defined problems
Uribe, D., Klein, J. D., & Sullivan, H. J. (2003) · Educational Technology Research and Development · doi:10.1007/bf02504514 · Cited by 165
Effects of Computer Programming on Cognitive Outcomes: A Meta-Analysis
Liao, Y.-K. C., & Bright, G. W. (1991) · Journal of Educational Computing Research · doi:10.2190/e53g-hh8k-ajrr-k69m · Cited by 148
Cognitive outcomes from the Game-Design and Learning (GDL) after-school program
Akcaoğlu, M., & Koehler, M. J. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.02.003 · Cited by 147
Umapathy, K., & Ritzhaupt, A. D. (2017) · ACM Transactions on Computing Education · doi:10.1145/2996201 · Cited by 145
Complex problem solving and intelligence: A meta-analysis
Stadler, M. J., Becker, N., Gödker, M., Leutner, D., & Greiff, S. (2015) · Intelligence · doi:10.1016/j.intell.2015.09.005 · Cited by 144
Effects of Logo and CAI environments on cognition and creativity.
Clements, D. H. (1986) · Journal of Educational Psychology · doi:10.1037/0022-0663.78.4.309 · Cited by 142
Meta‐Analysis: A Structural Equation Modeling Approach
Sund, R. (2016) · International Statistical Review · doi:10.1111/insr.12174 · Cited by 137
Pastor, D. A., & Lazowski, R. A. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1365684 · Cited by 136
Computational Thinking as an Emerging Competence Domain
Yadav, A. K., Good, J., Voogt, J. M., & Fisser, P. (2016) · Technical and vocational education and training · doi:10.1007/978-3-319-41713-4_49 · Cited by 134
Reasoning, Problem Solving, and Intelligence.
Sternberg, R. J. (1980) · Defense Technical Information Center (DTIC) · Cited by 124
Computer game development as a literacy activity
Owston, R., Wideman, H. H., Ronda, N. S., & Brown, C. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.05.015 · Cited by 124
Social-cognitive behaviors and higher-order thinking in educational computer environments
Nastasi, B. K., & Clements, D. H. (1992) · Learning and Instruction · doi:10.1016/0959-4752(92)90010-j · Cited by 122
Gráinne, C., Tomaz, K., Rensing, C., Konert, J., & Lavoué, É. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24258-3 · Cited by 114
Developing Mathematical Thinking with Scratch: An Experiment with 6th Grade Students
Calao, L. A., Moreno-León, J., Correa, H. E., & Robles, G. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24258-3_2 · Cited by 109
Computing education in K-12 schools: A review of the literature
Garneli, V., Giannakos, M. N., & Chorianopoulos, K. (2015) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2015.7096023 · Cited by 108
Teaching objects-first in introductory computer science
Cooper, S., Dann, W. P., & Pausch, R. F. (2003) · ACM SIGCSE Bulletin · doi:10.1145/792548.611966 · Cited by 107
Erol, O., & Kurt, A. A. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.08.017 · Cited by 104
Code to Learn: Where Does It Belong in the K-12 Curriculum?
Moreno-León, J., Robles, G., & Román-González, . (2016) · Journal of Information Technology Education Research · doi:10.28945/3521 · Cited by 103
Social and Cognitive Interactions in Educational Computer Environments
Clements, D. H., & Nastasi, B. K. (1988) · American Educational Research Journal · doi:10.3102/00028312025001087 · Cited by 97
Enhancement of Creativity in Computer Environments
Clements, D. H. (1991) · American Educational Research Journal · doi:10.2307/1162883 · Cited by 89
Nastasi, B. K., Clements, D. H., & Battista, M. T. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.1.150 · Cited by 89
The measurement of transfer of training.
Gagné, R. M., Foster, H., & Crowley, M. E. (1948) · Psychological Bulletin · doi:10.1037/h0061154 · Cited by 87
Code to learn with Scratch? A systematic literature review
Moreno-León, J., & Robles, G. (2016) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2016.7474546 · Cited by 86
Learning of Geometric Concepts in a Logo Environment
Clements, D. H., & Battista, M. T. (1989) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc.20.5.0450 · Cited by 84
Learning of Geometric Concepts in a Logo Environment
Clements, D. H., & Battista, M. T. (1989) · Journal for Research in Mathematics Education · doi:10.2307/749420 · Cited by 84
Longitudinal Study of the Effects of Logo Programming on Cognitive Abilities and Achievement
Clements, D. H. (1987) · Journal of Educational Computing Research · doi:10.2190/rcnv-2hyf-60cm-k7k7 · Cited by 82
Hayes, J., & Stewart, I. (2016) · British Journal of Educational Psychology · doi:10.1111/bjep.12114 · Cited by 81
Metacomponential development in a Logo programming environment.
Clements, D. H. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.1.141 · Cited by 80
Voss, J. F., Wiley, J., & Carretero, M. (1995) · Annual Review of Psychology · doi:10.1146/annurev.ps.46.020195.001103 · Cited by 78
Research on Logo: A Decade of Progress
Clements, D. H., & Sarama, J. H. (1997) · Computers in the Schools · doi:10.1300/j025v14n01_02 · Cited by 69
Bray, C. W. (1928) · Journal of Experimental Psychology · doi:10.1037/h0071273 · Cited by 68
Fitting meta‐analytic structural equation models with complex datasets
Wilson, S. J., Polanin, J. R., & Lipsey, M. W. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1199 · Cited by 63
Palumbo, D. B., & Reed, W. M. (1991) · Journal of Research on Computing in Education · doi:10.1080/08886504.1991.10781967 · Cited by 61
Remote Transfer of Scientific-Reasoning and Problem-Solving Strategies in Children
Chen, Z., & Klahr, D. (2008) · Advances in child development and behavior · doi:10.1016/s0065-2407(08)00010-4 · Cited by 61
Lai, A., & Yang, S.-M. (2011) · International Conference on Electrical and Control Engineering · doi:10.1109/iceceng.2011.6056908 · Cited by 61
On the Need for Research Evidence to Guide the Design of Computer Games for Learning
Mayer, R. E. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1133307 · Cited by 60
Kim, B., Kim, T., & Kim, J. (2013) · Journal of Educational Computing Research · doi:10.2190/ec.49.4.b · Cited by 59
Scherer, R. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01390 · Cited by 59
Self-citationImplementing Restricted Maximum Likelihood Estimation in Structural Equation Models
Cheung, M. W.-L. (2013) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.742404 · Cited by 56
weightr: Estimating Weight-Function Models for Publication Bias
Coburn, K. M., & Vevea, J. L. (2016) · doi:10.32614/cran.package.weightr · Cited by 56
The Effects of Mediated Programming Instruction on Preschool Children's Self-Monitoring
Miller, G. E., & Emihovich, C. A. (1986) · Journal of Educational Computing Research · doi:10.2190/cemm-lqhl-xn6d-1u15 · Cited by 54
Costa, J. M., & Miranda, G. L. (2016) · British Journal of Educational Technology · doi:10.1111/bjet.12496 · Cited by 54
Teaching creativity with computers
Clements, D. H. (1995) · Educational Psychology Review · doi:10.1007/bf02212491 · Cited by 52
Johnson-Gentile, K., Clements, D. H., & Battista, M. T. (1994) · Journal of Educational Computing Research · doi:10.2190/49ee-8pxl-yy8c-a923 · Cited by 45
Modeling complex marine ecosystems: an investigation of two teaching approaches with fifth graders
Papaevripidou, M., Constantinou, C. P., & Zacharia, Z. C. (2007) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2006.00217.x · Cited by 44
Ortiz, A. (2015) · Journal of Technology Education · doi:10.21061/jte.v26i2.a.3 · Cited by 43
Using Coding Apps to Support Literacy Instruction and Develop Coding Literacy
Hutchison, A. C., Nadolny, L., & Estapa, A. T. (2015) · The Reading Teacher · doi:10.1002/trtr.1440 · Cited by 43
Digital ink for cognitive assessment of computational thinking
Ambrosio, A. P., Xavier, C., & Georges, F. J. (2014) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2014.7044237 · Cited by 43
A Review of the Effectiveness of Creative Training on Adult Learners
Tsai, K. C. (2013) · Journal of Social Science Studies · doi:10.5296/jsss.v1i1.4329 · Cited by 42
Effects of Logo computer programming experience on problem solving and spatial relations ability
Miller, R. B., Kelly, G. N., & Kelly, J. T. (1988) · Contemporary Educational Psychology · doi:10.1016/0361-476x(88)90034-3 · Cited by 41
Concept Learning in Preschool Children: Effects of a Short-Term Logo Experience
Degelman, D., Free, J. U., Scarlato, M., et al. (1986) · Journal of Educational Computing Research · doi:10.2190/rh2k-4aq7-2598-tvea · Cited by 41
Complex tasks for use in human problem-solving research.
Ray, W. S. (1955) · Psychological Bulletin · doi:10.1037/h0044763 · Cited by 40
Analysis of Research in Programming Teaching Tools: An Initial Review
Salleh, S. M., Shukur, Z., & Judi, H. M. (2013) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2013.10.317 · Cited by 40
Seo, Y.-H., & Kim, J. (2016) · Indian Journal of Science and Technology · doi:10.17485/ijst/2016/v9i46/107837 · Cited by 40
Kim, S., Chung, K., & Yu, H. (2013) · The Journal of Creative Behavior · doi:10.1002/jocb.30 · Cited by 39
Comparative study of the cognitive consequences of inquiry-based Logo instruction.
Lehrer, R., Guckenberg, T., & Lee, O. (1988) · Journal of Educational Psychology · doi:10.1037/0022-0663.80.4.543 · Cited by 39
Learning Preproof Geometry With LOGO
Lehrer, R., Randle, L., & Sancilio, L. (1989) · Cognition and Instruction · doi:10.1207/s1532690xci0602_2 · Cited by 36
The Effects of Computer Programming on Problem-Solving Skills and Attitudes
Dalton, D. W., & Goodrum, D. A. (1991) · Journal of Educational Computing Research · doi:10.2190/762v-kv6t-d3d1-kdy2 · Cited by 34
The impact of LOGO on gifted children's achievement and creativity
Subhi, T. Y. (1999) · Journal of Computer Assisted Learning · doi:10.1046/j.1365-2729.1999.152082.x · Cited by 33
Leighton, J. P., & Sternberg, R. J. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei0423 · Cited by 33
Problem solving, planning ability and sharing processes with LOGO
Kapa, E. (1999) · Journal of Computer Assisted Learning · doi:10.1046/j.1365-2729.1999.151077.x · Cited by 30
Programming Objects to Think with: Logo and the Teaching and Learning of Problem Solving
Swan, K. P. (1991) · Journal of Educational Computing Research · doi:10.2190/ux0m-nhm2-1g5x-01x4 · Cited by 30
Effects of Logo Instruction on Cognitive Style
Cathcart, W. G. (1990) · Journal of Educational Computing Research · doi:10.2190/xnfc-rc25-fa6m-b33n · Cited by 30
Lehrer, R., & Randle, L. (1987) · Journal of Educational Computing Research · doi:10.2190/ufww-fadf-bk21-yr5n · Cited by 29
A meta-analysis of the effects of instructional interventions on students' mathematics achievement
Jacobse, A. E., & Harskamp, E. G. (2011) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 28
Battista, M. T., & Clements, D. H. (1986) · Computers in Human Behavior · doi:10.1016/0747-5632(86)90002-6 · Cited by 28
Lehrer, R., Lee, M., & Jeong, A. C. (1999) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0802_3 · Cited by 27
The Effects of Computer Programming on Performance in Mathematics.
Milner, S. D. (1973) · Cited by 25
Jenkins, C. (2015) · The International Journal of Education and Development using Information and Communication Technology (The University of the West Indies) · Cited by 24
Some Prerequisites for Teaching Thinking: Methodological issues in the Study of LOGO Programming
Littlefield, J., Delclos, V. R., Bransford, J., Clayton, K., & Franks, J. J. (1989) · Cognition and Instruction · doi:10.1207/s1532690xci0604_4 · Cited by 23
Effects of a Logo Microworld on Student Ability to Transfer a Concept
Thompson, A. D., & Wang, H.-M. C. (1988) · Journal of Educational Computing Research · doi:10.2190/1u7l-33hq-r2r1-6dcf · Cited by 23
The Effects of Learning a Computer Programming Language on the Logical Reasoning of School Children.
Seidman, R. H. (1981) · Cited by 20
The Effects of Logo Experience on First-Grade Children's Ability to Estimate Distance
Campbell, P. F., Fein, G. G., & Schwartz, S. S. (1991) · Journal of Educational Computing Research · doi:10.2190/qjy1-9jeg-0uay-j30d · Cited by 17
Gibbon, L. W. (2007) · BiblioBoard Library Catalog (Open Research Library) · Cited by 16
Brown, Q., Mongan, W. M., Kusic, D., et al. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--3826 · Cited by 14
The effect of logo programming language for creativity and problem solving
Pardamean, B., Evelin, E., & Honni, H. (2011) · Cited by 13
Effects of Learning to Program A Computer in BASIC or Logo on Problem-solving Abilities
Shaw, D. G. (1986) · AEDS Journal · doi:10.1080/00011037.1986.11008422 · Cited by 13
A Comparison of the Effects of Logo and a CAI Learning Environment on Skills Acquisition
Gallini, J. K. (1987) · Journal of Educational Computing Research · doi:10.2190/jrxe-4cag-p150-gq8g · Cited by 13
Logo and cognition: A theoretical foundation
Clements, D. H. (1986) · Computers in Human Behavior · doi:10.1016/0747-5632(86)90026-9 · Cited by 13
Effect of Robotics enhanced inquiry based learning in elementary Science education in South Korea.
Park, J. (2015) · Journal of Computers in Mathematics and Science Teaching · Cited by 12
Problem Solving, Instructional Methods and Logo Programming
Au, W., & Leung, J. P. (1991) · Journal of Educational Computing Research · doi:10.2190/k88q-rwv1-avpu-3dtk · Cited by 12
How and how much can cooperative logo environments enhance creativity and social relationships?
Mevarech, Z. R., & Kramarski, B. (1992) · Learning and Instruction · doi:10.1016/0959-4752(92)90012-b · Cited by 12
Cognitive Effects of a Logo-Enriched Mathematics Program for Middle School Students
Turner, S. V., & Land, M. L. (1988) · Journal of Educational Computing Research · doi:10.2190/r0xh-2vdd-4vfa-yb3h · Cited by 12
Bernardo, M. A., & Morris, J. D. (1994) · Journal of Research on Computing in Education · doi:10.1080/08886504.1994.10782108 · Cited by 12
The Effect of Learning to Program in Logo on Reasoning Skills of Junior High School Students
Many, W. A., Lockard, J., Abrams, P. D., et al. (1988) · Journal of Educational Computing Research · doi:10.2190/tc38-rjt8-l241-dv9w · Cited by 11
Does Instruction in Computer Programming Improve Problem Solving Ability
VanLengen, C. A., & Maddux, C. D. (1990) · Journal of the Association for Information Systems · Cited by 11
metaSEM: Meta-Analysis using Structural Equation Modeling
Cheung, M. (2015) · CRAN: Contributed Packages · doi:10.32614/cran.package.metasem · Cited by 10
A Meta-analysis of Computer Programming on Cognitive Outcomes: An Updated Synthesis
Liao, Y.-K. C. (2000) · EdMedia: World Conference on Educational Media and Technology · Cited by 9
Improving problem-solving skills through logo programming language
Pardamean, B., Suparyanto, T., & Evelyn, E. (2015) · The New Educational Review · doi:10.15804/tner.2015.41.3.04 · Cited by 9
Logo Programming, Problem Solving, and Knowledge-Based Instruction.
Swan, K. P., & Black, J. B. (1990) · Cited by 8
Which way to computer literacy, programming or applications experience?
Mynatt, B. T., Smith, K. H., Kamouri, A. L., et al. (1986) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(86)80023-2 · Cited by 8
The Effects of Logo-Based Instruction
Yusuf, M. M. (1995) · Journal of Educational Computing Research · doi:10.2190/nnlp-mn2r-m6cv-9ejf · Cited by 8
Psychology of Computer Use: X. Effect of Learning Logo on Children's Problem-Solving Skills
Poulin‐Dubois, D., McGilly, C. A., & Shultz, T. R. (1989) · Psychological Reports · doi:10.2466/pr0.1989.64.3c.1327 · Cited by 8
Transfer of Spatial Concepts from Logo to Map-Reading.
Geva, E., & Cohen, R. (1987) · Cited by 7
The relationship between learning logo and proficiency in mathematics
Hamada, R. M. (1986) · Medical Entomology and Zoology · Cited by 7
Learning Outcomes of Computer Programming Instruction for Middle-Grades Students: A Pilot Study.
Dillashaw, F. G., & Bell, S. R. (1985) · Cited by 6
Block, E. B., Simpson, D. L., & Reid, D. K. (1987) · Journal of Educational Computing Research · doi:10.2190/twkv-24ar-h12k-mfrl · Cited by 5
Effect of Using Logo on Pupils' Learning in Two-Dimensional Shapes
Yi, B. J., & Kwan, L. (2016) · Malaysian Online Journal of Educational Technology · Cited by 5
The effects of computer programming on young children's learning
Akdag, F. S. (1985) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 5
The effects of modeling and inspection methods upon problem solving in a computer programming course
Bruggeman, J. G. (1985) · Montana State University ScholarWorks (Montana State University) · Cited by 4
The Effect of Logo on the Nonverbal Reasoning Ability of Rural and Disadvantaged Third Graders
Reeder, L. K., & Leming, J. S. (1994) · Journal of Research on Computing in Education · doi:10.1080/08886504.1994.10782111 · Cited by 3
THE EFFECTS OF LOGO STUDY ON PROBLEM-SOLVING COGNITIVE ABILITIES OF SIXTH-GRADE STUDENTS
Fickel, M. G. (1986) · Lincoln (University of Nebraska) · Cited by 3
Chartier, D. (1996) · European Journal of Psychology of Education · doi:10.1007/bf03173283 · Cited by 3
Rose, N. S. (1983) · University of North Texas Digital Library (University of North Texas) · Cited by 3
Tsuei, M. (1998) · Cited by 2
Taitt, N. P. (1985) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 2
Programming computer graphics and the development of concepts in geometry
Dziak, N. J. (1985) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 2
Oprea, J. M. (1984) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 2
Effect of computer programming on the learning of calculus concepts
Flores, A. (1985) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 2
The use of Logo-Turtle Graphics in a training program to enhance spatial visualization
Miller, E. A. (1985) · Spectrum Research Repository (Concordia University) · Cited by 1
Koohang, A. A. (1984) · Cited by 1
Yoder, V. A. (1988) · Medical Entomology and Zoology · Cited by 1
Julie, C. (1988) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1
Choi, W. S. (1991) · ThinkTech (Texas Tech University) · Cited by 1
Pollock, M. L. (1997) · Cited by 1
Cited by
Computational Thinking, Between Papert and Wing
Lodi, M., & Martini, S. (2021) · Science & Education · doi:10.1007/s11191-021-00202-5 · Cited by 205
“A recent meta-review (Scherer et al., 2019) found evidence of strong near transfer, and of moderate-to-low far transfer: it is “ more likely to occur in situations that require cognitive skills close to programming, ” but recognizes flaws in the current body of research and advocates for more…”
The Computational Thinking Scale for Computer Literacy Education
Tsai, M.-J., Liang, J.-C., & Hsu, C.-Y. (2021) · Journal of Educational Computing Research · doi:10.1177/0735633120972356 · Cited by 166
“For example, the impact of artificial intelligence technology on human society has caused educational policy makers in many countries to emphasize the learning of computer programming in school curricula (Scherer et al., 2019; Seow et al., 2019).”
BackgroundScherer, R., Siddiq, F., & Sánchez Viveros, B. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106349 · Cited by 164
“In their meta-analysis of the transfer effects of learning computer programming on skills other than programming, Scherer et al. (2019) identified a moderate overall effect size, g ¼ 0.47.”
BackgroundMethodInfluentialSelf-citationA cognitive definition of computational thinking in primary education
Tsarava, K., Moeller, K., Román-González, ., Golle, J., Leifheit, L., Butz, M. V., & Ninaus, M. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104425 · Cited by 207
Sanders, T., Noetel, M., Parker, P., Del Pozo Cruz, B., Biddle, S., Ronto, R., Hulteen, R., Parker, R., Thomas, G., De Cocker, K., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01712-8 · Cited by 148
Metadata
- Authors
- Scherer, R., Siddiq, F., & Sánchez Viveros, B.
- Affiliations
- University of Oslo (NO)
- Corresponding author
- Scherer, Ronny
- Venue
- Journal of Educational Psychology
- Published
- 2019-07
- Volume
- 111
- Issue
- 5
- Pages
- 764-792
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2898166493
- Cited by
- 205
- References
- 198
- Citations by year
- 2026: 23 · 2025: 27 · 2024: 24 · 2023: 34 · 2022: 28 · 2021: 26 · 2020: 38 · 2019: 5
- FWCI
- 3.00
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- Journal of Educational Psychology (publishedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Funders
- Research Council of Norway (NFR-254744)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Creativity in Education and Neuroscience
- Social Sciences › Education › Education and Critical Thinking Development
- Keywords
- programming education, transfer of learning, near transfer, far transfer, cognitive skills, creativity, mathematical skills, metacognition, spatial ability, reasoning, academic performance, literacy, active control groups, problem solving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.