The DOI matches its Crossref record; 141 of the 141 references it cites were found in a registry or an index.
How Generative AI Influences Learning Outcomes in Programming Education: A Three-level Bayesian Meta-analysis
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575 · cited 1×
“This research employs a methodology following principles of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA; Moher et al., 2009 ).”
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · cited 3×
“A three-level modeling structure was adopted to handle the statistical dependencies among effect sizes (Borenstein et al., 2009 ; Spruit et al., 2020 ).”
brms : An R Package for Bayesian Multilevel Models Using Stan
Bürkner, P.-C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v080.i01 · Cited by 9,476 · cited 2×
“We synthesized effect sizes (Hedges’ g) using a Bayesian three-level random-effects model, fitted by Hamiltonian Monte Carlo in Stan via the brms package (Bürkner, 2017).”
(2015) · doi:10.1007/s11222-016-9696-4 · Cited by 5,611
Mind in Society: Development of Higher Psychological Processes
VYGOTSKY, L. S. (1980) · doi:10.2307/j.ctvjf9vz4 · Cited by 3,123
Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 3,001
Eccles, J. S., & Wigfield, A. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101859 · Cited by 2,368 · cited 1×
“Situ - ated expectancy-value theory holds that these beliefs, including competence beliefs, the value and interest attached to programming, and programming anxiety, arise from students’ appraisals of learning experiences (Eccles & Wigfield, 2020 ).”
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 2,267 · cited 1×
“GenAI denotes deep generative models, most prominently large language models that, in response to natural-language prompts, generate novel, human-like artifacts such as text, code, and images rather than merely classifying or retrieving existing content (Feuerriegel et al., 2024 ).”
Research works printed but not linked: 3
- Hedges, L. V., & Olkin, I. (2014). Statistical methods for meta-analysis. Elsevier Science.
- Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W., Rocktäschel, T., Riedel, S., & Kiela, D. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems,33, 9459–9474.
- Vehtari, A., Simpson, D., Gelman, A., Yao, Y., & Gabry, J. (2024). Pareto smoothed importance sampling. Journal of Machine Learning Research,25(72), 1–58.
Cited by
Still being checked.
Metadata
- Authors
- Wu, M., & Ouyang, F.
- Affiliations
- Zhejiang University (CN)
- Corresponding author
- Ouyang, Fan
- ORCID
- Venue
- Educational Psychology Review
- Published
- 2026-09-02
- Volume
- 38
- Issue
- 1
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W7205000450
- Semantic Scholar
- 664c6ecde897cdd4e1a1e04e5ab6340a6bfbb5d0
- Cited by
- 0
- References
- 138
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Educational Psychology Review (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- generative AI, programming education, learning outcomes, AI-assisted programming, higher-order thinking skills, student motivation, emotional outcomes, effect size, moderating effect, educational context, instructional design, AI system design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Generative AI Influences Learning Outcomes in Programming Education: A Three-level Bayesian Meta-analysis. https://app.cochat.ai/papers/10.1007/s10648-026-10211-x
- The paper
- Wu, M., & Ouyang, F. (2026). How Generative AI Influences Learning Outcomes in Programming Education: A Three-level Bayesian Meta-analysis. Educational Psychology Review. https://doi.org/10.1007/s10648-026-10211-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.