CoChat

Quality is Critical for Meaningful Synthesis of Afterschool Program Effects: A Systematic Review and Meta-analysis

Lester, Ashlee M., Chow, Jason C., Melton, Theresa N. · 2020 · Journal of Youth and Adolescence

The DOI matches its Crossref record; 39 of the 41 references it cites were found in a registry or an index.

Abstract

Afterschool programs are designed to promote academic achievement and youth development as well as mitigate risk for students who attend. Systematic reviews have reported that afterschool programs are associated with increased academic proficiency, school bonding, prosocial behavior, and decreased problem behavior. However, the majority of meta-analyses that report on these outcomes limit their samples to only rigorously conducted studies, which is not representative of the larger literature base. This systematic review and meta-analysis is designed to extend the literature by meta-analyzing a comprehensive sample of studies and examine the impact of study quality on meta-analytical results. A comprehensive literature and effect size extraction process search yielded 130 effect sizes from 30 studies that examined the effects of afterschool programs on secondary students' academic achievement and social / behavioral development. The majority of studies were unpublished reports, and study quality in the sample represented a high risk of bias. The results confirm the hypothesis that the inclusion of lower quality studies significantly impacts overall outcomes in comparison to prior meta-analyses that have limited samples. As such, it is imperative that researchers and practitioners increase the rigor of study design across individual program evaluations so that fewer reports will be excluded. This will improve future meta-analytic outcomes by ensuring a more representative sample of the literature base. Only through improved rigor of study design will a more clear understanding of program impacts on secondary students be possible.

Overview

Integrity signals

Registry

Crossref · 10.1007/s10964-019-01188-8

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 39 references

Research works printed but not linked: 3

  1. Alliance, A. (2016). America after 3pm special report: afterschool in communities of concentrated poverty. Washington, DC: Afterschool Alliance.
  2. *Carbone, P. M. (2010). The effects of an after-school tutoring program on the Pennsylvania System of Assessment. US: ProQuest Information & Learning.
  3. *Jarratt, K. (2014). Mathematics Achievement Outcomes for Middle School Students Attending School-Based Afterschool Mathematics Programs (Ed.D.). United States—Tennessee: Union University.

Cited by

See all 29

Metadata

Authors
Lester, A. M., Chow, J. C., & Melton, T. N.
Affiliations
  • Virginia Commonwealth University (US)
  • University of Virginia (US)
Corresponding author
Lester, Ashlee M.
Venue
Journal of Youth and Adolescence
Published
2020-01-02
Volume
49
Issue
2
Pages
369-382
ISSN
  • 0047-2891 (ISSN-L)
  • 1573-6601
OpenAlex
W2998324306
Cited by
29
References
41
Citations by year
2026: 5 · 2025: 6 · 2024: 3 · 2023: 5 · 2022: 3 · 2021: 5 · 2020: 2
FWCI
0.72
Type
journal article
Language
en
Open access
closed
Licence
Locations
  • Journal of Youth and Adolescence (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Youth Development and Social Support
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords
after-school programs, study quality, risk of bias, effect size heterogeneity, high school students, academic performance, youth development, prosocial behavior, behavioral problems, school connectedness, unpublished research
MeSH terms
Academic Success, Adolescent, Educational Measurement, Humans, Object Attachment, Peer Group, School Health Services, Schools, Students, Program Evaluation, Qualitative Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Quality is Critical for Meaningful Synthesis of Afterschool Program Effects: A Systematic Review and Meta-analysis. https://app.cochat.ai/papers/10.1007/s10964-019-01188-8
The paper
Lester, A. M., Chow, J. C., & Melton, T. N. (2020). Quality is Critical for Meaningful Synthesis of Afterschool Program Effects: A Systematic Review and Meta-analysis. Journal of Youth and Adolescence. https://doi.org/10.1007/s10964-019-01188-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.