The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Quality of Research Design Moderates Effects of Grade Retention on Achievement: A Meta-Analytic, Multilevel Analysis
Open accessAbstract
The present meta-analysis examines the effect of grade retention on academic outcomes and investigates systemic sources of variability in effect sizes. Using multilevel modeling (MLM), the authors investigate characteristics of 207 effect sizes across 22 studies published between 1990 and 2007 at two levels: the study (between) and individual (within) levels. Design quality is a study-level variable. Individual-level variables are median grade retained and median number of years postretention. Quality of design is associated with less negative effects. Years postretention is negatively associated with retention effects, and this effect is stronger for studies using grade comparisons versus age comparisons. The results challenge the widely held view that retention has a negative impact on achievement. Suggestions for future research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Allen, Chen, Willson, and Hughes, (2009) publication bias happens when publication favors studies with statistically significant results over studies with non-statistically significant results.”
From The Effects of Problem Posing on Student Mathematical Learning: A Meta-Analysis (2014) · cites this paper as Allen et al., 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
(2000) · Cited by 9,198
A nation at risk: the imperative for educational reform
Denning, P. J. (1983) · Communications of the ACM · doi:10.1145/358150.358154 · Cited by 3,925
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Cited by
Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.07.033 · Cited by 2,109
PISA 2018 Results (Volume V): Effective Policies, Successful Schools
OECD (2020) · PISA · doi:10.1787/ca768d40-en · Cited by 469
The Effects of Task Involvement Load on L2 Incidental Vocabulary Learning: A Meta‐Analytic Study
HUANG, S., WILLSON, V., & ESLAMI, Z. (2012) · The Modern Language Journal · doi:10.1111/j.1540-4781.2012.01394.x · Cited by 108
Self-citationThe Effects of Problem Posing on Student Mathematical Learning: A Meta-Analysis
Rosli, R., Capraro, M. M., & Capraro, R. M. (2014) · International Education Studies · doi:10.5539/ies.v7n13p227 · Cited by 106
Time to Proficiency in Young English Learners and Factors That Affect Progress
Zhang, X., & Winke, P. (2025) · TESOL Quarterly · doi:10.1002/tesq.3340 · Cited by 3
Metadata
- Authors
- Allen, C. S., Chen, Q., Willson, V. L., & Hughes, J. N.
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2009-12
- Volume
- 31
- Issue
- 4
- Pages
- 480-499
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W2116828785
- Cited by
- 257
- References
- 67
- FWCI
- 26.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality of Research Design Moderates Effects of Grade Retention on Achievement: A Meta-Analytic, Multilevel Analysis. https://app.cochat.ai/papers/10.3102/0162373709352239
- The paper
- Allen, C. S., Chen, Q., Willson, V. L., & Hughes, J. N. (2009). Quality of Research Design Moderates Effects of Grade Retention on Achievement: A Meta-Analytic, Multilevel Analysis. Educational Evaluation and Policy Analysis. https://doi.org/10.3102/0162373709352239
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.