The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Quality of Research Design Moderates Effects of Grade Retention on Achievement: A Meta-Analytic, Multilevel Analysis
Open accessAbstract
The present meta-analysis examines the effect of grade retention on academic outcomes and investigates systemic sources of variability in effect sizes. Using multilevel modeling (MLM), the authors investigate characteristics of 207 effect sizes across 22 studies published between 1990 and 2007 at two levels: the study (between) and individual (within) levels. Design quality is a study-level variable. Individual-level variables are median grade retained and median number of years postretention. Quality of design is associated with less negative effects. Years postretention is negatively associated with retention effects, and this effect is stronger for studies using grade comparisons versus age comparisons. The results challenge the widely held view that retention has a negative impact on achievement. Suggestions for future research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to Allen, Chen, Willson, and Hughes, (2009) publication bias happens when publication favors studies with statistically significant results over studies with non-statistically significant results.”
From The Effects of Problem Posing on Student Mathematical Learning: A Meta-Analysis (2014) · cites this paper as Allen et al., 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
(2000) · Cited by 9,198
A nation at risk: the imperative for educational reform
Denning, P. J. (1983) · Communications of the ACM · doi:10.1145/358150.358154 · Cited by 3,925
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
Searle, S. R., & Searle, S. R. (1971) · Cited by 3,229
Journal on Educational Psychology
Winston, J., Mandernach, J., Winsor, D. L., Sinnott, J. D., & Gujjar, A. A. (2014) · Cited by 2,947
Educational Leadership: A Field of Inquiry and Practice
Hart, A. W. (1999) · Educational Management & Administration · doi:10.1177/0263211x990273008 · Cited by 2,359
A Nation at Risk: The Imperative for Educational Reform
(1983) · The Elementary School Journal · doi:10.1086/461348 · Cited by 2,341
Summing up: The Science of Reviewing Research
Wilkinson, I., Light, R. J., & Pillemer, D. B. (1987) · Journal of Educational Statistics · doi:10.2307/1164691 · Cited by 1,471
Summing Up: The Science of Reviewing Research
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,427
No Child Left Behind Act of 2001
Zimmer, R., Hamilton, L. S., & Christina, R. (2010) · Cited by 882
Meta-analysis of Grade Retention Research: Implications for Practice in the 21st Century
Jimerson, S. R. (2001) · School Psychology Review · doi:10.1080/02796015.2001.12086124 · Cited by 597
Remedial Education and Student Achievement: A Regression-Discontinuity Analysis
Jacob, B. A., & Lefgren, L. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023778 · Cited by 590
Standard Errors and Sample Sizes for Two-Level Research
Snijders, T. A. B., & Bosker, R. J. (1993) · Journal of Educational Statistics · doi:10.3102/10769986018003237 · Cited by 487 · cited 2×
“Because it is not possible to obtain a true R value for a multilevel model in Mplus (or in HLM), we calculated pseudo-R values according to recommendations by Snijders and Bosker (1993). The within-unit variance explained is a measure of how well the independent”
MethodA Primer on Regression Artifacts
Campbell, D. T., & Kenny, D. A. (1999) · Medical Entomology and Zoology · Cited by 482
Flunking Grades: Research and Policies on Retention
Wilson, M., Shepard, L. A., & Smith, M. L. (1990) · Educational Evaluation and Policy Analysis · doi:10.2307/1163635 · Cited by 478
Statistical Methods for the Social and Behavioral Sciences.
Stallings, W. M., Marascuilo, L. A., & Serlin, R. C. (1989) · Journal of the American Statistical Association · doi:10.2307/2289907 · Cited by 368
Grade Retention and School Dropout: Investigating the Association
Roderick, M. (1994) · American Educational Research Journal · doi:10.2307/1163393 · Cited by 349
A prospective, longitudinal study of the correlates and consequences of early grade retention
Jimerson, S., Carlson, E., Rotert, M., Egeland, B., & Sroufe, L. A. (1997) · Journal of School Psychology · doi:10.1016/s0022-4405(96)00033-7 · Cited by 293
On the Success of Failure: A Reassessment of the Effects of Retention in the Primary School Grades
Alexander, K. L., Entwisle, D. R., & Dauber, S. L. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511500091 · Cited by 290
Effects of Kindergarten Retention Policy on Children’s Cognitive Growth in Reading and Mathematics
Hong, G., & Raudenbush, S. W. (2005) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737027003205 · Cited by 280
The Research Evidence on the Effects of Grade Retention
Jackson, G. B. (1975) · Review of Educational Research · doi:10.3102/00346543045004613 · Cited by 216
Grade Retention and School Performance:
McCoy, A. R., & Reynolds, A. J. (1999) · Journal of School Psychology · doi:10.1016/s0022-4405(99)00012-6 · Cited by 201
Effects of grade retention on academic performance and behavioral development
PAGANI, L., TREMBLAY, R. E., VITARO, F., BOULERICE, B., & MCDUFF, P. (2001) · Development and Psychopathology · doi:10.1017/s0954579401002061 · Cited by 191
Grade Retention and School Adjustment: An Explanatory Analysis
Reynolds, A. J. (1992) · Educational Evaluation and Policy Analysis · doi:10.2307/1164496 · Cited by 180
Failure in Grade: Do Retained Students Catch Up?
Meisels, S. J., & Liaw, F.-R. (1993) · The Journal of Educational Research · doi:10.1080/00220671.1993.9941169 · Cited by 178
The Research Evidence on the Effects of Grade Retention
Jackson, G. B. (1975) · Review of Educational Research · doi:10.2307/1170067 · Cited by 166
Jimerson, S. R., Pletcher, S. M. W., Graydon, K., Schnurr, B. L., Nickerson, A. B., & Kundert, D. K. (2006) · Psychology in the Schools · doi:10.1002/pits.20132 · Cited by 165
Effect of grade retention on self-system processes, school engagement, and academic performance.
Pierson, L. H., & Connell, J. P. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.3.300 · Cited by 150
Unraveling Teachers' Beliefs about Grade Retention
Tomchin, E. M., & Impara, J. C. (1992) · American Educational Research Journal · doi:10.3102/00028312029001199 · Cited by 141
Attributing Effects to Treatment in Matched Observational Studies
Rosenbaum, P. R. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479329 · Cited by 137
Retention Under Chicago’s High-Stakes Testing Program: Helpful, Harmful, or Harmless?
Roderick, M., & Nagaoka, J. (2005) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737027004309 · Cited by 134
Amplification of Sensitivity Analysis in Matched Observational Studies
Rosenbaum, P. R., & Silber, J. H. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08470 · Cited by 131
Heinsman, D. T., & Shadish, W. R. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.154 · Cited by 125
Kindergarten Retention: Academic and Behavioral Outcomes Through the End of Second Grade
Mantzicopoulos, P. Y., & Morrison, D. (1992) · American Educational Research Journal · doi:10.2307/1162907 · Cited by 103
School Adjustment of Children at Risk through Fourth Grade.
Reynolds, A. J., & Bezruczko, N. (1993) · Merrill-palmer Quarterly · Cited by 99
Examining the effects of grade retention on student reading performance: A longitudinal study
Silberglitt, B., Appleton, J. J., Burns, M. K., & Jimerson, S. R. (2006) · Journal of School Psychology · doi:10.1016/j.jsp.2006.05.004 · Cited by 92
Student Ratings of Stressful Experiences at Home and School
Anderson, G. E., Jimerson, S. R., & Whipple, A. D. (2005) · Journal of Applied School Psychology · doi:10.1300/j370v21n01_01 · Cited by 89
Wu, W., West, S. G., & Hughes, J. N. (2008) · Journal of Educational Psychology · doi:10.1037/a0013098 · Cited by 88
Self-citationA Synthesis of Grade Retention Research: Looking Backward and Moving Forward
Jimerson, S. R. (2001) · The California School Psychologist · doi:10.1007/bf03340883 · Cited by 74
Mantzicopoulos, P. Y. (1997) · Psychology in the Schools · Cited by 73
Willson, V. L., & Hughes, J. N. (2006) · Journal of School Psychology · doi:10.1016/j.jsp.2005.12.001 · Cited by 72
Self-citationToward a Political Explanation of Grade Retention
Bali, V. A., Anagnostopoulos, D., & Roberts, R. (2005) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737027002133 · Cited by 66
Byrnes, D. A., & Yamamoto, K. (1986) · Digital Commons - USU (Utah State University) · Cited by 64
Propensity Scores and Quasi-Experiments: A Testimony to the Practical Side of Lee Sechrest.
Shadish, W. R., Luellen, J. K., & Clark, M. H. (2006) · American Psychological Association eBooks · doi:10.1037/11384-008 · Cited by 57
Sipple, J. W., Killeen, K. M., & Monk, D. H. (2004) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737026002143 · Cited by 56
Gleason, K. A., Kwok, O., & Hughes, J. N. (2007) · The Elementary School Journal · doi:10.1086/516667 · Cited by 54
Self-citationWu, W., West, S. G., & Hughes, J. N. (2007) · Journal of School Psychology · doi:10.1016/j.jsp.2007.01.003 · Cited by 49
Self-citationAlternatives to Retention and Social Promotion
Picklo, D. M., & Christenson, S. L. (2005) · Remedial and Special Education · doi:10.1177/07419325050260050101 · Cited by 48
Retention and Academic Achievement Research Revisited from a United States Perspective.
Lorence, J. (2006) · Cited by 39
Early retention: Are there long-term beneficial effects?
Thomas, A., Armistead, L. P., Kempton, T., Lynch, S., Forehand, R., Nousiainen, S., Neighbors, B., & Tannenbaum, L. E. (1992) · Psychology in the Schools · Cited by 34
A follow-up study of high school students with a history of grade retention
Hagborg, W. J., Masella, G., Palladino, P., & Shepardson, J. (1991) · Psychology in the Schools · Cited by 33
A comparison of subset selection and analysis of covariance for the adjustment of confounders.
Little, R. J. A., An, H., Johanns, J., & Giordani, B. (2000) · Psychological Methods · doi:10.1037//1082-989x.5.4.459 · Cited by 31
Kindergarten retention and transition classrooms: Their relationship to achievement
Dennebaum, J., & Kulberg, J. M. (1994) · Psychology in the Schools · Cited by 30
The effects of early grade retention on the academic achievement of fourth-grade students
Johnson, E. R., Merrell, K. W., & Stover, L. M. (1990) · Psychology in the Schools · Cited by 30
Smooth and rough roads to academic achievement: Retention and race/class disparities in high school
Möller, S., Stearns, E., Blau, J. R., & Land, K. C. (2004) · Social Science Research · doi:10.1016/j.ssresearch.2004.08.001 · Cited by 28
The differences between retained and promoted children in educational services received
Peterson, L. S., & Hughes, J. N. (2010) · Psychology in the Schools · doi:10.1002/pits.20534 · Cited by 26
Self-citationLongitudinal outcome differences among promoted and transitional at-risk kindergarten students
Ferguson, P. C. (1991) · Psychology in the Schools · Cited by 22
Gredler, G. R. (1996) · Psychology in the Schools · doi:10.1002/1520-6807(199607)33:3<251::aid-pits2310330302>3.0.co;2-c · Cited by 20
Five to Ten Years after Placement: The Long-Term Efficacy of Retention and Pre-Grade Transition
Phelps, L., Dowdell, N., Rizzo, F. G., Ehrlich, P., & Wilczenski, F. L. (1992) · Journal of Psychoeducational Assessment · doi:10.1177/073428299201000203 · Cited by 15
Ferguson, P., & Streib, M. M. (1996) · Psychology in the Schools · Cited by 13
Cited by
Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.07.033 · Cited by 2,109
PISA 2018 Results (Volume V): Effective Policies, Successful Schools
OECD (2020) · PISA · doi:10.1787/ca768d40-en · Cited by 469
The Effects of Task Involvement Load on L2 Incidental Vocabulary Learning: A Meta‐Analytic Study
HUANG, S., WILLSON, V., & ESLAMI, Z. (2012) · The Modern Language Journal · doi:10.1111/j.1540-4781.2012.01394.x · Cited by 108
“These variables can affect both language proficiency and selection into the treatment intervention (Allen et al., 2009).”
BackgroundSelf-citationThe Effects of Problem Posing on Student Mathematical Learning: A Meta-Analysis
Rosli, R., Capraro, M. M., & Capraro, R. M. (2014) · International Education Studies · doi:10.5539/ies.v7n13p227 · Cited by 106
Time to Proficiency in Young English Learners and Factors That Affect Progress
Zhang, X., & Winke, P. (2025) · TESOL Quarterly · doi:10.1002/tesq.3340 · Cited by 3
Metadata
- Authors
- Allen, C. S., Chen, Q., Willson, V. L., & Hughes, J. N.
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2009-12
- Volume
- 31
- Issue
- 4
- Pages
- 480-499
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W2116828785
- Cited by
- 257
- References
- 67
- FWCI
- 26.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.