The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education
Abstract
Research in fields other than education has found that studies with small sample sizes tend to have larger effect sizes than those with large samples. This article examines the relationship between sample size and effect size in education. It analyzes data from 185 studies of elementary and secondary mathematics programs that met the standards of the Best Evidence Encyclopedia. As predicted, there was a significant negative correlation between sample size and effect size. The differences in effect sizes between small and large experiments were much greater than those between randomized and matched experiments. Explanations for the effects of sample size on effect size are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2000) · Cited by 9,198
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Kjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282 · cited 3×
“The main reason advanced by methodologists for effects of small samples in experimental studies in medicine is that publication bias is more serious in small sample research than in studies with large samples (Givens et al., 1997; Rothstein, Sutton, & Borenstein, 2005; Sterne et al., 2000; Taylor & Tweedy, 1998).”
BackgroundThe review of educational research.
(1931) · Journal of Educational Psychology · doi:10.1037/h0066448 · Cited by 1,562
Comprehensive School Reform and Achievement: A Meta-Analysis
Borman, G. D., Hewes, G. M., Overman, L. T., & Brown, S. (2003) · Review of Educational Research · doi:10.3102/00346543073002125 · Cited by 795
Torgesen, J. K., Wagner, R. K., Rashotte, C. A., Rose, E., Lindamood, P., Conway, T., & Garvan, C. (1999) · Journal of Educational Psychology · doi:10.1037//0022-0663.91.4.579 · Cited by 724
Cook, T. D., Shadish, W. R., & Wong, V. C. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20375 · Cited by 604 · cited 4×
“As noted by Cook et al. (2008), this does not mean that random assignment is unimportant, but it does imply that factors other than random assignment also need to be taken into account. In particular, the present findings argue against the policy of the WWC (2008b) of placing extraordinary value on randomized experime…”
BackgroundResultInfluentialSlavin, R. E. (2008) · Educational Researcher · doi:10.3102/0013189x08314117 · Cited by 560
Self-citationEffective Programs in Elementary Mathematics: A Best-Evidence Synthesis
Slavin, R. E., & Lake, C. (2008) · Review of Educational Research · doi:10.3102/0034654308317473 · Cited by 407
Self-citation
Cited by
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
Mind-Set Interventions Are a Scalable Treatment for Academic Underachievement
Paunesku, D., Walton, G. M., Romero, C., Smith, E. N., Yeager, D. S., & Dweck, C. S. (2015) · Psychological Science · doi:10.1177/0956797615571017 · Cited by 981
Cheung, A. C. K., & Slavin, R. E. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.001 · Cited by 792
Self-citationBai, S., Hew, K. F., & Huang, B. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100322 · Cited by 994
Godwin, A., Potvin, G., Hazari, Z., & Lock, R. (2016) · Journal of Engineering Education · doi:10.1002/jee.20118 · Cited by 574
Metadata
- Authors
- Slavin, R., & Smith, D.
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2009-12
- Volume
- 31
- Issue
- 4
- Pages
- 500-506
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W2169029212
- Cited by
- 360
- References
- 20
- FWCI
- 0.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education. https://app.cochat.ai/papers/10.3102/0162373709352369
- The paper
- Slavin, R., & Smith, D. (2009). The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education. Educational Evaluation and Policy Analysis. https://doi.org/10.3102/0162373709352369
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.