The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education
Abstract
Research in fields other than education has found that studies with small sample sizes tend to have larger effect sizes than those with large samples. This article examines the relationship between sample size and effect size in education. It analyzes data from 185 studies of elementary and secondary mathematics programs that met the standards of the Best Evidence Encyclopedia. As predicted, there was a significant negative correlation between sample size and effect size. The differences in effect sizes between small and large experiments were much greater than those between randomized and matched experiments. Explanations for the effects of sample size on effect size are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2000) · Cited by 9,198
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Kjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282 · cited 3×
“The main reason advanced by methodologists for effects of small samples in experimental studies in medicine is that publication bias is more serious in small sample research than in studies with large samples (Givens et al., 1997; Rothstein, Sutton, & Borenstein, 2005; Sterne et al., 2000; Taylor & Tweedy, 1998).”
BackgroundThe review of educational research.
(1931) · Journal of Educational Psychology · doi:10.1037/h0066448 · Cited by 1,562
Comprehensive School Reform and Achievement: A Meta-Analysis
Borman, G. D., Hewes, G. M., Overman, L. T., & Brown, S. (2003) · Review of Educational Research · doi:10.3102/00346543073002125 · Cited by 795
Torgesen, J. K., Wagner, R. K., Rashotte, C. A., Rose, E., Lindamood, P., Conway, T., & Garvan, C. (1999) · Journal of Educational Psychology · doi:10.1037//0022-0663.91.4.579 · Cited by 724
Cook, T. D., Shadish, W. R., & Wong, V. C. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20375 · Cited by 604 · cited 4×
“As noted by Cook et al. (2008), this does not mean that random assignment is unimportant, but it does imply that factors other than random assignment also need to be taken into account. In particular, the present findings argue against the policy of the WWC (2008b) of placing extraordinary value on randomized experime…”
BackgroundResultInfluentialSlavin, R. E. (2008) · Educational Researcher · doi:10.3102/0013189x08314117 · Cited by 560
Self-citationEffective Programs in Elementary Mathematics: A Best-Evidence Synthesis
Slavin, R. E., & Lake, C. (2008) · Review of Educational Research · doi:10.3102/0034654308317473 · Cited by 407
Self-citationEffective Reading Programs for the Elementary Grades: A Best-Evidence Synthesis
Slavin, R. E., Lake, C., Chambers, B., Cheung, A., & Davis, S. (2009) · Review of Educational Research · doi:10.3102/0034654309341374 · Cited by 312
Self-citationEffective Reading Programs for Middle and High Schools: A Best‐Evidence Synthesis
Slavin, R. E., Cheung, A., Groff, C., & Lake, C. (2008) · Reading Research Quarterly · doi:10.1598/rrq.43.3.4 · Cited by 283
Self-citationEffective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis
Slavin, R. E., Lake, C., & Groff, C. (2009) · Review of Educational Research · doi:10.3102/0034654308330968 · Cited by 281
Self-citationIssues in Comparisons Between Meta-analyses and Large Trials
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.14.1089 · Cited by 253
Toward Reform of Program Evaluation: Aims, Methods, and Institutional Arrangements.
Cain, P. S., & Cronbach, L. J. (1982) · Contemporary Sociology · doi:10.2307/2068404 · Cited by 170
The Effectiveness of a Group Reading Instruction Program with Poor Readers in Multiple Grades
Rashotte, C. A., MacPhee, K., & Torgesen, J. K. (2001) · Learning Disability Quarterly · doi:10.2307/1511068 · Cited by 165
Toward reform of program evaluation: Aims, methods, and institutional arrangements
Weiss, C. H. (1981) · Evaluation and Program Planning · doi:10.1016/0149-7189(81)90038-0 · Cited by 152
Givens, G. H., Smith, D. D., & Tweedie, R. L. (1997) · Statistical Science · doi:10.1214/ss/1030037958 · Cited by 127
Self-citationMeasures Inherent to Treatments in Program Effectiveness Reviews
Slavin, R., & Madden, N. A. (2011) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2011.558986 · Cited by 124
Self-citationTorgerson, C. J. (2006) · Journal of Research in Reading · doi:10.1111/j.1467-9817.2006.00318.x · Cited by 59
Cited by
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
Mind-Set Interventions Are a Scalable Treatment for Academic Underachievement
Paunesku, D., Walton, G. M., Romero, C., Smith, E. N., Yeager, D. S., & Dweck, C. S. (2015) · Psychological Science · doi:10.1177/0956797615571017 · Cited by 981
Cheung, A. C. K., & Slavin, R. E. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.001 · Cited by 792
Self-citationBai, S., Hew, K. F., & Huang, B. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100322 · Cited by 994
Godwin, A., Potvin, G., Hazari, Z., & Lock, R. (2016) · Journal of Engineering Education · doi:10.1002/jee.20118 · Cited by 574
Metadata
- Authors
- Slavin, R., & Smith, D.
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2009-12
- Volume
- 31
- Issue
- 4
- Pages
- 500-506
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W2169029212
- Cited by
- 360
- References
- 20
- FWCI
- 0.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.