The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
How Methodological Features Affect Effect Sizes in Education
Abstract
As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect sizes were roughly twice as large for published articles, small-scale trials, and experimenter-made measures, compared to unpublished documents, large-scale studies, and independent measures, respectively. Effect sizes were significantly higher in quasi-experiments than in randomized experiments. Excluding tutoring studies, there were no significant differences in effect sizes between elementary and middle/high studies. Regression analyses found that effects of all factors maintained after controlling for all other factors. Explanations for the effects of methodological features on effect sizes are discussed, as are implications for evidence-based policy.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, published studies in higher rated journals may report larger effects than unpublished reports due to biases in publishing only the stronger associations and significant results (Cheung & Slavin, 2016).”
From Does Natural Mentoring Matter? A Multilevel Meta‐analysis on the Association Between Natural Mentoring and Youth Outcomes (2018) · cites this paper as Cheung & Slavin, 2016
In the citing paper
“major factors that have consistently shown to affect meta‐analytic results in other fields of research are study characteristics, such as the year and quality of the study (Cheung & Slavin, 2016).”
From Does Natural Mentoring Matter? A Multilevel Meta‐analysis on the Association Between Natural Mentoring and Youth Outcomes (2018) · cites this paper as Cheung & Slavin, 2016
In the citing paper
“pre-to post effects generally are much larger than in randomized controlled studies [33,34]”
From Virtual reality exposure therapy for fear of spiders: an open trial and feasibility study of a new treatment for arachnophobia (2024) · cites this paper as [33]
In the citing paper
“Similar effect sizes are substantial; Cheung and Slavin (2016) find, in their meta-analysis of 197 RCTs, an average effect size on academic achievement of 0.16 standard deviations.”
From The effect of school closures on standardised student test outcomes (2022) · cites this paper as Cheung and Slavin (2016)
Citations
Cites
(2000) · Cited by 9,198
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,896
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
Is working memory training effective? A meta-analytic review
Melby-Lervåg, M., & Hulme, C. (2013) · Developmental Psychology · doi:10.1037/a0028228 · Cited by 1,782
Espinosa, J. C. (2004) · Cited by 939
Cheung, A. C. K., & Slavin, R. E. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.001 · Cited by 792
Self-citationFerguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603
Edmonds, M. S., Vaughn, S., Wexler, J., Reutebuch, C., Cable, A., Tackett, K. K., & Schnakenberg, J. W. (2009) · Review of Educational Research · doi:10.3102/0034654308325998 · Cited by 599
Grey literature in meta-analyses of randomized trials of health care interventions
Hopewell, S., McDonald, S., Clarke, M. J., & Egger, M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000010.pub3 · Cited by 598
Slavin, R. E. (2008) · Educational Researcher · doi:10.3102/0013189x08314117 · Cited by 560
Self-citation
Research works printed but not linked: 7
- Baron J., 2003, How to assess whether an educational intervention has been “proven effective” in rigorous research
- Buck S., 2015, Why government needs more randomized control trials: Refuting the myths
- Liao Y. K. C., 1999, Journal of Educational Multimedia and Hypermedia, 8, 255
- Nussle J., 2014, Moneyball for government
- Pearson P. D., 2005, The effects of technology on reading performance in the middle-school grades: A meta-analysis with recommendation for policy
- Slavin R. E., 2013, Education Week, 32, 24
- What Works Clearinghouse, 2014, Procedures and standards handbook
Cited by
Sorted by citations
Items 401–500 of 532
Executive Function and School Performance
Riccio, C. A., & Castro, M. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.005 · Cited by 2
Broadening the Focus of School Psychology Practice
Worrell, F. C., Hughes, T. L., & Dixson, D. D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.001 · Cited by 1
Adolescent Suicidal Behavior in Schools: What to Know and What to Do
Mazza, J. J., & Miller, D. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.020 · Cited by 1
Self-Regulated Learning in School Contexts
Cleary, T. J., Callan, G. L., & Pawlo, E. R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.012 · Cited by 1
Achieving Bloom's Two-Sigma Goal Using Intelligent Tutoring Systems
Hall, O. P. (2021) · IGI Global eBooks · doi:10.4018/978-1-7998-5345-9.ch031 · Cited by 2
Programa “creciendo juntos”: promoción de relaciones positivas para el alumnado
Álamo-Muñoz, A., Quintana, J. C. M., & Cruz-Sosa, M. D. M. (2022) · HUMAN REVIEW International Humanities Review / Revista Internacional de Humanidades · doi:10.37467/revhuman.v11.3923 · Cited by 1
Matalon, C., & Turliuc, M. N. (2023) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2023.01.010 · Cited by 1
Sacré, M., Toczek, M., Policard, F., Serres, G., Paulet, C., Petit, S., Neuville, E., & Lafontaine, D. (2023) · Revue internationale de pédagogie de l’enseignement supérieur · doi:10.4000/ripes.4901 · Cited by 1
Empirical Benchmarks for Planning and Interpreting Causal Effects of Community College Interventions
Weiss, M. J., Somers, M., & Hill, C. (2023) · Journal of Postsecondary Student Success · doi:10.33009/fsop_jpss132759 · Cited by 1
Preparing Preschool Educators to Monitor Child Progress
Shepley, C., Graley, D., & Lane, J. D. (2023) · Infants & Young Children · doi:10.1097/iyc.0000000000000255 · Cited by 1
Improving Reading Comprehension and Summarising Skills in Primary School: A Quasi-Experimental Study
Calvani, A., Marzano, A., Montesano, L., Pellegrini, M., Rizzo, A., Traversetti, M., & Vivanet, G. (2023) · Journal of Educational Cultural and Psychological Studies (ECPS Journal) · doi:10.7358/ecps-2023-028-calv · Cited by 1
The Trend of Metacognition Research Trend in Learning Biology in Indonesia
Idris, T., Rahmat, A., & Hidayat, T. (2024) · KnE Social Sciences · doi:10.18502/kss.v9i13.15911 · Cited by 1
Experimental education research: rethinking why, how, and when to use random assignment
Sims, S., Anders, J., Inglis, M., Lortie‐Forgues, H., Styles, B., & Weidmann, B. (2026) · Educational Research and Evaluation · doi:10.1080/13803611.2026.2678611 · Cited by 3
Simpson, A. (2018) · Educational Research and Evaluation · doi:10.1080/13803611.2018.1520131
School Psychologists in Early Childhood Settings
Alfonso, V. C., Ruby, S. F., Wissel, A. M., & Davari, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.033 · Cited by 1
Addressing “Won’t Do” Issues in Mathematics
Skinner, C. H., Wright, S. P., & McCallum, E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.003 · Cited by 1
Cross-Race/Ethnic Friendships in School
Graham, S., & Kogachi, K. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.011 · Cited by 1
The Improvement of Learners’ Proficiency in English Second Language Through Remedial Work
Linake, M. A., Thembekile, M. N., & Makeleni, S. (2021) · Arabic Language Literature & Culture · doi:10.11648/j.allc.20210601.11 · Cited by 1
Interventionsstudien im Geschichtsunterricht
Waldis, M. (2022) · Springer eBooks · doi:10.1007/978-3-658-29668-1_20 · Cited by 1
Η συνεργασία σχολείου-οικογένειας μέσω της γονικής συμμετοχής στο πλαίσιο του αειφόρου σχολείου
Ναούμ, Έ. (2023) · Περιβαλλοντική Εκπαίδευση για την Αειφορία · doi:10.12681/ees.35782 · Cited by 1
Roques, N. (2024) · Éducation & didactique · doi:10.4000/12n8k · Cited by 1
A multi-factorial evaluation of lower back injury risk factors in fast bowlers.
Barry, T. J. (2026) · e-space (Manchester Metropolitan University) · doi:10.83056/mmu.32478234 · Cited by 1
Rios, J. A., Ihlenfeldt, S. D., & Chávez, C. (2020) · doi:10.35542/osf.io/8b3ch · Cited by 1
Colenbrander, D., von Hagen, A., Kohnen, S., Wegener, S. V., Ko, K. Y., Beyersmann, E., Behzadnia, A., Parrila, R., & Castles, A. E. (2024) · doi:10.31234/osf.io/7h6zr · Cited by 1
Wu, M., & Ouyang, F. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10211-x
The Value of Consensus Priors: A Response to Simpson
Lortie‐Forgues, H., & Inglis, M. (2019) · Educational Researcher · doi:10.3102/0013189x19863426
How Best to Serve Court-Involved Youth in Schools
Andretta, J. R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.035
Coordinating Services with Nonschool Providers
Golden, M. E., & DuPaul, G. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.029
Emotional Disturbance versus Social Maladjustment
Hughes, T. L., Tansy, M. E., & Pask, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.021 · Cited by 1
Substance Use and Misuse Prevention: Guidance for Practitioners
Yu, S., & Sussman, S. Y. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.028
Impairments Related to Medical Conditions
Wodrich, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.026
Enhancing Reading Motivation in Schools
Zibulsky, J., & Schwartz, L. B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.002
Autism Spectrum Disorder and Illegal Acts
Pask, E. A., & Hughes, T. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.022
The School Psychologist’s Role in Facilitating the Transition to College
Kaufman, J., & Øverup, C. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.031
Internalizing Problems and Disorders of Childhood
Kamphaus, R. W., Walden, E. D., & Carrizales-Engelmann, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.019
Belonging in Schools: A Social Psychological Perspective
Perez, A. D., Lee, R. T., & Mendoza‐Denton, R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.010
Gelbar, N. W., & Theodore, L. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.006
Transition from School to Work within a Theory-based Problem-Solving Framework
Schmitt, A. J., Yarbrough, J. L., & Hennessey, J. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.032
Helping Teachers Use Progress Monitoring Data for Intervention Decisions
Burns, M. K., Aguilar, L. N., & Taylor, C. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.007
Psychological Considerations for Asthma
Bray, M. A., Root, M. M., Howell, M., & Bilias‐Lolis, E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.027
School Environments that Facilitate Delaying Gratification
Bembenutty, H. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.013
The enduring principles of effective writing teaching
Young, R., & Ferguson, F. (2020) · Routledge eBooks · doi:10.4324/9780429268984-10
2020 U.S. Presidential Election: Analysis of Female and Male Users on Twitter.Preprint
Karami, A., Clark, S. B., Anderson, M., Lee, D., Zhu, M., Boyajieff, H. R., & Goldschmidt, B. (2021) · arXiv (Cornell University)
Bissonnette, S., Boyer, C., & Morneau-Guérin, F. (2021) · Research Square · doi:10.21203/rs.3.rs-1129185/v4
Bissonnette, S., Boyer, C., & Morneau-Guérin, F. (2021) · Research Square · doi:10.21203/rs.3.rs-1129185/v1
Bissonnette, S., Boyer, C., & Morneau-Guérin, F. (2021) · Research Square · doi:10.21203/rs.3.rs-1129185/v2
Steve, B., Boyer, C., & Morneau-Guérin, F. (2021) · Research Square · doi:10.21203/rs.3.rs-1129185/v3
Interventionsstudien im Geschichtsunterricht
Waldis, M. (2022) · Springer eBooks · doi:10.1007/978-3-658-29673-5_20-1
Gnambs, T., & Schroeders, U. (2022) · doi:10.31234/osf.io/hte6z
Peut-on lutter contre l'échec scolaire ?
(2019) · Pédagogies en développement. Problématiques et recherches · doi:10.3917/dbu.craha.2019.01.0447
Smith, B., Morris, S. P., & Armitage, H. (2022) · Research Papers in Education · doi:10.1080/02671522.2022.2065522 · Cited by 1
Worrell, F. C., Hughes, T. L., & Dixson, D. D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108235532.038
Taylor, J. A., Polanin, J. R., Kowalski, S. M., Wilson, C. D., & Stuhlsatz, M. A. M. (2022) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2022.100312 · Cited by 1
Liu, Y. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1436546
Le mirage d’une méta-analyse sur les effets positifs des appareils portables
Boyer, C., & Bissonnette, S. (2022) · Formation et profession · doi:10.18162/fp.2022.a260
The Montessori Model and the Development of Creativity
Culclasure, B. T. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1437537
IV Congreso de educación Salesiana: desafíos juveniles para una transformación social
Cárdenas Tapia, P. J. (2021) · doi:10.7476/9789978106785
Bridging Research and the Classroom: The Legacy and Learning of Robert E. Slavin
Kiser, B. E. (2023) · Springer eBooks · doi:10.1007/978-3-030-81037-5_190-1
León, M. P., Castillo, C. R., & Burgos, H. (2021) · doi:10.18272/usfqpress.63
Better together: Supporting youth with mental health needs by utilizing the social network
Koper, N. (2023) · Utrecht University Repository (Utrecht University) · doi:10.33540/1736 · Cited by 1
La educación financiera: metodologías eficientes en centennials.
Castillo, G. D. P. S., Vélez, M. J. P., Jiménez, N. C. C., Ojeda, L. P. C., Ocampo, S. E. H., & López-Lapo, J. L. (2023) · Dilemas contemporáneos Educación Política y Valores · doi:10.46377/dilemas.v11i1.3832
Analisis Bibliometrik Kebijakan Berbasis Bukti dalam Bidang Pendidikan
Febriano, R. D., & Yuadi, I. (2023) · CAKRAWALA · doi:10.32781/cakrawala.v17i2.552
Bridging Research and the Classroom: The Legacy and Learning of Robert E. Slavin
Kiser, B. E. (2024) · Springer eBooks · doi:10.1007/978-3-031-25134-4_190
Zhang, Q., Sui, Y., Lin, F.-H., Guan, H., Li, L., Wang, K., Huang, Z., & Neitzel, A. J. (2024) · doi:10.2196/preprints.67953
Gupta, S., Pillai, R. R., & Ghosh, A. (2024) · Journal of Psychoactive Drugs · doi:10.1080/02791072.2024.2428139
Programa “creciendo juntos”: promoción de relaciones positivas para el alumnado
Álamo-Muñoz, A., Quintana, J. C. M., & Cruz-Sosa, M. D. M. (2022) · HUMAN REVIEW International Humanities Review / Revista Internacional de Humanidades · doi:10.37819/humanrev.v12i2.1038
Programa “creciendo juntos”: promoción de relaciones positivas para el alumnado
Álamo-Muñoz, A., Quintana, J. C. M., & Cruz-Sosa, M. D. M. (2022) · HUMAN REVIEW International Humanities Review / Revista Internacional de Humanidades · doi:10.37819/revhuman.v12i2.1038
Scaling Interleaved Practice: Preliminary Evidence from a Systematic Replication
Bartel, A. N., Davenport, J. L., & Matlen, B. J. (2025) · Proceedings. · doi:10.22318/icls2025.465159
Winkler, K., Schöfl, M., Kaufmann, L., & Weber, C. (2025) · Discover Education · doi:10.1007/s44217-025-00577-5
Is Relational Reasoning Ability Malleable?
Alexander, P. A., Logan, M. W., Maki, A. J. K., & Gans, N. E. (2025) · The Journal of Experimental Education · doi:10.1080/00220973.2025.2529997
Central Banks as EducatorsPreprint
Binder, C. C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5350333
Pellegrini, M., Martino, V. D., & Trinchero, R. (2025) · Journal of Educational Cultural and Psychological Studies (ECPS Journal) · doi:10.7358/ecps-2025-031-pell · Cited by 1
L’educazione basata su evidenza. Avanzamenti e potenzialità per la prassi e la ricerca educativa
Calvani, A. (2025) · Journal of Educational Cultural and Psychological Studies (ECPS Journal) · doi:10.7358/ecps-2025-031-cala · Cited by 1
Zhang, Q., Wang, X., Tian, X., & Gehlbach, H. (2025) · EdArXiv (OSF Preprints) · doi:10.35542/osf.io/nfwm4_v1 · Cited by 1
Financial Literacy Education and Foreclosure RatesPreprint
Baker, R., & Dorminey, J. W. (2025) · Research Square · doi:10.21203/rs.3.rs-7078298/v1
Scaling Learning Interventions: A Case Study in Interleaved Math Practice
Matlen, B. J., Bartel, A. N., Davenport, J. L., Rohrer, D., Heffernan, C., Shaw, S. T., & Heffernan, N. T. (2025) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3698205.3729554
Middleton, A. E., Avrit, K. J., Zielke, M. A., DeFries, E., Davila, M., & Frierson, S. L. (2025) · Education Sciences · doi:10.3390/educsci15111460
Smith, A. L., Ralston, R., Barker, R. M., Anderson, E. Z., & Christakis, D. (2025) · International Journal of Developmental Disabilities · doi:10.1080/20473869.2025.2590006
To block or not to block? : a meta-analysis of effectiveness of block-based programming
Talan, T., Doğan, Y., Kalınkara, Y., & Batdı, V. (2025) · Research in Science & Technological Education · doi:10.1080/02635143.2025.2593936
Cheung, J. J. H., & Merchant, A. (2025) · Medical Science Educator · doi:10.1007/s40670-025-02577-4
Chen, M. Y., & Pullman, A. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-604-120251011
Saengpanya, W., & Upasen, R. (2025) · Scientific Reports · doi:10.1038/s41598-025-30504-5
Chan, I., Chong, Y., & Tran, T. H. T. (2025) · Journal of Digital Educational Technology · doi:10.30935/jdet/17552
Labak, I., Bognar, B., & Meštrović, O. (2025) · Education Sciences · doi:10.3390/educsci16010036 · Cited by 3
Connections Between Participation in a Mini-Company Project and Creativity, Planning and Teamwork
Schanke, T., & Johansen, V. (2025) · Lecture notes in educational technology · doi:10.1007/978-981-95-5234-4_26
Plom, F., & Hill, M. A. (2025) · Widening Participation and Lifelong Learning · doi:10.5456/wpll.27.3.118
The Effects of Early Childhood Science Educational Interventions on Children’s Science Achievement
Lynch, K., Asher, C. A., Gotwals, A. W., & Settlage, J. (2026) · The Elementary School Journal · doi:10.1086/739369 · Cited by 1
Investigating Data Sharing Practices in Teaching Effectiveness Research
Sajjad, T., Hartig, J., Lösch, T., & Köhler, C. (2026) · AERA Open · doi:10.1177/23328584251409658
YABANCILARA DİL ÖĞRETİMİNDE TEKNOLOJİNİN KULLANIMI: BİR KARMA-META YÖNTEMİ
Batdı, V. (2021) · DergiPark (Istanbul University)
Multiple solution methods of factoring trinomials in undergraduate mathematics
Joung, E., Kang, M., & Park, B. J. (2026) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2026.2623644
Lin, Z., Huang, C., & Shi, J. (2026) · Behavioral Sciences · doi:10.3390/bs16030368
Pedagogisk forskning trenger store utvalg
Nordmo, M., & Myrene, K. (2026) · Norsk pedagogisk tidsskrift · doi:10.18261/npt.110.1.7
Unleashing computational thinking: a novel approach to reforming Indonesian primary math instruction
Danoebroto, S. W., Wahyudi, W., Ulloa, O., Rizky, R., Syaifuddin, A., & Araya, R. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1754373 · Cited by 2
Metadata
- Authors
- Cheung, A. C. K., & Slavin, R. E.
- Affiliations
- Chinese University of Hong Kong (HK)
- Johns Hopkins University (US)
- Venue
- Educational Researcher
- Published
- 2016-06
- Volume
- 45
- Issue
- 5
- Pages
- 283-292
- ISSN
- 0013-189X (ISSN-L)
- 1935-102X
- OpenAlex
- W2470242385
- Cited by
- 529
- References
- 37
- Citations by year
- 2026: 61 · 2025: 57 · 2024: 57 · 2023: 56 · 2022: 62 · 2021: 57 · 2020: 94 · 2019: 36 · 2018: 23 · 2017: 18 · 2016: 8
- FWCI
- 26.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Researcher (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Education › Educational Research and Methods
- Keywords
- effect size, research design, methodological characteristics, educational program evaluation, randomized experiments, quasi-experiments, unpublished research, preschool programs, reading programs, mathematics programs, science programs, evidence-based policy, publication bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review