The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Beyond small, medium, or large: points of consideration when interpreting effect sizes
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Indeed, wise interventions are often low cost, disproportionately benefit low performing groups, have effects that can be sustained over time and context, and, in contrast to interventions that target specialized knowledge, can have effects on a broad range of academic, behavioral, and psychological outcomes.”
From Tackling Educational Inequalities with Social Psychology: Identities, Contexts, and Interventions (2021) · cites this paper as Bakker et al., 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These characteristics make wise interventions particularly suitable for scaling up, even where the average size of their effect on the overall population is relatively small (Bakker et al., 2019;Kraft, 2020;Slavin & Madden, 2011).”
From Tackling Educational Inequalities with Social Psychology: Identities, Contexts, and Interventions (2021) · cites this paper as Bakker et al., 2019
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Indeed, wise interventions are often low cost, disproportionately benefit low performing groups, have effects that can be sustained over time and context, and, in contrast to interventions that target specialized knowledge, can have effects on a broad range of academic, behavioral, and psychological outcomes.”
From Tackling Educational Inequalities with Social Psychology: Identities, Contexts, and Interventions (2021) · cites this paper as Bakker et al., 2019
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Indeed, wise interventions are often low cost, disproportionately benefit low performing groups, have effects that can be sustained over time and context, and, in contrast to interventions that target specialized knowledge, can have effects on a broad range of academic, behavioral, and psychological outcomes.”
From Tackling Educational Inequalities with Social Psychology: Identities, Contexts, and Interventions (2021) · cites this paper as Bakker et al., 2019
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Indeed, wise interventions are often low cost, disproportionately benefit low performing groups, have effects that can be sustained over time and context, and, in contrast to interventions that target specialized knowledge, can have effects on a broad range of academic, behavioral, and psychological outcomes.”
From Tackling Educational Inequalities with Social Psychology: Identities, Contexts, and Interventions (2021) · cites this paper as Bakker et al., 2019
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306
Using Effect Size—or Why the P Value Is Not Enough
Sullivan, G. M., & Feinn, R. (2012) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-12-00156.1 · Cited by 5,553
Publication Manual of the American Psychological Association
DeCleene, K. E., & Fogo, J. (2011) · Occupational Therapy In Health Care · doi:10.3109/07380577.2011.629024 · Cited by 3,178
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · cited 1×
“There are many different measures of effect size appropriate for different situations (Kirk, 1996, counted 40 measures).”
BackgroundScientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
How to select, calculate, and interpret effect sizes.
Durlak, J. (2009) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp004 · Cited by 1,487
Publication Manual of the American Psychological Association
Yao, R. (2011) · Family and Consumer Sciences Research Journal · doi:10.1111/j.1552-3934.2011.02081.x · Cited by 1,459
In defense of external invalidity.
Mook, D. G. (1983) · American Psychologist · doi:10.1037/0003-066x.38.4.379 · Cited by 1,284
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
Publication Manual of the American Psychological Association (4th ed.).
Gullickson, T. (1996) · Contemporary Psychology · doi:10.1037/004700 · Cited by 1,241
When small effects are impressive
Prentice, D. A., & Miller, D. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.160 · Cited by 1,008
Mind-Set Interventions Are a Scalable Treatment for Academic Underachievement
Paunesku, D., Walton, G. M., Romero, C., Smith, E. N., Yeager, D. S., & Dweck, C. S. (2015) · Psychological Science · doi:10.1177/0956797615571017 · Cited by 981
Trafimow, D., & Marks, M. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2015.1012991 · Cited by 618
How Methodological Features Affect Effect Sizes in Education
Cheung, A. C. K., & Slavin, R. E. (2016) · Educational Researcher · doi:10.3102/0013189x16656615 · Cited by 529
Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802400072 · Cited by 477
(2009) · Cited by 439
Pre-post effect sizes should be avoided in meta-analyses
Cuijpers, P., Weitz, E., Cristea, I. A., & Twisk, J. (2017) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796016000809 · Cited by 432
(2012) · TigerPrints (Clemson University) · Cited by 402
Sun, S.-Y., Pan, W., & Wang, L. (2010) · Journal of Educational Psychology · doi:10.1037/a0019507 · Cited by 329
On the evaluation of systemic science education reform: Searching for instructional sensitivity
Ruiz‐Primo, M. A., Shavelson, R. J., Hamilton, L., & Klein, S. (2002) · Journal of Research in Science Teaching · doi:10.1002/tea.10027 · Cited by 244
Rigorous Large-Scale Educational RCTs Are Often Uninformative: Should We Be Concerned?
Lortie-Forgues, H., & Inglis, M. (2019) · Educational Researcher · doi:10.3102/0013189x19832850 · Cited by 234
Savelsbergh, E. R., Prins, G. T., Rietbergen, C., Fechner, S., Vaessen, B. E., Draijer, J., & Bakker, A. (2016) · Educational Research Review · doi:10.1016/j.edurev.2016.07.003 · Cited by 230
Self-citationPromoting good statistical practices: Some suggestions
Kirk, R. E. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971185 · Cited by 184
Toward Policy-Relevant Benchmarks for Interpreting Effect Sizes: Combining Effects With Costs
Harris, D. N. (2008) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373708327524 · Cited by 98
Shadish, W. R., Hedges, L. V., Horner, R. H., & Odom, S. L. (2015) · Cited by 87
Fryer, R. G. (2016) · National Bureau of Economic Research · doi:10.3386/w22130 · Cited by 79
Snook, I. A., O’Neill, J., Clark, J. C., O'Neill, A.-M., & Openshaw, R. (2009) · New Zealand Journal of Educational Studies · Cited by 74
Terhart, E. (2011) · Journal of Curriculum Studies · doi:10.1080/00220272.2011.576774 · Cited by 72
Translating standardized effects of education programs into more interpretable metrics
Baird, M. D., & Pane, J. F. (2019) · Educational Researcher · doi:10.3102/0013189x19848729 · Cited by 69
Bergeron, P., & Rivard, L. (2017) · McGill Journal of Education / Revue des sciences de l'éducation de McGill · doi:10.7202/1040816ar · Cited by 59
Comparing Groups: Randomization and Bootstrap Methods Using R
Zieffler, A., Harring, J. R., & Long, J. D. (2011) · Cited by 37
Zieffler, A., Harring, J. R., & Long, J. D. (2011) · Wiley eBooks · doi:10.1002/9781118063682 · Cited by 33
Interpreting Effect Sizes of Education Interventions. EdWorkingPaper No. 19-10.
Kraft, M. A. (2019) · Cited by 8
Research works printed but not linked: 1
- Coe, R. (2002). It’s the effect size, stupid. What effect size is and why it is important. Paper presented at the British Educational Research Association annual conference, Exeter, UK. Retrieved July 24, 2019 from https://www.cem.org/attachments/ebe/ESguide.pdf
Cited by
Sorted by citations
The Role of Mathematics in interdisciplinary STEM education
Maaß, K., Geiger, V., Ariza, M. R., & Goos, M. (2019) · ZDM · doi:10.1007/s11858-019-01100-5 · Cited by 367
Major, L., Francis, G. A., & Tsapali, M. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13116 · Cited by 359
Power to Detect What? Considerations for Planning and Evaluating Sample Size
Giner‐Sorolla, R., Montoya, A. K., Reifman, A. S., Carpenter, T., Lewis, N. A., Aberson, C. L., Bostyn, D. H., Conrique, B. G., Ng, B., Schoemann, A. M., et al. (2024) · Personality and Social Psychology Review · doi:10.1177/10888683241228328 · Cited by 324
Erath, K., Ingram, J., Moschkovich, J. N., & Prediger, S. (2021) · ZDM · doi:10.1007/s11858-020-01213-2 · Cited by 229
König, J., Blömeke, S., Jentsch, A., Schlesinger, L., Felske, C., Musekamp, F., & Kaiser, G. (2021) · Educational Studies in Mathematics · doi:10.1007/s10649-020-10021-0 · Cited by 231
Self-citation
Metadata
- Authors
- Bakker, A., Cai, J., English, L., Kaiser, G., Mesa, V., & Van Dooren, W.
- Affiliations
- Utrecht University (NL)
- University of Delaware (US)
- Queensland University of Technology (AU)
- Universität Hamburg (DE)
- University of Michigan (US)
- Corresponding author
- Bakker, Arthur
- Venue
- Educational Studies in Mathematics
- Published
- 2019-07-30
- Volume
- 102
- Issue
- 1
- Pages
- 1-8
- ISSN
- 0013-1954 (ISSN-L)
- 1573-0816
- OpenAlex
- W2966650813
- Cited by
- 302
- References
- 41
- Citations by year
- 2026: 26 · 2025: 48 · 2024: 43 · 2023: 52 · 2022: 52 · 2021: 55 · 2020: 20 · 2019: 6
- FWCI
- 22.25
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Educational Studies in Mathematics (publishedVersion)
- QUT ePrints (Queensland University of Technology) (submittedVersion)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Education › Educational Research and Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- effect size, statistical significance, mathematics education research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
