The DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
Evaluating Effect Size in Psychological Research: Sense and Nonsense
Open accessAbstract
Effect sizes are underappreciated and often misinterpreted—the most common mistakes being to describe them in ways that are uninformative (e.g., using arbitrary standards) or misleading (e.g., squaring effect-size rs). We propose that effect sizes can be usefully evaluated by comparing them with well-understood benchmarks or by considering them in terms of concrete consequences. In that light, we conclude that when reliably estimated (a critical consideration), an effect-size r of .05 indicates an effect that is very small for the explanation of single events but potentially consequential in the not-very-long run, an effect-size r of .10 indicates an effect that is still small at the level of single events but potentially more ultimately consequential, an effect-size r of .20 indicates a medium effect that is of some explanatory and practical use even in the short run and therefore even more important, and an effect-size r of .30 indicates a large effect that is potentially powerful in both the short and the long run. A very large effect size ( r = .40 or greater) in the context of psychological research is likely to be a gross overestimate that will rarely be found in a large sample or in a replication. Our goal is to help advance the treatment of effect sizes so that rather than being numbers that are ignored, reported without interpretation, or interpreted superficially or incorrectly, they become aspects of research reports that can better inform the application and theoretical development of psychological research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As Cohen's (1988) effect size benchmarks do not reflect effect size distributions in psychological and educational research, we refer to Funder and Ozer (2019) and Gignac and Szodorai (2016) to gauge the strength of our findings.”
From Blending Teacher Autonomy Support and Provision of Structure in the Classroom for Optimal Motivation: A Systematic Review and Meta-Analysis (2025) · cites this paper as Funder and Ozer (2019)
In the citing paper
“We interpreted magnitudes using contemporary behavioral science benchmarks (33, p. 156): an effect of r = .05 is “very small,” r = .10 is “small,” r = .20 is “medium,” and an effect size of r = .30 is “large.””
From Meta-analytic relations between personality and cognitive ability (2023) · cites this paper as [33]
In the citing paper
“The pattern of correlations shows a medium to large but positive relationship between procrastination and depression and anxiety symptoms [57, 58].”
From Procrastination, depression and anxiety symptoms in university students: a three-wave longitudinal study on the mediating role of perceived stress (2024) · cites this paper as [58]
In the citing paper
“even statistically small effects can yield serious consequences when impacting a large population over an extended period (Funder & Ozer, 2019).”
From Finding Your Place: Assessing Diversity, Equity, and Inclusion in an Academic Library (2025) · cites this paper as Funder & Ozer, 2019
In the citing paper
“We disagree. Cohen describes an R2 of 0.09 as a medium-size correlation, visible to the naked eye8. Funder & Ozer argue that, in psychology, an R2 of 0.09 indicates “a large effect that is potentially powerful in both the short and the long run”9.”
From Reply to: No specific relationship between hypnotic suggestibility and the rubber hand illusion (2022) · cites this paper as [9]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,517
Madison, P., & Mischel, W. (1968) · The American Journal of Psychology · doi:10.2307/1421067 · Cited by 4,346
Bystander intervention in emergencies: Diffusion of responsibility.
Darley, J. M., & Latane, B. (1968) · Journal of Personality and Social Psychology · doi:10.1037/h0025589 · Cited by 3,083
Cognitive consequences of forced compliance.
Festinger, L., & Carlsmith, J. M. (1959) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0041593 · Cited by 2,945
Effect size guidelines for individual differences researchers
Gignac, G. E., & Szodorai, E. T. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.06.069 · Cited by 2,860
Bargh, J. A., Chen, M., & Burrows, L. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.71.2.230 · Cited by 2,736
Bargh, J. A., Chen, M. I.-C., & Burrows, L. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.71.2.230 · Cited by 2,636
Handbook of research methods in personality psychology
(2007) · Choice Reviews Online · doi:10.5860/choice.45-2315 · Cited by 2,373
Research works printed but not linked: 9
- 10.1037/0022-3514.56.3.398 · doi:10.1037/0022-3514.56.3.398 · Paper page
- 10.1037/0022-3514.44.1.107 · doi:10.1037/0022-3514.44.1.107 · Paper page
- 10.1037/0003-066X.56.2.128 · doi:10.1037/0003-066x.56.2.128 · Paper page
- 10.1037/0033-2909.97.2.307 · DOI · Paper page
- Ozer D. J., 2007, Handbook of research methods in personality psychology, 495
- 10.1037/0003-066X.45.6.775 · DOI · Paper page
- Rosenthal R., 1996, Artifacts in behavioral research, 289
- 10.1037/0022-0663.74.2.166 · doi:10.1037/0022-0663.74.2.166 · Paper page
- Vohs K., 2018, Symposium conducted at the annual meeting of the Society for Personality and Social Psychology
Cited by
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Functional Fear Predicts Public Health Compliance in the COVID-19 Pandemic
Harper, C. A., Satchell, L. P., Fido, D., & Latzman, R. D. (2021) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-020-00281-5 · Cited by 1,564
“For example, Funder and Ozer (2019) reviewed various summative analyses of the psychology and reported r = .20 as the typical effect size.”
MethodInterpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
“First, I update prior reviews (Coe, 2002; Bloom et al., 2008, Lipsey et al. 2012) with insights from a number of new articles (e.g. Cheung & Slavin, 2016; Simpson, 2017; Soland & Meng Thum, 2019; Lortie-Forgues & Inglis, 2019; Baird & Pane, 2019; Funder & Ozer, 2019; Schäfer & Schwarz, 2019).”
Replicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Countering Misinformation and Fake News Through Inoculation and Prebunking
Lewandowsky, S., & van der Linden, S. (2021) · European Review of Social Psychology · doi:10.1080/10463283.2021.1876983 · Cited by 773
“…under 7.6% (Epstein & Robertson, 2015) and the 2016 election was decided by razor-thin margins in a few swing states), these effects can be considered meaningful when scaled (Funder & Ozer, 2019) and commensurate with effect sizes in persuasion research (Banas & Rains, 2010; Walter & Murphy, 2018).”
BackgroundInfluential
Metadata
- Authors
- Funder, D. C., & Ozer, D. J.
- Affiliations
- University of California, Riverside (US)
- Corresponding author
- Funder, David C.
- Venue
- Advances in Methods and Practices in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2019-05-08
- Volume
- 2
- Issue
- 2
- Pages
- 156-168
- ISSN
- 2515-2459 (ISSN-L)
- 2515-2467
- OpenAlex
- W2944339144
- Cited by
- 3,295
- References
- 52
- Citations by year
- 2026: 547 · 2025: 579 · 2024: 484 · 2023: 499 · 2022: 469 · 2021: 408 · 2020: 251 · 2019: 57
- FWCI
- 198.02
- Type
- journal article
- Language
- en
- Update notices
- correction (2020-11-30)
- Open access
- bronze
- doi.org
- Locations
- Advances in Methods and Practices in Psychological Science (publishedVersion)
- Funders
- Division of Social and Economic Sciences (BCS-1528131)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- effect size, effect size interpretation, benchmark, effect size overestimation, replication, practical significance, statistical misinterpretation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating Effect Size in Psychological Research: Sense and Nonsense. https://app.cochat.ai/papers/10.1177/2515245919847202
- The paper
- Funder, D. C., & Ozer, D. J. (2019). Evaluating Effect Size in Psychological Research: Sense and Nonsense. Advances in Methods and Practices in Psychological Science. https://doi.org/10.1177/2515245919847202
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.