The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Effect sizes, confidence intervals, and confidence intervals for effect sizes
Abstract
The present article provides a primer on (a) effect sizes, (b) confidence intervals, and (c) confidence intervals for effect sizes. Additionally, various admonitions for reformed statistical practice are presented. For example, a very important implication of the realization that there are dozens of effect size statistics is that authors must explicitly tell readers what effect sizes they are reporting. With respect to confidence intervals, when interpreting a 95% interval, we should never say that we are 95% confident that our interval captures the estimated population parameter. It is explained that effect sizes should be reported even for statistically nonsignificant effects. And, most importantly of all, it is emphasized that effect sizes should not be interpreted using Cohen's benchmarks. Instead, we ought to interpret our effects in direct and explicit comparison against the effects in the related prior literature. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 423–432, 2007.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Publication Manual of the American Psychological Association
DeCleene, K. E., & Fogo, J. (2012) · Occupational Therapy In Health Care · doi:10.3109/07380577.2011.629024 · Cited by 3,167
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Handbook of Complementary Methods in Education Research
(2012) · Routledge eBooks · doi:10.4324/9780203874769 · Cited by 2,029
Null Hypothesis Testing: Problems, Prevalence, and an Alternative
Anderson, D. R., Burnham, K. P., & Thompson, W. L. (2000) · The Journal of Wildlife Management · doi:10.2307/3803199 · Cited by 1,930
The Handbook of Research Synthesis.
Light, R. J., Cooper, H., & Hedges, L. V. (1994) · Journal of the American Statistical Association · doi:10.2307/2291021 · Cited by 1,868
Parametric measures of effect size.
Rosenthal, R. (1994) · Cited by 1,847
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
Olejnik, S., & Algina, J. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.434 · Cited by 1,622
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449
The Insignificance of Statistical Significance Testing
Johnson, D. H. (1999) · The Journal of Wildlife Management · doi:10.2307/3802789 · Cited by 1,104
Multiple regression as a general data-analytic system.
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026714 · Cited by 1,095
Estimation of effect size from a series of independent experiments.
Hedges, L. V. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.490 · Cited by 1,062
Beyond significance testing: Reforming data analysis methods in behavioral research.
Kline, R. B. (2004) · doi:10.1037/10693-000 · Cited by 1,034
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022
When small effects are impressive
Prentice, D. A., & Miller, D. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.160 · Cited by 1,008
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 830
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037//1082-989x.1.2.115 · Cited by 783
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 777
Effect sizes for research: A broad practical approach.
Grissom, R. J., & Kim, J. J. (2005) · Cited by 732
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-027 · Cited by 652
What If There Were No Significance Tests?
(2016) · Routledge eBooks · doi:10.4324/9781315629049 · Cited by 542
How to Estimate and Interpret Various Effect Sizes.
Vacha-Haase, T., & Thompson, B. (2004) · Journal of Counseling Psychology · doi:10.1037/0022-0167.51.4.473 · Cited by 539
Self-citationThompson, B. (2002) · Educational Researcher · doi:10.3102/0013189x031003025 · Cited by 538
Self-citationCumming, G., & Finch, S. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614002 · Cited by 528
Russek, E., & Hays, W. L. (1982) · Journal of the American Statistical Association · doi:10.2307/2287811 · Cited by 460
Foundations of behavioral statistics: An insight-based approach.
Thompson, B. (2006) · Cited by 445
Self-citationAdvances in Social Science Methodology
Thompson, B. (1994) · Cited by 423
Self-citationSome Difficulties of Interpretation Encountered in the Application of the Chi-Square Test
Berkson, J. (1938) · Journal of the American Statistical Association · doi:10.1080/01621459.1938.10502329 · Cited by 411
Size matters: the standard error of regressions in the American Economic Review
Ziliak, S. T., & McCloskey, D. N. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.024 · Cited by 408
Thompson, B. (2002) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2002.tb00167.x · Cited by 398
Self-citationAERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
Thompson, B. (1996) · Educational Researcher · doi:10.2307/1176337 · Cited by 339
Self-citationAlgina, J., Keselman, H. J., & Penfield, R. D. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.3.317 · Cited by 290
Canonical correlation analysis: A general parametric significance-testing system.
Knapp, T. R. (1978) · Psychological Bulletin · doi:10.1037//0033-2909.85.2.410 · Cited by 286
Use, Overuse, and Misuse of Significance Tests in Evolutionary Biology and Ecology
(1991) · The Bulletin of the Ecological Society of America · doi:10.2307/20167258 · Cited by 281
Smithson, M. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971392 · Cited by 274
A History of Effect Size Indices
Huberty, C. J. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062002002 · Cited by 241
Probability of the superior outcome of one treatment over another.
Grissom, R. J. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.2.314 · Cited by 217
Thompson, B. (1996) · Educational Researcher · doi:10.3102/0013189x025002026 · Cited by 211
Self-citationSignificance, Effect Sizes, Stepwise Methods, and Other Issues: Strong Arguments Move the Field
Thompson, B. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109599499 · Cited by 210
Self-citationMathematical vs. scientific significance.
Boring, E. G. (1919) · Psychological Bulletin · doi:10.1037/h0074554 · Cited by 146
Steiger, J. H., & Fouladi, R. T. (1992) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203611 · Cited by 108
Fidler, F. M. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402236876 · Cited by 107
The Importance of Effect Magnitude
Kirk, R. E. (2003) · Wiley eBooks · doi:10.1002/9780470756973.ch5 · Cited by 94
Statistical Techniques Employed inAERJandJCPArticles from 1988 to 1997: A Methodological Review
Kieffer, K. M., Reese, R. J., & Thompson, B. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109599489 · Cited by 91
Self-citationAbuse of hypothesis testing statistics in ecological risk assessment
Suter, G. W. (1996) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807039609383611 · Cited by 91
Reporting of Statistical Inference in the Journal of Applied Psychology: Little Evidence of Reform
Finch, S. J., Cumming, G., & Thomason, N. R. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971167 · Cited by 86
Approximate Confidence Intervals for Effect Sizes
Algina, J. J., & Keselman, H. J. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403256358 · Cited by 72
Hubbard, R., & Ryan, P. A. (2000) · Educational and Psychological Measurement · doi:10.1177/0013164400605001 · Cited by 66
Research Synthesis: Effect Sizes
Thompson, B. (2006) · doi:10.4324/9780203874769.ch35 · Cited by 58
Self-citationHess, B., Olejnik, S. F., & Huberty, C. J. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971572 · Cited by 55
Finch, S., Cumming, G., & Thomason, N. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401612001 · Cited by 52
Treatments of Effect Sizes and Statistical Significance Tests in Textbooks
Capraro, R. M., & Capraro, M. M. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402236877 · Cited by 49
Effect Sizes and their Intervals: The Two-Level Repeated Measures Case
Algina, J. J., Keselman, H. J., & Penfield, R. D. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404268675 · Cited by 43
The “significance” crisis in psychology and education
Thompson, B. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.034 · Cited by 37
Self-citationGlassman, M. (2002) · Educational Researcher · doi:10.3102/0013189x031005024 · Cited by 36
Is the Pearsonr2Biased, and if So, What Is the Best Correction Formula?
Wang, Z., & Thompson, B. (2007) · The Journal of Experimental Education · doi:10.3200/jexe.75.2.109-125 · Cited by 31
Self-citationNatesan, P., & Thompson, B. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164406292028 · Cited by 14
Self-citationRobust Confidence Intervals for Effect Size in the Two-Group Case
Keselman, H. J., Algina, J. J., & Fradette, K. (2005) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1130803320 · Cited by 6
Cited by
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
Preacher, K. J., & Kelley, K. (2011) · Psychological Methods · doi:10.1037/a0022658 · Cited by 3,060
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Un sistema de clasificación de los diseños de investigación en psicología
Ato, M., López-García, J. J., & Benavente, A. (2013) · Anales de Psicología · doi:10.6018/analesps.29.3.178511 · Cited by 2,254
How to Select, Calculate, and Interpret Effect Sizes
Durlak, J. A. (2009) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp004 · Cited by 1,446
Metadata
- Authors
- Thompson, B.
- Venue
- Psychology in the Schools
- Publisher
- Wiley
- Published
- 2007-04-03
- Volume
- 44
- Issue
- 5
- Pages
- 423-432
- ISSN
- 0033-3085 (ISSN-L)
- 1520-6807
- OpenAlex
- W2081574221
- Cited by
- 386
- References
- 64
- FWCI
- 13.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.