How to Estimate and Interpret Various Effect Sizes.
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
The present article presents a tutorial on how to estimate and interpret various effect sizes. The 5th edition
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Statistical Methods for Psychology.
Gudgeon, A. C., & Howell, D. C. (1994) · The Statistician · doi:10.2307/2348956 · Cited by 8,278
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Higher Education: Handbook of Theory and Research
(2007) · Higher Education: Handbook of Theory and Research · doi:10.1007/978-1-4020-5666-6 · Cited by 2,359
Parametric measures of effect size.
Rosenthal, R. (1994) · Cited by 1,847
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · cited 9×
“Various frameworks for classifying the several dozen effect size statistics have been presented (cf. Kirk, 1996; Thompson, 2002a).”
BackgroundInfluentialStatistical Power Analysis for the Behavioral Sciences
Wassertheil, S., & Cohen, J. (1970) · Biometrics · doi:10.2307/2529115 · Cited by 1,383
Handbook of counseling psychology
Brown, S. D., & Lent, R. W. (1992) · John Wiley & Sons, Inc. eBooks · Cited by 1,162
Reading and understanding more multivariate statistics
(2001) · Choice Reviews Online · doi:10.5860/choice.38-5067 · Cited by 1,125
Multiple regression as a general data-analytic system.
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026714 · Cited by 1,095
Handbook of counseling psychology
Palmer, M. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90017-5 · Cited by 1,056
Beyond significance testing: Reforming data analysis methods in behavioral research.
Kline, R. B. (2004) · doi:10.1037/10693-000 · Cited by 1,034
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 3×
“, nonsignificant results are filed and not even submitted for publication) and would perish (Greenwald, 1975; Rosenthal, 1979).”
BackgroundWhen small effects are impressive
Prentice, D. A., & Miller, D. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.160 · Cited by 1,008 · cited 2×
“One-size-fits-all rules of thumb are not always very helpful in interpreting effect sizes, as Prentice and Miller (1992) pointed out in their article, “When small effects are impressive.””
BackgroundMethodThe case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
The Handbook of Research Synthesis
Ziegel, E. R., Cooper, H., & Hedges, L. (1995) · Technometrics · doi:10.2307/1269651 · Cited by 927
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 830
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037//1082-989x.1.2.115 · Cited by 783
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 777
Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations
Olejnik, S., & Algina, J. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.2000.1040 · Cited by 701
What If There Were No Significance Tests?
(2013) · Psychology Press eBooks · doi:10.4324/9781315827353 · Cited by 667
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-027 · Cited by 652
Complementary methods for research in education
Winne, P. H. (1989) · Teaching and Teacher Education · doi:10.1016/0742-051x(89)90032-2 · Cited by 544
Thompson, B. (2002) · Educational Researcher · doi:10.3102/0013189x031003025 · Cited by 538
Self-citationBrand, J. L. (1997) · Digital Commons - Andrews University (Andrews University) · Cited by 537
Cumming, G., & Finch, S. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614002 · Cited by 528
How meta-analysis increases statistical power.
Cohn, L. D., & Becker, B. J. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.243 · Cited by 498
Russek, E., & Hays, W. L. (1982) · Journal of the American Statistical Association · doi:10.2307/2287811 · Cited by 460
Canonical Correlation Analysis
Thompson, B. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa068 · Cited by 457
Self-citationComplementary Methods for Research in Education
Jaeger, R. M., & Shulman, L. S. (1987) · Cited by 399
Thompson, B. (2002) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2002.tb00167.x · Cited by 398 · cited 3×
“One reason for recommending confidence intervals is that these intervals are readily amenable to graphic presentation, thus allowing a large number of effects across studies to be compared in an economical manner (Thompson, 2002b).”
BackgroundSelf-citationHandbook of counseling psychology, 3rd ed.
Brown, S. D., & Lent, R. W. (2000) · Cited by 364
AERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
Thompson, B. (1996) · Educational Researcher · doi:10.2307/1176337 · Cited by 339
Self-citationHigher Education: Handbook of Theory and Research
(2005) · Higher Education: Handbook of Theory and Research · doi:10.1007/1-4020-3279-x · Cited by 333
The Case Against Statistical Significance Testing, Revisited
Carver, R. P. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806591 · Cited by 319
Smithson, M. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971392 · Cited by 274
Evaluating Results Using Corrected and Uncorrected Effect Size Estimates
Snyder, P., & Lawson, S. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806594 · Cited by 265
Score Reliability: Contemporary Thinking on Reliability Issues
Thompson, B. (2002) · Cited by 255
Self-citationMeasures of effect size for categorical data.
Fleiss, J. L. (1994) · Cited by 248
A History of Effect Size Indices
Huberty, C. J. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062002002 · Cited by 241
Significance, Effect Sizes, Stepwise Methods, and Other Issues: Strong Arguments Move the Field
Thompson, B. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109599499 · Cited by 210
Self-citationTrusty, J., Thompson, B., & Petrocelli, J. V. (2004) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2004.tb00291.x · Cited by 186
Self-citationReplication and Researchers' Understanding of Confidence Intervals and Standard Error Bars
Cumming, G., Williams, J., & Fidler, F. (2004) · Understanding Statistics · doi:10.1207/s15328031us0304_5 · Cited by 172
A Primer on the Logic and Use of Canonical Correlation Analysis.
Thompson, B. (1991) · Measurement and Evaluation in Counseling and Development · Cited by 167
Self-citationThompson, B. (2003) · Sage eBooks · doi:10.4135/9781412985789 · Cited by 166
Self-citationHarlow, L. L., Mulaik, S. A., & Steiger, J. H. (2013) · doi:10.4324/9781315629049-15 · Cited by 134
Reporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect Size
Vacha-Haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000) · Theory & Psychology · doi:10.1177/0959354300103006 · Cited by 126
Self-citationSteiger, J. H., & Fouladi, R. T. (1992) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203611 · Cited by 108
Fidler, F. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402236876 · Cited by 102
Group Overlap as a Basis for Effect Size
Huberty, C. J., & Lowman, L. L. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970718 · Cited by 101
Discussion of Wike and Church's comments
Keppel, G. (1976) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/0022-5371(76)90024-4 · Cited by 99
The Importance of Effect Magnitude
Kirk, R. E. (2003) · Handbook of Research Methods in Experimental Psychology · doi:10.1002/9780470756973.ch5 · Cited by 94
Statistical Techniques Employed in AERJ and JCP Articles from 1988 to 1997: A Methodological Review
Kieffer, K. M., Reese, R. J., & Thompson, B. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109599489 · Cited by 91
Self-citationToward Improved Statistical Reporting in the Journal of Consulting and Clinical Psychology.
Fidler, F., Cumming, G., Thomason, N., Pannuzzo, D., Smith, J., Fyffe, P., Edmonds, H., Harrington, C., & Schmitt, R. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.136 · Cited by 72
Approximate Confidence Intervals for Effect Sizes
Algina, J., & Keselman, H. J. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403256358 · Cited by 71
Hess, B., Olejnik, S. F., & Huberty, C. J. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971572 · Cited by 62
Handbook of Research Methods in Experimental Psychology
(2005) · Blackwell Publishing Ltd eBooks · doi:10.1111/b.9781405132800.2005.x · Cited by 59
Confidence Intervals for Correlation Ratios
Fleishman, A. I. (1980) · Educational and Psychological Measurement · doi:10.1177/001316448004000309 · Cited by 47
Thompson, B. (1990) · Educational and Psychological Measurement · doi:10.1177/0013164490501003 · Cited by 43
Self-citationPast and Future American Psychological Association Guidelines for Statistical Practice
Finch, S., Thomason, N., & Cumming, G. (2002) · Theory & Psychology · doi:10.1177/0959354302126005 · Cited by 40
Glassman, M. (2002) · Educational Researcher · doi:10.3102/0013189x031005024 · Cited by 36
A Single Contrast Test Procedure
Huberty, C. J., & Morris, J. D. (1988) · Educational and Psychological Measurement · doi:10.1177/0013164488483001 · Cited by 33
Computing and Interpreting Effect Sizes
Hill, C. R., & Thompson, B. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/1-4020-2456-8_5 · Cited by 26
Self-citationGuidelines for Reporting Results of Group Quantitative Investigations
Snyder, P. (2000) · Journal of Early Intervention · doi:10.1177/10538151000230030401 · Cited by 23
Research works printed but not linked: 10
- 2001, Publication manual of the American Psychological Association
- Ezekiel, 1930, Methods of correlational analysis.
- 10.2307/1174772 · DOI · Paper page
- 10.1177/00131640121971374 · doi:10.1177/00131640121971374 · Paper page
- 10.1037/0022-0663.95.3.451 · doi:10.1037/0022-0663.95.3.451
- Hays, 1981, Statistics
- Huberty, 1983, Two-group comparisons and univariate classification., Educational and Psychological Measurement, 43, 15, 10.1177/001316448304300103 · DOI
- Tatsuoka. 1973 · doi:10.2307/1167201
- Thompson, (in press). Research synthesis: Effect sizes.
- Tracey, 2000, Issues in the analysis and interpretation of quantitative data: Deinstitutionalization of the null hypothesis test., 177
Cited by
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
An effect size primer: A guide for clinicians and researchers.
Ferguson, C. J. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0015808 · Cited by 3,467
Preacher, K. J., & Kelley, K. (2011) · Psychological Methods · doi:10.1037/a0022658 · Cited by 3,060
“We reiterate the “Three Reporting Rules” suggested by Vacha-Haase and Thompson (2004) for reporting effect size estimates; these rules are just as applicable in the mediation context as in many other contexts: 1.”
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
How Big Is “Big”? Interpreting Effect Sizes in L2 Research
Plonsky, L., & Oswald, F. L. (2014) · Language Learning · doi:10.1111/lang.12079 · Cited by 1,960
Metadata
- Authors
- Vacha-Haase, T., & Thompson, B.
- Venue
- Journal of Counseling Psychology
- Published
- 2004-10
- Volume
- 51
- Issue
- 4
- Pages
- 473-481
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W1979367205
- Cited by
- 539
- References
- 71
- FWCI
- 13.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.