Misuse of statistical tests in three decades of psychotherapy research.
Abstract
This article reviews the misuse of statistical tests in psychotherapy research studies published in the Journal of Consulting and Clinical Psychology in the years 1967-1968, 1977-1978, and 1987-1988. It focuses on 3 major problems in statistical practice: inappropriate uses of null hypothesis tests and p values, neglect of effect size, and inflation of Type I error rate. The impressive frequency of these problems is documented, and changes in statistical practices over the past 3 decades are interpreted in light of trends in psychotherapy research. The article concludes with practical suggestions for rational application of statistical tests.
Cites (4)
- Multiple comparisons among meansDunn, Olive Jean · 1961 · Journal of the American Statistical Association
- Things I have learned (so far).Cohen, Jacob · 1990 · American Psychologist
- The case against statistical significance testingCarver, Ronald · 1978 · Harvard Educational Review
- Do studies of statistical power have an effect on the power of studies?Sedlmeier, Peter, Gigerenzer, Gerd · 1989 · Psychological Bulletin
Cited by (21)
- How Do Risk Factors Work Together? Mediators, Moderators, and Independent, Overlapping, and Proxy Risk FactorsKraemer, Helena Chmura, Stice, Eric, Kazdin, Alan, Offord, David, Kupfer, David · 2001 · American Journal of Psychiatry
- Toward Evidence-Based Medical Statistics. 1: The P Value FallacyGoodman, Steven N. · 1999 · Annals of Internal Medicine
- Null hypothesis significance testing: a review of an old and continuing controversyNickerson, Raymond S. · 2000 · Psychological Methods
- Size of Treatment Effects and Their Importance to Clinical Research and PracticeKraemer, Helena Chmura, Kupfer, David J. · 2006 · Biological Psychiatry
- . Caution regarding the use of pilot studies to guide power calculations for study proposals.Kraemer, Helena Chmura, Mintz, Jim, Noda, Art, Tinklenberg, Jared, Yesavage, Jerome A. · 2006 · Archives of General Psychiatry
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Misuse of statistical tests in three decades of psychotherapy research. https://app.cochat.ai/papers/10.1037//0022-006x.62.1.75
- The paper
- Dar, R., Serlin, R. C., & Omer, H. (1994). Misuse of statistical tests in three decades of psychotherapy research. Journal of Consulting and Clinical Psychology. https://doi.org/10.1037//0022-006x.62.1.75
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.