Evidence that therapy works in clincally representative conditions.
The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Abstract
This article reports a secondary analysis of past therapy outcome meta-analysis. Fifteen meta-analysis provided effect sizes from 56 studies in previous reviews that met 1 of 3 increasingly stringent levels of criteria for clinical representativeness. The effect sizes were synthesized and compared with results from the original meta-analyses. Effect sizes from more clinically representative studies are the same size at all 3 criteria levels as in past meta-analyses. Almost no studies exist that meet the most stringent level of criteria. Results are interpreted cautiously because of controversy about what criteria best capture the notion of clinical representativeness, because so few experiments have tested therapy in clinical conditions, and because other models for exploring the generalizability of therapy outcome research to clinical conditions might yield different results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, clinical representativeness of studies is often rated based on a multitude of criteria, besides recruitment type, such as setting of treatment delivery, experience of therapists, and flexibility in treatment manuals [9,109].”
From Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis (2019) · cites this paper as [109]
Citations
Cites
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,517
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,997
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
Self-citationLipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488
Self-citationEffectiveness of psychotherapy
(2011) · Revision MCQs and EMIs for the MRCPsych · doi:10.1201/b13482-76 · Cited by 1,058
Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.108.1.30 · Cited by 671
Self-citation
Cited by
Morley, S., Eccleston, C., & Williams, A. (1999) · Pain · doi:10.1016/s0304-3959(98)00255-3 · Cited by 1,597
“5, is concordant with those from larger meta-analyses for psychological treatments for a variety of disorders (Shadish et al., 1997), and our conclusion is similar to that reached by Compas et al.”
ResultInfluentialThe psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783
“…& Yap, 1997; Gould, Otto, Pollack, & Liang, 1997; Gould, Otto, & Pollack, 1995; Lambert & Bergin, 1994; Nietzal et al., 1987; Roth & Fonagy, 1996; Shadish et al., 1997, 2000; Stevens, Hynan, & Allen, 2000;Taylor, 1996;van Balkom et al., 1997;Wampold et al., 1997), and studies reviewed and…”
BackgroundAcceptance and Values-Based Action in Chronic Pain: A Study of Treatment Effectiveness and Process
Vowles, K. E., & McCracken, L. M. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.3.397 · Cited by 500
“These results mirror the degree of success CBT has achieved within medical care settings in general (Compas, Haage, Keefe, Leitenberg, & Williams, 1999; Shadish et al., 1997).”
ResultThe Dodo bird verdict is alive and well-mostly.
Luborsky, L., Rosenthal, R., Diguer, L., Andrusyna, T. P., Berman, J. S., Levitt, J. T., Seligman, D. A., & Krause, E. D. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.1.2 · Cited by 581
“We will not deal here with the level of efficacy of these treatments, for there is much evidence already for their mostly good level of efficacy (e.g., Lambert & Bergin, 1994; Lipsey & Wilson, 1993; Shadish et al., 1997).”
BackgroundResultPsychotherapy for Children and Adolescents
Kazdin, A. E. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145105 · Cited by 462
Metadata
- Authors
- Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., Jorm, A. F., Lyons, L. C., Nietzel, M. T., Robinson, L., Prout, H. T., Smith, M. L., Svartberg, M., & Weiss, B.
- Affiliations
- University of Memphis (US)
- ORCID
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 1997
- Volume
- 65
- Issue
- 3
- Pages
- 355-365
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2049024183
- Cited by
- 186
- References
- 94
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 3 · 2022: 3 · 2021: 3 · 2020: 6 · 2019: 3 · 2018: 6 · 2017: 1 · 2016: 1 · 2015: 5 · 2014: 7 · 2013: 6 · 2012: 9
- FWCI
- 14.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- generalizability, effect size, clinical conditions
- MeSH terms
- Humans, Psychotherapy, Meta-Analysis as Topic, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evidence that therapy works in clincally representative conditions. https://app.cochat.ai/papers/10.1037/0022-006x.65.3.355
- The paper
- Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., Jorm, A. F., Lyons, L. C., Nietzel, M. T., Robinson, L., Prout, H. T., Smith, M. L., Svartberg, M., & Weiss, B. (1997). Evidence that therapy works in clincally representative conditions. Journal of Consulting and Clinical Psychology. https://doi.org/10.1037/0022-006x.65.3.355
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.