The DOI matches its Crossref record; 160 of the 160 references it cites were found in a registry or an index.
Research on psychotherapy efficacy and effectiveness: Between Scylla and Charybdis?
Abstract
Clinical researchers have recently begun to explore differences between psychotherapy outcome studies that focus on efficacy and those that focus on effectiveness. The authors provide concise descriptions of these research models, followed by more extended consideration of the most important conceptual and empirical distinctions between the two. Research on the efficacy/effectiveness distinction is then put into context: The common treatment variables that also influence treatment outcomes are reviewed. Fifty years of research on psychotherapy outcomes are next considered; contemporary research on the efficacy and effectiveness research models is emphasized. A description and evaluation of current efforts to heighten the value of technique-focused research to clinicians follow. The authors conclude by anticipating some promising future directions in this research domain.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A limitation of this study was the lack of an active comparator, such as treatment-as-usual (Hanna, 2003; Nathan et al., 2000).”
From Effectiveness of web-based guided self-help cognitive behavioral therapy-enhanced for binge-eating disorder: An implementation study (2024) · cites this paper as Nathan et al., 2000
In the citing paper
“The randomized controlled design and the equivalence between the intervention groups are important factors enhancing the internal validity of a study [71].”
From Comparing internet-based cognitive behavioral therapy with standard care for women with fear of birth: Randomized controlled trial (2018) · cites this paper as [71]
In the citing paper
“Second, although primarily an efficacy study, the generous inclusion of participants and the naturalistic setting of this study resemble the prioritizations of effectiveness studies [71], resulting in a reduced level of control regarding potential confounding variables (eg, heterogeneity within the sample in terms of the symptom severity, comorbidity, and concurrent treatments).”
From Comparing internet-based cognitive behavioral therapy with standard care for women with fear of birth: Randomized controlled trial (2018) · cites this paper as [71]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,845
Cognitive Therapy for Depression
(2012) · PsycEXTRA Dataset · doi:10.1037/e675542012-001 · Cited by 9,678
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
The necessary and sufficient conditions of therapeutic personality change.
Rogers, C. R. (1957) · Journal of Consulting Psychology · doi:10.1037/h0045357 · Cited by 5,599
Rogers, C. R. (1961) · Cited by 4,342
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,998
Cognitive Therapy in Depression
Kovács, M. (1980) · Journal of the American Academy of Psychoanalysis · doi:10.1521/jaap.1.1980.8.1.127 · Cited by 3,422
Relation between working alliance and outcome in psychotherapy: A meta-analysis
Horvath, A. O., & Symonds, B. D. (1991) · Journal of Counseling Psychology · doi:10.1037/0022-0167.38.2.139 · Cited by 2,673
The two disciplines of scientific psychology.
Cronbach, L. J. (1957) · American Psychologist · doi:10.1037/h0043943 · Cited by 2,590
Handbook of Psychotherapy and Behavior Change
Sanford, E. F. (1988) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1988.42.1.153 · Cited by 2,586
Research works printed but not linked: 23
- 1952, Diagnostic and statistical manual of mental disorders.
- 1995, Template for developing guidelines: Interventions for mental disorders and psychosocial aspects of physical disorders.
- Beck, 1979, Cognitive therapy of depression.
- Beutler, 1994, Therapist variables., 229
- Carroll, 1962, Alice's adventures in Wonderland. Harmondsworth
- Chambless, 1998, Update on empirically validated therapies, II., The Clinical Psychologist, 51, 3
- Cohen, 1965, Some statistical issues in psychological research., 95
- Elkin, 1994, The NIMH Treatment of Depression Collaborative Research Program: Where we began and where we are., 114
- Eysenck, 1960, Behavior therapy and the neuroses.
- Glass, 1980, Summarizing effect sizes., 13
- Greenberg, 1994, Psychotherapy research: A clinician's view., 1
- Hays, 1963, Statistics.
- Howard, 1995, The design of clinically relevant outcome research: Some considerations and an example., 3
- Lambert, 1992, Psychotherapy outcome research: Implications for integrative and eclectic therapies., 94
- Maling, 1994, From research to practice to research to, 246
- 1999, Bridging science and service.
- Orlinsky, 1986, Process and outcome in psychotherapy., 311
- Rachman, 1980, The effects of the psychological therapies.
- Smith, 1980, Integrating studies of psychotherapy outcomes., 47
- Smith, 1980, Benefits of psychotherapy.
- Spence, 1994, The failure to ask the hard questions., 19
- Strupp, 1984, Psychotherapy in a new key: A guide to time-limited psychotherapy.
- Weiss, 1986, The psychoanalytic process: Theory, clinical observations, and empirical research.
Cited by
Sorted by citations
Items 201–259 of 259
Context sensitivity: A prognostic patient characteristic for digital psychotherapy
Hull, T. D. (2021) · doi:10.7916/d8-ymp7-ny97 · Cited by 1
Psychological treatment outcomes for outpatients in a clinical context
Lundkvist, J. E., Georgsson, K., Carlbring, P., Borg, E., Ramnerö, J., Johansson, R., Ljungberg, T., & Anderbro, T. (2023) · Nordic Psychology · doi:10.1080/19012276.2023.2206540 · Cited by 1
Case, M. (2011) · CommonKnowledge Research Repository (Pacific University Oregon) · Cited by 1
Green, H. J., Frank, R. M., Butwell, A., & Beck, O. J. (2007) · Behaviour Change · doi:10.1375/bech.24.2.87 · Cited by 1
Examination of an Attachment Training for Mentoring Effectiveness
Brooks, S. (2011) · Cited by 1
Defining and delivering effective counselling and psychotherapy
Moloney, L. (2016) · Cited by 1
Psychology & Behavior Analysis
Smith, T. E., Atar, B., Ferreira, T., & Valentine, P. V. (2015) · Cited by 1
A History of Clinical Child and Adolescent Psychology
Routh, D. K. (2018) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190634841.013.1 · Cited by 1
How do we find out what works for whom? Evaluating the efficacy and effectiveness of psychotherapy
McMorrow, E., & Carr, A. (2003) · Research Repository UCD (University College Dublin) · Cited by 1
Webb, M. S. (2005) · Digital Commons - University of South Florida (University of South Florida) · Cited by 1
Introduction to the special issue: Psychology in the 21st century.
Eisenberg, N., Robertson, L. C., & Sher, K. J. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.6.803 · Cited by 1
Chorpita, B. F., Miranda, J. M., & Bernstein, A. (2014) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199328710.013.012 · Cited by 1
5 – Can I trust this evidence?
Herbert, R. (2011) · Elsevier eBooks · doi:10.1016/b978-0-7020-4270-6.00005-3
Traylor, A. C. (2007) · Cited by 1
Weaver, A. (2011) · D-Scholarship@Pitt (University of Pittsburgh)
Functional Outcomes in a Postacute Brain Injury Rehabilitation Program
Brahmstadt, E. (2012) · Digital Commons - PCOM (Philadelphia College of Osteopathic Medicine)
Is de ene therapeut beter dan de andere?
la Croix, K., de Jong, K., & de Groot, E. (2013) · Tijdschrift voor Psychotherapie · doi:10.1007/s12485-013-0030-8
Psychiatric Practice Guidelines: A Step Forward for Psychiatry
Nathan, P. E. (2007) · Contemporary Psychology · doi:10.1037/a0005919
Self-citationResearch Clinic Approach to the Evaluation of Integrative and Humanistic Psychotherapies
van Rijn, B., & Wild, C. (2010)
Advancing the Research Culture at Seattle Pacific University: Training Local Clinical Scientists
Diddams, M., MacDonald, D., & Skidmore, J. A. (2004)
GRASSO, M., & Stampa, P. (2008) · IRIS Research product catalog (Sapienza University of Rome)
Zimmermann, G., Pomini, V., & Mouline, Q. (2013)
Silva, R. C. (2004) · Revista Latinoamericana de Psicopatologia Fundamental · doi:10.1590/1415-47142004001016
Provider-Level Manual Adaptation: Patterns, Predictors, and Impact on Child Outcomes
Osterberg, L. D. (2010) · OakTrust (Texas A&M University Libraries)
Missing Outcome Data in a Naturalistic Psychodynamic Group Therapy Study
Jensen, H. H., Mortensen, E. L., & Lötz, M. (2017) · Psychology · doi:10.4236/psych.2017.83027
Cucchi, A. (2017) · Counselling Psychology Review · doi:10.53841/bpscpr.2017.32.3.47
À propos de l’article de S. Gilbert : vers une réaffirmation des paradigmes de la psychanalyse ?
Guénoun, T. (2020) · In Analysis · doi:10.1016/j.inan.2020.01.010
Kuncewicz, D. (2020) · Current Issues in Personality Psychology · doi:10.5114/cipp.2020.94697
Widdowson, M. (2020) · International Journal of Transactional Analysis Research & Practice · doi:10.29044/v4i1p26
Stakeholder Views on Children's Mental Health Services
Rodríguez, A. (2012) · PubMed Central · doi:10.25772/gzpt-rg80
(2009) · Wiley eBooks · doi:10.1002/9780470684382.refs
Sabin, C. A. (2010) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.3060961.2742060
Stuart, S. P., & Robertson, M. S. (2020) · Érès eBooks · doi:10.3917/eres.stuart.2021.01.0007
Self-citationMilne, D. L. (2017) · Wiley eBooks · doi:10.1002/9781119107644.refs
(2016) · Wiley eBooks · doi:10.1002/9781118972519.refs
(2020) · Mardaga eBooks · doi:10.3917/mard.favez.2020.01.0333
The social impact, prevalence, and contemporary short-term treatment of mental health conditions
Silverman, M. J. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198865285.003.0001
Treatments and illness management and recovery
Silverman, M. J. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780198865285.003.0002
Shield, K. D., Rehm, J. T., Rehm, M. X., Gmel, G. E., & Drummond, C. (2021) · doi:10.32920/14668782.v1
Shield, K. D., Rehm, J. T., Rehm, M. X., Gmel, G. E., & Drummond, C. (2021) · doi:10.32920/14668782
(2008) · doi:10.1002/9781118269947.ch5
Quinoy, A. M., Hourigan, S. E., Southam‐Gerow, M. A., Ward, A. M., Brown, R. C., Haskell, A., Macphee, M., & Allin, R. B. (2011) · PsycEXTRA Dataset · doi:10.1037/e698852011-001
Sluiter, M. N., Bos, E. H., Doornenbal, J. M., de Jonge, P., & Batstra, L. (2023) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000704 · Cited by 1
Treatment validity for intervention studies.
Chambless, D. L., & Hollon, S. D. (2023) · American Psychological Association eBooks · doi:10.1037/0000319-030
Learning, research, and publishing studies in the supervision domain
Vîşcu, L.-I., Cădariu, I.-E., & Watkins, C. E., Jr. (2023) · Elsevier eBooks · doi:10.1016/b978-0-443-19254-8.00002-6
Grasso, M., & Stampa, P. (2011) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-61735-516-520251013
THERAPEUTIC IN SUPERVISION: AN INEVITABILITY, A MISTAKE, OR A BLESSING?
Михайлович, С. Д., & Румянцева, И. В. (2025) · doi:10.54775/ppl.2025.18.62.001
Written Exposure Therapy for the Treatment of Posttraumatic Stress Disorder
DeJesus, C. R., Sloan, D. M., Ogale, N., & Kalia, A. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29009-1.00103-7
Langhinrichsen‐Rohling, J., Watson, S., Ersoff, M., Worsley, J., Kroll, B., & Hollenhead, J. (2026) · American Journal of Community Psychology · doi:10.1002/ajcp.70087
Asfaw, B. B., Katona, C., & Smith, J. A. (2026) · Counselling Psychology Quarterly · doi:10.1080/09515070.2026.2737121
Quinoy, A. M. (2011) · VCU Scholars Compass (Virginia Commonwealth University) · doi:10.25772/ckk0-2n17
Metadata
- Authors
- Nathan, P. E., Stuart, S. P., & Dolan, S. L.
- Affiliations
- University of Iowa (US)
- Venue
- Psychological Bulletin
- Published
- 2000
- Volume
- 126
- Issue
- 6
- Pages
- 964-981
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W1994615242
- Cited by
- 258
- References
- 153
- Citations by year
- 2026: 4 · 2025: 2 · 2023: 8 · 2022: 8 · 2021: 10 · 2020: 11 · 2019: 4 · 2018: 4 · 2017: 9 · 2016: 9 · 2015: 7 · 2014: 8 · 2013: 11 · 2012: 16
- FWCI
- 14.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- psychotherapy efficacy, psychotherapy effectiveness, treatment outcome research, treatment variables
- MeSH terms
- Forecasting, Health Services Research, Humans, Psychotherapy, United States, Randomized Controlled Trials as Topic, Treatment Outcome, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review