The DOI matches its Crossref record; 160 of the 160 references it cites were found in a registry or an index.
Research on psychotherapy efficacy and effectiveness: Between Scylla and Charybdis?
Abstract
Clinical researchers have recently begun to explore differences between psychotherapy outcome studies that focus on efficacy and those that focus on effectiveness. The authors provide concise descriptions of these research models, followed by more extended consideration of the most important conceptual and empirical distinctions between the two. Research on the efficacy/effectiveness distinction is then put into context: The common treatment variables that also influence treatment outcomes are reviewed. Fifty years of research on psychotherapy outcomes are next considered; contemporary research on the efficacy and effectiveness research models is emphasized. A description and evaluation of current efforts to heighten the value of technique-focused research to clinicians follow. The authors conclude by anticipating some promising future directions in this research domain.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A limitation of this study was the lack of an active comparator, such as treatment-as-usual (Hanna, 2003; Nathan et al., 2000).”
From Effectiveness of web-based guided self-help cognitive behavioral therapy-enhanced for binge-eating disorder: An implementation study (2024) · cites this paper as Nathan et al., 2000
In the citing paper
“The randomized controlled design and the equivalence between the intervention groups are important factors enhancing the internal validity of a study [71].”
From Comparing internet-based cognitive behavioral therapy with standard care for women with fear of birth: Randomized controlled trial (2018) · cites this paper as [71]
In the citing paper
“Second, although primarily an efficacy study, the generous inclusion of participants and the naturalistic setting of this study resemble the prioritizations of effectiveness studies [71], resulting in a reduced level of control regarding potential confounding variables (eg, heterogeneity within the sample in terms of the symptom severity, comorbidity, and concurrent treatments).”
From Comparing internet-based cognitive behavioral therapy with standard care for women with fear of birth: Randomized controlled trial (2018) · cites this paper as [71]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,845
Cognitive Therapy for Depression
(2012) · PsycEXTRA Dataset · doi:10.1037/e675542012-001 · Cited by 9,678
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
The necessary and sufficient conditions of therapeutic personality change.
Rogers, C. R. (1957) · Journal of Consulting Psychology · doi:10.1037/h0045357 · Cited by 5,599
Rogers, C. R. (1961) · Cited by 4,342
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,998
Cognitive Therapy in Depression
Kovács, M. (1980) · Journal of the American Academy of Psychoanalysis · doi:10.1521/jaap.1.1980.8.1.127 · Cited by 3,422
Relation between working alliance and outcome in psychotherapy: A meta-analysis
Horvath, A. O., & Symonds, B. D. (1991) · Journal of Counseling Psychology · doi:10.1037/0022-0167.38.2.139 · Cited by 2,673
The two disciplines of scientific psychology.
Cronbach, L. J. (1957) · American Psychologist · doi:10.1037/h0043943 · Cited by 2,590
Handbook of Psychotherapy and Behavior Change
Sanford, E. F. (1988) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1988.42.1.153 · Cited by 2,586
(1993) · Medical Entomology and Zoology · Cited by 2,491
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
(1997) · Journal of Studies on Alcohol · doi:10.15288/jsa.1997.58.7 · Cited by 1,905
The effects of psychotherapy: an evaluation.
Eysenck, H. J. (1952) · Journal of Consulting Psychology · doi:10.1037/h0063633 · Cited by 1,734
The effectiveness of psychotherapy: The Consumer Reports study.
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037//0003-066x.50.12.965 · Cited by 1,626
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488
Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
Luborsky, L. (1975) · Archives of General Psychiatry · doi:10.1001/archpsyc.1975.01760260059004 · Cited by 1,485
Persuasion and Healing: A Comparative Study of Psychotherapy
Frank, J. D. (1961) · Cited by 1,391
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.4.1 · Cited by 1,350
Interpersonal Psychotherapy Of Depression
Klerman, G. L. (1984) · Medical Entomology and Zoology · Cited by 1,315
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294
Three-Year Outcomes for Maintenance Therapies in Recurrent Depression
Frank, E. (1990) · Archives of General Psychiatry · doi:10.1001/archpsyc.1990.01810240013002 · Cited by 1,294
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037//0022-0663.74.2.166 · Cited by 1,233
Handbook of Psychotherapy Integration
(2005) · Oxford University Press eBooks · doi:10.1093/med/9780195165791.001.0001 · Cited by 1,145
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091
Effectiveness of psychotherapy
Puri, B. K., Ho, R., & Treasden, I. (2011) · CRC Press eBooks · doi:10.1201/b13482-76 · Cited by 1,058
Some implicit common factors in diverse methods of psychotherapy.
Rosenzweig, S. (1936) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1936.tb05248.x · Cited by 1,042
Handbook of clinical psychology
Wolman, B. B. (1965) · McGraw-Hill eBooks · Cited by 960
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037/0022-0663.74.2.166 · Cited by 920
The dose-effect relationship in psychotherapy.
Howard, K. I., Kopta, S. M., Krause, M. S., & Orlinsky, D. E. (1986) · American Psychologist · doi:10.1037/0003-066x.41.2.159 · Cited by 891
Psychotherapy and Personality Change
Dupont, G. M., Rogers, C. R., & Dymond, R. F. (1955) · The American Catholic Sociological Review · doi:10.2307/3708791 · Cited by 861
Principles Of Psychoanalytic Psychotherapy: A Manual For Supportive-expressive Treatment
Luborsky, L. B. (1984) · Medical Entomology and Zoology · Cited by 856
Chambless, D. (1995) · PsycEXTRA Dataset · doi:10.1037/e554972011-003 · Cited by 710
Robinson, L. A., Berman, J., & Neimeyer, R. (1990) · Psychological bulletin · doi:10.1037/0033-2909.108.1.30 · Cited by 691
An Update on Empirically Validated Therapies
Chambless, D., Sanderson, W., Shoham, V., Johnson, S. B., Pope, K., Crits-Christoph, P., Baker, M., Johnson, B., Woody, S., Sue, S., et al. (1998) · PsycEXTRA Dataset · doi:10.1037/e555332011-003 · Cited by 633
A.N.W (1959) · Animal Behaviour · doi:10.1016/0003-3472(59)90073-9 · Cited by 615
Meta-analysis of comparative therapy outcome studies: a replication and refinement.
Shapiro, D. A., & Shapiro, D. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.581 · Cited by 590
(1994) · American Journal of Psychiatry · doi:10.1176/ajp.151.12.1 · Cited by 581
Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1059 · Cited by 573
The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy.
Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., Halperin, G., Bishop, M., Berman, J. S., & Schweizer, E. (1999) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.6.1.95 · Cited by 572
Handbook of psychotherapy and behavior change, 4th ed.
Bergin, A. E., & Garfield, S. L. (1994) · Cited by 539
NIMH Treatment of Depression Collaborative Research Program
Elkin, I. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790260103013 · Cited by 520
Interpersonal Psychotherapy of Depression
Koenigsberg, H. W. (1985) · Psychosomatics · doi:10.1016/s0033-3182(85)72763-6 · Cited by 518
(1993) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.1993.tb05219.x · Cited by 506
Meta‐Analysis of Therapist Effects in Psychotherapy Outcome Studies
Crits-Christoph, P. F., Baranackie, K., Kurcias, J., Beck, A. T., Carroll, K. M., Perry, K. J., Luborsky, L. B., McLellan, A. T., WOODY, G. E., Thompson, L. W., et al. (1991) · Psychotherapy Research · doi:10.1080/10503309112331335511 · Cited by 433
Handbook of Psychotherapy Integration
(2019) · Oxford University Press eBooks · doi:10.1093/med-psych/9780190690465.001.0001 · Cited by 393
Psychotherapy outcome research: Implications for integrative and eclectical therapists.
Lambert, M. J. (1992) · Cited by 390
The effects of psychological therapies under clinically representative conditions: a meta-analysis
Shadish, W. R., Navarro, A. M., Matt, G. E., & Phillips, G. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.4.512 · Cited by 381
Persuasion and Healing: A Comparative Study of Psychotherapy
Meehan, M. C. (1973) · JAMA · doi:10.1001/jama.1973.03220220089034 · Cited by 351
Therapeutic Factors in Psychotherapy
Frank, J. D. (1971) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1971.25.3.350 · Cited by 344
Effects of family and marital psychotherapies: a meta-analysis.
Shadish, W., Montgomery, L. M., Wilson, P., Wilson, M. R., Bright, I., & Okwumabua, T. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.6.992 · Cited by 320
"Are all psychotherapies equivalent?".
Stiles, W. B., Shapiro, D. A., & Elliott, R. (1986) · American Psychologist · doi:10.1037/0003-066x.41.2.165 · Cited by 315
On the relation of clinical research to clinical practice: Current issues, new directions.
Barlow, D. H. (1981) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.49.2.147 · Cited by 313
The researcher's own therapy allegiances: a ''wild card'' in comparisons of treatment efficacy
Luborsky, L. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.95 · Cited by 308
Psychodynamic Psychotherapy Of Borderline Patients
Kernberg, O. F., Selzer, M. A., Koenigsberg, H. W., Carr, A. C., & Appelbaüm, A. H. (1989) · Medical Entomology and Zoology · Cited by 302
Efficacy of Interpersonal Psychotherapy as a Maintenance Treatment of Recurrent Depression
Frank, E. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810360017002 · Cited by 291
Toward a more clinically valid approach to therapy research.
Goldfried, M. R., & Wolfe, B. E. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.143 · Cited by 273
Comparative outcome studies of psychotherapy: methodological issues and strategies.
Kazdin, A. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.95 · Cited by 258
Some implications of psychotherapy research for therapeutic practice.
Bergin, A. E. (1966) · Journal of Abnormal Psychology · doi:10.1037/h0023577 · Cited by 254
Persons, J. (1991) · American Psychologist · doi:10.1037/0003-066x.46.2.99 · Cited by 251
(1996) · American Journal of Psychiatry · doi:10.1176/ajp.153.10.1 · Cited by 243
A Note on Percent Variance Explained as A Measure of the Importance of Effects
Rosenthal, R., & Rubin, D. B. (1979) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1979.tb02713.x · Cited by 238
Practice guideline for major depressive disorder in adults. American Psychiatric Association
(1993) · American Journal of Psychiatry · doi:10.1176/ajp.150.4.1 · Cited by 226
Persons, J. B. (1991) · American Psychologist · doi:10.1037//0003-066x.46.2.99 · Cited by 224
Some problems associated with "validated" forms of psychotherapy.
Garfield, S. (1996) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1996.tb00073.x · Cited by 220
Effects of family and marital psychotherapies: A meta-analysis.
Shadish, W. R., Montgomery, L. M., Wilson, P. A., et al. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.6.992 · Cited by 219
Does professional training make a therapist more effective?
Berman, J. S., & Norton, N. C. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.98.2.401 · Cited by 218
Phillips, M. (1996) · Medical Entomology and Zoology · Cited by 216
On the relation of clinical research to clinical practice: Current issues, new directions.
Barlow, D. H. (1981) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.49.2.147 · Cited by 215
An Experiment in the Prevention of Delinquency: The Cambridge-Somerville Youth Study
Shalloo, J. P., Powers, E., & Witmer, H. L. (1952) · The Journal of Criminal Law Criminology and Police Science · doi:10.2307/1139954 · Cited by 210
ABUSE OF THE DRUG METAPHOR IN PSYCHOTHERAPY PROCESS-OUTCOME RESEARCH
Stiles, W. B., & Shapiro, D. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90007-x · Cited by 204
American Journal of Psychiatry celebrates 150th anniversary
Andreasen, N. C. (1994) · American Journal of Psychiatry · doi:10.1176/ajp.151.6.1 · Cited by 204
Assessing Clinical Significance: Proposed Extensions to Method
Tingey, R., Lambert, M. J., Burlingame, G. M., & Hansen, N. B. (1996) · Psychotherapy Research · doi:10.1080/10503309612331331638 · Cited by 198
Short-term dynamically oriented psychotherapy: A review and meta-analysis
Anderson, É. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(95)00027-m · Cited by 196
Science as an ally of practice.
Seligman, M. E. P. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1072 · Cited by 195
Evidence that therapy works in clincally representative conditions.
Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., Jorm, A. F., Lyons, L. C., Nietzel, M. T., Robinson, L., et al. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.3.355 · Cited by 186
SPECIFIC AND NONSPECIFIC FACTORS IN PSYCHOTHERAPY: A PROBLEMATIC PARADIGM FOR PSYCHOTHERAPY RESEARCH
Butler, S., & Strupp, H. (1986) · Psychotherapy · doi:10.1037/h0085590 · Cited by 185
Are all psychotherapies equivalent
Stiles, W. B., Shapiro, D., & Elliott, R. (1986) · American Psychologist · doi:10.1037//0003-066x.41.2.165 · Cited by 178
Comparative outcome studies of psychotherapy: Methodological issues and strategies.
Kazdin, A. E. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.95 · Cited by 167
Selemon, L. D., Goldman‐Rakic, P. S., & Tamminga, C. A. (1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.1.5 · Cited by 150
Methodological Problems in Identifying Efficacious Psychotherapies
Wampold, B. E. (1997) · Psychotherapy Research · doi:10.1080/10503309712331331853 · Cited by 149
Health care policy, psychotherapy research, and the future of psychotherapy.
Barlow, D. H. (1996) · American Psychologist · doi:10.1037//0003-066x.51.10.1050 · Cited by 146
Assessing the statistical and social importance of the effects of psychotherapy.
Rosenthal, R. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.1.4 · Cited by 143
Studying the effectiveness of psychotherapy. How well can clinical trials do the job?
Jacobson, N., & Christensen, A. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1031 · Cited by 143
Psychotherapy: Clinical, research, and theoretical issues.
Strupp, H. H. (1973) · Jason Aronson eBooks · doi:10.1037/11523-000 · Cited by 140
Grief: normal and pathological variants
Viederman, M. (1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.1.1 · Cited by 137
Ogles, B. M., Lambert, M. J., & Sawyer, J. D. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.2.321 · Cited by 135
Individual Psychotherapy and Behavior Therapy
Bergin, A. E., & Suinn, R. M. (1975) · Annual Review of Psychology · doi:10.1146/annurev.ps.26.020175.002453 · Cited by 130
Research-structured vs clinically flexible versions of social learning-based marital therapy.
Jacobson, N. S., Schmaling, K. B., Holtzworth-Munroe, A., Katt, J. L., Wood, L. F., & Follette, V. M. (1989) · Behaviour Research and Therapy · doi:10.1016/0005-7967(89)90076-4 · Cited by 128
Random versus nonrandom assignment in controlled experiments: Do you get the same answer?
Shadish, W. R., & Ragsdale, K. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.6.1290 · Cited by 126
Identifying empirically supported treatments: What if we didn't?
Beutler, L. E. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.113 · Cited by 122
Placebo controls in psychotherapy research: A sine qua non or a placebo for research problems?
Parloff, M. B. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.79 · Cited by 121
Comparative therapy outcome research: methodological implications of meta-analysis.
Shapiro, D. A., & Shapiro, D. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.1.42 · Cited by 117
Therapeutic alliance and outcome: Impact of treatment length and pretreatment symptomatology.
Eaton, T. T., Abeles, N., & Gutfreund, M. J. (1988) · Psychotherapy · doi:10.1037/h0085379 · Cited by 108
Crits-Christoph, P. F. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.216 · Cited by 108
Research Foundations for Psychotherapy Practice
&NA; (1996) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199605000-00014 · Cited by 106
Health care policy, psychotherapy research, and the future of psychotherapy.
Barlow, D. H. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1050 · Cited by 105
Personality Styles and Brief Psychotherapy
Horowitz, M. J. (1997) · Medical Entomology and Zoology · Cited by 102
Psychotherapy Research And Practice: Bridging The Gap
Talley, P. F., Strupp, H. H., & Butler, S. F. (1994) · Medical Entomology and Zoology · Cited by 101
Assessing the statistical and social importance of the effects of psychotherapy.
Rosenthal, R. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.1.4 · Cited by 101
Comparative therapy outcome research: Methodological implications of meta-analysis.
Shapiro, D. A., & Shapiro, D. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.1.42 · Cited by 100
Personality Styles and Brief Psychotherapy
Reinhart, M. J. (1985) · American Journal of Psychiatry · doi:10.1176/ajp.142.11.1380-a · Cited by 97
Practice guidelines: Not yet ideal.
Nathan, P. (1998) · American Psychologist · doi:10.1037/0003-066x.53.3.290 · Cited by 96
Self-citationOgles, B. M., Lambert, M. J., & Sawyer, J. D. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.2.321 · Cited by 95
VARIETIES OF PSYCHOTHERAPEUTIC EXPERIENCE
Artiss, K. L. (1975) · Psychiatric Annals · doi:10.3928/0048-5713-19751001-08 · Cited by 94
(1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.11.1 · Cited by 88
The efficacy and effectiveness of psychotherapy relative to medications.
Hollon, S. D. (1996) · American Psychologist · doi:10.1037//0003-066x.51.10.1025 · Cited by 87
Manualized behavior therapy: Merits and challenges
Eifert, G. H., Schulte, D., Zvolensky, M. J., Lejuez, C. W., & Lau, A. W. (1997) · Behavior Therapy · doi:10.1016/s0005-7894(97)80005-6 · Cited by 85
Luborsky, L. B., Singer, B., & Luborsky, L. (1976) · PubMed · Cited by 84
Individual Psychotherapy: Process and Outcome
Goldfried, M. R., Greenberg, L. S., & Marmar, C. R. (1990) · Annual Review of Psychology · doi:10.1146/annurev.ps.41.020190.003303 · Cited by 84
Placebo controls in psychotherapy research: A sine qua non or a placebo for research problems?
Parloff, M. B. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.79 · Cited by 83
Psychotherapy: Can the practitioner learn from the researcher?
Strupp, H. H. (1989) · American Psychologist · doi:10.1037//0003-066x.44.4.717 · Cited by 80
Identifying empirically supported treatments: What if we didn't?
Beutler, L. E. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.113 · Cited by 80
Zlotnick, C., Elkin, I., & Shea, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.4.655 · Cited by 79
The analysis of change: Issues, fallacies, and new ideas.
Gottman, J. M., & Rushe, R. H. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.6.907 · Cited by 78
Kopta, S. M., Lueger, R. J., Saunders, S. M., & Howard, K. I. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.441 · Cited by 77
How should efficacy be evaluated in randomized clinical trials of treatments for depression?
Thase, M. E. (1999) · PubMed · Cited by 73
Placebos and common factors in two decades of psychotherapy research.
Horváth, P. (1988) · Psychological bulletin · doi:10.1037/0033-2909.104.2.214 · Cited by 71
Expanding the frontier of treatment research.
NORQUIST, G. S., Lebowitz, B. D., & Hyman, S. E. (1999) · Prevention & Treatment · doi:10.1037/1522-3736.2.1.21a · Cited by 69
Krasner, L. (1971) · Annual Review of Psychology · doi:10.1146/annurev.ps.22.020171.002411 · Cited by 69
Elkin, I., Pilkonis, P. A., Docherty, J. P., & Sotsky, S. M. (1988) · American Journal of Psychiatry · doi:10.1176/ajp.145.9.1070 · Cited by 64
The analysis of change: Issues, fallacies, and new ideas.
Gottman, J. M., & Rushe, R. H. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.6.907 · Cited by 64
Research foundations for psychotherapy practice
Aveline, M. O., & Shapiro, D. L. (1995) · Medical Entomology and Zoology · Cited by 58
Individual psychotherapy and behavior therapy.
Gomes-Schwartz, B., Hadley, S. W., & Strupp, H. (1978) · Annual Review of Psychology · doi:10.1146/annurev.ps.29.020178.002251 · Cited by 58
The efficacy and effectiveness of psychotherapy relative to medications.
Hollon, S. D. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1025 · Cited by 58
Psychotherapy: Can the practitioner learn from the researcher?
Strupp, H. H. (1989) · American Psychologist · doi:10.1037/0003-066x.44.4.717 · Cited by 55
Howard, K. I., Krause, M. S., Saunders, S. M., & Kopta, S. M. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.221 · Cited by 52
Evaluating therapy in a delinquency prevention program.
Hl, T., & POWERS, E. (1953) · PubMed · Cited by 51
Are science and practice commensurable?
Stricker, G. (1997) · American Psychologist · doi:10.1037/0003-066x.52.4.442 · Cited by 45
Everybody has won, and all must have prizes
Patel, L. K., & David, T. (1996) · The Lancet · doi:10.1016/s0140-6736(96)06346-5 · Cited by 45
Psychotherapy research and its incredible credibility crisis
Parloff, M. (1984) · Clinical Psychology Review · doi:10.1016/0272-7358(84)90038-2 · Cited by 42
Client likability: A variable in the study of psychotherapy.
Stoler, N. (1963) · Journal of Consulting Psychology · doi:10.1037/h0041054 · Cited by 39
Howard, K. I., & Orlinsky, D. E. (1972) · Annual Review of Psychology · doi:10.1146/annurev.ps.23.020172.003151 · Cited by 39
The dissemination of efficacious psychological treatments.
Crits-Christoph, P. F. (1996) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1996.tb00080.x · Cited by 34
Allegiance Effects in Treatment Research: A Commentary
Hollon, S. (2006) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.107 · Cited by 32
Efficacy and effectiveness of psychotherapy: Two paradigms, one science.
Mintz, J., Drake, R. E., & Crits-Christoph, P. F. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1084 · Cited by 32
Commentary. What is the investigator allegiance effect and what should we do about it?
Thase, M. E. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.113 · Cited by 28
Lambert, M. J. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.127 · Cited by 26
Brief psychotherapy methods in clinical research.
Koss, M. P., Butcher, J. N., & Strupp, H. H. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.60 · Cited by 25
Organizational requirements for effective clinical effectiveness studies.
Klein, D. F., & Smith, L. B. (1999) · Prevention & Treatment · doi:10.1037/1522-3736.2.1.22a · Cited by 24
Commentary. Allegiance effects in treatment research: a commentary
Hollon, S. D. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.107 · Cited by 21
Brief psychotherapy methods in clinical research.
Koss, M. P., Butcher, J. N., & Strupp, H. H. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.60 · Cited by 21
The Effects of Common and Specific Factors in Short-Term Anxiety-Provoking Psychotherapy
Svartberg, M., SELTZER, M. H., & Stiles, T. C. (1998) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199811000-00005 · Cited by 18
Standardization of intervention: The tie that binds psychotherapy research and practice.
Kiesler, D. J. (1994) · Cited by 15
Can Psychotherapy Research Answer This Psychotherapist's Questions?
Edelson, M. (1992) · Contemporary Psychoanalysis · doi:10.1080/00107530.1992.10746741 · Cited by 14
Empirically validated treatments, psychotherapy integration, and the politics of psychotherapy.
Fensterheim, H., & Raw, S. D. (1996) · Journal of Psychotherapy Integration · doi:10.1037/h0101101 · Cited by 13
NIMH support for psychotherapy research: Opportunities and questions.
Street, L. L., & Lebowitz, B. D. (1999) · Prevention & Treatment · doi:10.1037//1522-3736.2.0003a · Cited by 12
Beyond Allegiance to Comparative Outcome Studies
Shoham, V., & Rohrbaugh, M. (2006) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.120 · Cited by 11
Influence of psychotherapy research on clinical practice: An experimental survey.
Sargent, M. M., & Cohen, L. H. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.5.718 · Cited by 10
Commentary. Dealing with the effects of therapy allegiances
Klein, D. F. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.124 · Cited by 9
Further differentiation of common factors.
Elkin, I. (1995) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1995.tb00026.x · Cited by 7
Vietnam: Is Globalization a Friend or a Foe?
Nathan, M. (1999) · Southeast Asian affairs · doi:10.1355/seaa99t · Cited by 7
Lambert, M. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.127 · Cited by 6
Commentary. Beyond allegiance to comparative outcome studies
Shoham, V. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.120 · Cited by 5
Influence of psychotherapy research on clinical practice: An experimental survey.
Sargent, M. M., & Cohen, L. H. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.5.718 · Cited by 5
Gendlin, E. T., & Rychlak, J. F. (1970) · Annual Review of Psychology · doi:10.1146/annurev.ps.21.020170.001103 · Cited by 4
Commentary. Dealing with the effects of therapy allegiances
Klein, D. B. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.124 · Cited by 3
Research works printed but not linked: 23
- 1952, Diagnostic and statistical manual of mental disorders.
- 1995, Template for developing guidelines: Interventions for mental disorders and psychosocial aspects of physical disorders.
- Beck, 1979, Cognitive therapy of depression.
- Beutler, 1994, Therapist variables., 229
- Carroll, 1962, Alice's adventures in Wonderland. Harmondsworth
- Chambless, 1998, Update on empirically validated therapies, II., The Clinical Psychologist, 51, 3
- Cohen, 1965, Some statistical issues in psychological research., 95
- Elkin, 1994, The NIMH Treatment of Depression Collaborative Research Program: Where we began and where we are., 114
- Eysenck, 1960, Behavior therapy and the neuroses.
- Glass, 1980, Summarizing effect sizes., 13
- Greenberg, 1994, Psychotherapy research: A clinician's view., 1
- Hays, 1963, Statistics.
- Howard, 1995, The design of clinically relevant outcome research: Some considerations and an example., 3
- Lambert, 1992, Psychotherapy outcome research: Implications for integrative and eclectic therapies., 94
- Maling, 1994, From research to practice to research to, 246
- 1999, Bridging science and service.
- Orlinsky, 1986, Process and outcome in psychotherapy., 311
- Rachman, 1980, The effects of the psychological therapies.
- Smith, 1980, Integrating studies of psychotherapy outcomes., 47
- Smith, 1980, Benefits of psychotherapy.
- Spence, 1994, The failure to ask the hard questions., 19
- Strupp, 1984, Psychotherapy in a new key: A guide to time-limited psychotherapy.
- Weiss, 1986, The psychoanalytic process: Theory, clinical observations, and empirical research.
Cited by
Sorted by citations
Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.4.631 · Cited by 1,212
The psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783
Efficacy of Interpersonal Psychotherapy for Postpartum Depression
O’Hara, M. W., Stuart, S. P., Gorman, L., & Wenzel, A. E. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.11.1039 · Cited by 666
Self-citationWesten, D., & Morrison, K. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.6.875 · Cited by 635
Borckardt, J. J., Nash, M. R., Murphy, M. D., Moore, M., Shaw, D. L., & O'Neil, P. M. (2008) · American Psychologist · doi:10.1037/0003-066x.63.2.77 · Cited by 408
Metadata
- Authors
- Nathan, P. E., Stuart, S. P., & Dolan, S. L.
- Affiliations
- University of Iowa (US)
- Venue
- Psychological Bulletin
- Published
- 2000
- Volume
- 126
- Issue
- 6
- Pages
- 964-981
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W1994615242
- Cited by
- 258
- References
- 153
- Citations by year
- 2026: 4 · 2025: 2 · 2023: 8 · 2022: 8 · 2021: 10 · 2020: 11 · 2019: 4 · 2018: 4 · 2017: 9 · 2016: 9 · 2015: 7 · 2014: 8 · 2013: 11 · 2012: 16
- FWCI
- 14.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- psychotherapy efficacy, psychotherapy effectiveness, treatment outcome research, treatment variables
- MeSH terms
- Forecasting, Health Services Research, Humans, Psychotherapy, United States, Randomized Controlled Trials as Topic, Treatment Outcome, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review