Research on psychotherapy efficacy and effectiveness: Between Scylla and Charybdis?

Nathan, Peter E.; Stuart, Scott P.; Dolan, Sara L.

doi:10.1037/0033-2909.126.6.964

Cited by 259Psychotherapy Techniques and ApplicationsCounseling, Therapy, and Family DynamicsCounseling Practices and Supervision

Research on psychotherapy efficacy and effectiveness: Between Scylla and Charybdis?

Nathan, Peter E., Stuart, Scott P., Dolan, Sara L.·2000·Psychological Bulletin

DOI 10.1037/0033-2909.126.6.964

Open this paper in CoChat — free account

Abstract

Clinical researchers have recently begun to explore differences between psychotherapy outcome studies that focus on efficacy and those that focus on effectiveness. The authors provide concise descriptions of these research models, followed by more extended consideration of the most important conceptual and empirical distinctions between the two. Research on the efficacy/effectiveness distinction is then put into context: The common treatment variables that also influence treatment outcomes are reviewed. Fifty years of research on psychotherapy outcomes are next considered; contemporary research on the efficacy and effectiveness research models is emphasized. A description and evaluation of current efforts to heighten the value of technique-focused research to clinicians follow. The authors conclude by anticipating some promising future directions in this research domain.

Integrity signals

Registry

Crossref · 10.1037/0033-2909.126.6.964

Cites

162 of 162 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A limitation of this study was the lack of an active comparator, such as treatment-as-usual.
“A limitation of this study was the lack of an active comparator, such as treatment-as-usual (Hanna, 2003; Nathan et al., 2000).”
From Effectiveness of web-based guided self-help cognitive behavioral therapy-enhanced for binge-eating disorder: An implementation study (2024) · cites this paper as Nathan et al., 2000
The randomized controlled design and the equivalence between the intervention groups are important factors enhancing the internal validity of a study.
“The randomized controlled design and the equivalence between the intervention groups are important factors enhancing the internal validity of a study [71].”
From Comparing internet-based cognitive behavioral therapy with standard care for women with fear of birth: Randomized controlled trial (2018) · cites this paper as [71]
Although primarily an efficacy study, the generous inclusion of participants and the naturalistic setting resemble the prioritizations of effectiveness studies, resulting in a reduced level of control regarding potential confounding variables.
“Second, although primarily an efficacy study, the generous inclusion of participants and the naturalistic setting of this study resemble the prioritizations of effectiveness studies [71], resulting in a reduced level of control regarding potential confounding variables (eg, heterogeneity within the sample in terms of the symptom severity, comorbidity, and concurrent treatments).”
From Comparing internet-based cognitive behavioral therapy with standard care for women with fear of birth: Randomized controlled trial (2018) · cites this paper as [71]

Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,841 · see citing works
Cognitive Therapy for Depression
(2012) · PsycEXTRA Dataset · doi:10.1037/e675542012-001 · Cited by 9,678 · see citing works
Clinical significance: A statistical approach to defining meaningful change in psychotherapy research.
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · see citing works
The necessary and sufficient conditions of therapeutic personality change.
Rogers, C. R. (1957) · Journal of Consulting Psychology · doi:10.1037/h0045357 · Cited by 5,599 · see citing works
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,998 · see citing works
On Becoming a Person
Rogers, C. R. (1961) · Cited by 3,796 · see citing works
Cognitive Therapy in Depression
Kovács, M. (1980) · Journal of the American Academy of Psychoanalysis · doi:10.1521/jaap.1.1980.8.1.127 · Cited by 3,422 · see citing works
Relation between working alliance and outcome in psychotherapy: A meta-analysis
Horvath, A. O., & Symonds, B. D. (1991) · Journal of Counseling Psychology · doi:10.1037/0022-0167.38.2.139 · Cited by 2,673 · see citing works
Handbook of Psychotherapy and Behavior Change
Sanford, E. F. (1988) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1988.42.1.153 · Cited by 2,581 · see citing works
The two disciplines of scientific psychology.
Cronbach, L. J. (1957) · American Psychologist · doi:10.1037/h0043943 · Cited by 2,545 · see citing works
Untitled work
(1993) · Medical Entomology and Zoology · Cited by 2,491 · see citing works
National Institute of Mental Health Treatment of Depression Collaborative Research Program: General Effectiveness of Treatments
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300 · see citing works
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · see citing works
The benefits of psychotherapy
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123 · see citing works
Matching Alcoholism Treatments to Client Heterogeneity: Project MATCH posttreatment drinking outcomes.
(1997) · Journal of Studies on Alcohol · doi:10.15288/jsa.1997.58.7 · Cited by 1,905 · see citing works
The effects of psychotherapy: an evaluation.
Eysenck, H. J. (1952) · Journal of Consulting Psychology · doi:10.1037/h0063633 · Cited by 1,734 · see citing works
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608 · see citing works
The effectiveness of psychotherapy: The Consumer Reports study.
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037//0003-066x.50.12.965 · Cited by 1,591 · see citing works
Update on empirically validated therapies, II: (619622010-001)
Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., Daiuto, A., DeRubeis, R., Detweiler, J., Haaga, D. A. F., et al. (1997) · PsycEXTRA Dataset · doi:10.1037/e619622010-001 · Cited by 1,488 · see citing works
Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
Luborsky, L. (1975) · Archives of General Psychiatry · doi:10.1001/archpsyc.1975.01760260059004 · Cited by 1,485 · see citing works
Persuasion and Healing: A Comparative Study of Psychotherapy
Frank, J. D. (1961) · Cited by 1,391 · see citing works
Practice guideline for the treatment of patients with schizophrenia. American Psychiatric Association
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.4.1 · Cited by 1,347 · see citing works
The dose-effect relationship in psychotherapy.
Howard, K. I., Kopta, S. M., Krause, M. S., & Orlinsky, D. E. (1986) · American Psychologist · doi:10.1037/0003-066x.41.2.159 · Cited by 1,339 · see citing works
Interpersonal Psychotherapy Of Depression
Klerman, G. L. (1984) · Medical Entomology and Zoology · Cited by 1,315 · see citing works
Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294 · see citing works
Three-Year Outcomes for Maintenance Therapies in Recurrent Depression
Frank, E. (1990) · Archives of General Psychiatry · doi:10.1001/archpsyc.1990.01810240013002 · Cited by 1,294 · see citing works
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037//0022-0663.74.2.166 · Cited by 1,233 · see citing works
Handbook of Psychotherapy Integration
(2005) · Oxford University Press eBooks · doi:10.1093/med/9780195165791.001.0001 · Cited by 1,145 · see citing works
A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes."
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · see citing works
Effectiveness of psychotherapy
Puri, B. K., Ho, R., & Treasden, I. (2011) · CRC Press eBooks · doi:10.1201/b13482-76 · Cited by 1,058 · see citing works
Some implicit common factors in diverse methods of psychotherapy.
Rosenzweig, S. (1936) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1936.tb05248.x · Cited by 1,042 · see citing works
Handbook of clinical psychology
Wolman, B. B. (1965) · McGraw-Hill eBooks · Cited by 963 · see citing works
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037/0022-0663.74.2.166 · Cited by 920 · see citing works
Psychotherapy and Personality Change
Dupont, G. M., Rogers, C. R., & Dymond, R. F. (1955) · The American Catholic Sociological Review · doi:10.2307/3708791 · Cited by 861 · see citing works
Training in and Dissemination of Empirically-Validated Psychological Treatments: Report and Recommendations
Chambless, D. (1995) · PsycEXTRA Dataset · doi:10.1037/e554972011-003 · Cited by 710 · see citing works
Psychotherapy for the treatment of depression: a comprehensive review of controlled outcome research.
Robinson, L. A., Berman, J., & Neimeyer, R. (1990) · Psychological bulletin · doi:10.1037/0033-2909.108.1.30 · Cited by 691 · see citing works
An Update on Empirically Validated Therapies
Chambless, D., Sanderson, W., Shoham, V., Johnson, S. B., Pope, K., Crits-Christoph, P., Baker, M., Johnson, B., Woody, S., Sue, S., et al. (1998) · PsycEXTRA Dataset · doi:10.1037/e555332011-003 · Cited by 633 · see citing works
Principles Of Psychoanalytic Psychotherapy: A Manual For Supportive-expressive Treatment
Luborsky, L. B. (1984) · Medical Entomology and Zoology · Cited by 631 · see citing works
Annual review of psychology
A.N.W (1959) · Animal Behaviour · doi:10.1016/0003-3472(59)90073-9 · Cited by 615 · see citing works
Meta-analysis of comparative therapy outcome studies: a replication and refinement.
Shapiro, D. A., & Shapiro, D. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.581 · Cited by 590 · see citing works
Practice guideline for the treatment of patients with bipolar disorder. American Psychiatric Association
(1994) · American Journal of Psychiatry · doi:10.1176/ajp.151.12.1 · Cited by 582 · see citing works
Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1059 · Cited by 573 · see citing works
The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy.
Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., Halperin, G., Bishop, M., Berman, J. S., & Schweizer, E. (1999) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.6.1.95 · Cited by 572 · see citing works
Handbook of psychotherapy and behavior change, 4th ed.
Bergin, A. E., & Garfield, S. L. (1994) · Cited by 539 · see citing works
NIMH Treatment of Depression Collaborative Research Program
Elkin, I. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790260103013 · Cited by 520 · see citing works
Interpersonal Psychotherapy of Depression
Koenigsberg, H. W. (1985) · Psychosomatics · doi:10.1016/s0033-3182(85)72763-6 · Cited by 518 · see citing works
Project MATCH: Rationale and Methods for a Multisite Clinical Trial Matching Patients to Alcoholism Treatment
(1993) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.1993.tb05219.x · Cited by 503 · see citing works
"Are all psychotherapies equivalent?"
Stiles, W. B., Shapiro, D. A., & Elliott, R. (1986) · American Psychologist · doi:10.1037//0003-066x.41.2.165 · Cited by 487 · see citing works
Meta‐Analysis of Therapist Effects in Psychotherapy Outcome Studies
Crits-Christoph, P. F., Baranackie, K., Kurcias, J., Beck, A. T., Carroll, K. M., Perry, K. J., Luborsky, L. B., McLellan, A. T., WOODY, G. E., Thompson, L. W., et al. (1991) · Psychotherapy Research · doi:10.1080/10503309112331335511 · Cited by 433 · see citing works
Handbook of Psychotherapy Integration
(2019) · Oxford University Press eBooks · doi:10.1093/med-psych/9780190690465.001.0001 · Cited by 393 · see citing works
Psychotherapy outcome research: Implications for integrative and eclectical therapists.
Lambert, M. J. (1992) · Cited by 390 · see citing works
The effects of psychological therapies under clinically representative conditions: a meta-analysis
Shadish, W. R., Navarro, A. M., Matt, G. E., & Phillips, G. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.4.512 · Cited by 381 · see citing works
Persuasion and Healing: A Comparative Study of Psychotherapy
Meehan, M. C. (1973) · JAMA · doi:10.1001/jama.1973.03220220089034 · Cited by 351 · see citing works
Therapeutic Factors in Psychotherapy
Frank, J. D. (1971) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1971.25.3.350 · Cited by 344 · see citing works
"Are all psychotherapies equivalent?"
Stiles, W. B., Shapiro, D. A., & Elliott, R. (1986) · American Psychologist · doi:10.1037/0003-066x.41.2.165 · Cited by 322 · see citing works
Effects of family and marital psychotherapies: a meta-analysis.
Shadish, W., Montgomery, L. M., Wilson, P., Wilson, M. R., Bright, I., & Okwumabua, T. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.6.992 · Cited by 320 · see citing works
On the relation of clinical research to clinical practice: Current issues, new directions.
Barlow, D. H. (1981) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.49.2.147 · Cited by 313 · see citing works
The researcher's own therapy allegiances: a ''wild card'' in comparisons of treatment efficacy
Luborsky, L. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.95 · Cited by 308 · see citing works
Psychodynamic Psychotherapy Of Borderline Patients
Kernberg, O. F., Selzer, M. A., Koenigsberg, H. W., Carr, A. C., & Appelbaüm, A. H. (1989) · Medical Entomology and Zoology · Cited by 302 · see citing works
Efficacy of Interpersonal Psychotherapy as a Maintenance Treatment of Recurrent Depression
Frank, E. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810360017002 · Cited by 291 · see citing works
Toward a more clinically valid approach to therapy research.
Goldfried, M. R., & Wolfe, B. E. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.143 · Cited by 273 · see citing works
Comparative outcome studies of psychotherapy: methodological issues and strategies.
Kazdin, A. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.95 · Cited by 258 · see citing works
Some implications of psychotherapy research for therapeutic practice.
Bergin, A. E. (1966) · Journal of Abnormal Psychology · doi:10.1037/h0023577 · Cited by 254 · see citing works
Psychotherapy outcome studies do not accurately represent current models of psychotherapy. A proposed remedy.
Persons, J. (1991) · American Psychologist · doi:10.1037/0003-066x.46.2.99 · Cited by 251 · see citing works
Practice guideline for the treatment of patients with nicotine dependence. American Psychiatric Association
(1996) · American Journal of Psychiatry · doi:10.1176/ajp.153.10.1 · Cited by 243 · see citing works
A Note on Percent Variance Explained as A Measure of the Importance of Effects
Rosenthal, R., & Rubin, D. B. (1979) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1979.tb02713.x · Cited by 238 · see citing works
Practice guideline for major depressive disorder in adults. American Psychiatric Association
(1993) · American Journal of Psychiatry · doi:10.1176/ajp.150.4.1 · Cited by 226 · see citing works
Psychotherapy outcome studies do not accurately represent current models of psychotherapy: A proposed remedy.
Persons, J. B. (1991) · American Psychologist · doi:10.1037//0003-066x.46.2.99 · Cited by 224 · see citing works
Effects of family and marital psychotherapies: A meta-analysis.
Shadish, W. R., Montgomery, L. M., Wilson, P. A., et al. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.6.992 · Cited by 219 · see citing works
Does professional training make a therapist more effective?
Berman, J. S., & Norton, N. C. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.98.2.401 · Cited by 218 · see citing works
All Must Have Prizes
Phillips, M. (1996) · Medical Entomology and Zoology · Cited by 216 · see citing works
On the relation of clinical research to clinical practice: Current issues, new directions.
Barlow, D. H. (1981) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.49.2.147 · Cited by 215 · see citing works
Some problems associated with "validated" forms of psychotherapy.
Garfield, S. L. (1996) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1996.tb00073.x · Cited by 212 · see citing works
An Experiment in the Prevention of Delinquency: The Cambridge-Somerville Youth Study
Shalloo, J. P., Powers, E., & Witmer, H. L. (1952) · The Journal of Criminal Law Criminology and Police Science · doi:10.2307/1139954 · Cited by 210 · see citing works
American Journal of Psychiatry celebrates 150th anniversary
Andreasen, N. C. (1994) · American Journal of Psychiatry · doi:10.1176/ajp.151.6.1 · Cited by 204 · see citing works
Abuse of the drug metaphor in psychotherapy process-outcome research
Stiles, W. B., & Shapiro, D. A. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90007-x · Cited by 202 · see citing works
Assessing Clinical Significance: Proposed Extensions to Method
Tingey, R., Lambert, M. J., Burlingame, G. M., & Hansen, N. B. (1996) · Psychotherapy Research · doi:10.1080/10503309612331331638 · Cited by 198 · see citing works
Short-term dynamically oriented psychotherapy: A review and meta-analysis
Anderson, É. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(95)00027-m · Cited by 196 · see citing works
Science as an ally of practice.
Seligman, M. E. P. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1072 · Cited by 195 · see citing works
Specific and nonspecific factors in psychotherapy: A problematic paradigm for psychotherapy research.
Butler, S. F., & Strupp, H. H. (1986) · Psychotherapy · doi:10.1037/h0085590 · Cited by 193 · see citing works
Studying the effectiveness of psychotherapy: How well can clinical trials do the job?
Jacobson, N. S., & Christensen, A. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1031 · Cited by 188 · see citing works
Evidence that therapy works in clincally representative conditions.
Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., Jorm, A. F., Lyons, L. C., Nietzel, M. T., Robinson, L., et al. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.3.355 · Cited by 186 · see citing works
Comparative outcome studies of psychotherapy: Methodological issues and strategies.
Kazdin, A. E. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.95 · Cited by 167 · see citing works
Corex, III; Prefrontal Cortex
Selemon, L. D., Goldman‐Rakic, P. S., & Tamminga, C. A. (1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.1.5 · Cited by 150 · see citing works
Methodological Problems in Identifying Efficacious Psychotherapies
Wampold, B. E. (1997) · Psychotherapy Research · doi:10.1080/10503309712331331853 · Cited by 149 · see citing works
Assessing the statistical and social importance of the effects of psychotherapy.
Rosenthal, R. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.1.4 · Cited by 143 · see citing works
Psychotherapy: Clinical, research, and theoretical issues.
Strupp, H. H. (1973) · Jason Aronson eBooks · doi:10.1037/11523-000 · Cited by 140 · see citing works
Grief: normal and pathological variants
Viederman, M. (1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.1.1 · Cited by 137 · see citing works
Clinical significance of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data.
Ogles, B. M., Lambert, M. J., & Sawyer, J. D. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.2.321 · Cited by 135 · see citing works
Individual Psychotherapy and Behavior Therapy
Bergin, A. E., & Suinn, R. M. (1975) · Annual Review of Psychology · doi:10.1146/annurev.ps.26.020175.002453 · Cited by 130 · see citing works
Research-structured vs clinically flexible versions of social learning-based marital therapy.
Jacobson, N. S., Schmaling, K., Holtzworth-Munroe, A., Katt, J. L., Wood, L., & Follette, V. (1989) · Behaviour Research and Therapy · doi:10.1016/0005-7967(89)90076-4 · Cited by 129 · see citing works
Random versus nonrandom assignment in controlled experiments: Do you get the same answer?
Shadish, W. R., & Ragsdale, K. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.6.1290 · Cited by 126 · see citing works
Health care policy, psychotherapy research, and the future of psychotherapy.
Barlow, D. H. (1996) · American Psychologist · doi:10.1037//0003-066x.51.10.1050 · Cited by 124 · see citing works
Identifying empirically supported treatments: What if we didn't?
Beutler, L. E. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.113 · Cited by 122 · see citing works
Placebo controls in psychotherapy research: A sine qua non or a placebo for research problems?
Parloff, M. B. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.79 · Cited by 121 · see citing works
Therapeutic alliance and outcome: Impact of treatment length and pretreatment symptomatology.
Eaton, T. T., Abeles, N., & Gutfreund, M. J. (1988) · Psychotherapy · doi:10.1037/h0085379 · Cited by 108 · see citing works
Limitations of the dodo bird verdict and the role of clinical trials in psychotherapy research: Comment on Wampold et al. (1997).
Crits-Christoph, P. F. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.216 · Cited by 108 · see citing works
Research Foundations for Psychotherapy Practice
&NA; (1996) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199605000-00014 · Cited by 106 · see citing works
Health care policy, psychotherapy research, and the future of psychotherapy.
Barlow, D. H. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1050 · Cited by 105 · see citing works
Personality Styles and Brief Psychotherapy
Horowitz, M. J. (1997) · Medical Entomology and Zoology · Cited by 102 · see citing works
Psychotherapy Research And Practice: Bridging The Gap
Talley, P. F., Strupp, H. H., & Butler, S. F. (1994) · Medical Entomology and Zoology · Cited by 101 · see citing works
Assessing the statistical and social importance of the effects of psychotherapy.
Rosenthal, R. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.1.4 · Cited by 101 · see citing works
Comparative therapy outcome research: Methodological implications of meta-analysis.
Shapiro, D. A., & Shapiro, D. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.1.42 · Cited by 100 · see citing works
Personality Styles and Brief Psychotherapy
Reinhart, M. J. (1985) · American Journal of Psychiatry · doi:10.1176/ajp.142.11.1380-a · Cited by 97 · see citing works
Clinical significance of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data.
Ogles, B. M., Lambert, M. J., & Sawyer, J. D. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.2.321 · Cited by 95 · see citing works
VARIETIES OF PSYCHOTHERAPEUTIC EXPERIENCE
Artiss, K. L. (1975) · Psychiatric Annals · doi:10.3928/0048-5713-19751001-08 · Cited by 94 · see citing works
Practice guidelines: Not yet ideal.
Nathan, P. E. (1998) · American Psychologist · doi:10.1037/0003-066x.53.3.290 · Cited by 93 · see citing works
Self-citation
Practice guideline for the treatment of patients with substance use disorders: alcohol, cocaine, opioids. American Psychiatric Association
(1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.11.1 · Cited by 88 · see citing works
The efficacy and effectiveness of psychotherapy relative to medications.
Hollon, S. D. (1996) · American Psychologist · doi:10.1037//0003-066x.51.10.1025 · Cited by 87 · see citing works
Manualized behavior therapy: Merits and challenges
Eifert, G. H., Schulte, D., Zvolensky, M. J., Lejuez, C. W., & Lau, A. W. (1997) · Behavior Therapy · doi:10.1016/s0005-7894(97)80005-6 · Cited by 85 · see citing works
Comparative studies of psychotherapies: is it true that "everybody has won and all must have prizes"?
Luborsky, L. B., Singer, B., & Luborsky, L. (1976) · PubMed · Cited by 84 · see citing works
Individual Psychotherapy: Process and Outcome
Goldfried, M. R., Greenberg, L. S., & Marmar, C. R. (1990) · Annual Review of Psychology · doi:10.1146/annurev.ps.41.020190.003303 · Cited by 84 · see citing works
Placebo controls in psychotherapy research: A sine qua non or a placebo for research problems?
Parloff, M. B. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.79 · Cited by 83 · see citing works
Psychotherapy: Can the practitioner learn from the researcher?
Strupp, H. H. (1989) · American Psychologist · doi:10.1037//0003-066x.44.4.717 · Cited by 80 · see citing works
Identifying empirically supported treatments: What if we didn't?
Beutler, L. E. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.113 · Cited by 80 · see citing works
The analysis of change: Issues, fallacies, and new ideas.
Gottman, J. M., & Rushe, R. H. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.6.907 · Cited by 78 · see citing works
How should efficacy be evaluated in randomized clinical trials of treatments for depression?
Thase, M. E. (1999) · PubMed · Cited by 73 · see citing works
INDIVIDUAL PSYCHOTHERAPY OUTCOME AND PROCESS RESEARCH: Challenges Leading to Greater Turmoil or a Positive Transition?
Kopta, S. M., Lueger, R. J., Saunders, S. M., & Howard, K. I. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.441 · Cited by 72 · see citing works
Placebos and common factors in two decades of psychotherapy research.
Horváth, P. (1988) · Psychological bulletin · doi:10.1037/0033-2909.104.2.214 · Cited by 71 · see citing works
Expanding the frontier of treatment research.
NORQUIST, G. S., Lebowitz, B. D., & Hyman, S. E. (1999) · Prevention & Treatment · doi:10.1037/1522-3736.2.1.21a · Cited by 69 · see citing works
Behavior Therapy
Krasner, L. (1971) · Annual Review of Psychology · doi:10.1146/annurev.ps.22.020171.002411 · Cited by 69 · see citing works
Individual Psychotherapy and Behavior Therapy
Gomes-Schwartz, B., Hadley, S. W., & Strupp, H. H. (1978) · Annual Review of Psychology · doi:10.1146/annurev.ps.29.020178.002251 · Cited by 66 · see citing works
Conceptual and methodological issues in comparative studies of psychotherapy and pharmacotherapy, II: Nature and timing of treatment effects
Elkin, I., Pilkonis, P. A., Docherty, J. P., & Sotsky, S. M. (1988) · American Journal of Psychiatry · doi:10.1176/ajp.145.9.1070 · Cited by 64 · see citing works
The analysis of change: Issues, fallacies, and new ideas.
Gottman, J. M., & Rushe, R. H. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.6.907 · Cited by 64 · see citing works
Comparative therapy outcome research: Methodological implications of meta-analysis.
Shapiro, D. A., & Shapiro, D. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.1.42 · Cited by 64 · see citing works
Research foundations for psychotherapy practice
Aveline, M. O., & Shapiro, D. L. (1995) · Medical Entomology and Zoology · Cited by 58 · see citing works
The efficacy and effectiveness of psychotherapy relative to medications.
Hollon, S. D. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1025 · Cited by 58 · see citing works
Does the gender of a patient or the gender of a therapist affect the treatment of patients with major depression?
Zlotnick, C., Elkin, I., & Shea, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.4.655 · Cited by 57 · see citing works
Psychotherapy: Can the practitioner learn from the researcher?
Strupp, H. H. (1989) · American Psychologist · doi:10.1037/0003-066x.44.4.717 · Cited by 55 · see citing works
Does the gender of a patient or the gender of a therapist affect the treatment of patients with major depression?
Zlotnick, C., Elkin, I., & Shea, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.4.655 · Cited by 53 · see citing works
Trials and tribulations in the meta-analysis of treatment differences: Comment on Wampold et al. (1997).
Howard, K. I., Krause, M. S., Saunders, S. M., & Kopta, S. M. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.221 · Cited by 52 · see citing works
Evaluating therapy in a delinquency prevention program.
Hl, T., & POWERS, E. (1953) · PubMed · Cited by 51 · see citing works
Are science and practice commensurable?
Stricker, G. (1997) · American Psychologist · doi:10.1037/0003-066x.52.4.442 · Cited by 45 · see citing works
Everybody has won, and all must have prizes
Patel, L. K., & David, T. (1996) · The Lancet · doi:10.1016/s0140-6736(96)06346-5 · Cited by 45 · see citing works
Psychotherapy research and its incredible credibility crisis
Parloff, M. B. (1984) · Clinical Psychology Review · doi:10.1016/0272-7358(84)90038-2 · Cited by 40 · see citing works
Client likability: A variable in the study of psychotherapy.
Stoler, N. (1963) · Journal of Consulting Psychology · doi:10.1037/h0041054 · Cited by 39 · see citing works
Psychotherapeutic Processes
Howard, K. I., & Orlinsky, D. E. (1972) · Annual Review of Psychology · doi:10.1146/annurev.ps.23.020172.003151 · Cited by 39 · see citing works
Allegiance effects in treatment research: A commentary.
Hollon, S. D. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.107 · Cited by 37 · see citing works
The dissemination of efficacious psychological treatments.
Crits-Christoph, P. F. (1996) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1996.tb00080.x · Cited by 34 · see citing works
Efficacy and effectiveness of psychotherapy: Two paradigms, one science.
Mintz, J., Drake, R. E., & Crits-Christoph, P. F. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1084 · Cited by 32 · see citing works
What is the investigator allegiance effect and what should we do about it?
Thase, M. E. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.113 · Cited by 27 · see citing works
Are differential treatment effects inflated by researcher therapy allegiance? Could Clever Hans count?
Lambert, M. J. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.127 · Cited by 26 · see citing works
Brief psychotherapy methods in clinical research.
Koss, M. P., Butcher, J. N., & Strupp, H. H. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.60 · Cited by 25 · see citing works
Organizational requirements for effective clinical effectiveness studies.
Klein, D. F., & Smith, L. B. (1999) · Prevention & Treatment · doi:10.1037/1522-3736.2.1.22a · Cited by 24 · see citing works
Commentary. Allegiance effects in treatment research: a commentary
Hollon, S. D. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.107 · Cited by 21 · see citing works
Brief psychotherapy methods in clinical research.
Koss, M. P., Butcher, J. N., & Strupp, H. H. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.60 · Cited by 21 · see citing works
Commentary. What is the investigator allegiance effect and what should we do about it?
Thase, M. E. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.113 · Cited by 20 · see citing works
The Effects of Common and Specific Factors in Short-Term Anxiety-Provoking Psychotherapy
Svartberg, M., SELTZER, M. H., & Stiles, T. C. (1998) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199811000-00005 · Cited by 18 · see citing works
Standardization of intervention: The tie that binds psychotherapy research and practice.
Kiesler, D. J. (1994) · Cited by 15 · see citing works
Can Psychotherapy Research Answer This Psychotherapist's Questions?
Edelson, M. (1992) · Contemporary Psychoanalysis · doi:10.1080/00107530.1992.10746741 · Cited by 14 · see citing works
Empirically validated treatments, psychotherapy integration, and the politics of psychotherapy.
Fensterheim, H., & Raw, S. D. (1996) · Journal of Psychotherapy Integration · doi:10.1037/h0101101 · Cited by 13 · see citing works
NIMH support for psychotherapy research: Opportunities and questions.
Street, L. L., & Lebowitz, B. D. (1999) · Prevention & Treatment · doi:10.1037//1522-3736.2.0003a · Cited by 12 · see citing works
Beyond allegiance to comparative outcome studies.
Shoham, V., & Rohrbaugh, M. J. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.120 · Cited by 12 · see citing works
Influence of psychotherapy research on clinical practice: An experimental survey.
Sargent, M. M., & Cohen, L. H. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.5.718 · Cited by 10 · see citing works
Dealing with the effects of therapy allegiances.
Klein, D. F. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.124 · Cited by 9 · see citing works
Further differentiation of common factors.
Elkin, I. (1995) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1995.tb00026.x · Cited by 7 · see citing works
Vietnam: Is Globalization a Friend or a Foe?
Nathan, M. (1999) · Southeast Asian affairs · doi:10.1355/seaa99t · Cited by 7 · see citing works
Commentary. Are differential treatment effects inflated by researcher therapy allegiance? Could Clever Hans count
Lambert, M. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.127 · Cited by 6 · see citing works
Commentary. Beyond allegiance to comparative outcome studies
Shoham, V. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.120 · Cited by 5 · see citing works
Influence of psychotherapy research on clinical practice: An experimental survey.
Sargent, M. M., & Cohen, L. H. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.5.718 · Cited by 5 · see citing works
Psychotherapeutic Processes
Gendlin, E. T., & Rychlak, J. F. (1970) · Annual Review of Psychology · doi:10.1146/annurev.ps.21.020170.001103 · Cited by 4 · see citing works
Commentary. Dealing with the effects of therapy allegiances
Klein, D. B. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy/6.1.124 · Cited by 3 · see citing works

Flagged first, then by citations

Sorted by citations

The Empirical Status of Empirically Supported Psychotherapies: Assumptions, Findings, and Reporting in Controlled Clinical Trials.
Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.4.631 · Cited by 1,212 · see citing works
The psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783 · see citing works
Efficacy of Interpersonal Psychotherapy for Postpartum Depression
O’Hara, M. W., Stuart, S. P., Gorman, L., & Wenzel, A. E. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.11.1039 · Cited by 650 · see citing works
Self-citation
A multidimensional meta-analysis of treatments for depression, panic, and generalized anxiety disorder: An empirical examination of the status of empirically supported therapies
Westen, D., & Morrison, K. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.6.875 · Cited by 635 · see citing works
Clinical practice as natural laboratory for psychotherapy research: A guide to case-based time-series analysis.
Borckardt, J. J., Nash, M. R., Murphy, M. D., Moore, M., Shaw, D. L., & O'Neil, P. M. (2008) · American Psychologist · doi:10.1037/0003-066x.63.2.77 · Cited by 408 · see citing works
Evidence-Based Assessment of Child and Adolescent Disorders: Issues and Challenges
Mash, E., & Hunsley, J. (2005) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3403_1 · Cited by 379 · see citing works
Overcoming Depression on the Internet (ODIN) (2): A Randomized Trial of a Self-Help Depression Skills Program With Reminders
Clarke, G., Eubanks, D., Reid, E., Kelleher, C., O'Connor, E., DeBar, L. L., Lynch, F., Nunley, S., & Gullion, C. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e16 · Cited by 372 · see citing works
Using evidence-based internet interventions to reduce health disparities worldwide.
Muñoz, R. F. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1463 · Cited by 242 · see citing works
Modeling the impact of alcohol dependence on mortality burden and the effect of available treatment interventions in the European Union
Rehm, J. T., Shield, K. D., Gmel, G. E., Rehm, M. X., & Frick, U. (2012) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2012.08.001 · Cited by 255 · see citing works
Toward Large-Scale Implementation of Empirically Supported Treatments for Children: A Review and Observations by the Hawaii Empirical Basis to Services Task Force
Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A. M., Amundsen, M. J., McGee, C., Serrano, A. C., Yates, A., Burns, J. A., & Morelli, P. T. T. (2002) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.2002.tb00504.x · Cited by 255 · see citing works
Procrastination at Work and Time Management Training
van Eerde, W. (2003) · The Journal of Psychology · doi:10.1080/00223980309600625 · Cited by 255 · see citing works
The case for practical clinical trials in psychiatry.
March, J. S., Silva, S. G., Compton, S., Shapiro, M., Califf, R., & Krishnan, R. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.5.836 · Cited by 240 · see citing works
Bridging evidence‐based practice and practice‐based evidence: developing a rigorous and relevant knowledge for the psychological therapies
Barkham, M., & Mellor‐Clark, J. (2003) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.379 · Cited by 241 · see citing works
An Efficacy/Effectiveness Study of Cognitive-Behavioral Treatment for Adolescents With Comorbid Major Depression and Conduct Disorder
Rohde, P., Clarke, G. N., Mace, D. E., Jorgensen, J. S., & Seeley, J. R. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000121067.29744.41 · Cited by 214 · see citing works
Efficacy of short-term psychotherapy for multiple medically unexplained physical symptoms: a meta-analysis
Kleinstäuber, M., Witthöft, M., & Hiller, W. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.001 · Cited by 212 · see citing works
A Tale of Two Visions: Can a New View of Personality Help Integrate Psychology?
Mayer, J. D. (2005) · American Psychologist · doi:10.1037/0003-066x.60.4.294 · Cited by 195 · see citing works
Psychological Approaches to Origins and Treatments of Somatoform Disorders
Witthöft, M., & Hiller, W. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.121208.131505 · Cited by 172 · see citing works
Why Ineffective Psychotherapies Appear to Work: A Taxonomy of Causes of Spurious Therapeutic Effectiveness
Lilienfeld, S. O., Ritschel, L. A., Lynn, S. J., Cautin, R. L., & Latzman, R. D. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614535216 · Cited by 191 · see citing works
Assessing clinical significance: Application to the beck depression inventory
Seggar, L. B., Lambert, M. J., & Hansen, N. B. (2002) · Behavior Therapy · doi:10.1016/s0005-7894(02)80028-4 · Cited by 162 · see citing works
A randomized controlled trial of Internet-based self-help training for recurrent headache in childhood and adolescence
Trautmann, E., & Kröner-Herwig, B. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.09.004 · Cited by 159 · see citing works
Potential Mediators of Cognitive-Behavioral Therapy for Adolescents With Comorbid Major Depression and Conduct Disorder.
Kaufman, N. K., Rohde, P., Seeley, J. R., Clarke, G. N., & Stice, E. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.38 · Cited by 157 · see citing works
Preliminary evidence on the effectiveness of psychological treatments delivered at a university counseling center.
Minami, T., Davies, D. R., Tierney, S. C., Bettmann, J. E., McAward, S. M., Averill, L. A., Huebner, L. A., Weitzman, L. M., Benbrook, A. R., Serlin, R. C., et al. (2009) · Journal of Counseling Psychology · doi:10.1037/a0015398 · Cited by 133 · see citing works
An Evaluation of the Dose–Response Relationship in Naturalistic Treatment Settings Using Survival Analysis
Hansen, N. B., & Lambert, M. (2003) · Mental Health Services Research · doi:10.1023/a:1021751307358 · Cited by 127 · see citing works
Psychotherapeutic interventions for depressed, low-income women: A review of the literature
Levy, L. B., & O'Hara, M. W. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.06.006 · Cited by 121 · see citing works
Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: A preliminary study.
Minami, T., Wampold, B. E., Serlin, R. C., Hamilton, E. G., Brown, G. S. (., & Kircher, J. C. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.1.116 · Cited by 120 · see citing works
Empirically guided coordination of multiple evidence-based treatments: An illustration of relevance mapping in children's mental health services
Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0023982 · Cited by 110 · see citing works
HIV Sexual Risk-Reduction Interventions for Youth: A Review and Methodological Critique of Randomized Controlled Trials
Pedlow, C. T., & Carey, M. P. (2003) · Behavior Modification · doi:10.1177/0145445503251562 · Cited by 106 · see citing works
A History of Clinical Psychology as a Profession in America (and a Glimpse at Its Future)
Benjamin, L. T. (2004) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143758 · Cited by 103 · see citing works
The influence of attrition in evaluating the efficacy and effectiveness of mindfulness-based interventions
Nam, S., & Toneatto, T. (2016) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-016-9667-1 · Cited by 96 · see citing works
Therapeutically Induced Changes in Couple Identity: The Role of We-ness and Interpersonal Processing in Relationship Satisfaction
Reid, D. W., Dalton, E. J., Laderoute, K., Doell, F. K., & Nguyen, T. T. T. (2006) · Genetic Social and General Psychology Monographs · doi:10.3200/mono.132.3.241-288 · Cited by 96 · see citing works
Written emotional disclosure: A controlled study of the benefits of expressive writing homework in outpatient psychotherapy
Graf, M. C., Gaudiano, B. A., & Geller, P. A. (2008) · Psychotherapy Research · doi:10.1080/10503300701691664 · Cited by 90 · see citing works
Assessing the Statistical and Personal Significance of the Method of Levels
Carey, T. A., Carey, M., Mullan, R. J., Spratt, C. G., & Spratt, M. B. (2009) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465809005232 · Cited by 86 · see citing works
The external validity of controlled clinical trials of psychotherapy for depression and anxiety: A naturalistic study
Morrison, K. H., Bradley, R. G., & Westen, D. (2003) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1348/147608303765951168 · Cited by 85 · see citing works
Randomized placebo-controlled field study of the effects of bright light and melatonin in adaptation to night work
Bjorvatn, B., Stangenes, K. M., Øyane, N., Forberg, K., Löwden, A., Holsten, F., & Åkerstedt, T. (2007) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.1129 · Cited by 84 · see citing works
Effect of Client-Therapist Gender Match on the Therapeutic Relationship: An Exploratory Analysis
Bhati, K. S. (2014) · Psychological Reports · doi:10.2466/21.02.pr0.115c23z1 · Cited by 79 · see citing works
Applying Treatment Outcome Research in Clinical Practice: Techniques for Adapting Interventions to the Real World
Connor-Smith, J. K., & Weisz, J. R. (2003) · Child and Adolescent Mental Health · doi:10.1111/1475-3588.00038 · Cited by 77 · see citing works
Evaluation of structured cognitive–behavioural treatment programmes in reducing criminal recidivism
McGuire, J., Bilby, C. A. L., Hatcher, R. M., Hollin, C. R., Hounsome, J. C., & Palmer, E. J. (2007) · Journal of Experimental Criminology · doi:10.1007/s11292-007-9047-8 · Cited by 74 · see citing works
Practice‐based Evidence as a Complement to Evidence‐based Practice: From Dichotomy to Chiasmus
Barkham, M., & Margison, F. R. (2007) · Wiley eBooks · doi:10.1002/9780470713242.ch25 · Cited by 71 · see citing works
Traumatized refugees, their therapists, and their interpreters: three perspectives on psychological treatment.
Mirdal, G., Ryding, E., & Sondej, M. E. (2012) · Psychology and psychotherapy · doi:10.1111/j.2044-8341.2011.02036.x · Cited by 68 · see citing works
One-day behavioral treatment for patients with comorbid depression and migraine: a pilot study
Dindo, L., Recober, A., Marchman, J. N., Turvey, C., & O'Hara, M. W. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.05.007 · Cited by 64 · see citing works
The effectiveness of psychotherapy in treating depressive disorders in primary care practice: clinical and cost perspectives
Schulberg, H. C., Raue, P. J., & Rollman, B. L. (2002) · General Hospital Psychiatry · doi:10.1016/s0163-8343(02)00175-5 · Cited by 62 · see citing works
Making fidelity an intramural game: Localizing quality assurance procedures to promote sustainability of evidence‐based practices in usual care.
Hogue, A., Ozechowski, T. J., Robbins, M. S., & Waldron, H. B. (2013) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12023 · Cited by 62 · see citing works
Effectiveness of day hospital treatment for anorexia nervosa and bulimia nervosa
Fittig, E., Jacobi, C., Backmund, H., Gerlinghoff, M., & Wïttchen, H. (2008) · European Eating Disorders Review · doi:10.1002/erv.883 · Cited by 60 · see citing works
The Gap Between Couple Therapy Research Efficacy and Practice Effectiveness
Halford, W. K., Pepping, C. A., & Petch, J. F. (2015) · Journal of Marital and Family Therapy · doi:10.1111/jmft.12120 · Cited by 59 · see citing works
Feminist Interventions: Accountability Beyond Symptom Reduction
Worell, J. (2001) · Psychology of Women Quarterly · doi:10.1111/1471-6402.00033 · Cited by 59 · see citing works
The misleading Dodo Bird verdict. How much of the outcome variance is explained by common and specific factors?
de Felice, G., Giuliani, A., Halfon, S., Andreassi, S., Paoloni, G., & Orsucci, F. F. (2019) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2019.01.006 · Cited by 57 · see citing works
Developing Clinical Supervision Research through Reasoned Analogies with Therapy
Milne, D. (2006) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.489 · Cited by 47 · see citing works
Linking Session Focus to Treatment Outcome in Evidence-Based Treatments for Adolescent Substance Abuse.
Hogue, A., Liddle, H. A., Dauber, S., & Samuolis, J. (2004) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.41.2.83 · Cited by 54 · see citing works
Wearing Blue-Blockers in the Morning Could Improve Sleep of Workers on a Permanent Night Schedule: A Pilot Study
Sasseville, A., Benhaberou-Brun, D., Fontaine, C., Charron, M.-C., & Hébert, M. (2009) · Chronobiology International · doi:10.1080/07420520903044398 · Cited by 53 · see citing works
A Developmental Psychopathology Approach to the Prevention of Mental Health Disorders
Ialongo, N. S., Rogosch, F. A., Cicchetti, D., Toth, S. L., Buckley, J. A., Petras, H., & Neiderhiser, J. M. (2015) · Wiley eBooks · doi:10.1002/9780470939383.ch24 · Cited by 52 · see citing works
Mediation and moderation of psychological pain treatments: Response expectancies and hypnotic suggestibility.
Milling, L. S., Reardon, J. M., & Carosella, G. M. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.2.253 · Cited by 51 · see citing works
Warning messages for electronic gambling machines: evidence for regulatory policies
Ginley, M. K., Whelan, J. P., Pfund, R. A., Peter, S. C., & Meyers, A. W. (2017) · Addiction Research & Theory · doi:10.1080/16066359.2017.1321740 · Cited by 51 · see citing works
The Boulder model: A dream deferred--or lost?
Nathan, P. E. (2000) · American Psychologist · doi:10.1037//0003-066x.55.2.250 · Cited by 49 · see citing works
Self-citation
Comparing internet-based cognitive behavioral therapy with standard care for women with fear of birth: Randomized controlled trial
Rondung, E., Ternström, E., Hildingsson, I., Haines, H. M., Sundin, Ö., Ekdahl, J., Karlström, A., Larsson, B., Segeblad, B., Baylis, R., et al. (2018) · JMIR Mental Health · doi:10.2196/10420 · Cited by 47 · see citing works
“Second, although primarily an efficacy study, the generous inclusion of participants and the naturalistic setting of this study resemble the prioritizations of effectiveness studies [71], resulting in a reduced level of control regarding potential confounding variables (eg, heterogeneity within the sample in terms of…”
Background
Sustainability of the effects of multisystemic therapy for juvenile delinquents in The Netherlands: effects on delinquency and recidivism
Dutch MST Cost-Effectiveness Study Group, Asscher, J. J., Deković, M., Manders, W. A., van der Laan, P. H., Prins, P. J. M., & van Arum, S. (2014) · Journal of Experimental Criminology · doi:10.1007/s11292-013-9198-8 · Cited by 50 · see citing works
Interpersonal psychotherapy for depression? The need to define its ecological niche
Parker, G. B., Parker, I., Brotchie, H., & Stuart, S. P. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.03.019 · Cited by 44 · see citing works
Self-citation
Acceptance and Commitment Therapy for Primary Headache Sufferers: A Randomized Controlled Trial of Efficacy
Vasiliou, V. S., Karademas, E. C., Christou, Y., Papacostas, S., & Karekla, M. (2021) · The Journal of Pain · doi:10.1016/j.jpain.2020.06.006 · Cited by 45 · see citing works
Assessment of the Efficacy of a Stress Management Program for Informal Caregivers of Dependent Older Adults
Lopez, J., Crespo, M., & Zarit, S. H. (2007) · The Gerontologist · doi:10.1093/geront/47.2.205 · Cited by 44 · see citing works
Adapting Evidence-Based Mental Health Treatments in Community Settings
Southam‐Gerow, M. A., Hourigan, S. E., & Allin, R. B. (2008) · Behavior Modification · doi:10.1177/0145445508322624 · Cited by 44 · see citing works
A Sobering Look at Treatment Effectiveness of Military-Related Posttraumatic Stress Disorder
Levi, O., Yehuda, A. B., Pine, D. S., & Bar‐Haim, Y. (2021) · Clinical Psychological Science · doi:10.1177/21677026211051314 · Cited by 45 · see citing works
The future of psychology practice and science.
Bray, J. H. (2010) · American Psychologist · doi:10.1037/a0020273 · Cited by 42 · see citing works
Obesity Reduction Black Intervention Trial (ORBIT): Design and Baseline Characteristics
Fitzgibbon, M., Stolley, M. R., Schiffer, L. A., Sharp, L. K., Singh, V., Horn, L. V., & Dyer, A. R. (2008) · Journal of Women s Health · doi:10.1089/jwh.2007.0614 · Cited by 42 · see citing works
Use of Fidelity Assessments to Train Clinicians in the CBT for PTSD Program for Clients With Serious Mental Illness
Lu, W., Yanos, P. T., Gottlieb, J. D., Marcello, S. C., Silverstein, S. M., Xie, H., Rosenberg, S. D., & Mueser, K. T. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201000458 · Cited by 41 · see citing works
Integrating Interventions and Services Research: Progress and Prospects.
Southam‐Gerow, M. A., Ringeisen, H. L., & Sherrill, J. T. (2006) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.2006.00001.x · Cited by 41 · see citing works
Effectiveness of the prevention program for externalizing problem behaviour (PEP) in children with symptoms of attention-deficit/hyperactivity disorder and oppositional defiant disorder – generalization to the real world
Hautmann, C., Hanisch, C., Mayer, I., Plück, J., & Döpfner, M. (2008) · Journal of Neural Transmission · doi:10.1007/s00702-007-0866-6 · Cited by 41 · see citing works
Effectiveness of the home‐start parenting support program: Behavioral outcomes for parents and children
Asscher, J. J., Hermanns, J. M. A., & Deković, M. (2008) · Infant Mental Health Journal · doi:10.1002/imhj.20171 · Cited by 41 · see citing works
One-Year Follow-up of a Parent Management Training for Children with Externalizing Behaviour Problems in the Real World
Hautmann, C., Hoijtink, H. J. A., Eichelberger, I., Hanisch, C., Plück, J., Walter, D., & Döpfner, M. (2009) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246580999021x · Cited by 39 · see citing works
Efficacy and Effectiveness Approaches in Behavioral Treatment Trials
Nash, J. M., McCrory, D. C., Nicholson, R. A., & Andrasik, F. (2005) · Headache The Journal of Head and Face Pain · doi:10.1111/j.1526-4610.2005.05102.x · Cited by 39 · see citing works
L'évaluation empirique des psychothérapies
Despland, J., Zimmermann, G., & de Roten, Y. (2006) · Psychothérapies · doi:10.3917/psys.062.0091 · Cited by 38 · see citing works
Choosing a control group in effectiveness trials of behavioral drug abuse treatments
Brigham, G. S., Feaster, D. J., Wakim, P., & Dempsey, C. L. (2009) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2009.05.004 · Cited by 38 · see citing works
How practitioners (and others) can make scientifically viable contributions to clinical-outcome research using the single-case time-series design
Borckardt, J. J., & Nash, M. R. (2002) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207140208410095 · Cited by 38 · see citing works
Effectiveness of Systems Training for Emotional Predictability and Problem Solving (STEPPS) for Borderline Personality Problems in a ‘Real-World’ Sample: Moderation by Diagnosis or Severity?
Bos, E. H., van Wel, E. B., Appelo, M., & Verbraak, M. (2011) · Psychotherapy and Psychosomatics · doi:10.1159/000321793 · Cited by 33 · see citing works
Cognitive-Behavioral Therapy for Depression in Bipolar Disorder: A Meta-Analysis
Gregory, V. L. (2010) · Journal of Evidence-Based Social Work · doi:10.1080/15433710903176088 · Cited by 36 · see citing works
Smoking cessation in primary care – a randomized controlled trial of bupropione, nicotine replacements, <scp>CBT</scp> and a minimal intervention
Wittchen, H., Hoch, E., Klotsche, J., & Muehlig, S. (2011) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.328 · Cited by 38 · see citing works
Cognitive behavioral therapy techniques and strategies.
Wenzel, A. E., Dobson, K. S., & Hays, P. A. (2016) · American Psychological Association eBooks · doi:10.1037/14936-000 · Cited by 34 · see citing works
Home-Based vs. Clinic-Based Parent–Child Interaction Therapy: Comparative Effectiveness in the Context of Dissemination and Implementation
Fowles, T. R., Masse, J. J., McGoron, L., Beveridge, R. M., Williamson, A. A., Smith, M. A., & Parrish, B. P. (2017) · Journal of Child and Family Studies · doi:10.1007/s10826-017-0958-3 · Cited by 32 · see citing works
The Best Kept Secret in Social Work: Empirical Support for Contemporary Psychodynamic Social Work Practice
Mishna, F., Wert, M. V., & Asakura, K. (2013) · Journal of Social Work Practice · doi:10.1080/02650533.2013.818944 · Cited by 31 · see citing works
Scrutinising NICE: The impact of the National Institute for Health and Clinical Excellence Guidelines on the provision of counselling and psychotherapy in primary care in the UK
Guy, A., Loewenthal, D., Thomas, R., & Stephenson, S. (2012) · Psychodynamic Practice · doi:10.1080/14753634.2012.640153 · Cited by 32 · see citing works
Annotation: Randomised trials
Harrington, R., Cartwright‐Hatton, S., & Stein, A. L. (2002) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00087 · Cited by 30 · see citing works
Musculoskeletal pain in primary health care a biopsychosocial perspective for assessment and treatment
Westman, A. (2010) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 28 · see citing works
“Choose change”: design and methods of an acceptance and commitment therapy effectiveness trial for transdiagnostic treatment-resistant patients
Villanueva, J., Meyer, A. H., Rinner, M. T. B., Firsching, V. J., Benoy, C., Brogli, S., Walter, M., Bader, K., & Gloster, A. T. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2109-4 · Cited by 25 · see citing works
Randomized versus nonrandomized studies of alcohol treatment: participants, methodological features and posttreatment functioning.
Moyer, A. E., & Finney, J. W. (2002) · Journal of Studies on Alcohol · doi:10.15288/jsa.2002.63.542 · Cited by 24 · see citing works
Humanistic and Integrative Therapies for Anxiety and Depression
van Rijn, B., & Wild, C. (2013) · Transactional Analysis Journal · doi:10.1177/0362153713499545 · Cited by 24 · see citing works
AFFECTIVE DISORDERS
Beach, S. R. H. (2003) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2003.tb01203.x · Cited by 24 · see citing works
Feasibility, adherence, and effectiveness of blended psychotherapy for severe mental illnesses: scoping review
Ehrt-Schäfer, Y., Rusmir, M., Vetter, J., Seifritz, E., Müller, M., & Kleim, B. (2023) · JMIR Mental Health · doi:10.2196/43882 · Cited by 24 · see citing works
What is IPT? The Basic Principles and the Inevitability of Change
Stuart, S. P. (2007) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-007-9063-z · Cited by 23 · see citing works
Self-citation
Measuring the Effectiveness of Transactional Analysis: An International Study
Novey, T. B. (2002) · Transactional Analysis Journal · doi:10.1177/036215370203200103 · Cited by 23 · see citing works
Mediation analysis of Mode Deactivation Therapy, (MDT).
Apsche, J. A., Bass, C. K., & Backlund, B. (2012) · The Behavior Analyst Today · doi:10.1037/h0100723 · Cited by 22 · see citing works
Reduzierung alkoholbedingter Mortalität durch Behandlung der Alkoholabhängigkeit
Rehm, J. T., Rehm, M. X., Shield, K. D., Gmel, G. E., Frick, U., & Mann, K. F. (2014) · SUCHT - Zeitschrift für Wissenschaft und Praxis / Journal of Addiction Research and Practice · doi:10.1024/0939-5911.a000299 · Cited by 22 · see citing works
How does psychotherapy influence personality? A theoretical integration
Mayer, J. D. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20076 · Cited by 22 · see citing works
Qui sont les psychothérapeutes efficaces? Implications pour la formation en psychologie
Lecomte, C., Savard, R., Drouin, M., & Guillon, V. (2004) · Revue québécoise de psychologie · Cited by 21 · see citing works
Making the leap: From experimental psychopathology to clinical trials
Blackwell, S. E., & Woud, M. L. (2022) · Journal of Experimental Psychopathology · doi:10.1177/20438087221080075 · Cited by 18 · see citing works
A Case for Translation From the Clinic to the Laboratory
Kredlow, M. A., de Voogd, L. D., & Phelps, E. A. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211039852 · Cited by 24 · see citing works
Longer term outcome of cognitive-behavioural and psychodynamic psychotherapy in routine mental health care: Randomised controlled trial
Watzke, B., Rüddel, H., Jürgensen, R., Koch, U., Kriston, L., Grothgar, B., & Schulz, H. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.005 · Cited by 20 · see citing works
The potential impact of increased treatment rates for alcohol dependence in the United Kingdom in 2004
Shield, K. D., Rehm, J., Rehm, M. X., Gmel, G., & Drummond, C. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-53 · Cited by 20 · see citing works
Piloting a practice research network: A 12‐month evaluation of the Human Givens approach in primary care at a general medical practice
Andrews, W. P., Twigg, E., Minami, T., & Johnson, G. (2011) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/j.2044-8341.2010.02004.x · Cited by 20 · see citing works
Does Parent Management Training for Children with Externalizing Problem Behavior in Routine Care Result in Clinically Significant Changes?
Hautmann, C., Stein, P., Hanisch, C., Eichelberger, I., Plück, J., Walter, D., & Döpfner, M. (2009) · Psychotherapy Research · doi:10.1080/10503300902777148 · Cited by 20 · see citing works
What Every Therapist Needs to Know About Couple Therapy
Halford, W. K., & Pepping, C. A. (2019) · Behaviour Change · doi:10.1017/bec.2019.12 · Cited by 20 · see citing works
Predicting the effectiveness of the Home-Start parenting support program
Asscher, J. J., Hermanns, J. M. A., Deković, M., & Reitz, E. (2006) · Children and Youth Services Review · doi:10.1016/j.childyouth.2006.07.002 · Cited by 20 · see citing works
Preventive Interventions and Harm Reduction in Online and Electronic Gambling: A Systematic Review
Fiskaali, A., Stenbro, A. W., Marcussen, T., & Rask, M. T. (2022) · Journal of Gambling Studies · doi:10.1007/s10899-022-10126-6 · Cited by 21 · see citing works

Efficacy, Effectiveness, and the Clinical Utility of Psychotherapy Research
Hofmann, S. G., & Weinberger, J. (2013) · Routledge eBooks · doi:10.4324/9780203943427-12 · Cited by 43 · see citing works
Psychotherapy, Efficacy of
McGinn, L. K., Sanderson, W. C., & Steinberg, J. A. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy1053
Translating Efficacy into Effectiveness
Byrne, S. M., Moncrieff-Boyd, J., & Fursland, A. (2017) · Springer eBooks · doi:10.1007/978-981-287-104-6_62 · Cited by 1 · see citing works
Efficacy Versus Effectiveness Research
Dalrymple, K. L., Gaudiano, B. A., & Weinstock, L. M. (2015) · The Encyclopedia of Clinical Psychology · doi:10.1002/9781118625392.wbecp472 · Cited by 1 · see citing works
Effective Psychotherapy and Effective Psychotherapists
Charman, D. P. (2003) · Routledge eBooks · doi:10.4324/9781410609311-7 · Cited by 2 · see citing works

Authors: Nathan, P. E., Stuart, S. P., & Dolan, S. L.
Affiliations: University of Iowa (US)
ORCID: Stuart, Scott P.
Dolan, Sara L.
Venue: Psychological Bulletin
Publisher: American Psychological Association (APA)
Published: 2000
Volume: 126
Issue: 6
Pages: 964-981
ISSN: 0033-2909 (ISSN-L)
1939-1455
DOI: 10.1037/0033-2909.126.6.964
OpenAlex: W1994615242
Cited by: 258
References: 153
Citations by year: 2026: 4 · 2025: 2 · 2023: 8 · 2022: 8 · 2021: 10 · 2020: 11 · 2019: 4 · 2018: 4 · 2017: 9 · 2016: 9 · 2015: 7 · 2014: 8 · 2013: 11 · 2012: 16
FWCI: 14.28
Type: journal article
Language: en
Open access: closed
Locations: Psychological Bulletin (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
Social Sciences › Psychology › Social Psychology › Counseling Practices and Supervision
Keywords: psychotherapy efficacy, psychotherapy effectiveness, treatment outcome research, treatment variables
MeSH terms: Forecasting, Health Services Research, Humans, Psychotherapy, United States, Randomized Controlled Trials as Topic, Treatment Outcome, Outcome Assessment, Health Care

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Research on psychotherapy efficacy and effectiveness: Between Scylla and Charybdis?

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks