The DOI matches its Crossref record; 180 of the 180 references it cites were found in a registry or an index.
Meta-analysis of comparative therapy outcome studies: A replication and refinement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Indeed, there is some evidence that psychological therapists become less effective over the years following qualification”
From Therapist drift redux: Why well-meaning clinicians fail to deliver evidence-based therapy, and how to get back on track (2016) · cites this paper as Shapiro & Shapiro, 1982
In the citing paper
“Age and experience are not enough to ensure that we improve, and might be more closely related to drift from evidence-based methods and weaker patient outcomes”
From Therapist drift redux: Why well-meaning clinicians fail to deliver evidence-based therapy, and how to get back on track (2016) · cites this paper as Shapiro & Shapiro, 1982
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
- STATISTICAL PACKAGE FOR SOCIAL SCIENCES
Reddy, M. V. (2014) · Apple Academic Press eBooks · doi:10.1201/b17560-26 · Cited by 12,121
(1975) · Medical Entomology and Zoology · Cited by 7,245
(1962) · Medical Entomology and Zoology · Cited by 4,856
Lewis, J. A., & Finney, D. (1972) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2346498 · Cited by 2,677
Problem solving and behavior modification.
D'Zurilla, T. J., & Goldfried, M. R. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0031360 · Cited by 2,257
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
The relation between socioeconomic status and academic achievement.
White, K. R. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.3.461 · Cited by 1,741
Cognitive-Behavior Modification: An Integrative Approach
Meichenbaum, D. H. (1977) · Medical Entomology and Zoology · Cited by 1,619
Cited by
Sorted by citations
Items 101–200 of 588
Stevens, S. E., Hynan, M. T., & Allen, M. R. (2000) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.7.3.273 · Cited by 118
PSYCHOTHERAPY PROCESS-OUTCOME CORRELATIONS MAY BE MISLEADING
Stiles, W. B. (1988) · Psychotherapy · doi:10.1037/h0085320 · Cited by 122
Prescriptive v. Exploratory Psychotherapy
Shapiro, D. A., & Firth, J. (1987) · British Journal of Psychiatry · doi:10.1192/bjp.151.6.790 · Cited by 105
Self-citationAn apology for research integration in the study of psychotherapy.
Glass, G. V., & Kliegl, R. M. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.1.28 · Cited by 113
A systematic review of quasi-experiments in software engineering
Kampenes, V. B., Dybå, T., Hannay, J. E., & Sjøberg, D. I. K. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.04.006 · Cited by 114
Benchmarks for psychotherapy efficacy in adult major depression.
Minami, T., Wampold, B. E., Serlin, R. C., Kircher, J. C., & Brown, G. S. (. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.2.232 · Cited by 119
Meta-analysis: Techniques, applications, and functions.
Strube, M., & Hartmann, D. P. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.1.14 · Cited by 113
Is follow-up necessary in evaluating psychotherapy?
Nicholson, R. A., & Berman, J. S. (1983) · PubMed · Cited by 107
Drisko, J. W. (2004) · Families in Society The Journal of Contemporary Social Services · doi:10.1606/1044-3894.239 · Cited by 114
Weisz, J. R., & Hawley, K. M. (1998) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp2702_7 · Cited by 104
Placebo controls in psychotherapy research: A sine qua non or a placebo for research problems?
Parloff, M. B. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.54.1.79 · Cited by 121
Hsu, L. (1989) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.57.1.131 · Cited by 104
Comparison of a Randomized and Two Quasi-Experimental Designs in a Single Outcome Evaluation
Aiken, L. S., West, S. G., Schwalm, D. E., Carroll, J. L., & Hsiung, S. (1998) · Evaluation Review · doi:10.1177/0193841x9802200203 · Cited by 105
Comparative therapy outcome research: Methodological implications of meta-analysis.
Shapiro, D. A., & Shapiro, D. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.51.1.42 · Cited by 100
Self-citationRelative effectiveness of behavioral versus nonbehavioral child psychotherapy.
Weiss, B., & Weisz, J. R. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.2.317 · Cited by 100
IDENTIFYING POTENTIALLY INTERESTING VARIABLES AND ANALYSIS OPPORTUNITIES
Lipsey, M. W. (2019) · Russell Sage Foundation eBooks · doi:10.7758/9781610448864.11 · Cited by 100
Dose–effect relations in time-limited combined psycho-pharmacological treatment for depression
DEKKER, J., MOLENAAR, P. J., KOOL, S., VAN AALST, G., PEEN, J., & de JONGHE, F. (2005) · Psychological Medicine · doi:10.1017/s0033291704002685 · Cited by 76
The legacy of Saul Rosenzweig: The profundity of the dodo bird.
Duncan, B. (2002) · Journal of Psychotherapy Integration · doi:10.1037/1053-0479.12.1.32 · Cited by 35
Cognitive therapy versus systematic desensitization: Is one treatment superior?
Berman, J. S., Miller, R. C., & Massman, P. J. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.3.451 · Cited by 99
Individualized Stress Management for Primary Hypertension
von der Linden, W., Lenz, J. W., & Con, A. H. (2001) · Archives of Internal Medicine · doi:10.1001/archinte.161.8.1071 · Cited by 97
Evaluation Research on Correctional Treatment in West Germany: A Meta-analysis
Lösel, F., & Köferl, P. (1989) · Research in criminology · doi:10.1007/978-3-642-86017-1_21 · Cited by 100
Psychodynamic Measures of Therapeutic Change
Blatt, S. J., & Auerbach, J. S. (2003) · Psychoanalytic Inquiry · doi:10.1080/07351692309349034 · Cited by 95
Current Findings Regarding the Effectiveness of Counseling: Implications for Practice
Lambert, M. J., & Cattani, K. (1996) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1996.tb02299.x · Cited by 95
Chung, T. D., Yu, J. J., Kong, T., Spiotto, M. T., & Lin, J. M. (2000) · The Prostate · doi:10.1002/(sici)1097-0045(20000101)42:1 · Cited by 102
Implications of a Self-Regulation Model of Therapy for Treatment of Addictive Behaviors
Kanfer, F. H. (1986) · Springer eBooks · doi:10.1007/978-1-4613-2191-0_2 · Cited by 94
The Role of Locus of Control in Daily Life
Ryon, H., & Gleason, M. (2014) · Personality and Social Psychology Bulletin · doi:10.1177/0146167213507087 · Cited by 83
A new scale for assessing the quality of randomized clinical trials of psychotherapy
Kocsis, J. H., Gerber, A. J., Milrod, B. L., Roose, S. P., Barber, J. P., Thase, M. E., Perkins, P., & Leon, A. C. (2009) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2009.07.001 · Cited by 87
Behavioral and cognitive treatment methods: A critical comparative review
Sweet, A. A., & Loizeaux, A. L. (1991) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(91)90014-v · Cited by 85
Matt, G. E. (1997) · Clinical Psychology Review · doi:10.1016/s0272-7358(96)00042-6 · Cited by 85
Rorschach Changes Following Brief and Short-Term Therapy
Exner, J. E., & Andronikof, A. (1992) · Journal of Personality Assessment · doi:10.1207/s15327752jpa5901_6 · Cited by 84
Beutler, L. (2006) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.9.1.30 · Cited by 90
Making Science Matter in Clinical Practice: Redefining Psychotherapy
Beutler, L. (2009) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.2009.01168.x · Cited by 86
Psychotherapy Outcome Research with Children and Adolescents: The State of the Art
Weisz, J. R., Huey, S. J., & Weersing, V. R. (1998) · Advances in Clinical Child Psychology · doi:10.1007/978-1-4757-9038-2_2 · Cited by 82
Lösel, F. A. (1995) · Psychology Crime and Law · doi:10.1080/10683169508409762 · Cited by 82
Bernard, M. E., Ellis, A., & Terjesen, M. D. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/0-387-26375-6_1 · Cited by 79
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R. H., Sheldon, T., & Song, F. (1998) · PubMed · Cited by 79
Treatment Readiness and Responsivity: Contributing to Effective Correctional Programming
Serin, R. C. (1997) · Cited by 77
Hope as a Common Factor across Psychotherapy Approaches
Snyder, C., & Taylor, J. (2000) · Elsevier eBooks · doi:10.1016/b978-012654050-5/50007-5 · Cited by 77
Autogenic Training: A narrative and quantitative review of clinical outcome
von der Linden, W. (1994) · Applied Psychophysiology and Biofeedback · doi:10.1007/bf01721069 · Cited by 77
The Efficacy of Psychological, Educational, and Behavioral Treatment
Lipsey, M. W., & Wilson, D. B. (2017) · Routledge eBooks · doi:10.4324/9781315089256-4 · Cited by 74
A meta-analysis of school-based studies of psychotherapy
Prout, H. T., & Demartino, R. A. (1986) · Journal of School Psychology · doi:10.1016/0022-4405(86)90061-0 · Cited by 74
Hides, L. M., Samet, S., & Lubman, D. I. (2010) · Drug and Alcohol Review · doi:10.1111/j.1465-3362.2010.00207.x · Cited by 77
Alliance, Negotiation, and Rupture Resolution
Safran, J. D., Muran, J. C., & Proskurov, B. (2008) · Humana Press eBooks · doi:10.1007/978-1-59745-444-5_9 · Cited by 76
An overview of psychotherapy outcome research: Implications for practice.
Whiston, S. C., & Sexton, T. L. (1993) · Professional Psychology Research and Practice · doi:10.1037//0735-7028.24.1.43 · Cited by 72
A Study of Asynchronous Mobile-Enabled SMS Text Psychotherapy
Hull, T. D., & Mahan, K. (2016) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2016.0114 · Cited by 70
Meta-analysis of Comparative Therapy Outcome Research: a Critical Appraisal
Shapiro, D. A., & Shapiro, D. (1982) · Behavioural Psychotherapy · doi:10.1017/s0141347300006285 · Cited by 66
Self-citationBarlow, S., Burlingame, G., & Fuhriman, A. J. (2000) · Group Dynamics Theory Research and Practice · doi:10.1037/1089-2699.4.1.115 · Cited by 64
Identification of patients at risk for nonresponse and negative outcome in psychotherapy.
Mohr, D. C., Beutler, L. E., Engle, D. E., Shoham-Salomon, V., & al, E. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.5.622 · Cited by 68
Weiss, B., & Weisz, J. R. (1990) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf01342752 · Cited by 66
Interpretive and supportive psychotherapies: Matching therapy and patient personality.
Piper, W. E., Joyce, A. S., McCallum, M., Azim, H. F. A., & Ogrodniczuk, J. S. (2002) · American Psychological Association eBooks · doi:10.1037/10445-000 · Cited by 65
Identifying highly effective psychotherapists in a managed care environment.
Brown, G. S. J., Lambert, M. J., Jones, E. R., & Minami, T. (2005) · PubMed · Cited by 65
Dose-effect relationship in children's psychotherapy services.
Salzer, M. S., Bickman, L., & Lambert, E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.2.228 · Cited by 65
The Efficacy of Hypnotherapy in the Treatment of Psychosomatic Disorders: Meta-analytical Evidence
Flammer, E., & Alladin, A. (2007) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207140701338696 · Cited by 63
Hansen, J. T. (2005) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2005.tb00362.x · Cited by 62
Predictors of deterioration among patients with substance‐use disorders
Moos, R. H., Moos, B. S., & Finney, J. W. (2001) · Journal of Clinical Psychology · doi:10.1002/jclp.1105 · Cited by 62
The dose—effect relationship in psychotherapy: A defining achievement for Dr. Kenneth Howard
Kopta, S. M. (2003) · Journal of Clinical Psychology · doi:10.1002/jclp.10167 · Cited by 61
Dennis, L. K., Dawson, D. V., & Resnick, M. I. (2002) · Prostate Cancer and Prostatic Diseases · doi:10.1038/sj.pcan.4500586 · Cited by 60
Risk factors for symptom exacerbation among treated patients with substance use disorders
Moos, R. H., Nichol, A. C., & Moos, B. S. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00063.x · Cited by 61
A REVIEW OF TREATMENT RESEARCH FOR SELF‐INJURIOUS AND STEREOTYPED RESPONDING
Gorman‐Smith, D., & Matson, J. L. (1985) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.1985.tb00357.x · Cited by 60
Scientific and practical advantages of comparative design in psychotherapy outcome research.
Basham, R. B. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.1.88 · Cited by 60
An analysis (meta- and otherwise) of multinational transfer pricing research
Borkowski, S. C. (1996) · The International Journal of Accounting · doi:10.1016/s0020-7063(96)90012-6 · Cited by 59
Miciak, M., Gross, D. P., & Joyce, A. S. (2011) · Scandinavian Journal of Caring Sciences · doi:10.1111/j.1471-6712.2011.00923.x · Cited by 60
Frank's "common elements" in psychotherapy: nonspecific factors and placebos.
Parloff, M. (1986) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1986.tb03485.x · Cited by 23
Psychotherapy of depression: A self-confirmation model.
Andrews, J. D. (1989) · Psychological Review · doi:10.1037//0033-295x.96.4.576 · Cited by 57
Effect Sizes in the Treatment of Sexual Offenders
Marshall, W. L., & McGuire, J. (2003) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x03256663 · Cited by 54
Lee, C. M., Picard, M., & Blain, M. D. (1994) · Journal of Family Psychology · doi:10.1037/0893-3200.8.1.3 · Cited by 54
Hansen, J. T. (2003) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.2003.tb01834.x · Cited by 53
Matt, G. E. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.1.106 · Cited by 53
Erekson, D. M., Janis, R. A., Bailey, R. J., Cattani, K., & Pedersen, T. R. (2017) · Journal of Counseling Psychology · doi:10.1037/cou0000252 · Cited by 52
What Is and Can Be Attributed to the Therapeutic Relationship?
Beutler, L. E., & Harwood, T. M. (2002) · Journal of Contemporary Psychotherapy · doi:10.1023/a:1015579111666 · Cited by 52
Haaga, D. A. F., & Davison, G. C. (1991) · Cited by 53
A review of meta-analyses conducted on psychotherapy outcome research
Brown, J. (1987) · Clinical Psychology Review · doi:10.1016/0272-7358(87)90002-x · Cited by 52
George, L. (1997) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.1997.00421.x · Cited by 51
Metaanalysis of Research on Social Work Practice in Mental Health
(1988) · Social Work · doi:10.1093/sw/33.4.325 · Cited by 52
Counselling in primary care: a randomised controlled trial.
Hemmings, A. (1997) · Patient Education and Counseling · doi:10.1016/s0738-3991(97)00035-9 · Cited by 52
Psychotherapies should be assessed for both benefit and harm
Scott, J. L., & Young, A. H. (2016) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.115.169060 · Cited by 57
Expertise in Counseling Psychology: A Concept in Search of Support
Lichtenberg, J. W. (1997) · Educational Psychology Review · doi:10.1023/a:1024783107643 · Cited by 50
Introduction to psychotherapy research.
Lambert, M. J. (2004) · American Psychological Association eBooks · doi:10.1037/10092-041 · Cited by 50
Boisvert, C. M., & Faust, D. (2003) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.34.5.508 · Cited by 39
Common Factors in Psychotherapy
Weinberger, J. (1993) · Springer eBooks · doi:10.1007/978-1-4757-9782-4_4 · Cited by 108
Researchers' images of psychotherapy: Their origins and influence on research
Orlinsky, D. E. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90002-0 · Cited by 49
Treatment effects with an adolescent abuse survivor’s group
Kruczek, T. A., & Vitanza, S. A. (1999) · Child Abuse & Neglect · doi:10.1016/s0145-2134(99)00023-x · Cited by 48
Achievements and limitations of psychotherapy research.
Lambert, M., & Bergin, A. (1992) · American Psychological Association eBooks · doi:10.1037/10110-010 · Cited by 40
Postmodern Implications for Theoretical Integration of Counseling Approaches
Hansen, J. T. (2002) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2002.tb00196.x · Cited by 47
Childhood Punishment, Denial, and Political Attitudes
Milburn, M. A., Conrad, S. D., Sala, F. D., & Carberry, S. (1995) · Political Psychology · doi:10.2307/3792222 · Cited by 47
How practitioners can systematically use empirical evidence in treatment selection.
Beutler, L., Moleiro, C., & Talebi, H. (2002) · Journal of Clinical Psychology · doi:10.1002/jclp.10106 · Cited by 50
Help-Seeking as a Coping Mechanism
Wills, T. (1987) · Springer eBooks · doi:10.1007/978-1-4757-9865-4_2 · Cited by 49
Barker, S. L., Funk, S. C., & Houston, B. K. (1988) · Clinical Psychology Review · doi:10.1016/0272-7358(88)90082-7 · Cited by 45
Howard, K. I., Orlinsky, D. E., & Lueger, R. J. (1994) · The British Journal of Psychiatry · doi:10.1192/bjp.165.1.4 · Cited by 45
Hedman-Lagerlöf, M., Hedman-Lagerlöf, E., & Öst, L.-G. (2018) · Psychological Medicine · doi:10.1017/s0033291718000259 · Cited by 61
The value of RCT evidence depends on the quality of statistical analysis.
Faulkner, C., Fidler, F., & Cumming, G. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.12.001 · Cited by 45
Building Robust Psychotherapies for Children and Adolescents
Weisz, J. R. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613512658 · Cited by 43
Stress management at work: With whom, for whom and to what ends?
Reynolds, S., & Briner, R. (1994) · British Journal of Guidance and Counselling · doi:10.1080/03069889400760081 · Cited by 50
Doidge, N. (1997) · Psychoanalytic Inquiry · doi:10.1080/07351699709534161 · Cited by 46
Rational emotive behavior therapy: applications for working with parents and teachers
Terjesen, M. D., & Kurasaki, R. E. (2009) · Estudos de Psicologia (Campinas) · doi:10.1590/s0103-166x2009000100001 · Cited by 42
What Do Relatives of People With Schizophrenia Find Helpful About Family Intervention?
Budd, R. J., & Hughes, I. C. T. (1997) · Schizophrenia Bulletin · doi:10.1093/schbul/23.2.341 · Cited by 42
Specific and nonspecific factors in psychotherapy: A case of cognitive therapy for depression
Oei, T., & Shuttlewood, G. (1996) · Clinical Psychology Review · doi:10.1016/0272-7358(96)00009-8 · Cited by 46
Michalak, J., Kosfelder, J., Meyer, F. P., & Schulte, D. (2003) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/0084-5345.32.2.94 · Cited by 42
Beutler, L. E., Machado, P. P. P., Engle, D. E., & Mohr, D. C. (1993) · Journal of Psychotherapy Integration · doi:10.1037/h0101191 · Cited by 42
Impact of random assignment on study outcome: An empirical examination
Ottenbacher, K. J. (1992) · Controlled Clinical Trials · doi:10.1016/0197-2456(92)90029-y · Cited by 41
Metadata
- Authors
- Shapiro, D. A., & Shapiro, D.
- Affiliations
- University of Sheffield (GB)
- ORCID
- Shapiro, David A.
- Venue
- Psychological Bulletin
- Published
- 1982
- Volume
- 92
- Issue
- 3
- Pages
- 581-604
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2040742438
- Cited by
- 590
- References
- 179
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3 · 2023: 37 · 2022: 6 · 2021: 5 · 2020: 4 · 2019: 12 · 2018: 7 · 2017: 6 · 2016: 8 · 2015: 14 · 2014: 12 · 2013: 15 · 2012: 12
- FWCI
- 2.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, replication, treatment outcome comparison
- MeSH terms
- Behavior Therapy, Mental Disorders, Humans, Outcome and Process Assessment, Health Care, Psychotherapy, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review