The DOI matches its Crossref record; 180 of the 180 references it cites were found in a registry or an index.
Meta-analysis of comparative therapy outcome studies: A replication and refinement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Indeed, there is some evidence that psychological therapists become less effective over the years following qualification”
From Therapist drift redux: Why well-meaning clinicians fail to deliver evidence-based therapy, and how to get back on track (2016) · cites this paper as Shapiro & Shapiro, 1982
In the citing paper
“Age and experience are not enough to ensure that we improve, and might be more closely related to drift from evidence-based methods and weaker patient outcomes”
From Therapist drift redux: Why well-meaning clinicians fail to deliver evidence-based therapy, and how to get back on track (2016) · cites this paper as Shapiro & Shapiro, 1982
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
- STATISTICAL PACKAGE FOR SOCIAL SCIENCES
Reddy, M. V. (2014) · Apple Academic Press eBooks · doi:10.1201/b17560-26 · Cited by 12,121
(1975) · Medical Entomology and Zoology · Cited by 7,245
(1962) · Medical Entomology and Zoology · Cited by 4,856
Lewis, J. A., & Finney, D. (1972) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2346498 · Cited by 2,677
Problem solving and behavior modification.
D'Zurilla, T. J., & Goldfried, M. R. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0031360 · Cited by 2,257
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Smith, M. L., Glass, G. V., & Miller, T. I. (1980) · Medical Entomology and Zoology · Cited by 2,123
The relation between socioeconomic status and academic achievement.
White, K. R. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.3.461 · Cited by 1,741
Cognitive-Behavior Modification: An Integrative Approach
Meichenbaum, D. H. (1977) · Medical Entomology and Zoology · Cited by 1,619
Flagged first, then by citations
Cited by
Sorted by citations
Items 201–300 of 588
Psychotherapy research and its incredible credibility crisis
Parloff, M. (1984) · Clinical Psychology Review · doi:10.1016/0272-7358(84)90038-2 · Cited by 42
Training psychologists for evidence-based practice.
Hunsley, J. D. (2007) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cp2007_1_32 · Cited by 39
Frank, J. D. (1983) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00015958 · Cited by 39
Placebo treatment versus no treatment
Hróbjartsson, A., & Pc, G. (2002) · doi:10.1002/14651858.cd003974 · Cited by 38
Factors related to psychotherapists' self-assessment when treating anxiety and other disorders
Parker, Z. J., & Waller, G. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.12.010 · Cited by 38
Reassessing Predictors of Therapist Competence
Herman, K. C. (1993) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1993.tb02272.x · Cited by 38
Identification of meta-analyses
Dickersin, K., Higgins, K., & Meinert, C. L. (1990) · Controlled Clinical Trials · doi:10.1016/0197-2456(90)90032-w · Cited by 38
Strube, M., Gardner, W. P., & Hartmann, D. P. (1985) · Clinical Psychology Review · doi:10.1016/0272-7358(85)90030-3 · Cited by 38
Reynolds, S. A., & Shapiro, D. A. (1991) · Human Relations · doi:10.1177/001872679104400705 · Cited by 38
Self-citationA systematic review of the effectiveness of brief psychological therapies in primary health care.
Hemmings, A. (2000) · Families Systems & Health · doi:10.1037/h0091857 · Cited by 36
A Review of the Empirical Basis for Counseling: Implications for Practice and Training
Sexton, T., & Whiston, S. (1991) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1991.tb01215.x · Cited by 43
Rational Emotive Behavior Therapy
(2014) · Oxford University Press eBooks · doi:10.1093/obo/9780199828340-0147 · Cited by 35
Kivlighan, D., Goldberg, S. B., Abbas, M., Pace, B. T., Yulish, N. E., Thomas, J. G., Cullen, M. M., Flückiger, C., & Wampold, B. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.05.003 · Cited by 34
Quasi‐experimentation in a critical multiplist mode
Shadish, W. R., Cook, T. D., & Houts, A. C. (1986) · New Directions for Program Evaluation · doi:10.1002/ev.1432 · Cited by 35
Toward a common focus in psychotherapy research.
Elkins, D. N. (2012) · Psychotherapy · doi:10.1037/a0027797 · Cited by 34
The Counsellor's Self in Therapy: An Inevitable Presence
Reupert, A. (2006) · International Journal for the Advancement of Counselling · doi:10.1007/s10447-005-9001-2 · Cited by 38
A review of psychotherapy outcome research: Considerations for school‐based mental health providers
Zirkelback, E. H., & Reese, R. J. (2010) · Psychology in the Schools · doi:10.1002/pits.20526 · Cited by 35
Castañeiras, C. E., García, F., Bianco, J. L., & Fernández‐Álvarez, H. (2006) · Psychotherapy Research · doi:10.1080/10503300600802867 · Cited by 32
Bias in Meta-Analytic Estimates of the Absolute Efficacy of Psychotherapy
Staines, G. L., & Cleland, C. M. (2007) · Review of General Psychology · doi:10.1037/1089-2680.11.4.329 · Cited by 32
The effect of therapist experience on psychotherapy outcomes
Leon, S. C., Martinovich, Z., Lutz, W., & Lyons, J. S. (2005) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.473 · Cited by 32
Psychotherapy Assessment and Treatment Selection
Tillett, R. (1996) · The British Journal of Psychiatry · doi:10.1192/bjp.168.1.10 · Cited by 32
How Useful is Meta-analysis in Evaluating the Effects of Different Psychological Therapies?
Wilson, G. (1982) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s0141347300007783 · Cited by 19
Moriana, J. A., & Martínez, V. A. (2011) · Revista de Psicopatología y Psicología Clínica · doi:10.5944/rppc.vol.16.num.2.2011.10353 · Cited by 31
Youth Psychotherapy Change Trajectories and Early Warning System Accuracy in a Managed Care Setting
Nelson, P. L., Warren, J. S., Gleave, R. L., & Burlingame, G. M. (2013) · Journal of Clinical Psychology · doi:10.1002/jclp.21963 · Cited by 31
Wampold, B. E., Mondin, G. W., Moody, M., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.226 · Cited by 31
Behavior Modeling Training in Organizations: Concerns and Conclusions
Mayer, S. J., & Russell, J. S. (1987) · Journal of Management · doi:10.1177/014920638701300103 · Cited by 31
Psychotherapy research: A special issue.
VandenBos, G. R. (1986) · American Psychologist · doi:10.1037//0003-066x.41.2.111 · Cited by 31
Recent applications of meta-analysis in clinical research
Shapiro, D. A. (1985) · Clinical Psychology Review · doi:10.1016/0272-7358(85)90027-3 · Cited by 31
Self-citationEysenck, H. J. (1987) · Springer eBooks · doi:10.1007/978-1-4899-0827-8_1 · Cited by 31
Tolin, D. F. (2014) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12080 · Cited by 29
Female Counselors and Male Perpetrators of Violence Against Women
Tyagi, S. V. (2006) · Women & Therapy · doi:10.1300/j015v29n01_01 · Cited by 29
Leichsenring, F., & Rabung, S. (2006) · Psychotherapy Research · doi:10.1080/10503300600805217 · Cited by 29
Session impact and outcome in stress management training
Reynolds, S., Taylor, E., & Shapiro, D. (1993) · Journal of Community & Applied Social Psychology · doi:10.1002/casp.2450030409 · Cited by 33
Self-citationBack to basics: Psychotherapy is an interpersonal process
Andrews, H. B. (2001) · Australian Psychologist · doi:10.1080/00050060108259642 · Cited by 29
Meta-analysis of Comparative Therapy Outcome Studies: a Reply to Wilson
Shapiro, D. A., & Shapiro, D. (1982) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s0141347300008181 · Cited by 29
Self-citationHansen, J. T. (2006) · Counseling and Values · doi:10.1002/j.2161-007x.2006.tb00051.x · Cited by 28
Groth‐Marnat, G., Roberts, R. J., & Beutler, L. E. (2001) · Australian Psychologist · doi:10.1080/00050060108259643 · Cited by 28
Meta-analysis of paradoxical interventions.
Hill, K. A. (1987) · Psychotherapy · doi:10.1037/h0085714 · Cited by 28
IMPACT OF QUALITY ITEMS ON STUDY OUTCOME
Verhagen, A., de Bie, R. D., Lenssen, A., de Vet, H. D., Kessels, A., Boers, M., & van den Brandt, P. A. (2000) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300103174 · Cited by 27
Publication bias and the evaluation of psychotherapy efficacy in reviews of the research literature
Sohn, D. A. (1996) · Clinical Psychology Review · doi:10.1016/0272-7358(96)00005-0 · Cited by 28
Psicoterapia de grupo e considerações sobre o paciente como agente da própria mudança
Bechelli, L. P. D. C., & dos Santos, M. A. (2002) · Revista Latino-Americana de Enfermagem · doi:10.1590/s0104-11692002000300012 · Cited by 28
Individual Psychotherapy and Behavior Change
Parloff, M. B., London, P., & Wolfe, B. (1986) · Annual Review of Psychology · doi:10.1146/annurev.ps.37.020186.001541 · Cited by 28
Weisz, J. R. (2015) · Verhaltenstherapie · doi:10.1159/000430432 · Cited by 27
Empirically Supported Treatments: the Deconstruction of a Myth
Elkins, D. (2007) · Journal of Humanistic Psychology · doi:10.1177/0022167807302003 · Cited by 31
The effectiveness of treatment in institutional and community settings
Lösel, F. A. (1993) · Criminal Behaviour and Mental Health · doi:10.1002/cbm.1993.3.4.416 · Cited by 27
Saketopoulou, A. (1999) · Psychotherapy · doi:10.1037/h0087663 · Cited by 27
Guidelines for Conducting and Reporting Meta-Analyses
Rothstein, H. R., & McDaniel, M. A. (1989) · Psychological Reports · doi:10.2466/pr0.1989.65.3.759 · Cited by 27
The science of training II: Prepracticum and practicum training.
Callahan, J. L., & Watkins, C. E., Jr. (2018) · Training and Education in Professional Psychology · doi:10.1037/tep0000209 · Cited by 26
Wampold, B. E., Ollendick, T. H., & King, N. J. (2006) · American Psychological Association eBooks · doi:10.1037/11265-007 · Cited by 26
Anderson, K. W. (1998) · Psychotherapy Research · doi:10.1080/10503309812331332197 · Cited by 31
Hoag, M. J., & Burlingame, G. M. (1997) · Journal of Child and Adolescent Group Therapy · doi:10.1007/bf02548949 · Cited by 26
Measuring the Effectiveness of Parent Education
Medway, F. J. (1989) · Elsevier eBooks · doi:10.1016/b978-0-08-091820-4.50015-5 · Cited by 26
Unerwünschte Wirkungen, Nebenwirkungen und Fehlentwicklungen
Strauss, B. M., Linden, M., Haupt, M.-L., & Kaczmarek, S. (2012) · Psychotherapeut · doi:10.1007/s00278-012-0932-x · Cited by 25
Feaster, D. J., Newman, F. L., & Rice, C. (2003) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.382 · Cited by 25
Meta-analysis in the social sciences:
Wampold, B., Ahn, H.-N., & Kim, D. (2000) · Asia Pacific Education Review · doi:10.1007/bf03026147 · Cited by 29
Ce qui agit effectivement en psychothérapie : facteurs communs ou agents spécifiques
de Roten, Y. (2006) · Bulletin de psychologie · doi:10.3917/bupsy.486.0585 · Cited by 25
Group cognitive behavioural therapy interventions with cancer patients: a review of the literature
Bottomley, A. (1996) · European Journal of Cancer Care · doi:10.1111/j.1365-2354.1996.tb00225.x · Cited by 25
Does criminal offender treatment work
Simon, L. M. J. (1998) · Applied and Preventive Psychology · doi:10.1016/s0962-1849(05)80018-6 · Cited by 22
What the future holds: Machine learning to predict success in psychotherapy
Taubitz, F.-S., Büdenbender, B., & Alpers, G. W. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2022.104116 · Cited by 25
Hall, J. A., & Rosenthal, R. (2018) · Social and Personality Psychology Compass · doi:10.1111/spc3.12414 · Cited by 23
The Dimensions of Common Factors in Counseling
Leibert, T. (2011) · International Journal for the Advancement of Counselling · doi:10.1007/s10447-011-9115-7 · Cited by 27
L’évaluation des psychothérapies
Despland, J. (2006) · L Encéphale · doi:10.1016/s0013-7006(06)76282-0 · Cited by 25
Integrative health care model for climacteric stage women: design of the intervention
Doubova, S. V., Espinosa-Alarcón, P. A., Flores‐Hernández, S., Infante, C., & Pérez‐Cuevas, R. (2011) · BMC Women s Health · doi:10.1186/1472-6874-11-6 · Cited by 25
Sonnenstuhl, W. J. (1988) · The Journal of Applied Behavioral Science · doi:10.1177/002188638802400404 · Cited by 23
Investigator allegiance and the evaluation of psychotherapy outcome research
Berman, J. S., & Reich, C. M. (2010) · European Journal of Psychotherapy & Counselling · doi:10.1080/13642531003637775 · Cited by 24
Unbalanced Designs to Maximize Statistical Power in Psychotherapy Efficacy Studies
Hsu, L. M. (1994) · Psychotherapy Research · doi:10.1080/10503309412331333932 · Cited by 23
Ramsden, S., Tickle, A., Dawson, D. L., & Harris, S. (2016) · Journal of Intellectual Disabilities · doi:10.1177/1744629515612627 · Cited by 16
Applications of the psychotherapy phase model to clinically significant deterioration.
Swift, J. K., Callahan, J. L., Heath, C., Herbert, G. L., & Levine, J. C. (2010) · Psychotherapy · doi:10.1037/a0019787 · Cited by 22
Hersh, J., Metz, K. L., & Weisz, J. R. (2016) · International Journal of Cognitive Therapy · doi:10.1521/ijct.2016.9.2.140 · Cited by 22
A systematic clinical demonstration of promising PTSD treatment approaches.
Carbonell, J. L., & Figley, C. R. (1999) · Traumatology An International Journal · doi:10.1177/153476569900500106 · Cited by 22
Faust, D., & Zlotnick, C. (1995) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.5640020303 · Cited by 24
Qui sont les psychothérapeutes efficaces? Implications pour la formation en psychologie
Lecomte, C., Savard, R., Drouin, M., & Guillon, V. (2004) · Revue québécoise de psychologie · Cited by 21
Treatment of personality disorders
Clarkin, J. F. (1996) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1996.tb01222.x · Cited by 21
Psychotherapy, clinical evidence, and the self-fulfilling prophecy.
Masling, J. M., & Cohen, I. S. (1987) · Psychoanalytic Psychology · doi:10.1037/h0079124 · Cited by 21
Outcome and Process Measures in Brief Group Psychotherapy
MacKenzie, K. R., & Livesley, W. J. (1986) · Psychiatric Annals · doi:10.3928/0048-5713-19861201-09 · Cited by 21
Evaluating the performance of departments of psychotherapy
Fonagy, P., & Higgitt, A. (1989) · Psychoanalytic Psychotherapy · doi:10.1080/02668738900700121 · Cited by 21
Evaluating the dodo's verdict: Do all interventions have equivalent outcomes?
Reid, W. J. (1997) · Social Work Research · doi:10.1093/swr/21.1.5 · Cited by 21
Stieger, M., Allemand, M., Roberts, B. W., & Davis, J. P. (2021) · Journal of Personality · doi:10.1111/jopy.12672 · Cited by 27
Watzke, B., Rüddel, H., Jürgensen, R., Koch, U., Kriston, L., Grothgar, B., & Schulz, H. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.005 · Cited by 17
Margraf, J. (2009) · Springer eBooks · doi:10.1007/978-3-540-79541-4_1 · Cited by 14
¡Enjaulad a Dodo, por favor! El cuento de que todas las psicoterapias son igual de eficaces
González‐Blanch, C., & Carral-Fernández, L. (2017) · Papeles del Psicólogo - Psychologist Papers · doi:10.23923/pap.psicol2017.2828 · Cited by 23
Gálvez‐Lara, M., Corpas, J., Moreno, E. M., Martínez, J. F. V., Sánchez-Raya, A., & Moriana, J. A. (2018) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-018-0257-6 · Cited by 20
Tratamientos psicológicos con apoyo empírico y práctica clínica basada en la evidencia
Llobell, J. P. I., Navarro, M. D. F., & Monterde-i-Bort, H. (2004) · Papeles del Psicólogo - Psychologist Papers · Cited by 20
The Policy Relevance of Personality TraitsPreprint
Bleidorn, W., Hill, P. L., Back, M. D., Denissen, J. J. A., Hennecke, M., Hopwood, C. J., Jokela, M. M., Kandler, C., Lucas, R. E., Luhmann, M., et al. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/a9rbn · Cited by 32
Mohanty, S. N., Satpathy, S., Chopra, R., & Mahato, S. (2024) · Advances in Integrative Medicine · doi:10.1016/j.aimed.2024.04.003 · Cited by 21
Disclosure of Personal Problems, Self-Esteem, and the Facilitativeness of Friends and Lovers
Cramer, D. (1990) · British Journal of Guidance and Counselling · doi:10.1080/03069889000760171 · Cited by 19
The Gender Difference Hypothesis: A Synthesis of Research Findings
Jones, B. K. (1990) · Educational Administration Quarterly · doi:10.1177/0013161x90026001002 · Cited by 19
A methodological and empirical critique of psychotherapy outcome meta-analysis.
Searles, J. S. (1985) · Behaviour Research and Therapy · doi:10.1016/0005-7967(85)90173-1 · Cited by 17
Helpful Actions of Close Friends to Personal Problems and Distress
Cramer, D. (1990) · British Journal of Guidance and Counselling · doi:10.1080/03069889000760271 · Cited by 19
Two-Year Follow-up of the Sheffield Psychotherapy Project
Shapiro, D. A., & Firth-Cozens, J. (1990) · British Journal of Psychiatry · doi:10.1192/bjp.157.3.389 · Cited by 20
Self-citationWhere are the emperor's clothes?
Brody, N. (1983) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00016101 · Cited by 19
DiMeo, M. A., Moore, G. K., & Lichtenstein, C. (2012) · Journal of Community Psychology · doi:10.1002/jcop.20516 · Cited by 18
Therapeutic Techniques vs Therapeutic Relationships in Child Behavior Therapy
Motta, R., & Lynch, C. (1990) · Psychological Reports · doi:10.2466/pr0.1990.67.1.315 · Cited by 21
Some metrical issues with meta-analysis of therapy effects.
Lund, T. (1988) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.1988.tb00770.x · Cited by 18
Should we allow psychotherapy research to determine clinical practice?
Fonagy, P., & Target, M. (1996) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1996.tb00077.x · Cited by 18
Peniston, E. G. (1988) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(88)90022-5 · Cited by 18
Efficacy of rational-emotive therapy: A quantitative analysis.
Engels, G. I., Garnefski, N., & Diekstra, R. F. W. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.6.1083 · Cited by 17
Dies, R. R. (1992) · Psychotherapy · doi:10.1037/0033-3204.29.1.58 · Cited by 17
Is interpersonal psychotherapy in group format a therapeutic option in late‐life depression?
Scocco, P., Leo, D. D., & Frank, E. (2002) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.301 · Cited by 17
The role of meta-analysis in the evaluation of psychotherapy
Kazdin, A. (1985) · Clinical Psychology Review · doi:10.1016/0272-7358(85)90029-7 · Cited by 19
Metadata
- Authors
- Shapiro, D. A., & Shapiro, D.
- Affiliations
- University of Sheffield (GB)
- ORCID
- Shapiro, David A.
- Venue
- Psychological Bulletin
- Published
- 1982
- Volume
- 92
- Issue
- 3
- Pages
- 581-604
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2040742438
- Cited by
- 590
- References
- 179
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3 · 2023: 37 · 2022: 6 · 2021: 5 · 2020: 4 · 2019: 12 · 2018: 7 · 2017: 6 · 2016: 8 · 2015: 14 · 2014: 12 · 2013: 15 · 2012: 12
- FWCI
- 2.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, replication, treatment outcome comparison
- MeSH terms
- Behavior Therapy, Mental Disorders, Humans, Outcome and Process Assessment, Health Care, Psychotherapy, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review