The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting.
Abstract
OBJECTIVE: Psychotherapy researchers have long questioned whether increased therapist experience is linked to improved outcomes. Despite numerous cross-sectional studies examining this question, no large-scale longitudinal study has assessed within-therapist changes in outcomes over time. METHOD: The present study examined changes in psychotherapists' outcomes over time using a large, longitudinal, naturalistic psychotherapy data set. The sample included 6,591 patients seen in individual psychotherapy by 170 therapists who had on average 4.73 years of data in the data set (range = 0.44 to 17.93 years). Patient-level outcomes were examined using the Outcome Questionnaire-45 and a standardized metric of change (prepost d). Two-level multilevel models (patients nested within therapist) were used to examine the relationship between therapist experience and patient prepost d and early termination. Experience was examined both as chronological time and cumulative patients seen. RESULTS: Therapists achieved outcomes comparable with benchmarks from clinical trials. However, a very small but statistically significant change in outcome was detected indicating that on the whole, therapists' patient prepost d tended to diminish as experience (time or cases) increases. This small reduction remained when controlling for several patient-level, caseload-level, and therapist-level characteristics, as well as when excluding several types of outliers. Further, therapists were shown to vary significantly across time, with some therapists showing improvement despite the overall tendency for outcomes to decline. In contrast, therapists showed lower rates of early termination as experience increased. CONCLUSIONS: Implications of these findings for the development of expertise in psychotherapy are explored. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Hill, C. E., Baumann, E. C., Shafran, N., Gupta, S., Morrison, A., Pérez‐Rojas, A. E., Spangler, P. T., Griffin, S., Pappa, L., & Gelso, C. J. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000053 · Cited by 65
RetractedR: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278 · cited 1×
“Slopes estimated in individual regression models provide an alternative method for indexing an individual therapist’s change in outcome across time that is not weighted for the number of patients the therapist saw within the data set (as is the case for the multilevel model; Pinheiro & Bates, 2000).”
MethodJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Psychotherapy Relationships That Work
Norcross, J. C. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199737208.001.0001 · Cited by 947
Size of Treatment Effects and Their Importance to Clinical Research and Practice
Kraemer, H. C., & Kupfer, D. J. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.014 · Cited by 850
(2011) · Cited by 725
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657
Changes in counseling center client problems across 13 years
Benton, S. A., Robertson, J. M., Tseng, W.-C., Newton, F. B., & Benton, S. L. (2003) · Professional Psychology: Research and Practice · doi:10.1037/0735-7028.34.1.66 · Cited by 619
Patient-focused research: Using patient outcome data to enhance treatment effects.
Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.69.2.159 · Cited by 603
A lab test and algorithms for identifying clients at risk for treatment failure
Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20108 · Cited by 542
Self-citationSpecific vs Nonspecific Factors in Psychotherapy: A Controlled Study of Outcome
Strupp, H. H. (1979) · Archives of General Psychiatry · doi:10.1001/archpsyc.1979.01780100095009 · Cited by 486
Wampold, B. E., & Brown, G. S. (. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.914 · Cited by 476
Self-citationAn investigation of self-assessment bias in mental health providers
Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012) · Psychological Reports · doi:10.2466/02.07.17.pr0.110.2.639-644 · Cited by 394
Waiting for supershrink: an empirical analysis of therapist effects
Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.383 · Cited by 330
Self-citationGraduate training in psychotherapy: Are therapy outcomes enhanced?
Stein, D. M., & Lambert, M. J. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.2.182 · Cited by 327
Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.656 · Cited by 321
Baldwin, S. A., Berkeljon, A., Atkins, D. C., Olsen, J. A., & Nielsen, S. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0015235 · Cited by 273
Self-citationThe role of deliberate practice in the development of highly effective psychotherapists.
Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P. (2015) · Psychotherapy · doi:10.1037/pst0000015 · Cited by 267
Self-citationExpertise in psychotherapy: An elusive goal?
Tracey, T. J. G., Wampold, B. E., Lichtenberg, J. W., & Goodyear, R. K. (2014) · American Psychologist · doi:10.1037/a0035099 · Cited by 265
Self-citationOkiishi, J. C., Lambert, M. J., Eggett, D., Nielsen, L., Dayton, D. D., & Vermeersch, D. A. (2006) · Journal of Clinical Psychology · doi:10.1002/jclp.20272 · Cited by 253
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6558 · Cited by 179
Psychotherapist burnout: A componential analysis.
Raquepaw, J. M., & Miller, R. S. (1989) · Professional Psychology: Research and Practice · doi:10.1037//0735-7028.20.1.32 · Cited by 166
Borkovec, T. D., Echemendía, R. J., Ragusea, S. A., & Ruiz, M. A. (2001) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.8.2.155 · Cited by 162
Minami, T., Davies, D. R., Tierney, S. C., Bettmann, J. E., McAward, S. M., Averill, L. A., Huebner, L. A., Weitzman, L. M., Benbrook, A. R., Serlin, R. C., et al. (2009) · Journal of Counseling Psychology · doi:10.1037/a0015398 · Cited by 145
Self-citationIssenberg, S. B., McGaghie, W. C., Gordon, D. L., Symes, S. N., PETRUSA, E. R., Hart, I. R., & Harden, R. M. (2002) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1404_4 · Cited by 137
Skovholt, T. M., & Trotter-Mathison, M. (2014) · Routledge eBooks · doi:10.4324/9780203893326 · Cited by 129
Erdur‐Baker, Ö., Aberson, C. L., Barrow, J. C., & Draper, M. R. (2006) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.37.3.317 · Cited by 128
Benchmarks for psychotherapy efficacy in adult major depression.
Minami, T., Wampold, B. E., Serlin, R. C., Kircher, J. C., & Brown, G. S. (. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.2.232 · Cited by 128
Self-citationPractice makes perfect and other myths about mental health services.
Bickman, L. (1999) · American Psychologist · doi:10.1037/h0088206 · Cited by 123
Searching for Expertise in Counseling, Psychotherapy, and Professional Psychology
Skovholt, T. M., Rønnestad, M. H., & Jennings, L. L. (1997) · Educational Psychology Review · doi:10.1023/a:1024798723295 · Cited by 108
Investigating the relationship between competence and patient outcome with CBT
Branson, A., Shafran, R., & Myles, P. J. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.03.002 · Cited by 88
Identifying highly effective psychotherapists in a managed care environment.
Brown, G. S. J., Lambert, M. J., Jones, E. R., & Minami, T. (2005) · PubMed · Cited by 82
Accelerated relearning after retrieval-induced forgetting: The benefit of being forgotten.
Storm, B. C., Bjork, E. L., & Bjork, R. A. (2008) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.34.1.230 · Cited by 79
A Merging Theory of Expertise and Intelligence
Horn, J. L., & Masunaga, H. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816796.034 · Cited by 78
Effectiveness of a computer-based system to teach bedside cardiology
Issenberg, S. B., PETRUSA, E. R., McGaghie, W. C., Felner, J. M., WAUGH, R. A., Nash, I. S., & Hart, I. R. (1999) · Academic Medicine · doi:10.1097/00001888-199910000-00051 · Cited by 70
The bilevel structure of the Outcome Questionnaire–45.
Bludworth, J., Tracey, T. J. G., & Glidden-Tracey, C. E. (2010) · Psychological Assessment · doi:10.1037/a0019187 · Cited by 70
Predicting counseling center clients' response to counseling: A 1-year follow-up.
Snell, M. N., Mallinckrodt, B. S., Hill, R. D., & Lambert, M. J. (2001) · Journal of Counseling Psychology · doi:10.1037/0022-0167.48.4.463 · Cited by 64
Differences among trainees in client outcomes associated with the phase model of change.
Budge, S. L., Owen, J. J., Kopta, S. M., Minami, T., Hanson, M., & Hirsch, G. S. (2012) · Psychotherapy · doi:10.1037/a0029565 · Cited by 49
The effect of therapist experience on psychotherapy outcomes
Leon, S. C., Martinovich, Z., Lutz, W., & Lyons, J. S. (2005) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.473 · Cited by 47
Improving Physician–Patient Communication Through Coaching of Simulated Encounters
Ravitz, P., Lancee, W. J., Lawson, A., Maunder, R., Hunter, J., Leszcz, M., McNaughton, N., & Pain, C. (2013) · Academic Psychiatry · doi:10.1176/appi.ap.11070138 · Cited by 41
Cited by
Sharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00593-2 · Cited by 500
The professional and personal characteristics of effective psychotherapists: a systematic review
Heinonen, E., & Nissen-Lie, H. A. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1620366 · Cited by 292
A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support
Sharma, A., Miner, A., Atkins, D., & Althoff, T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.425 · Cited by 268
A systematic review of therapist effects: A critical narrative update and refinement to review
Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.08.004 · Cited by 222
Bashkirova, A., & Krpan, D. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100066 · Cited by 55
Metadata
- Authors
- Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E.
- Venue
- Journal of Counseling Psychology
- Published
- 2016-01
- Volume
- 63
- Issue
- 1
- Pages
- 1-11
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2238700998
- Cited by
- 278
- References
- 43
- FWCI
- 32.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.