The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting.
Abstract
OBJECTIVE: Psychotherapy researchers have long questioned whether increased therapist experience is linked to improved outcomes. Despite numerous cross-sectional studies examining this question, no large-scale longitudinal study has assessed within-therapist changes in outcomes over time. METHOD: The present study examined changes in psychotherapists' outcomes over time using a large, longitudinal, naturalistic psychotherapy data set. The sample included 6,591 patients seen in individual psychotherapy by 170 therapists who had on average 4.73 years of data in the data set (range = 0.44 to 17.93 years). Patient-level outcomes were examined using the Outcome Questionnaire-45 and a standardized metric of change (prepost d). Two-level multilevel models (patients nested within therapist) were used to examine the relationship between therapist experience and patient prepost d and early termination. Experience was examined both as chronological time and cumulative patients seen. RESULTS: Therapists achieved outcomes comparable with benchmarks from clinical trials. However, a very small but statistically significant change in outcome was detected indicating that on the whole, therapists' patient prepost d tended to diminish as experience (time or cases) increases. This small reduction remained when controlling for several patient-level, caseload-level, and therapist-level characteristics, as well as when excluding several types of outliers. Further, therapists were shown to vary significantly across time, with some therapists showing improvement despite the overall tendency for outcomes to decline. In contrast, therapists showed lower rates of early termination as experience increased. CONCLUSIONS: Implications of these findings for the development of expertise in psychotherapy are explored. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Hill, C. E., Baumann, E. C., Shafran, N., Gupta, S., Morrison, A., Pérez‐Rojas, A. E., Spangler, P. T., Griffin, S., Pappa, L., & Gelso, C. J. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000053 · Cited by 65
RetractedR: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Psychotherapy Relationships That Work
Norcross, J. C. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199737208.001.0001 · Cited by 947
Size of Treatment Effects and Their Importance to Clinical Research and Practice
Kraemer, H. C., & Kupfer, D. J. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.014 · Cited by 850
(2011) · Cited by 725
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657
Cited by
Sharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00593-2 · Cited by 500
The professional and personal characteristics of effective psychotherapists: a systematic review
Heinonen, E., & Nissen-Lie, H. A. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1620366 · Cited by 292
A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support
Sharma, A., Miner, A., Atkins, D., & Althoff, T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.425 · Cited by 268
A systematic review of therapist effects: A critical narrative update and refinement to review
Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.08.004 · Cited by 222
Bashkirova, A., & Krpan, D. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100066 · Cited by 55
Metadata
- Authors
- Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E.
- Venue
- Journal of Counseling Psychology
- Published
- 2016-01
- Volume
- 63
- Issue
- 1
- Pages
- 1-11
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2238700998
- Cited by
- 278
- References
- 43
- FWCI
- 32.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. https://app.cochat.ai/papers/10.1037/cou0000131
- The paper
- Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (2016). Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. Journal of Counseling Psychology. https://doi.org/10.1037/cou0000131
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.