The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
The role of deliberate practice in the development of highly effective psychotherapists.
Abstract
Little empirical research exists about highly effective psychotherapists, and none about the factors that mediate the acquisition and maintenance of superior performance skills (e.g., Ericsson, 1996, 2006; Ericsson, Krampe, & Tesch-Romer, 1993). In the full sample, a 3-level multilevel modeling (Level 1: clients; Level 2: therapists; Level 3: organization types) of practitioner outcomes was used to examine the contribution of the therapist to treatment effectiveness. Consistent with prior research, in the full sample (n = 69 therapists; n = 4,580 clients) it was found that therapist effects explained 5.1% of the variance in outcome, after adjusting for initial severity. Therapist gender, caseload, and age were not found to be significant predictors. In a subsample of therapists, the relationship between outcome and therapist demographic variables, professional development activities, and work practices was analyzed (n = 17 therapists, n = 1,632 clients). Therapist characteristics (e.g., years of experience, gender, age, profession, highest qualification, caseload, degree of theoretical integration) did not significantly predict client-reported outcomes. Consistent with the literature on expertise and expert performance, the amount of time spent targeted at improving therapeutic skills was a significant predictor of client outcomes. Further, highly effective therapists indicated requiring more effort in reviewing therapy recordings alone than did the rest of the cohort. Caveats and implications for clinical practice, continuing professional development, and training are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
The role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564 · cited 6×
“Items were developed from both a systematic review of the literature on DP and its research methodologies (e.g., Côte et al., 2005; Ericsson et al., 1993) and consultation with K. Anders Ericsson, a leading researcher on expert performance (Ericsson, 1996, 2004, 2006; Ericsson et al., 1993).”
BackgroundMethodResultInfluentialJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Design and Analysis: A Researcher's Handbook
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,822
Equivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966 · cited 1×
“…Burns, 2009); (d) using standardized patients’ simulated case vignettes to improve interaction with clients (Issenberg, McGaghie, Petrusa, Gordon, & Scalese, 2005; Ravitz et al., 2013), and (e) setting aside time to reflect and plan ahead (Lemov, Woolway, & Yezzi, 2012; Miller & Hubble, 2011).”
Generalized, Linear, and Mixed Models
McCulloch, C. E., & Searle, S. R. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471722073 · Cited by 2,994
Ericsson, K. A. (2004) · Academic Medicine · doi:10.1097/00001888-200410001-00022 · Cited by 2,988 · cited 1×
“Items were developed from both a systematic review of the literature on DP and its research methodologies (e.g., Côte et al., 2005; Ericsson et al., 1993) and consultation with K. Anders Ericsson, a leading researcher on expert performance (Ericsson, 1996, 2004, 2006; Ericsson et al., 1993).”
MethodEXPERT AND EXCEPTIONAL PERFORMANCE: Evidence of Maximal Adaptation to Task Constraints
Ericsson, K. A., & Lehmann, A. C. (1996) · Annual Review of Psychology · doi:10.1146/annurev.psych.47.1.273 · Cited by 2,139
Alliance in individual psychotherapy
Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011) · Psychotherapy · doi:10.1037/a0022186 · Cited by 2,072
Ericsson, K. A. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.038 · Cited by 1,629 · cited 2×
“Researchers have noted the important role that reviewing performance recordings can play in the identification and remediation of errors (Abbass, 2004; Binder, 1999; Ericsson, 1996;, 2006; Norcross & VandenBos, 2011).”
BackgroundMethodContextual interference effects on the acquisition, retention, and transfer of a motor skill.
Shea, J. B., & Morgan, R. L. (1979) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.5.2.179 · Cited by 1,227
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · cited 1×
“(cid:2) .94) and 1-week test–retest reliability for the measure (Spearman’s (cid:4) (cid:2) .90 [Evans et al., 2002]) are both high.”
BackgroundTherapist Success and Its Determinants
Luborsky, L. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790290084010 · Cited by 759
(2011) · Cited by 725
How psychotherapists develop: A study of therapeutic work and professional growth.
Orlinsky, D. E., Collaborative Research Network of the Society for Psychotherapy Research, & Rønnestad, M. H. (2005) · doi:10.1037/11157-000 · Cited by 621
Improving access to psychological therapy: initial evaluation of two UK demonstration sites
Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R., & Wright, B. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.010 · Cited by 599
CORE: Clinical Outcomes in Routine Evaluation
Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & McGrath, G. (2000) · Journal of Mental Health · doi:10.1080/713680250 · Cited by 560
Deliberate Practice Spells Success: Why Grittier Competitors Triumph at the National Spelling Bee
Duckworth, A. L., Kirby, T. A., Tsukayama, E., Berstein, H., & Ericsson, K. A. (2011) · Social Psychological and Personality Science · doi:10.1177/1948550610385872 · Cited by 560
A lab test and algorithms for identifying clients at risk for treatment failure
Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20108 · Cited by 542
Maintaining excellence: Deliberate practice and elite performance in young and older pianists.
Krampe, R. T., & Ericsson, K. A. (1996) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.125.4.331 · Cited by 540
The Acquisition of Expert Performance: An Introduction to Some of the Issues
Ericsson, K. A. (1996) · doi:10.4324/9781315805948-6 · Cited by 481
Wampold, B. E., & Brown, G. S. (. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.914 · Cited by 476
Lambert, M. J., & Shimokawa, K. (2011) · Psychotherapy · doi:10.1037/a0022238 · Cited by 452
An investigation of self-assessment bias in mental health providers
Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012) · Psychological Reports · doi:10.2466/02.07.17.pr0.110.2.639-644 · Cited by 394
Waiting for supershrink: an empirical analysis of therapist effects
Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.383 · Cited by 330
Côté, Ericsson, K. A., & Law, M. P. (2005) · Journal of Applied Sport Psychology · doi:10.1080/10413200590907531 · Cited by 323
The role of deliberate practice in chess expertise
Charness, N., Tuffiash, M., Krampe, R., Reingold, E., & Vasyukova, E. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1106 · Cited by 306
Characteristics of expert development in rhythmic gymnastics: a retrospective study.
Law, M. P., Côté, J., & Ericsson, K. A. (2007) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2008.9671814 · Cited by 270
Expertise in psychotherapy: An elusive goal?
Tracey, T. J. G., Wampold, B. E., Lichtenberg, J. W., & Goodyear, R. K. (2014) · American Psychologist · doi:10.1037/a0035099 · Cited by 265
Ericsson, K. A., Nandagopal, K., & Roring, R. W. (2009) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1393.001 · Cited by 229
Crits-Christoph, P., Gibbons, M. B. C., Hamilton, J., Ring-Kurtz, S., & Gallop, R. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0023668 · Cited by 220
(1996) · Cited by 218
The outcome of psychotherapy: Yesterday, today, and tomorrow.
Miller, S. D., Hubble, M. A., Chow, D. L., & Seidel, J. A. (2013) · Psychotherapy · doi:10.1037/a0031097 · Cited by 194
Self-citationExpertise in Medicine and Surgery
Norman, G., Eva, K., Brooks, L., & Hamstra, S. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.019 · Cited by 173
Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.698918 · Cited by 137
(2006) · Cited by 131
Ericsson, K. A. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609817.022 · Cited by 116
LEAVING IT AT THE OFFICE: A GUIDE TO PSYCHOTHERAPIST SELF-CARE
Norcross, J. C., & Guy, J. D. (2001) · Medical Entomology and Zoology · Cited by 111
Deliberate practice at work: A study with insurance agents
Sonnentag, S., & Kleine, B. M. (2000) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317900166895 · Cited by 111
A deliberate practice account of typing proficiency in everyday typists.
Keith, N., & Ericsson, K. A. (2007) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.13.3.135 · Cited by 101
Gobet, F. R., & Charness, N. H. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816796.030 · Cited by 97
Issues in teaching and learning time-limited psychodynamic psychotherapy
Binder, J. (1999) · Clinical Psychology Review · doi:10.1016/s0272-7358(98)00078-6 · Cited by 93
The therapist as a neglected variable in psychotherapy research.
Garfield, S. L. (1997) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1997.tb00097.x · Cited by 85
Small-Group Videotape Training for Psychotherapy Skills Development
Abbass, A. A. (2004) · Academic Psychiatry · doi:10.1176/appi.ap.28.2.151 · Cited by 68
Establishing Specificity in Psychotherapy Scientifically: Design and Evidence Issues
Wampold, B. E. (2005) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.bpi025 · Cited by 66
Differences among trainees in client outcomes associated with the phase model of change.
Budge, S. L., Owen, J. J., Kopta, S. M., Minami, T., Hanson, M., & Hirsch, G. S. (2012) · Psychotherapy · doi:10.1037/a0029565 · Cited by 49
Facilitating client change: Principles based upon the experience of eminent psychotherapists
Levitt, H. M., & Williams, D. C. (2010) · Psychotherapy Research · doi:10.1080/10503300903476708 · Cited by 47
Improving Physician–Patient Communication Through Coaching of Simulated Encounters
Ravitz, P., Lancee, W. J., Lawson, A., Maunder, R., Hunter, J., Leszcz, M., McNaughton, N., & Pain, C. (2013) · Academic Psychiatry · doi:10.1176/appi.ap.11070138 · Cited by 41
The study of supershrinks: development and deliberate practices of highly effective psychotherapists
Chow, D. L. (2014) · eSpace (Curtin University) · Cited by 29
Self-citationMastery and Expertise in Counseling
Skovholt, T. M., & Jennings, L. L. (2005) · Journal of Mental Health Counseling · doi:10.17744/mehc.27.1.gnblmy6g3dbqduq4 · Cited by 28
A five-year evaluation of the Human Givens therapy using a practice research network
Andrews, W. P., Wislocki, A. P., Short, F., Chow, D. L., & Minami, T. (2013) · Mental Health Review Journal · doi:10.1108/mhrj-04-2013-0011 · Cited by 16
Self-citation
Cited by
Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000131 · Cited by 278
Self-citationA systematic review of therapist effects: A critical narrative update and refinement to review
Johns, R. G., Barkham, M., Kellett, S., & Saxon, D. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.08.004 · Cited by 222
Hara, K. M., Aviram, A., Constantino, M. J., Westra, H. A., & Antony, M. M. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1253605 · Cited by 31
An Affair to Remember: A Mixed-Methods Survey Examining Therapists’ Experiences Treating Infidelity
Irvine, T. J., & Peluso, P. R. (2022) · The Family Journal · doi:10.1177/10664807211061826 · Cited by 14
Mental health care consumers’ relative valuing of clinician performance information.
Boswell, J. F., Constantino, M. J., Oswald, J. M., Bugatti, M., Goodwin, B., & Yucel, R. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000264 · Cited by 12
Metadata
- Authors
- Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P.
- Venue
- Psychotherapy
- Published
- 2015
- Volume
- 52
- Issue
- 3
- Pages
- 337-345
- ISSN
- 0033-3204 (ISSN-L)
- 1939-1536
- OpenAlex
- W2322431173
- Cited by
- 267
- References
- 53
- FWCI
- 24.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.