The DOI matches its Crossref record; 99 of the 99 references it cites were found in a registry or an index.
Expertise in psychotherapy: An elusive goal?
Abstract
It has been argued that psychotherapy is a profession without any expertise (Shanteau, 1992). We examine the validity of this claim, reviewing the literature on expertise, clinical decision making, and psychotherapeutic outcome assessment, and find it a reasonable assessment. There is no demonstration of accuracy and skill that is associated with experience as a therapist. We posit that this absence of an expertise-experience relation is attributable to therapists' lack of access to quality outcome information regarding their interventions and an overreliance on fallible information-processing strategies even when such outcome information is available. The research on providing outcome feedback is reviewed, and although it does relate to client improvement, it has not been shown to be associated with any gains in therapist skill or expertise. We propose a model of outcome information usage and specific a priori hypothesis testing as a means of developing expertise. (PsycINFO Database Record (c) 2014 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Human Inference: Strategies and Shortcomings of Social Judgment.
Cherniak, C., Nisbett, R., & Ross, L. (1983) · The Philosophical Review · doi:10.2307/2184495 · Cited by 4,196
Pintrich, P. R. (2003) · Journal of Educational Psychology · doi:10.1037/0022-0663.95.4.667 · Cited by 3,047
Misinformation and Its Correction: Continued Influence and Successful Debiasing
Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612451018 · Cited by 2,920
Conditions for intuitive expertise: A failure to disagree.
Kahneman, D., & Klein, G. (2009) · American Psychologist · doi:10.1037/a0016755 · Cited by 2,443
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
EXPERT AND EXCEPTIONAL PERFORMANCE: Evidence of Maximal Adaptation to Task Constraints
Ericsson, K. A., & Lehmann, A. C. (1996) · Annual Review of Psychology · doi:10.1146/annurev.psych.47.1.273 · Cited by 2,139
Hindsight is not equal to foresight: The effect of outcome knowledge on judgment under uncertainty.
Fischhoff, B. (1975) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.1.3.288 · Cited by 1,837
Ericsson, K. A. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.038 · Cited by 1,629
Why People Fail to Recognize Their Own Incompetence
Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003) · Current Directions in Psychological Science · doi:10.1111/1467-8721.01235 · Cited by 1,224
Kazdin, A. E. (2008) · American Psychologist · doi:10.1037/0003-066x.63.3.146 · Cited by 1,112
Overconfidence in case-study judgments.
Oskamp, S. (1965) · Journal of Consulting Psychology · doi:10.1037/h0022125 · Cited by 1,060
Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.620 · Cited by 873
Competence in experts: The role of task characteristics
Shanteau, J. (1992) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(92)90064-e · Cited by 864
Two Approaches to the Study of Experts' Characteristics
Chi, M. T. H. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.002 · Cited by 741
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737
Predicting the effect of cognitive therapy for depression: A study of unique and common factors.
Castonguay, L. G., Goldfried, M. R., Wiser, S., & Raue, P. J. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.64.3.497 · Cited by 718
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657
The heart and soul of change: Delivering what works in therapy (2nd ed.).
(2010) · American Psychological Association eBooks · doi:10.1037/12075-000 · Cited by 657
Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.842 · Cited by 646
Self-citationPatient-focused research: Using patient outcome data to enhance treatment effects.
Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.69.2.159 · Cited by 603
Simple models or simple processes? Some research on clinical judgments.
Goldberg, L. R. (1968) · American Psychologist · doi:10.1037/h0026206 · Cited by 578
Under what conditions does theory obstruct research progress?
Greenwald, A. G., Pratkanis, A. R., Leippe, M. R., & Baumgardner, M. H. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.216 · Cited by 574
Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1059 · Cited by 573
A lab test and algorithms for identifying clients at risk for treatment failure
Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20108 · Cited by 542
Specific vs Nonspecific Factors in Psychotherapy: A Controlled Study of Outcome
Strupp, H. H. (1979) · Archives of General Psychiatry · doi:10.1001/archpsyc.1979.01780100095009 · Cited by 486
Wampold, B. E., & Brown, G. S. (. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.914 · Cited by 476
Self-citationStudies of Expertise from Psychological Perspectives
Feltovich, P. J., Prietula, M. J., & Ericsson, K. A. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.004 · Cited by 467
Lambert, M. J., & Shimokawa, K. (2011) · Psychotherapy · doi:10.1037/a0022238 · Cited by 452
Studying the clinician: judgment research and psychological assessment
(1999) · Choice Reviews Online · doi:10.5860/choice.36-3045 · Cited by 444
Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0034332 · Cited by 443
Self-citationMeta‐Analysis of Therapist Effects in Psychotherapy Outcome Studies
Crits-Christoph, P., Baranackie, K., Kurcias, J., Beck, A., Carroll, K., Perry, K., Luborsky, L., McLellan, A., Woody, G., Thompson, L., et al. (1991) · Psychotherapy Research · doi:10.1080/10503309112331335511 · Cited by 433
Therapist effects: facilitative interpersonal skills as a predictor of therapist success.
Anderson, T., Ogles, Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20583 · Cited by 400
Eliminating the hindsight bias.
Arkes, H. R., Faust, D., Guilmette, T. J., & Hart, K. (1988) · Journal of Applied Psychology · doi:10.1037//0021-9010.73.2.305 · Cited by 396
An investigation of self-assessment bias in mental health providers
Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012) · Psychological Reports · doi:10.2466/02.07.17.pr0.110.2.639-644 · Cited by 394
Effects of training in time-limited dynamic psychotherapy: Changes in therapist behavior.
Henry, W. P., Butler, S. F., Strupp, H. H., & Schacht, T. E. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.3.434 · Cited by 383
On the solving of ill-structured problems.
Voss, J. F., & Post, T. A. (1988) · Cited by 369
Lilienfeld, S. O., Ritschel, L. A., Lynn, S. J., Cautin, R. L., & Latzman, R. D. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.09.008 · Cited by 341
Clinical Judgment and Decision Making
Garb, H. N. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143810 · Cited by 341
Impediments to accurate clinical judgment and possible ways to minimize their impact.
Arkes, H. R. (1981) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.49.3.323 · Cited by 340
Hindsight bias among physicians weighing the likelihood of diagnoses.
Arkes, H. R., Wortmann, R. L., Saville, P. D., & Harkness, A. R. (1981) · Journal of Applied Psychology · doi:10.1037//0021-9010.66.2.252 · Cited by 333
Waiting for supershrink: an empirical analysis of therapist effects
Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.383 · Cited by 330
Kim, D.-M., Wampold, B. E., & Bolt, D. M. (2006) · Psychotherapy Research · doi:10.1080/10503300500264911 · Cited by 330
Self-citationLambert, M. J. (2010) · American Psychological Association eBooks · doi:10.1037/12141-000 · Cited by 327
Graduate training in psychotherapy: Are therapy outcomes enhanced?
Stein, D. M., & Lambert, M. J. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.2.182 · Cited by 327
Meehl, P. E. (1956) · American Psychologist · doi:10.1037/h0044164 · Cited by 324
Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., & Hawkins, E. J. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20113 · Cited by 322
Problem-Solving Skill in the Social Sciences
Voss, J. F., Greene, T. R., Post, T. A., & Penner, B. C. (1983) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60099-7 · Cited by 288
Clinical judgment, clinical training, and professional experience.
Garb, H. N. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.387 · Cited by 275
The partners for change outcome management system
Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20111 · Cited by 264
Feedback to clinicians: Theory, research, and practice
Sapyta, J., Riemer, M., & Bickman, L. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20107 · Cited by 253
Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.5.747 · Cited by 249
Oskamp, S. (1962) · Psychological Monographs: General and Applied · doi:10.1037/h0093849 · Cited by 243
Therapist effects in outpatient psychotherapy: A three-level growth curve approach.
Lutz, W., Leon, S. C., Martinovich, Z., Lyons, J. S., & Stiles, W. B. (2007) · Journal of Counseling Psychology · doi:10.1037/0022-0167.54.1.32 · Cited by 233
Developing and Delivering Practice‐Based Evidence: A Guide for the Psychological Therapies
(2010) · Wiley eBooks · doi:10.1002/9780470687994 · Cited by 198
Evaluation, Diagnosis, and Prediction in Parole Decision Making
Carroll, J. S., Wiener, R. L., Coates, D., Galegher, J., & Alibrio, J. J. (1982) · Law & Society Review · doi:10.2307/3053536 · Cited by 195
When prophecy bends: The preference-expectation link in U.S. presidential elections, 1952-1980.
Granberg, D. O., & Brent, E. E. (1983) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.45.3.477 · Cited by 189
Comparative effectiveness of professional and paraprofessional helpers.
Ja, H., Cf, S., & Hj, R. (1984) · PubMed · Cited by 186
Clients: The neglected common factor in psychotherapy.
Bohart, A., & Tallman, K. (2010) · American Psychological Association eBooks · doi:10.1037/12075-003 · Cited by 186
Goldberg, L. R. (1959) · Journal of Consulting Psychology · doi:10.1037/h0048736 · Cited by 165
Saxon, D., & Barkham, M. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028898 · Cited by 163
The outcome of psychotherapy: Yesterday, today, and tomorrow.
Miller, S. D., Hubble, M. A., Chow, D. L., & Seidel, J. A. (2013) · Psychotherapy · doi:10.1037/a0031097 · Cited by 163
(2011) · doi:10.1177/0963721411421922 · Cited by 162
Boswell, J. F., Gallagher, M. W., Sauer-Zavala, S. E., Bullis, J. R., Gorman, J. M., Shear, M. K., Woods, S. W., & Barlow, D. H. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0031437 · Cited by 150
The Meta-Analysis of Clinical Judgment Project: Effects of Experience on Judgment Accuracy
Spengler, P. M., White, M. J., Ægisdóttir, S., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G. R., et al. (2007) · The Counseling Psychologist · doi:10.1177/0011000006295149 · Cited by 150
Gill, M. J., Jr. Swann William, B., & Silvera, D. H. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.5.1101 · Cited by 144
On the relationship between therapist experience and psychotherapy outcome
Stein, D. M. (1984) · Clinical Psychology Review · doi:10.1016/0272-7358(84)90025-4 · Cited by 134
Contextualizing psychotherapy as a healing practice: Culture, history, and methods
Wampold, B. E. (2001) · Applied and Preventive Psychology · doi:10.1017/s0962-1849(02)01001-6 · Cited by 131
Self-citationMinami, T., Wampold, B. E., Serlin, R. C., Hamilton, E. G., Brown, G. S. (., & Kircher, J. C. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.1.116 · Cited by 130
Self-citationNissen-Lie, H. A., Monsen, J. T., Ulleberg, P., & Rønnestad, M. H. (2013) · Psychotherapy Research · doi:10.1080/10503307.2012.735775 · Cited by 129
Clinical judgment and decision making in neuropsychology
Wedding, D., & Faust, D. (1989) · Archives of Clinical Neuropsychology · doi:10.1016/0887-6177(89)90016-4 · Cited by 128
Ericsson, K. A. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511609817.022 · Cited by 116
Testing Hypotheses about Other People
Snyder, M., & Campbell, B. (1980) · Personality and Social Psychology Bulletin · doi:10.1177/014616728063015 · Cited by 93
Medical School Performance of Initially Rejected Students
DeVaul, R. A., Jervey, F., Chappell, J. A., Caver, P., Short, B., & O'Keefe, S. (1987) · JAMA · doi:10.1001/jama.1987.03390010051027 · Cited by 86
Laska, K. M., Smith, T. L., Wislocki, A. P., Minami, T., & Wampold, B. E. (2013) · Journal of Counseling Psychology · doi:10.1037/a0031294 · Cited by 85
Self-citationBeutler, L. E. (1997) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1997.tb00098.x · Cited by 78
Outcome-Informed Clinical Work
Miller, S. D., Duncan, B. L., & Hubble, M. A. (2005) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195165791.003.0004 · Cited by 75
Strohmer, D. C., Shivy, V. A., & Chiodo, A. L. (1990) · Journal of Counseling Psychology · doi:10.1037/0022-0167.37.4.465 · Cited by 72
Haverkamp, B. E. (1993) · Journal of Counseling Psychology · doi:10.1037//0022-0167.40.3.303 · Cited by 68
Preventing anchoring errors in clinical judgment.
Friedlander, M. L., & Phillips, S. D. (1984) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.52.3.366 · Cited by 57
Supershrinks: What is the secret of their success?
Sd, M., Duncan, B. L., & Hubble, M. A. (2008) · Psychotherapy in Australia · Cited by 53
Differences among trainees in client outcomes associated with the phase model of change.
Budge, S. L., Owen, J. J., Kopta, S. M., Minami, T., Hanson, M., & Hirsch, G. S. (2012) · Psychotherapy · doi:10.1037/a0029565 · Cited by 49
Admission decisions and performance during medical school
Milstein, R. M., Wilkinson, L., Burrow, G. N., & Kessen, W. (1981) · Academic Medicine · doi:10.1097/00001888-198102000-00001 · Cited by 46
Intermediate Effects in Psychodiagnostic Classification
Witteman, C. L. M., & van den Bercken, J. H. L. (2007) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.23.1.56 · Cited by 44
Science and pseudoscience in clinical psychology: Initial thoughts, reflections, and considerations.
Lilienfeld, S. O., Lynn, S. J., & Lohr, J. M. (2003) · Cited by 44
Some considerations relative to nondirective counseling as therapy
Hathaway, S. R. (2000) · Journal of Clinical Psychology · Cited by 43
The Role of Experience in Professional Training and Development of Psychological Counsellors
Strasser, J., & Gruber, H. G. (2006) · Kluwer Academic Publishers eBooks · doi:10.1007/1-4020-2094-5_2 · Cited by 41
Williams, E. F., Dunning, D. A., & Kruger, J. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0032416 · Cited by 41
Fischer, P. A., Fischer, J., Weisweiler, S., & Frey, D. (2010) · British Journal of Social Psychology · doi:10.1348/014466610x499668 · Cited by 41
The study of clinical judgment: an ecological approach
Rock, D. L., Bransford, J. D., Maisto, S. A., & Morey, L. C. (1987) · Clinical Psychology Review · doi:10.1016/0272-7358(87)90011-0 · Cited by 39
Garb, H. N., & Boyle, P. A. (2003) · Cited by 39
Expertise: Acquisition, Limitations, and Control
Lewandowsky, S., & Thomas, J. L. (2009) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723409x448044 · Cited by 33
Davies, M. F. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.4.736 · Cited by 29
Groth‐Marnat, G., Roberts, R. J., & Beutler, L. E. (2001) · Australian Psychologist · doi:10.1080/00050060108259643 · Cited by 28
Assessing Diagnostic Expertise of Counselors Using the Cochran–Weiss–Shanteau (CWS) Index
Witteman, C. L. M., Weiss, D. J., & Metzmacher, M. (2012) · Journal of Counseling & Development · doi:10.1111/j.1556-6676.2012.00005.x · Cited by 26
Comment: Effects of Experience on Judgment Accuracy
Lichtenberg, J. W. (2007) · The Counseling Psychologist · doi:10.1177/0011000008330829 · Cited by 11
Self-citationFollies subdued: Informational efficiency under adaptive expectations and confirmatory bias
Aldashev, G., Carletti, T., & Righi, S. (2011) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.03.001 · Cited by 10
Cited by
Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000131 · Cited by 278
Self-citationThe role of deliberate practice in the development of highly effective psychotherapists.
Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P. (2015) · Psychotherapy · doi:10.1037/pst0000015 · Cited by 267
Lilienfeld, S. O., Ritschel, L. A., Lynn, S. J., Cautin, R. L., & Latzman, R. D. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614535216 · Cited by 191
Goldberg, S. B., Flemotomos, N., Martinez, V. R., Tanana, M. J., Kuo, P. B., Pace, B. T., Villatte, J. L., Georgiou, P. G., Van Epps, J., Imel, Z. E., et al. (2020) · Journal of Counseling Psychology · doi:10.1037/cou0000382 · Cited by 141
Designing Contestability: Interaction Design, Machine Learning, and Mental Health
Hirsch, T., Merced, K., Narayanan, S., Imel, Z. E., & Atkins, D. C. (2017) · Proceedings of the 2017 Conference on Designing Interactive Systems · doi:10.1145/3064663.3064703 · Cited by 110
Metadata
- Authors
- Tracey, T. J. G., Wampold, B. E., Lichtenberg, J. W., & Goodyear, R. K.
- Venue
- American Psychologist
- Published
- 2014
- Volume
- 69
- Issue
- 3
- Pages
- 218-229
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2319736527
- Cited by
- 265
- References
- 99
- FWCI
- 40.88
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.