Effect of Matching Therapists to Patients vs Assignment as Usual on Adult Psychotherapy Outcomes: A Randomized Clinical Trial
Open accessAbstract
Importance: Psychotherapists possess strengths and weaknesses in treating different mental health problems, yet performance information is rarely harnessed in mental health care (MHC). To our knowledge, no prior studies have tested the causal efficacy of prospectively matching patients to therapists with empirically derived strengths in treating patients' specific concerns. Objective: To test the effect of measurement-based matching vs case assignment as usual (CAU) on psychotherapy outcomes. Design, Setting, and Participants: In this randomized clinical trial, adult outpatients were recruited between November 2017 and April 2019. Assessments occurred at baseline and repeatedly during treatment at 6 community MHC clinics in Cleveland, Ohio. To be eligible, patients had to make their own MHC decisions. Of 1329 individuals screened, 288 were randomized. Excluding those who withdrew or provided no assessments beyond baseline, 218 patients treated by 48 therapists were included in the primary modified intent-to-treat analyses. Interventions: Therapist performance was assessed pretrial across 15 or more historical cases based on patients' pre-post reporting across 12 problem domains of the routinely administered Treatment Outcome Package (TOP). Therapists were classified in each domain as effective (on average, patients' symptoms reliably improved), neutral (on average, patients' symptoms neither reliably improved nor deteriorated), or ineffective (on average, patients' symptoms reliably deteriorated). Trial patients were randomly assigned to good-fitting therapists (matched group) or were assigned to therapists pragmatically (CAU group). There were multiple match levels, ranging from therapists being effective on the 3 most elevated domains reported by patients and not ineffective on any others (highest) to not effective on the most elevated domains reported by patients but also not ineffective on any domain (lowest). Therapists treated patients in the matched and CAU groups, and treatment was unmanipulated. Main Outcomes and Measures: General symptomatic and functional impairment across all TOP domains (average z scores relative to the general population mean; higher scores indicate greater impairment), global distress (Symptom Checklist-10; higher scores indicate greater distress), and domain-specific impairment on each individual's most elevated TOP-assessed problem. Results: Of 218 patients, 147 (67.4%) were female, and 193 (88.5%) were White. The mean (SD) age was 33.9 (11.2) years. Multilevel modeling indicated a match effect on reductions in weekly general symptomatic and functional impairment (γ110 = -0.03; 95% CI, -0.05 to -0.01; d = 0.75), global distress (γ110 = -0.16; 95% CI, -0.30 to -0.02; d = 0.50), and domain-specific impairment (γ110 = -0.01; 95% CI -0.01 to -0.006; d = 0.60), with no adverse events. Conclusions and Relevance: Matching patients with therapists based on therapists' performance strengths can improve MHC outcomes. Trial Registration: ClinicalTrials.gov Identifier: NCT02990000.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Clients experienced greater decrease in symptoms when matched with providers who had a history of treating their presenting concern effectively.
“Clients experienced greater decrease in symptoms when matched with providers who had a history of treating their presenting concern effectively.”
From Using Machine Learning to Match Clients and Therapy Providers: Evaluating Clinical Quality and Cost of Care (2025) · cites this paper as [21]
One clinical trial demonstrated that historical clinical performance data from providers can be leveraged to match clients with providers more effectively.
“One clinical trial evaluating such an algorithm demonstrated that historical clinical performance data from providers can be leveraged to match clients with providers more effectively.21”
From Using Machine Learning to Match Clients and Therapy Providers: Evaluating Clinical Quality and Cost of Care (2025) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 29 · Cited by 53
Research works printed but not linked: 21
- Institute of Medicine. Improving the Quality of Health Care for Mental and Substance-Use Conditions. National Academies Press; 2006.
- Thorpe KE, Florence CS, Joski P. Which medical conditions account for the rise in health care spending? Health Aff (Millwood). 2004;23(suppl 1): W4-437-445. doi:10.1377/hlthaff.W4.437 · DOI
- Kraus DR, Castonguay L, Boswell JF, Nordberg SS, Hayes JA. Therapist effectiveness: implications for accountability and patient care. Psychother Res. 2011;21(3):267-276. doi:10.1080/10503307.2011. 563249 · DOI
- Lambert MJ. The efficacy and effectiveness of psychotherapy. In: Lambert MJ, ed. Bergin & Garfield's Handbook of Psychotherapy and Behavior Change. 6th ed. Wiley; 2013:169-218.
- Firth N, Barkham M, Kellett S, Saxon D. Therapist effects and moderators of effectiveness and efficiency in psychological wellbeing practitioners: a multilevel modelling analysis. Behav Res Ther. 2015;69:54-62. doi:10.1016/j.brat.2015. 04.001 · DOI
- Imel ZE, Sheng E, Baldwin SA, Atkins DC. Removing very low-performing therapists: a simulation of performance-based retention in psychotherapy. Psychotherapy (Chic). 2015;52(3): 329-336. doi:10.1037/pst0000023 · DOI
- Saxon D, Barkham M. Patterns of therapist variability: therapist effects and the contribution of patient severity and risk. J Consult Clin Psychol. 2012;80(4):535-546. doi:10.1037/a0028898 · DOI
- Muir HJ, Coyne AE, Morrison NR, Boswell JF, Constantino MJ. Ethical implications of routine outcomes monitoring for patients, psychotherapists, and mental health care systems. Psychotherapy (Chic). 2019;56(4):459-469. doi:10.1037/pst0000246 · DOI
- Kraus DR, Bentley JH, Alexander PC, et al. Predicting therapist effectiveness from their own practice-based evidence. J Consult Clin Psychol. 2016;84(6):473-483. doi:10.1037/ccp0000083 · DOI · Paper page
- Boswell JF, Constantino MJ, Kraus DR, Bugatti M, Oswald JM. The expanding relevance of routinely collected outcome data for mental health care decision making. Adm Policy Ment Health. 2016;43(4):482-491. doi:10.1007/s10488-015- 0649-6 · DOI
- Boswell JF, Constantino MJ, Oswald JM, et al. A multi-method study of mental health care patients' attitudes toward clinician-level performance information. Psychiatr Serv. 2021;72 (4):452-456. doi:10.1176/appi.ps.202000366 · DOI · Paper page
- Boswell JF, Constantino MJ, Oswald JM, Bugatti M, Goodwin B, Yucel R. Mental health care consumers' relative valuing of clinician performance information. J Consult Clin Psychol. 2018;86(4): 301-308. doi:10.1037/ccp0000264 · DOI · Paper page
- Kraus DR, Seligman DA, Jordan JR. Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: the Treatment Outcome Package. J Clin Psychol. 2005;61(3):285-314. doi:10.1002/jclp.20084 · DOI
- Wampold BE, Brown GS. Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. J Consult Clin Psychol. 2005;73(5):914-923. doi:10.1037/0022- 006X.73.5.914 · DOI
- Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991;59(1):12-19. doi:10.1037/0022-006X. 59.1.12 · DOI · Paper page
- Rosen CS, Drescher KD, Moos RH, Finney JW, Murphy RT, Gusman F. Six-and ten-item indexes of psychological distress based on the Symptom Checklist-90. Assessment. 2000;7(2):103-111. doi:10.1177/107319110000700201 · DOI
- Allison PD. Missing data. In: Marsden PV, Wright JD, eds. Handbook of Survey Research. 2nd ed. Emerald Group Publishing; 2010:631-657.
- Tu JV, Donovan LR, Lee DS, et al. Effectiveness of public report cards for improving the quality of cardiac care: the EFFECT study: a randomized trial. JAMA. 2009;302(21):2330-2337. doi:10.1001/jama. 2009.1731 · DOI
- Farley DO, Elliott MN, Short PF, Damiano P, Kanouse DE, Hays RD. Effect of CAHPS performance information on health plan choices by Iowa Medicaid beneficiaries. Med Care Res Rev. 2002;59(3):319-336. doi:10.1177/ 107755870205900305 · DOI
- Rousmaniere T, Wright CV, Boswell J, et al. Keeping psychologists in the driver's seat: four perspectives on quality improvement and clinical data registries. Psychotherapy (Chic). 2020;57(4): 562-573. doi:10.1037/pst0000227 · DOI
- Constantino MJ, Vîslă A, Coyne AE, Boswell JF. A meta-analysis of the association between patients' early treatment outcome expectation and their posttreatment outcomes. Psychotherapy (Chic). 2018;55(4):473-485. doi:10.1037/pst0000169 · DOI
- Authors
- Constantino, M. J., Boswell, J. F., Coyne, A. E., Swales, T. P., & Kraus, D. R.
- Affiliations
- University of Massachusetts Amherst (US)
- State University of New York (US)
- Psychological and Behavioral Consultants, Beachwood, Ohio
- Outcome Referrals Inc, Framingham, Massachusetts
- Corresponding author
- Constantino, Michael J.
- Venue
- JAMA Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2021-09-01
- Volume
- 78
- Issue
- 9
- Pages
- 960
- ISSN
- 2168-622X (ISSN-L)
- PMC
- PMC8190692
- OpenAlex
- W3169134539
- Cited by
- 53
- References
- 29
- Citations by year
- 2026: 12 · 2025: 8 · 2024: 11 · 2023: 15 · 2022: 6 · 2021: 1
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- JAMA Psychiatry (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- psychotherapy outcome, case assignment, adult outpatients, mental health services, functional disability, community mental health centers, patient-reported outcomes
- MeSH terms
- Psychological Distress, Psychotherapists, Adult, Mental Disorders, Clinical Competence, Double-Blind Method, Female, Humans, Male, Middle Aged, Outcome and Process Assessment, Health Care, Professional-Patient Relations, Psychotherapy, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review