Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system.
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Outcome research has documented worsening among a minority of the patient population (5% to 10%). In this study, we conducted a meta-analytic and mega-analytic review of a psychotherapy quality assurance system intended to enhance outcomes in patients at risk of treatment failure. METHOD: Original data from six major studies conducted at a large university counseling center and a hospital outpatient setting (N = 6,151, mean age = 23.3 years, female = 63.2%, Caucasian = 85%) were reanalyzed to examine the effects of progress feedback on patient outcome. In this quality assurance system, the Outcome Questionnaire-45 was routinely administered to patients to monitor their therapeutic progress and was utilized as part of an early alert system to identify patients at risk of treatment failure. Patient progress feedback based on this alert system was provided to clinicians so that they could intervene before treatment failure occurred. Meta-analytic and mega-analytic approaches were applied in intent-to-treat and efficacy analyses of the effects of feedback interventions. RESULTS: Three forms of feedback interventions-integral elements of this quality assurance system-were effective in enhancing treatment outcome, especially for signal alarm patients. Two of the three feedback interventions were also effective in preventing treatment failure (clinical support tools and the provision of patient progress feedback to therapists). CONCLUSIONS: The current state of evidence appears to support the efficacy and effectiveness of feedback interventions in enhancing treatment outcome.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“therapist supervision and feedback can improve patient outcomes, 52,53”
From Canadian Network for Mood and Anxiety Treatments (CANMAT) 2016 Clinical Guidelines for the Management of Adults with Major Depressive Disorder (2016) · cites this paper as [52]
In the citing paper
“Using MBC results in more clinically effective,17 cost-effective,18 and efficient treatment.19”
From Using Machine Learning to Match Clients and Therapy Providers: Evaluating Clinical Quality and Cost of Care (2025) · cites this paper as [19]
Citations
Cites
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 1×
“Following recommendations by Overton (1998) and Hedges and Vevea (1998), we used a random-effects model, given that the research on providing feedback for the purpose of enhancing treatment outcome is relatively new in psychotherapy outcome literature, that studies included in this meta-analysis contained slight varia…”
MethodBergin and Garfield's Handbook of Psychotherapy and Behavior Change
Lambert, M. J. (2003) · Cited by 3,383
Self-citationFixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064
The psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783 · cited 1×
“Similarly, an argument can be made against causal statements based on the data of studies not directly compared in the same randomized trials, such as in the case of comparing the CST Fb group and the pooled TAU group in the studies of Harmon et al. (2007) and Slade et al.”
BackgroundSelf-citationÆgisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · cited 2×
“As has been repeatedly demonstrated in clinical research, any prediction relying on statistical or actuarial methods tends to fare better than clinical judgment alone (Ægisdóttir et al., 2006; Grove, 2005).”
Background
Cited by
Items 401–500 of 660
Horn, D. H. A. V., Goodman, J. D., Lynch, K. G., Bonn‐Miller, M. O., Thomas, T., Re, A. C. D., Babson, K. A., & McKay, J. R. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.113282 · Cited by 4
PACT : A protocol for assessment, mechanism‐based case formulation and treatment planning
Hagmayer, Y., Witteman, C. L. M., & Claes, L. (2021) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13540 · Cited by 5
“observed changes are as expected could be judged by comparing the patient's progress to similar patients using an electronic database.(28) Question 2 requests clinicians to reassess the mechanisms identified as relevant in the case formulation.”
MethodSenger, K., Rubel, J. A., Kleinstäuber, M., Schröder, A., Köck, K., Lambert, M. J., Lutz, W., & Heider, J. (2021) · Psychotherapy Research · doi:10.1080/10503307.2021.1993376 · Cited by 5
“…been known that patients who are at risk to have a poor treatment outcome can be identified early in treatment by using routine outcome monitoring systems which signal a risk of poor therapy response (Carlier et al., 2012; Delgadillo et al., 2018; Harmon et al., 2005; Shimokawa et al., 2010).”
BackgroundSelf-citationCiepliński, K. M., & Karkut-Rzondtkowska, J. (2019) · Zeitschrift für Psychodrama und Soziometrie · doi:10.1007/s11620-019-00480-w · Cited by 5
Lutz, W., Clausen, S. A., & Deisenhofer, A. (2019) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000518 · Cited by 7
Malins, S., Moghaddam, N. G., Morriss, R. K., & Schroder, T. A. (2019) · Psychotherapy Research · doi:10.1080/10503307.2019.1657250 · Cited by 6
“Current evidence from Randomized Controlled Trials (RCTs) and subsequent meta-analyses suggest that ROM can have beneficial effects for both treat-ment efficacy and efficiency (Delgadillo et al., 2018; Lambert, Whipple, & Kleinstäuber, 2018; Shimokawa, Lambert, & Smart, 2010).”
Smits, D., Stinckens, N., Luyckx, K., & Claes, L. (2015) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12086 · Cited by 9
Maier, L., Engesser, D., Petermann-Meyer, A., Paul, R., Reuter, K., & Singer, S. (2023) · PPmP Psychotherapie Psychosomatik Medizinische Psychologie · doi:10.1055/a-1850-1886 · Cited by 4
“[28] Shimokawa K, Lambert MJ, Smart DW.”
Forand, N. R., Nettiksimmons, J., Anton, M. T., Truxson, R., Vanderwood, K. K., & Green, B. (2025) · JMIR Formative Research · doi:10.2196/76264 · Cited by 6
Smith, A., Mangelsdorf, S. N., Baker, S. T. E., Jafari, J., Álvarez‐Jiménez, M., Hitchcock, C., & Cross, S. P. M. (2025) · Journal of Medical Internet Research · doi:10.2196/73793 · Cited by 4
“Evidence consistently shows that MBC contributes to improved outcomes by ensuring that interventions remain attuned to the evolving needs and priorities of the individual, thereby supporting long-term engagement and improved outcomes [84-86].”
Herman, T., Fine, E., Makol, B. A., Wang, M., Talbott, E., McLeod, B. D., Yusuf, A., & Reyes, A. D. L. (2025) · Behavioral Disorders · doi:10.1177/01987429251371074 · Cited by 4
“…measurement-based care, prior work indicates that progress feedback paradigms hold promise in connecting the content of services with data on patterns or changes in client functioning during the receipt of these services (e.g., Delgadillo et al., 2022; Lambert et al., 2003; Shimokawa et al., 2010).”
Hawkins, E. J., Danner, A. N., Malte, C. A., Painter, J. M., Lott, A. M. K., & Baer, J. S. (2018) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2018.07.001 · Cited by 4
Implications of Clinically Significant Change Research for Evidence‐Based Counseling Practice
Hatchett, G. T. (2021) · Journal of Counseling & Development · doi:10.1002/jcad.12398 · Cited by 6
Ko, H., Shin, J. H., & Cooper, L. D. (2022) · Assessment · doi:10.1177/10731911221115144 · Cited by 4
“In addition, it helps with early identification of failure, sudden gains, or changes that can, in turn, predict intervention outcomes and inform improvement efforts (Deschênes & Dugas, 2013; Fortney et al., 2017; Lambert et al., 2005; Shimokawa et al., 2010).”
BackgroundSwanson, L. M., Patel, P. D., Montalva, R., Bullard, K. H., Parikh, S. V., & Dalack, G. W. (2022) · Psychiatric Services · doi:10.1176/appi.ps.202200032 · Cited by 4
Pinsof, W. M., Zinbarg, R. E., He, Y., Goldsmith, J. Z., Latta, T. A., & Lebow, J. L. (2024) · Psychotherapy Research · doi:10.1080/10503307.2023.2283523 · Cited by 5
“In a meta-analysis of OQ-45 studies, Shimokawa et al. (2010) found that adding it to TAU significantly improved outcomes.”
Development and Validation of the Career Counseling Outcome Questionnaire in Two Clinical Settings
Milot‐Lapointe, F., & Corff, Y. L. (2024) · Journal of Career Assessment · doi:10.1177/10690727241299127 · Cited by 4
“Indeed, as it has been extensively demonstrated in meta-analyses in the fi eld of personal counseling (e.g., Shimokawa et al., 2010), clinical use of outcome measures helps counselors identify clients who are at risk of leaving counseling without clinical gains and improve counseling effectiveness.”
Predicting Youth Treatment Failure: An Investigation of Clinical Versus Actuarial Judgment
Salisbury, T. N. (2014) · ScholarsArchive (Brigham Young University) · Cited by 6
Rizvi, S. L. (2013) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2013.03.003 · Cited by 4
Predicting Change in an Integrated Dual Diagnosis Substance Abuse Intensive Outpatient Program
Wise, E. A., Streiner, D. L., & Gallop, R. (2017) · Substance Use & Misuse · doi:10.1080/10826084.2016.1264970 · Cited by 4
Predictors of non-responding in short-term psychodynamic group therapy
Jensen, H. H., Mortensen, E. L., & Lötz, M. (2017) · Nordic Psychology · doi:10.1080/19012276.2017.1323664 · Cited by 4
“A previous meta-analysis and mega-analytic review by Shimokawa, Lambert, and Smart (2010) concluded that therapist feedback of patient progress in the course of therapy, not only affected improvement of patients who initially failed to respond to therapy, but also increased the odds of experiencing…”
MethodEspel‐Huynh, H., Goldstein, C. M., Finnegan, O. L., Elwy, A. R., Wing, R. R., & Thomas, J. G. (2021) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-021-00206-6 · Cited by 4
Outcomes Assessment in Psychological Treatment: Spanish adaptation of OQ-45 (Outcome Questionnaire)
Castillo, I. I., & Penas, P. (2021) · Revista Latinoamericana de Psicología · doi:10.14349/rlp.2021.v53.7 · Cited by 4
Li, L., & Childs, A. W. (2021) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000555 · Cited by 5
Prozess und Outcome-Evaluation mithilfe des Synergetischen Navigationssystems (SNS)
Schiepek, G. K. (2022) · Psychotherapie-Wissenschaft · doi:10.30820/1664-9583-2022-1-51 · Cited by 6
“Ein häufig benutzter Ansatz nutzt den «Outcome Question-niare (OQ)», um Einzelverläufe mit einem Standardver-lauf («standard track») zu vergleichen und Abweichungen davon zu erkennen (z. B. Probst et al., 2013; Shimokawa et al., 2010).”
Do as I say, not as I do: Therapist Evaluation of a Practice and Supervision Aid
Kuo, P. B., Soma, C. S., Axford, K., Hirsch, T., Imel, Z. E., & Epps, J. V. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555185 · Cited by 6
Schiepek, G. K., Marinell, T., Aichhorn, W., Schöller, H. J., & Harrer, M. E. (2023) · Entropy · doi:10.3390/e25101403 · Cited by 6
“Out of the field of MPs, different studies gave evidence of nonlinear, chaotic, and self-organizing dynamics in clinical change (e.g., [25,37]), which supports the assumption that self-organization is a more general mechanism, not restricted to mindfulness dynamics.”
BackgroundKing, A. C., Harris-Lane, L. M., Bérubé, S., Burke, K., Churchill, A., Cornish, P. A., Goguen, B., Jaouich, A., & Rash, J. A. (2023) · International Journal of Mental Health Systems · doi:10.1186/s13033-023-00611-9 · Cited by 6
“The implementation of continuous progress monitoring may be effective in addressing this barrier given that it has proven beneficial to identify clients who are not progressing as expected and inform timely changes in the care plan [63].”
BackgroundWashburn, M., Parrish, D. E., Oxhandler, H. K., Ma, A. K., & Garrison, B. V. (2021) · Research on Social Work Practice · doi:10.1177/10497315211051623 · Cited by 4
“Most strikingly, Shimokawa, Lambert, and Smart (2010) synthesized outcomes for over 4000 patients participating in six rigorous clinical trials and determined that offering clients ongoing objective feedback regarding their progress was associated with positive treatment gains, particularly for…”
BackgroundTilden, T. (2018) · Familiendynamik · doi:10.21706/fd-43-4-320 · Cited by 4
Reyes, A. D. L., Talbott, E., Yusuf, A., Dryburgh, N. S. J., & Goodman, K. L. (2026) · Clinical Psychology Review · doi:10.1016/j.cpr.2026.102705 · Cited by 3
Familieterapiens fremtid – terapeuten mellem evidenskrav og udvikling
Bargmann, S. (2013) · Fokus på familien · doi:10.18261/issn0807-7487-2013-02-04 · Cited by 5
Sensitivity to change of the Systemic Therapy Inventory of Change (STIC) intersession scales
He, Y., Zinbarg, R. E., Goldsmith, J. Z., Williams, A. L., & Pinsof, W. M. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2244150 · Cited by 3
Steidtmann, D. K., Raffel, K. E., Green, J. D., MacPhee, E. R., Nagle-Yang, S. M., Schwenk, S., Cooke, D. L., Santisteban, A. C., & Dempsey, A. G. (2024) · Psychiatric Services · doi:10.1176/appi.ps.20240135 · Cited by 3
Bjurner, P., Isacsson, N. H., Abdesslem, F. B., Boman, M., Forsell, E., & Kaldo, V. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100816 · Cited by 3
“Continuous monitoring of symptoms has been used in several studies to detect patients at risk of being a non-responder in a more reliable way than psychotherapist's own predictions (Lambert, 2015) and has led to fewer failed treatments (Shimokawa et al., 2010).”
Predicting individual change during the course of treatment
Wise, E. A., Streiner, D. L., & Gallop, R. (2015) · Psychotherapy Research · doi:10.1080/10503307.2015.1104421 · Cited by 5
Dissemination in psychotherapy: The case of progress monitoring measures.
Knoll, M. L., & Fitzpatrick, M. R. (2020) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000242 · Cited by 4
Using Client and Supervision Feedback to Improve Supervision in Health Care
Mahon, D. (2022) · Counseling and Family Therapy Scholarship Review · doi:10.53309/2576-926x.1044 · Cited by 3
Anticipating and Planning for the Duration of Counseling
Hatchett, G. T. (2020) · Journal of Mental Health Counseling · doi:10.17744/mehc.42.1.01 · Cited by 5
Wie Forschung das Therapieren noch effektiver machen kann
Wampold, B. E. (2020) · Vandenhoeck & Ruprecht eBooks · doi:10.13109/9783666459115.17 · Cited by 3
Bradley, S. C., Doucet, R., Kohler, E., & Drapeau, M. (2016) · Santé mentale au Québec · doi:10.7202/1036099ar · Cited by 3
Jacob, J., Napoleone, E., Zamperoni, V., Levy, L., Barnard, M., & Wolpert, M. (2017) · Springer eBooks · doi:10.1007/978-3-319-50675-3_15 · Cited by 3
Psychological Assessment in Treatment
Maruish, M. E. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop210006 · Cited by 4
Psychological Treatment, Effectiveness of
Lambert, M. J., & Harmon, K. L. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.21078-7 · Cited by 3
Self-citationEvaluating the Efficacy of Client Feedback in Group Psychotherapy
Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2014) · PsycEXTRA Dataset · doi:10.1037/e533762014-001 · Cited by 4
Borgnolo, L. J., McKenna, S., Hickie, I. B., Varidel, M., Turner, A., Gorban, C., LaMonica, H. M., Chong, M. K., Capon, W., Dimitropoulos, G., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/67597 · Cited by 4
Stuit, F., Engelsbel, F., Boenink, A. D., Barneveld-Oudt, L., Beekman, A. T. F., & Metz, M. J. (2025) · Community Mental Health Journal · doi:10.1007/s10597-025-01535-z · Cited by 2
Negative events in psychotherapy: A narrative review
Ram, D., Manjunatha, N., & Math, S. B. (2026) · Industrial Psychiatry Journal · doi:10.4103/ipj.ipj_114_25 · Cited by 3
“[58] 1.”
Kamardina, A., Saunders, R., & Broglia, E. (2026) · Journal of Mental Health · doi:10.1080/09638237.2026.2622085 · Cited by 2
“This could support client monitoring and progress feedback, for example, identifying individuals who are “off-track”, which was shown to improve outcomes (Shimokawa et al., 2010).”
The zentensive: A psychodynamically oriented meditation retreat for psychotherapists.
Goldberg, S. B., & Sachter, L. D. (2018) · Practice Innovations · doi:10.1037/pri0000059 · Cited by 2
Einfluss von Verlaufsfeedback auf die Behandlungseffektivität ambulanter Psychotherapien
Schöttke, H., Unrath, M., & Uhlmann, C. (2019) · Verhaltenstherapie · doi:10.1159/000501176 · Cited by 2
Vos, M. M. W. K.-D., Colleye, L. C., Tiemens, B. G., Engelsbel, F., de Jong, K., Witteman, C. L. M., & Nugter, A. (2022) · Research in Psychotherapy Psychopathology Process and Outcome · doi:10.4081/ripppo.2022.647 · Cited by 3
“to increase when a clinical support tool is offered (Shimokawa et al., 2010).”
BackgroundMethodRoutine outcome monitoring (ROM) and feedback: Research review and recommendations.
Barkham, M., de Jong, K., Delgadillo, J., & Lutz, W. (2024) · American Psychological Association eBooks · doi:10.1037/0000409-026 · Cited by 3
Lampis, J., & Rocca, G. (2024) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70002 · Cited by 2
Erekson, D. M., Ogles, B. M., & Lambert, M. J. (2025) · CBT: science into practice · doi:10.1007/978-3-031-90428-8_5 · Cited by 2
Self-citationHet geheim van de smid: Visie van de behandelaar in de ggz op werkzame factoren in therapie
Meijer, Y., & de Haan, E. (2015) · Tijdschrift voor Psychotherapie · doi:10.1007/s12485-015-0003-1 · Cited by 2
How to Include Analytic Patients in Research and How This Affects Treatment
Clemence, A. J., Tillman, J. G., & Poston, J. M. (2015) · Psychoanalytic Inquiry · doi:10.1080/07351690.2015.987599 · Cited by 2
“, patients who evidence clinically significant improvement at posttest), can facilitate greater overall reductions in distress, and is associated with increased session attendance (Shimokawa et al., 2010).”
BackgroundInfluentialImplementering af Feedback Informed Treatment i institutioner
Christensen, A., & Dalgaard, M. (2013) · Fokus på familien · doi:10.18261/issn0807-7487-2013-04-06 · Cited by 2
Client Deterioration in Individual Psychotherapy: A Systematic Review
Lazar, E. (2017) · Cited by 6
Leverage points in evidence-based professional psychology training.
Warren, J. S., & Park, S. Y. (2018) · Training and Education in Professional Psychology · doi:10.1037/tep0000216 · Cited by 2
Lutz, W., Clausen, S. A., Bennemann, B., Zimmermann, D., Prinz, J. N., Rubel, J. A., & Deisenhofer, A. (2019) · Verhaltenstherapie · doi:10.1159/000501026 · Cited by 2
“Dies betrifft im Besonderen Lutz/Clausen/Bennemann/Zimmermann/ Prinz/Rubel/Deisenhofer Verhaltenstherapie 2019;29:145–154150 DOI: 10.1159/000501026 NOT-Patientinnen und -Patienten [Shimokawa et al., 2010; Lambert et al., 2018].”
BackgroundInfluentialBuckingham, S. L., Becker, K. D., Reding, M. E. J., Daleiden, E. L., & Chorpita, B. F. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00957-8 · Cited by 3
Choice, voice and collaboration: using preference accommodation and feedback in trauma therapy
Mahon, D. (2021) · Mental Health and Social Inclusion · doi:10.1108/mhsi-06-2021-0032 · Cited by 3
Gryesten, J. R., Poulsen, S., & Arnfred, S. (2022) · International Journal of Qualitative Methods · doi:10.1177/16094069221084786 · Cited by 2
“With regard to the identification of potential treatment failures, research shows that clinicians are not good at predicting which patients will end unremitted (Hannan et al., 2005; Shimokawa et al., 2010).”
BackgroundResultIntegration of Measurement-Based Care for Youth Depression and Suicidality Using VitalSign6
Mitchell, T. B., Wakefield, S. M., Rezaeizadeh, A., Minhajuddin, A., Pipes, R., Mayes, T. L., Elmore, J. S., & Trivedi, M. H. (2024) · Child Psychiatry & Human Development · doi:10.1007/s10578-024-01680-8 · Cited by 2
“Several review articles, including those with youth, have shown that MBC leads to better patient outcomes compared to usual care (e.g., Shimokawa et al. 2010; Tam and Ronan 2017; Waldrop and McGuinness 2017).”
The Effects of Using Clinical Support Tools to Prevent Treatment Failure
Washington, T. K. (2010) · ScholarsArchive (Brigham Young University) · Cited by 3
Outcome feedback technology helps therapists to tailor care
Glazebrook, C., & Davies, E. B. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30212-8 · Cited by 2
Balancing Access to Medications and Psychosocial Treatments
Areán, P. A., & Ratzliff, A. (2019) · Springer eBooks · doi:10.1007/978-3-030-11908-9_5 · Cited by 2
Deep learning v psychoterapii: Strojová analýza nahrávek terapeutických sezení
Masarykova univerzita, C. R., Řiháček, T., & Matějka, P. (2021) · E-psychologie · doi:10.29364/epsy.414 · Cited by 2
Categorização da quarta sessão de psicoterapias bem e mal sucedidas
Rossi, P. R. (2012) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.47.2012.tde-19072012-112658 · Cited by 10
Nurturing Expertise at Mental Health Agencies
Goldberg, S. B., Babins‐Wagner, R., & Miller, S. D. (2017) · Wiley eBooks · doi:10.1002/9781119165590.ch10 · Cited by 2
Attitudes toward standardized assessment among individuals who use substances
Leav, S., Revill, A. S., Anderson, L. E., Kidd, C., & Gullo, M. J. (2023) · Addiction Research & Theory · doi:10.1080/16066359.2023.2199205 · Cited by 2
“The therapeutic benefits of progress monitoring are supported by several meta-analyses (Shimokawa et al. 2010; Gondek et al. 2016; Lambert et al. 2018; de Jong et al. 2021).”
BackgroundPrediction of adolescent psychotherapy outcomes using youth- and caregiver-reported symptoms data
Henderson, C. E., Woodard, G. S., Simmonds‐Buckley, M., Christensen, M. R., Jensen‐Doss, A., Douglas, S. R., & Delgadillo, J. (2024) · Psychotherapy Research · doi:10.1080/10503307.2024.2394187 · Cited by 1
“There is substantial evidence in the adult literature that MBC is particularly effective for clients who are not-on-track (NOT) to improve, operationalized as a client’s level of symptomatology exceeding the expected trajectory (de Jong et al., 2021; Rognstad et al., 2023; Shimokawa et al., 2010).”
Rowe, C. L., Williams, A. R., & Bisaga, A. M. (2024) · Substance Use & Addiction Journal · doi:10.1177/29767342241283174 · Cited by 1
Towards an Integrated Approach to Evidence-Based Practice in Psychotherapy
Compare, A., & Tona, A. L. (2024) · Springer eBooks · doi:10.1007/978-3-031-71904-2_1 · Cited by 1
Using Patient Feedback in Psychotherapy and Training
Doorn, K. A. (2024) · Springer eBooks · doi:10.1007/978-3-031-71904-2_23 · Cited by 1
Askari, N., Gupta, R., Hussain‐Shamsy, N., Barker, L. C., Champagne, T., Lam, R. W. M., Bishop, K., Pirmohamed, J., Michalowska, M., Shah, V., et al. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06876-3 · Cited by 1
Pålerud, K. M., Helmich, M. A., Hoffart, A., Ebrahimi, O. V., Snuggerud, T. R., & Johnson, S. U. (2025) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70111 · Cited by 2
Demir, S., Brakemeier, E.-L., & Kaiser, T. (2025) · Cognitive Therapy and Research · doi:10.1007/s10608-025-10663-5 · Cited by 1
“(de Jong et al., 2021; Lambert et al., 2018; Rognstad et al., 2023; Shimokawa et al., 2010 ).”
Deterioration in mental health: towards a conceptualization based on patients’ perspectives
Låver, J., McAleavey, A. A., Valaker, I., Øien, J.-M. T., & Moltu, C. (2026) · International Journal of Qualitative Studies on Health and Well-Being · doi:10.1080/17482631.2026.2644587 · Cited by 1
“…as a predetermined numerical change in self-reported scale scores, for instance using the Reliable Change Index (RCI) and related definitions of clinically significant change (Honkalampi et al., 2025; Jacobson & Truax, 1991; Rozental et al., 2018; Shimokawa et al., 2010; Østergård et al., 2020).”
Der therapeutische Mehrwert von Prozessfeedback aus Sicht von Therapeut*innen und Patient*innen
Schiepek, G. K., Schöller, H. J., & Hülsner, Y. (2026) · Die Psychotherapie · doi:10.1007/s00278-026-00845-1 · Cited by 2
Braga, C. (2015) · Scholar Commons (University of South Carolina) · Cited by 1
Possible Negative Effects of Psychotherapies
Gülüm, İ. V. (2012) · Psikiyatride Guncel Yaklasimlar - Current Approaches in Psychiatry · doi:10.5455/cap.20120430
Routine Outcome Monitoring: ‘love it or leave it’?
de Jong, K., & Spijker, A. V. ’. (2013) · Tijdschrift voor Psychotherapie · doi:10.1007/s12485-013-0032-6 · Cited by 1
Yates, C. M. (2012) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 2
Jamshidi, P., & Sylvestre, J. C. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.104993 · Cited by 2
“Similarly, the work of Lambert and his colleagues has shown that tracking clients’ outcomes and using the information to intervene with clients who are not making expected progress can significantly decrease the odds of treatment failure and increase the odds of clients making improvements in their psychological well-…”
BackgroundTransforming Cultures to Enable Stage-Related Care of Mental Ill-Health
McGorry, P. D., Hickie, I. B., & Cross, S. P. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781139839518.013 · Cited by 2
Plant, C. P., Donohue, B. C., Freeman, A. J., & Allen, D. N. (2020) · Behavior Modification · doi:10.1177/0145445520935394 · Cited by 3
“…in-session behavior when seeking to 1032 Behavior Modification 45(6) reduce child maltreatment potential, and is consistent with studies that have found treatment provider feedback is associated with greater gains in treatment in adults (Shimokawa et al., 2010) and children (Bickman et al., 2011).”
BackgroundResultInfluentialInternal and External Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.003 · Cited by 1
Margraf, J., & Scholten, S. (2018) · Springer eBooks · doi:10.1007/978-3-662-54911-7_14 · Cited by 3
Hepner, K. A., Roth, C. P., O’Hanlon, C. E., & Marsolais, E. (2023) · RAND Corporation eBooks · doi:10.7249/rra2522-1 · Cited by 3
Reyes, A. D. L. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197686607.003.0023 · Cited by 1
Zhang, T., Buckman, J. E. J., Suh, J. W., Stott, J. C. H., Singh, S., Jena, R., Naqvi, S. A., Pilling, S., Cape, J. D., & Saunders, R. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.08.027 · Cited by 1
Johnson, L. N., Anderson, S. R., & Wagner, K. N. (2025) · European Journal of Mental Health · doi:10.5708/ejmh.20.2025.0036 · Cited by 2
“(Bickman et al., 2011; Shimokawa et al., 2010), doubling the amount of progress in couple cases (Anker et al., 2009; Reese et al., 2010), decreasing the number of sessions, and giving clients a voice in their therapy experience (Johnson et al., 2017).”
Demir, S., Brakemeier, E., & Kaiser, T. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2589387 · Cited by 1
Therapist Utilization of Evidence-Based Treatment Monitoring
Southwick, J. S. (2011) · ScholarsArchive (Brigham Young University) · Cited by 1
Shimokawa, K. (2010) · ScholarsArchive (Brigham Young University) · Cited by 2
Self-citationAllred, A. M. (2012) · ScholarsArchive (Brigham Young University) · Cited by 2
Monitorování účinnosti v psychoterapii a poradenství
Řiháček, T., & Juhová, D. S. (2016) · TESTFÓRUM · doi:10.5817/tf2016-7-99 · Cited by 3
Metadata
- Authors
- Shimokawa, K., Lambert, M. J., & Smart, D. W.
- Affiliations
- Brigham Young University (US)
- ORCID
- Lambert, Michael J.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2010
- Volume
- 78
- Issue
- 3
- Pages
- 298-311
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2143726303
- Semantic Scholar
- 94c5e3fb3707d960610a79e604c2b070280c0014
- Cited by
- 657
- References
- 38
- Citations by year
- 2026: 18 · 2025: 23 · 2024: 64 · 2023: 24 · 2022: 37 · 2021: 57 · 2020: 47 · 2019: 47 · 2018: 59 · 2017: 54 · 2016: 45 · 2015: 61 · 2014: 44 · 2013: 31 · 2012: 30
- FWCI
- 26.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Brigham Young University
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Keywords
- treatment failure, early alert systems, progress feedback, patient outcomes, Outcome Questionnaire-45, clinical support tools, therapist feedback, counseling centers
- MeSH terms
- Adult, Mental Disorders, Feedback, Female, Humans, Male, Psychology, Clinical, Psychotherapy, Quality Assurance, Health Care, Surveys and Questionnaires, Referral and Consultation, Risk, Outcome Assessment, Health Care, Treatment Failure, Disease Progression, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.