Implementing Measurement-Based Care in Behavioral Health: A Review

Lewis, Cara C.; Boyd, Meredith; Puspitasari, Ajeng; Navarro, Elena; Howard, Jacqueline; Kassab, Hannah; Hoffman, Mira; Scott, Kelli; Lyon, Aaron; Douglas, Susan; Simon, Greg; Kroenke, Kurt

doi:10.1001/jamapsychiatry.2018.3329

Cited by 606Health Policy Implementation SciencePsychotherapy Techniques and ApplicationsPsychiatric care and mental health services

Implementing Measurement-Based Care in Behavioral Health: A Review

Open access

Lewis, Cara C., Boyd, Meredith, Puspitasari, Ajeng, Navarro, Elena, Howard, Jacqueline, Kassab, Hannah, Hoffman, Mira, Scott, Kelli +4 more·2019·JAMA Psychiatry

DOI 10.1001/jamapsychiatry.2018.3329PMC PMC6584602

Open this paper in CoChat — free account

Abstract

Importance: Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up. Observations: Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives. Conclusions and Relevance: This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1001/jamapsychiatry.2018.3329

Cites

89 of 89 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

MBC has been associated with multi-faceted clinical benefits, including greater retention, engagement, and therapeutic alliances during treatment with better patient outcomes that occur more quickly and last longer than traditional care.
“MBC has been associated with multi-faceted clinical benefits, including greater retention, engagement, and therapeutic alliances during treatment with better patient outcomes that occur more quickly and last longer than traditional care (14-19).”
From Initial insights from a quality improvement initiative to develop an evidence-informed young adult substance use program (2022) · cites this paper as [14]
In “Effectiveness of MBC Over Usual Care” (page unavailable), the review reports better outcomes than usual care and faster symptom improvement in youth. “Mechanisms of Action for MBC” (page unavailable) describes enhanced engagement as suggested by qualitative work, but calls therapeutic alliance a hypothesis requiring investigation. The cited passages do not establish greater retention or that benefits last longer than with usual care. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Fewer than 20% of mental health practitioners use MBC consistently, and only 5% implement it at the recommended frequency.
“fewer than 20% of mental health practitioners use it consistently, and only 5% implement it at the recommended frequency [19]”
From Predictors and Correlates of Depression and Anxiety Symptom Trajectories in a Large Digital Mental Health Provider: Retrospective Analysis of Data From Rula Health (2025) · cites this paper as [19]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898 · see citing works
Self-citation
Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058 · see citing works
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254 · see citing works
Clinical versus mechanical prediction: a meta-analysis
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.1.19 · Cited by 1,640 · see citing works
Accelerating the Diffusion of Innovations Using Opinion Leaders
Valente, T. W., & Davis, R. (1999) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271629956600105 · Cited by 707 · see citing works
Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system.
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657 · see citing works
Is it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608 · see citing works
A Tipping Point for Measurement-Based Care
Fortney, J. C., Unützer, J., Wrenn, G. L., Pyne, J. M., Smith, G. R., Schoenbaum, M., & Harbin, H. T. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500439 · Cited by 568 · see citing works
Effects of pay for performance in health care: A systematic review of systematic reviews
Eijkenaar, F., Emmert, M., Scheppach, M., & Schöffski, O. (2013) · Health Policy · doi:10.1016/j.healthpol.2013.01.008 · Cited by 562 · see citing works
Incorporating Patient-Reported Outcomes Into Health Care To Engage Patients And Enhance Care
Lavallee, D. C., Chenok, K. E., Love, R. M., Petersen, C. C., Holve, E., Segal, C. D., & Franklin, P. D. (2016) · Health Affairs · doi:10.1377/hlthaff.2015.1362 · Cited by 549 · see citing works
Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494 · see citing works
Using Measurement-Based Care to Enhance Any Treatment
Scott, K., & Lewis, C. C. (2015) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.01.010 · Cited by 461 · see citing works
Self-citation
Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435 · see citing works
The Effects of Providing Therapists With Feedback on Patient Progress During Psychotherapy: Are Outcomes Enhanced?
Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001) · Psychotherapy Research · doi:10.1080/713663852 · Cited by 433 · see citing works
Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial
Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011) · Psychiatric Services · doi:10.1176/appi.ps.002052011 · Cited by 421 · see citing works
Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice.
Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003) · Journal of Counseling Psychology · doi:10.1037/0022-0167.50.1.59 · Cited by 374 · see citing works
Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting.
Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016062 · Cited by 347 · see citing works
Measurement-based care versus standard care for major depression: A randomized controlled trial with blind raters
Guo, T., Xiang, Y.-T., Xiao, L., Hu, C.-Q., Chiu, H. F. K., Ungvari, G. S., Correll, C. U., Lai, K. Y. C., Feng, L., Geng, Y., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14050652 · Cited by 308 · see citing works
Enhancing psychotherapy outcomes via providing feedback on client progress: a replication
Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.324 · Cited by 306 · see citing works
Clinicians and outcome measurement: What's the use?
Garland, A. F., Kruse, M. I., & Aarons, G. A. (2003) · The Journal of Behavioral Health Services & Research · doi:10.1007/bf02287427 · Cited by 298 · see citing works
A Measurement Feedback System (MFS) Is Necessary to Improve Mental Health Outcomes
Hamilton, J. D., & Bickman, L. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181825af8 · Cited by 270 · see citing works
Enhancing outcome for potential treatment failures: Therapist–client feedback and clinical support tools
Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E. J., Nielsen, S. L., Slade, K., & Lutz, W. (2007) · Psychotherapy Research · doi:10.1080/10503300600702331 · Cited by 268 · see citing works
Patient-reported Outcomes (PROs)
Snyder, C. F., Jensen, R. E., Segal, J. B., & Wu, A. W. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1d84 · Cited by 258 · see citing works
Monitoring Treatment Progress and Providing Feedback is Viewed Favorably but Rarely Used in Practice
Jensen‐Doss, A., Haimes, E. M. B., Smith, A. M., Lyon, A. R., Lewis, C. C., Stanick, C., & Hawley, K. M. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0763-0 · Cited by 256 · see citing works
Self-citation
Does a continuous feedback system improve psychotherapy outcome?
Reese, R. J., Norsworthy, L., & Rowlands, S. R. (2009) · Psychotherapy · doi:10.1037/a0017901 · Cited by 243 · see citing works
Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults
Kendrick, T., El-Gohary, M., Stuart, B. L., Gilbody, S. M., Churchill, R. C., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A. L., de Jong, K., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011119.pub2 · Cited by 237 · see citing works
Psychiatrists in the UK do not use outcomes measures
Gilbody, S. M., House, A. O., & Sheldon, T. (2002) · The British Journal of Psychiatry · doi:10.1192/bjp.180.2.101 · Cited by 231 · see citing works
Closing the false divide: sustainable approaches to integrating mental health services into primary care
Kroenke, K., & Unutzer, J. (2017) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3967-9 · Cited by 231 · see citing works
Self-citation
The therapeutic effects of providing patient progress information to therapists and patients
Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004) · Psychotherapy Research · doi:10.1093/ptr/kph027 · Cited by 230 · see citing works
Does providing feedback on patient-reported outcomes to healthcare professionals result in better outcomes for patients? A systematic review
Boyce, M., & Browne, J. P. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0390-0 · Cited by 228 · see citing works
Free, Brief, and Validated: Standardized Instruments for Low-Resource Mental Health Settings
Beidas, R. S., Stewart, R. E., Walsh, L., Lucas, S., Downey, M. M., Jackson, K., Fernandez, T., & Mandell, D. S. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.02.002 · Cited by 225 · see citing works
The Role of Technical Advances in the Adoption and Integration of Patient-reported Outcomes in Clinical Care
Jensen, R. E., Rothrock, N. E., DeWitt, E. M., Spiegel, B. M. R., Tucker, C. A., Crane, H. M., Forrest, C. B., Patrick, D. L., Fredericksen, R. J., Shulman, L. M., et al. (2015) · Medical Care · doi:10.1097/mlr.0000000000000289 · Cited by 217 · see citing works
Patients' and doctors' views on depression severity questionnaires incentivised in UK quality and outcomes framework: qualitative study
Dowrick, C., Leydon, G. M., McBride, A., Howe, A., Burgess, H., Clarke, P., Maisey, S., & Kendrick, T. (2009) · BMJ · doi:10.1136/bmj.b663 · Cited by 213 · see citing works
Routine outcome monitoring in the Netherlands: practical experiences with a web‐based strategy for the assessment of treatment outcome in clinical practice
de Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E. M., & Zitman, F. G. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.696 · Cited by 195 · see citing works
Why Don't Psychiatrists Use Scales to Measure Outcome When Treating Depressed Patients?
Zimmerman, M., & McGlinchey, J. B. (2008) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v69n1209 · Cited by 179 · cited 1× · see citing works
“CONCLUSIONS AND RELEVANCE This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC’s core components; (2) develop criterion standard methods for monitoring fidelity and reporting qual…”
Effect of client feedback on couple psychotherapy outcomes.
Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010) · Psychotherapy · doi:10.1037/a0021182 · Cited by 167 · see citing works
Quality Improvement With Pay-for-Performance Incentives in Integrated Behavioral Health Care
Unützer, J., Chan, Y.-F., Hafer, E., Knaster, J., Shields, A., Powers, D., & Veith, R. C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300555 · Cited by 167 · see citing works
Why Some Clinicians Use Outcome Measures and Others Do Not
Hatfield, D. R., & Ogles, B. M. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0110-y · Cited by 164 · see citing works
Feedback from Outcome Measures and Treatment Effectiveness, Treatment Efficiency, and Collaborative Practice: A Systematic Review
Gondek, D., Edbrooke-Childs, J. H., Fink, E., Deighton, J., & Wolpert, M. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0710-5 · Cited by 159 · see citing works
Improving Community-Based Mental Health Care for Children: Translating Knowledge into Action
Garland, A. F., Haine‐Schlagel, R., Brookman-Frazee, L. I., Baker-Ericzén, M. J., Trask, E. V., & Fawley-King, K. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0450-8 · Cited by 144 · see citing works
Using Feedback From Patient-Reported Outcome Measures in Mental Health Services: A Scoping Study and Typology
Krägeloh, C. U., Czuba, K., Billington, D. R., Kersten, P., & Siegert, R. J. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201400141 · Cited by 142 · see citing works
Patient-Reported Outcomes Assessment in Cancer Trials: Taking Stock, Moving Forward
Lipscomb, J., Reeve, B. B., Clauser, S. B., Abrams, J. S., Bruner, D. W., Burke, L. B., Denicoff, A. M., Ganz, P. A., Gondek, K., Minasian, L. M., et al. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2007.12.4644 · Cited by 135 · see citing works
Implementing a Measurement Feedback System: A Tale of Two Sites
Bickman, L., Douglas, S. R., de Andrade, A. R. V., Tomlinson, M. M., Gleacher, A. A., Olin, S.-C. S., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0647-8 · Cited by 134 · see citing works
Self-citation
Patient-reported outcome measures: literature review
Williams, K., Sansoni, J., Morris, D., Grootemaat, P. E., & Thompson, C. J. (2016) · Research Online (University of Wollongong) · Cited by 117 · see citing works
Implementation teams: A new lever for organizational change
Higgins, M. C., Weiner, J. M., & Young, L. V. (2012) · Journal of Organizational Behavior · doi:10.1002/job.1773 · Cited by 112 · see citing works
Understanding Clinicians’ Diagnostic Practices: Attitudes Toward the Utility of Diagnosis and Standardized Diagnostic Tools
Jensen‐Doss, A., & Hawley, K. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0334-3 · Cited by 112 · see citing works
Challenges and Opportunities in Measuring the Quality of Mental Health Care
Kilbourne, A. M., Keyser, D. J., & Pincus, H. A. (2010) · The Canadian Journal of Psychiatry · doi:10.1177/070674371005500903 · Cited by 110 · see citing works
A Self-Report Symptom and Problem Rating Scale to Increase Inpatients' Involvement in Treatment
Eisen, S. V., Dickey, B., & Sederer, L. I. (2000) · Psychiatric Services · doi:10.1176/appi.ps.51.3.349 · Cited by 106 · see citing works
Uses and Abuses of Patient Reported Outcome Measures (PROMs): Potential Iatrogenic Impact of PROMs Implementation and How It Can Be Mitigated
Wolpert, M. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0509-1 · Cited by 99 · see citing works
The application of a feedback-informed approach in psychological service with youth: Systematic review and meta-analysis
Tam, H. E., & Ronan, K. R. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.04.005 · Cited by 97 · see citing works
Implementing a Measurement Feedback System in Community Mental Health Clinics: A Case Study of Multilevel Barriers and Facilitators
Gleacher, A. A., Olin, S.-C. S., Nadeem, E., Pollock, M., Ringle, V. A. M., Bickman, L., Douglas, S. R., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0642-0 · Cited by 90 · see citing works
Self-citation
Capabilities and Characteristics of Digital Measurement Feedback Systems: Results from a Comprehensive Review
Lyon, A. R., Lewis, C. C., Boyd, M. R., Hendrix, E., & Liu, F. F. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0719-4 · Cited by 88 · see citing works
Self-citation
Efficacy of client feedback in group psychotherapy with soldiers referred for substance abuse treatment
Schuman, D. L., Slone, N. C., Reese, R. J., & Duncan, B. L. (2014) · Psychotherapy Research · doi:10.1080/10503307.2014.900875 · Cited by 87 · see citing works
Progress monitoring in mental health and addiction treatment: A means of improving care.
Goodman, J. D., McKay, J. R., & DePhilippis, D. (2013) · Professional Psychology Research and Practice · doi:10.1037/a0032605 · Cited by 83 · see citing works
Improving the efficiency of psychological treatment using outcome feedback technology
Delgadillo, J., Overend, K., Lucock, M. P., Groom, M., Kirby, N., McMillan, D., Gilbody, S. M., Lutz, W., Rubel, J. A., & de Jong, K. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.09.011 · Cited by 81 · see citing works
Pay for Performance in Behavioral Health
Bremer, R. W., Scholle, S. H., Keyser, D. J., Houtsinger, J. K., & Pincus, H. A. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.12.1419 · Cited by 80 · see citing works
A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs
Crits-Christoph, P. F., Ring‐Kurtz, S., Hamilton, J. L., Lambert, M. J., Gallop, R., McClure, B., Kulaga, A., & Rotrosen, J. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.09.003 · Cited by 74 · see citing works
Implementing measurement-based care (iMBC) for depression in community mental health: a dynamic cluster randomized trial study protocol
Lewis, C. C., Scott, K., Marti, C. N., Marriott, B. R., Kroenke, K., Putz, J. W., Mendel, P. J., & Rutkowski, D. (2015) · Implementation Science · doi:10.1186/s13012-015-0313-2 · Cited by 70 · see citing works
Self-citation
Evaluating the efficacy of client feedback in group psychotherapy.
Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015) · Group Dynamics Theory Research and Practice · doi:10.1037/gdn0000026 · Cited by 68 · see citing works
Improving the efficiency of cognitive-behavioural therapy by using formal client feedback
Janse, P. D., de Jong, K., van Dijk, M. K., Hutschemaekers, G. J. M., & Verbraak, M. J. P. M. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1152408 · Cited by 65 · see citing works
Taking PROs and patient-centered care seriously: incremental and disruptive ideas for incorporating PROs in oncology practice
Donaldson, M. S. (2008) · Quality of Life Research · doi:10.1007/s11136-008-9414-6 · Cited by 64 · see citing works
The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems
Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., & McCauley, E. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0637-x · Cited by 63 · see citing works
Self-citation
Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study
Simon, W., Lambert, M. J., Busath, G. L., Vazquez, A., Berkeljon, A., Hyer, K., Granley, M., & Berrett, M. E. (2013) · Psychotherapy Research · doi:10.1080/10503307.2013.787497 · Cited by 61 · see citing works
Client Progress Monitoring and Feedback in School-Based Mental Health
Borntrager, C. F., & Lyon, A. R. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.03.007 · Cited by 61 · see citing works
Self-citation
Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice
Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Göllner, R., & Tritt, K. (2013) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2013.07.003 · Cited by 58 · see citing works
Using Patient Reported Outcome Measures to Improve Service Effectiveness (UPROMISE): Training clinicians to Use Outcome Measures in Child Mental Health
Edbrooke-Childs, J. H., Wolpert, M., & Deighton, J. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0600-2 · Cited by 54 · see citing works
Patient-reported outcomes are changing the landscape in oncology care: challenges and opportunities for payers.
Zagadailov, E. A., Fine, M. J., & Shields, A. L. (2013) · PubMed Central · Cited by 51 · see citing works
Measurement-Based Care in Psychiatry
Waldrop, J., & McGuinness, T. M. (2017) · Journal of Psychosocial Nursing and Mental Health Services · doi:10.3928/02793695-20170818-01 · Cited by 43 · see citing works
Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content
Douglas, S. R., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R., & Bickman, L. (2015) · Psychotherapy Research · doi:10.1080/10503307.2015.1059966 · Cited by 42 · see citing works
Self-citation
Adverse Effects of Outcome Monitoring Feedback in Patients With Personality Disorders: A Randomized Controlled Trial in Day Treatment and Inpatient Settings
de Jong, K., Segaar, J. A., Ingenhoven, T., Busschbach, J. J. V., & Timman, R. (2017) · Journal of Personality Disorders · doi:10.1521/pedi_2017_31_297 · Cited by 42 · see citing works
Factors Influencing Consumer Outcome Monitoring in Implementation of Evidence-Based Practices: Results from the National EBP Implementation Project
Marty, D., Rapp, C., McHugo, G. J., & Whitley, R. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0157-4 · Cited by 41 · see citing works
A Digital Feedback System to Support Implementation of Measurement-Based Care by School-Based Mental Health Clinicians
Lyon, A. R., Pullmann, M. D., Whitaker, K. M., Ludwig, K. A., Wasse, J. K., & McCauley, E. (2017) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2017.1280808 · Cited by 41 · see citing works
Self-citation
A Peer Review Feedback Method of Promoting Compliance with Preventive Care Guidelines in a Resident Ambulatory Care Clinic
Goebel, L. J. (1997) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30309-1 · Cited by 40 · see citing works
Increasing psychotherapists' adoption and implementation of the evidence-based practice of progress monitoring
Persons, J. B., Koerner, K., Eidelman, P., Thomas, C., & Liu, H. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.11.004 · Cited by 38 · see citing works
Deriving Implementation Strategies for Outcome Monitoring Feedback from Theory, Research and Practice
de Jong, K. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0589-6 · Cited by 37 · see citing works
A Systematic Overview of Measurement-Based Care in the Treatment of Childhood and Adolescent Depression
Elmquist, J., Melton, T., Croarkin, P. E., & McClintock, S. M. (2010) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000386908.07160.91 · Cited by 36 · see citing works
Self-Compassion Mediates the Relationship Between Mindfulness and Borderline Personality Disorder Symptoms
Scheibner, H. J., Daniels, A., Guendelman, S., Utz, F., & Bermpohl, F. (2017) · Journal of Personality Disorders · doi:10.1521/pedi_2017_31_331 · Cited by 36 · see citing works
Implementing measurement based care in community mental health: a description of tailored and standardized methods
Lewis, C. C., Puspitasari, A. J., Boyd, M. R., Scott, K., Marriott, B. R., Hoffman, M., Navarro, E., & Kassab, H. D. (2018) · BMC Research Notes · doi:10.1186/s13104-018-3193-0 · Cited by 36 · see citing works
Self-citation
Extreme deviations from expected recovery curves and their associations with therapeutic alliance, social support, motivation, and life events in psychosomatic in-patient therapy
Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., & Tritt, K. (2015) · Psychotherapy Research · doi:10.1080/10503307.2014.981682 · Cited by 35 · see citing works
Feedback-informed treatment in emergency psychiatry; a randomised controlled trial
van Oenen, F. J., Schipper, S., Van, R., Schoevers, R. A., Visch, I., Peen, J., & Dekker, J. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0811-z · Cited by 35 · see citing works
Progress Monitoring in an Integrated Health Care System: Tracking Behavioral Health Vital Signs
Steinfeld, B. I., Franklin, A., Mercer, B. M., Fraynt, R. J., & Simon, G. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0648-7 · Cited by 31 · see citing works
Self-citation
Using Mental Health Outcome Measures in Everyday Clinical Practice
Patterson, P., Matthey, S., & Baker, M. K. (2006) · Australasian Psychiatry · doi:10.1080/j.1440-1665.2006.02266.x · Cited by 30 · see citing works
The relationship between progress feedback and therapeutic outcome in student counselling: A randomised control trial
Murphy, K. P., Rashleigh, C. M., & Timulák, L. (2012) · Counselling Psychology Quarterly · doi:10.1080/09515070.2012.662349 · Cited by 28 · see citing works
Context-dependent accountability strategies to improve the transfer of training: A proposed theoretical model and research propositions
Grossman, R., & Burke-Smalley, L. A. (2017) · Human Resource Management Review · doi:10.1016/j.hrmr.2017.08.001 · Cited by 26 · see citing works
A Curriculum in Measurement-Based Care: Screening and Monitoring of Depression in a Psychiatric Resident Clinic
Arbuckle, M. R., Weinberg, M., Kistler, S. C., Cabaniss, D. L., Isaacs, A., Sederer, L. I., & Essock, S. M. (2013) · Academic Psychiatry · doi:10.1176/appi.ap.12080152 · Cited by 18 · see citing works
Introduction to the special section on child and adolescent psychotherapy research
Midgley, N., Capella, C., Goodman, G., Lis, A., Noom, M. J., Tishby, O., & Weitkamp, K. (2017) · Psychotherapy Research · doi:10.1080/10503307.2017.1380864 · Cited by 14 · see citing works
Cognitive functioning and cortisol suppression in recurrent major depression
Hansson, P. B., Murison, R. C. C., Lund, A., & Hammar, Å. (2013) · PsyCh Journal · doi:10.1002/pchj.29 · Cited by 12 · see citing works
A conceptual model for generating and validating in-session clinical judgments
Jacinto, S., Lewis, C. C., Braga, J. N., & Scott, K. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1169329 · Cited by 3 · see citing works
Self-citation

Flagged first, then by citations

1 of the 90 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

[86]Glasziou PP, Buchan H, Del Mar C, Pay for performance: how to make it worth doing. BMJ 2012; 345(7870): 22– 25.

Sorted by citations

Mental health and clinical psychological science in the time of COVID-19: Challenges, opportunities, and a call to action
Gruber, J., Prinstein, M. J., Clark, L. A., Rottenberg, J., Abramowitz, J. S., Albano, A. M., Aldao, A., Borelli, J. L., Chung, T., Davila, J., et al. (2021) · American Psychologist · doi:10.1037/amp0000707 · Cited by 697 · see citing works
Canadian Network for Mood and Anxiety Treatments (CANMAT) 2023 Update on Clinical Guidelines for Management of Major Depressive Disorder in Adults: Réseau canadien pour les traitements de l'humeur et de l'anxiété (CANMAT) 2023 : Mise à jour des lignes directrices cliniques pour la prise en charge du trouble dépressif majeur chez les adultes
Lam, R. W. M., Kennedy, S. H., Adams, G. C., Bahji, A., Beaulieu, S., Bhat, V., Blier, P., Blumberger, D. M., Brietzke, E. M., Chakrabarty, T., et al. (2024) · The Canadian Journal of Psychiatry · doi:10.1177/07067437241245384 · Cited by 408 · see citing works
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251 · see citing works
Hazardous drinking and alcohol use disorders
MacKillop, J. M., Agabio, R., Ewing, S. W. F., Heilig, M. A., Kelly, J. F., Leggio, L., Lingford-Hughes, A. R., Palmer, A. A., Parry, C. D. H., Ray, L. A., et al. (2022) · Nature Reviews Disease Primers · doi:10.1038/s41572-022-00406-1 · Cited by 235 · see citing works
Clinical Practice Guideline for the Assessment and Treatment of Children and Adolescents With Major and Persistent Depressive Disorders
Walter, H. J., Abright, A. R., Bukstein, O. G., Diamond, J., Keable, H., Ripperger-Suhler, J. A., & Rockhill, C. (2022) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2022.10.001 · Cited by 200 · see citing works
Perceived benefits and limitations of using patient-reported outcome measures in clinical practice with individual patients: a systematic review of qualitative studies
Campbell, R., Ju, A., King, M. T., & Rutherford, C. (2022) · Quality of Life Research · doi:10.1007/s11136-021-03003-z · Cited by 188 · see citing works
Improving mental health services: a 50-year journey from randomized experiments to artificial intelligence and precision mental health
Bickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184 · see citing works
Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations
Barkham, M., de Jong, K., Delgadillo, J., & Lutz, W. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2181114 · Cited by 173 · see citing works
Collaborative mental health care: A narrative review
Reist, C., Petiwala, I., Latimer, J., Raffaelli, S. B., Chiang, M., Eisenberg, D., & Campbell, S. (2022) · Medicine · doi:10.1097/md.0000000000032554 · Cited by 162 · see citing works
Population-Based Approaches to Mental Health: History, Strategies, and Evidence
Purtle, J., Nelson, K. L., Counts, N. Z., & Yudell, M. (2020) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040119-094247 · Cited by 157 · see citing works
Minimally important differences and severity thresholds are estimated for the PROMIS depression scales from three randomized clinical trials
Kroenke, K., Stump, T. E., Chen, C. X., Kean, J., Bair, M. J., Damush, T. M., Krebs, E. E., & Monahan, P. O. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.101 · Cited by 131 · see citing works
Self-citation
The Needs-to-Goals Gap: How informant discrepancies in youth mental health assessments impact service delivery
Reyes, A. D. L., Talbott, E., Power, T. J., Michel, J. J., Cook, C. R., Racz, S. J., & Fitzpatrick, O. M. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102114 · Cited by 131 · see citing works
Understanding the Role of Clinical Champions and Their Impact on Clinician Behavior Change: The Need for Causal Pathway Mechanisms
Morena, A., Gaias, L. M., & Larkin, C. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.896885 · Cited by 114 · see citing works
A Development Pathway Towards Precision Mental Health Care
Delgadillo, J., & Lutz, W. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1048 · Cited by 108 · see citing works
Findings from World Mental Health Surveys of the perceived helpfulness of treatment for patients with major depressive disorder
Harris, M. G., Kazdin, A. E., Chiu, W. T., Sampson, N. A., Aguilar-Gaxiola, S., Al-Hamzawi, A., Alonso, J., Altwaijri, Y., Andrade, L. H., Cardoso, G., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1107 · Cited by 100 · see citing works
Self-citation
Comparative Responsiveness and Minimally Important Difference of Common Anxiety Measures
Kroenke, K., Baye, F. M., & Lourens, S. G. (2019) · Medical Care · doi:10.1097/mlr.0000000000001185 · Cited by 97 · see citing works
Self-citation
The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability
Lyon, A. R., Coifman, J., Cook, H., McRee, E., Liu, F. F., Ludwig, K. A., Dorsey, S., Koerner, K., Munson, S. A., & McCauley, E. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00183-0 · Cited by 89 · see citing works
Self-citation
The Coronavirus Impact Scale: Construction, Validation, and Comparisons in Diverse Clinical Samples
Stoddard, J., Reynolds, E. K., Paris, R., Haller, S. P., Johnson, S. B., Zik, J. B., Elliotte, E., Maru, M., Jaffe, A., Mallidi, A., et al. (2023) · JAACAP Open · doi:10.1016/j.jaacop.2023.03.003 · Cited by 87 · see citing works
Toward a Unified Framework for Positive Psychology Interventions: Evidence-Based Processes of Change in Coaching, Prevention, and Training
Ciarrochi, J., Hayes, S. C., Oades, L. G., & Hofmann, S. G. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.809362 · Cited by 95 · see citing works
Assessing the accuracy of automatic speech recognition for psychotherapy
Miner, A. S., Haque, A., Fries, J., Fleming, S. L., Wilfley, D. E., Wilson, G. T., Milstein, A. S., Jurafsky, D., Arnow, B. A., Agras, W. S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0285-8 · Cited by 82 · see citing works
Measurement-based Care as a Practice Improvement Tool: Clinical and Organizational Applications in Youth Mental Health
Jensen‐Doss, A., Douglas, S. R., Phillips, D. A., Gencdur, O., Zalman, A., & Gomez, N. E. (2020) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2020.1784062 · Cited by 71 · see citing works
Self-citation
What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals
Connors, E. H., Douglas, S. R., Jensen‐Doss, A., Landes, S. J., Lewis, C. C., McLeod, B. D., Stanick, C., & Lyon, A. R. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01063-w · Cited by 70 · see citing works
Self-citation
Evidence Base for Measurement-Based Care in Child and Adolescent Psychiatry
Parikh, A., Fristad, M. A., Axelson, D., & Krishna, R. (2020) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2020.06.001 · Cited by 63 · see citing works
TARGET JNL: Neuropsychiatric Disease and Treatment Clinically Significant Changes in the 17- and 6-Item Hamilton Rating Scales for Depression: A STAR*D Report
Rush, A. J., South, C. C., Jain, S. B., Agha, R. S., Zhang, M., Shrestha, S., Khan, Z., Hassan, M., & Trivedi, M. H. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s305331 · Cited by 62 · see citing works
To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth
McLeod, B. D., Jensen‐Doss, A., Lyon, A. R., Douglas, S. R., & Beidas, R. S. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2042698 · Cited by 60 · see citing works
Self-citation
Natural language processing markers for psychosis and other psychiatric disorders: emerging themes and research agenda from a Cross-Linguistic Workshop
Corona Hernández, H., Corcoran, C., Achim, A. M., de Boer, J. N., Boerma, T., Brederoo, S. G., Cecchi, G. A., Ciampelli, S., Elvevåg, B., Fusaroli, R., et al. (2023) · Schizophrenia Bulletin · doi:10.1093/schbul/sbac215 · Cited by 56 · see citing works
Implementing Measurement-Based Care for Depression: Practical Solutions for Psychiatrists and Primary Care Physicians
Hong, R. H., Murphy, J., Michalak, E. E., Chakrabarty, T., Wang, Z., Parikh, S. V., Culpepper, L., Yatham, L. N., Lam, R. W. M., & Chen, J. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s283731 · Cited by 58 · see citing works
Multimodal Mental Health Digital Biomarker Analysis From Remote Interviews Using Facial, Vocal, Linguistic, and Cardiovascular Patterns
Jiang, Z., Seyedi, S. S., Griner, E. L., Abbasi, A., Rad, A. B., Kwon, H., Cotes, R. O., & Clifford, G. D. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3352075 · Cited by 75 · see citing works
Common measures or common metrics? A plea to harmonize measurement results
de Beurs, E., Boehnke, J. R., & Fried, E. I. (2022) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2742 · Cited by 55 · see citing works
Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review
de Jong, K., Douglas, S. R., Wolpert, M., Delgadillo, J., Aas, B., Bovendeerd, B., Carlier, I. V. E., Compare, A., Edbrooke-Childs, J. H., Janse, P. D., et al. (2024) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-024-01381-3 · Cited by 53 · see citing works
Self-citation
Peak-end bias in retrospective recall of depressive symptoms on the PHQ-9.
Horwitz, A. G., Zhao, Z., & Sen, S. (2023) · Psychological Assessment · doi:10.1037/pas0001219 · Cited by 52 · see citing works
Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions
McAleavey, A. A., de Jong, K., Nissen‐Lie, H. A., Boswell, J. F., Moltu, C., & Lutz, W. (2024) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-024-01351-9 · Cited by 50 · see citing works
Provider Perspectives on Integrating Sensor-Captured Patient-Generated Data in Mental Health Care
Ng, A., Kornfield, R., Schueller, S. M., Zalta, A. K., Brennan, M. B., & Reddy, M. C. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359217 · Cited by 46 · see citing works
Rapid Adoption and Implementation of Telehealth Group Psychotherapy During COVID 19: Practical Strategies and Recommendations
Puspitasari, A. J., Heredia, D., Gentry, M., Sawchuk, C., Theobald, B., Moore, W., Tiede, M., Galardy, C., & Schak, K. (2021) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2021.05.002 · Cited by 45 · see citing works
Self-citation
Randomized Trial of an Organizational Implementation Strategy to Improve Measurement-Based Care Fidelity and Youth Outcomes in Community Mental Health
Williams, N. J., Marcus, S. C., Ehrhart, M. G., Sklar, M., Esp, S. M., Carandang, K. M., Vega, N. R., Gomes, A. E., Brookman-Frazee, L. I., & Aarons, G. A. (2023) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2023.11.010 · Cited by 46 · see citing works
Discussing measurement-based care with patients: An analysis of clinician-patient dyads
Holliday, S. B., Hepner, K. A., Farmer, C. M., Mahmud, A., Kimerling, R. E., Smith, B. N., & Rosen, C. S. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1776413 · Cited by 41 · see citing works
Diagnostic operating characteristics of PROMIS scales in screening for depression
Kroenke, K., Stump, T. E., Kean, J. T., Krebs, E. E., Damush, T. M., Bair, M. J., & Monahan, P. O. (2021) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2021.110532 · Cited by 39 · see citing works
Self-citation
Future Challenges in Psychotherapy Research for Personality Disorders
Kramer, U., Eubanks, C. F., Bertsch, K., Herpertz, S. C., McMain, S., Mehlum, L. I., Renneberg, B., & Zimmermann, J. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01379-4 · Cited by 41 · see citing works
Client perspectives on psychotherapy failure
Knox, S., Miller, C., Twidwell, R. E., & Knowlton, G. (2022) · Psychotherapy Research · doi:10.1080/10503307.2022.2110020 · Cited by 38 · see citing works
Concordance between clinician-rated and patient reported outcome measures of depressive symptoms in treatment resistant depression
Hershenberg, R., McDonald, W. M., Crowell, A., Riva-Posse, P., Craighead, W. E., Mayberg, H. S., & Dunlop, B. W. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.108 · Cited by 40 · see citing works
Digitization of Measurement-Based Care Pathways in Mental Health Through REDCap and Electronic Health Record Integration: Development and Usability Study
Hawley, S., Yu, J., Bogetic, N., Potapova, N., Wakefield, C., Thompson, M., Kloiber, S. M., Hill, S., Jankowicz, D., & Rotenberg, D. J. (2021) · Journal of Medical Internet Research · doi:10.2196/25656 · Cited by 37 · see citing works
Measuring ICD shock anxiety: Status update on the Florida Shock Anxiety Scale after over a decade of use
Tripp, C., Huber, N. L., Kuhl, E. A., & Sears, S. F. (2019) · Pacing and Clinical Electrophysiology · doi:10.1111/pace.13793 · Cited by 35 · see citing works
Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences
Solstad, S. M., Kleiven, G. S., Castonguay, L. G., & Moltu, C. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1788741 · Cited by 35 · see citing works
Is Treatment Working? Detecting Real Change in the Treatment of Child and Adolescent Depression
Liu, F. F., & Adrian, M. C. (2019) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2019.02.011 · Cited by 34 · see citing works
Patient, family and provider views of measurement-based care in an early-psychosis intervention programme
Cuperfain, A. B., Hui, K., Berkhout, S., Foussias, G., Gratzer, D., Kidd, S. A., Kozloff, N., Kurdyak, P. A., Linaksita, B., Miranda, D., et al. (2021) · BJPsych Open · doi:10.1192/bjo.2021.1005 · Cited by 33 · see citing works
A Novel and Integrated Digitally Supported System of Care for Depression and Anxiety: Findings From an Open Trial
Wolitzky-Taylor, K. B., LeBeau, R. T., Arnaudova, I., Barnes‐Horowitz, N. M., Gong-Guy, E., Fears, S. C., Congdon, E. L., Freimer, N. B., & Craske, M. G. (2023) · JMIR Mental Health · doi:10.2196/46200 · Cited by 32 · see citing works
Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial
Williams, N. J., Ehrhart, M. G., Aarons, G. A., Esp, S. M., Sklar, M., Carandang, K. M., Vega, N. R., Brookman-Frazee, L. I., & Marcus, S. C. (2024) · Implementation Science · doi:10.1186/s13012-024-01356-w · Cited by 33 · see citing works
Predicting treatment effects in unipolar depression: A meta-review
Gillett, G., Tomlinson, A., Efthimiou, O., & Cipriani, A. (2020) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2020.107557 · Cited by 33 · see citing works
Feasibility and Initial Outcomes of a Group-Based Teletherapy Psychiatric Day Program for Adults With Serious Mental Illness: Open, Nonrandomized Trial in the Context of COVID-19
Puspitasari, A. J., Heredia, D., Coombes, B. J., Geske, J. R., Gentry, M. T., Moore, W. R., Sawchuk, C. N., & Schak, K. M. (2021) · JMIR Mental Health · doi:10.2196/25542 · Cited by 32 · see citing works
Self-citation
What do clinicians want? Understanding frontline addiction treatment clinicians’ preferences and priorities to improve the design of measurement-based care technology
Tauscher, J. S., Cohn, E. B., Johnson, T. R., Diteman, K. D., Ries, R. K., Atkins, D. C., & Hallgren, K. A. (2021) · Addiction Science & Clinical Practice · doi:10.1186/s13722-021-00247-5 · Cited by 32 · see citing works
Attitudes Towards the Use of Routine Outcome Monitoring of Psychological Therapies Among Mental Health Providers: The EBPAS–ROM
Rye, M., Rognmo, K., Aarons, G. A., & Skre, I. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00968-5 · Cited by 32 · see citing works
Trauma Informed Interventions to Reduce Seclusion, Restraint and Restrictive Practices Amongst Staff Caring for Children and Adolescents with Challenging Behaviours: A Systematic Review
Kelly, P., Saab, M. M., Hurley, E. J., Heffernan, M., Goodwin, J., Mulud, Z. A., O’Malley, M., O’Mahony, J., Curtin, M., Groen, G., et al. (2023) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-023-00524-2 · Cited by 30 · see citing works
Advancing clinical neuroscience through enhanced tools: Pediatric social anxiety as an example
Smith, A. R., Kircanski, K., Brotman, M. A., Quyen, B., Subar, A. R., Silk, J. S., Engel, S. G., Crosby, R. D., Harrewijn, A., White, L. K., et al. (2019) · Depression and Anxiety · doi:10.1002/da.22937 · Cited by 30 · see citing works
The Digital Clinic: An Innovative Mental Health Care Delivery Model Utilizing Hybrid Synchronous and Asynchronous Treatment
Macrynikola, N., Nguyen, N. S., Lane, E., Yen, S., & Torous, J. B. (2023) · NEJM Catalyst · doi:10.1056/cat.23.0100 · Cited by 30 · see citing works
Predicting outcomes of psychotherapy for depression with electronic health record data
Coley, R. Y., Boggs, J. M., Beck, A., & Simon, G. E. (2021) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2021.100198 · Cited by 29 · see citing works
Self-citation
Changes in affective and cognitive distortion symptoms of depression are reciprocally related during cognitive behavior therapy.
Persons, J., Marker, C., & Bailey, E. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104338 · Cited by 22 · see citing works
Manifestation of depression in speech overlaps with characteristics used to represent and recognize speaker identity
Dumpala, S. H., Dikaios, K., Rodriguez, S., Langley, R., Rempel, S., Uher, R., & Oore, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-35184-7 · Cited by 30 · see citing works
Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed‐methods quality improvement project
Wert, M. J. V., Malik, M. A., Memel, B., Moore, R., Buccino, D. L., Hackerman, F., Kumari, S., Everett, A. S., & Narrow, W. E. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13457 · Cited by 29 · see citing works
Integrating User-Centered Design and Behavioral Science to Design a Mobile Intervention for Obesity and Binge Eating: Mixed Methods Analysis
Graham, A. K., Munson, S. A., Reddy, M. C., Neubert, S. W., Green, E. A., Chang, A., Spring, B. J., Mohr, D. C., & Wildes, J. E. (2020) · JMIR Formative Research · doi:10.2196/23809 · Cited by 29 · see citing works
How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care
Lyon, A. R., Liu, F. F., Connors, E. H., King, K. M., Coifman, J. I., Cook, H., McRee, E., Ludwig, K., Law, A., Dorsey, S., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00325-y · Cited by 28 · see citing works
Self-citation
Integrated Digital Mental Health Care: A Vision for Addressing Population Mental Health Needs
Lim, C. T., Fuchs, C. H., & Torous, J. B. (2024) · International Journal of General Medicine · doi:10.2147/ijgm.s449474 · Cited by 28 · see citing works
Implementation of Measurement-Based Care in Mental Health Service Settings for Youth: A Systematic Review
Whitmyre, E. D., Esposito-Smythers, C. L., López, R., Goldberg, D. G., Liu, F. F., & Defayette, A. B. (2024) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-024-00498-z · Cited by 28 · see citing works
Integrating Routine Screening for Opioid Use Disorder into Primary Care Settings: Experiences from a National Cohort of Clinics
Austin, E. J., Briggs, E. S., Ferro, L., Barry, P., Heald, A., Curran, G. M., Saxon, A. J., Fortney, J. C., Ratzliff, A., & Williams, E. C. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07675-2 · Cited by 27 · see citing works
Measurement-based care and psychological assessment: Using measurement to enhance psychological treatment.
Resnick, S. G., Oehlert, M. E., Hoff, R. A., & Kearney, L. K. (2020) · Psychological Services · doi:10.1037/ser0000491 · Cited by 26 · see citing works
Communication strategies to facilitate the implementation of new clinical practices: a qualitative study of community mental health therapists
ALBRIGHT, K. J., Navarro, E., Jarad, I., Boyd, M. R., Powell, B. J., & Lewis, C. C. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab139 · Cited by 30 · see citing works
Self-citation
Implementation strategies to promote measurement-based care in schools: evidence from mental health experts across the USA
Connors, E. H., Lyon, A. R., Garcia, K. A., Sichel, C. E., Hoover, S., Weist, M. D., & Tebes, J. K. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00319-w · Cited by 26 · see citing works
Self-citation
Setting measurement‐based care in motion: practical lessons in the implementation and integration of measurement‐based care in psychiatry clinical practice
Martin-Cook, K., Palmer, L., Thornton, L., Rush, A. J., Tamminga, C. A., & Ibrahim, H. M. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s308615 · Cited by 25 · see citing works
Challenges in Investigating the Effective Components of Feedback from Routine Outcome Monitoring (ROM) in Youth Mental Health Care
van Sonsbeek, M. A. M. S., Hutschemaekers, G. J. M., Veerman, J. W., Vermulst, A. A., Kleinjan, M., & Tiemens, B. G. (2020) · Child & Youth Care Forum · doi:10.1007/s10566-020-09574-1 · Cited by 24 · see citing works
Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency
Sale, R., Bearman, S. K., Woo, R., & Baker, N. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01076-5 · Cited by 24 · see citing works
A framework to make PROMs relevant to patients: qualitative study of communication preferences of PROMs
Lai, C. H., Shapiro, L. M., Amanatullah, D. F., Chou, L. B., Gardner, M. J., Hu, S. S., Safran, M. R., & Kamal, R. N. (2021) · Quality of Life Research · doi:10.1007/s11136-021-02972-5 · Cited by 24 · see citing works
A systematic review of brief, freely accessible, and valid self-report measures for substance use disorders and treatment
Stewart, R. E., Cardamone, N. C., Schachter, A., Becker, C., McKay, J. R., & Becker‐Haimes, E. M. (2022) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2022.109729 · Cited by 24 · see citing works
Validation of the PCL-5, PHQ-9, and GAD-7 in a Sample of Veterans
Ahmadi, A., Ponder, W. N., Carbajal, J., Schuman, D. L., Whitworth, J., Yockey, R. A., & Galusha, J. M. (2023) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000002898 · Cited by 24 · see citing works
Using the Beck Depression Inventory to Assess Anhedonia: A Scale Validation Study
Cogan, A. B., Persons, J. B., & Kring, A. M. (2023) · Assessment · doi:10.1177/10731911231164628 · Cited by 23 · see citing works
Progress feedback in psychotherapy: Advantages, challenges, and future directions
Janse, P. D., van Sonsbeek, M. A. M. S., Bovendeerd, B., & de Jong, K. (2025) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2025.102110 · Cited by 22 · see citing works
Strategies to enhance communication with telemental health measurement-based care (tMBC).
Douglas, S. R., Jensen‐Doss, A., Ordorica, C., & Comer, J. S. (2020) · Practice Innovations · doi:10.1037/pri0000119 · Cited by 22 · see citing works
Self-citation
Beyond the Therapist’s Office: Merging Measurement-Based Care and Digital Medicine in the Real World
Chiauzzi, E. J., & Wicks, P. J. (2021) · Digital Biomarkers · doi:10.1159/000517748 · Cited by 21 · see citing works
The Patient Mania Questionnaire (PMQ-9): a Brief Scale for Assessing and Monitoring Manic Symptoms
Cerimele, J. M., Russo, J., Bauer, A. M., Hawrilenko, M., Pyne, J. M., Dalack, G. W., Kroenke, K., Unützer, J., & Fortney, J. C. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06947-7 · Cited by 21 · see citing works
Self-citation
Loss of PTSD Diagnosis in Response to Evidence-Based Treatments
Milligan, T., Smolenski, D. J., Lara‐Ruiz, J., & Kelber, M. S. (2025) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2025.0695 · Cited by 22 · see citing works
Using Digital Measurement–Based Care for the Treatment of Anxiety and Depression in Children and Adolescents: Observational Retrospective Analysis of Bend Health Data
Huffman, L. G., Lawrence‐Sidebottom, D., Huberty, J., Roots, M., Roots, K., Parikh, A., Guerra, R., & Weiser, J. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/46154 · Cited by 21 · see citing works
Organization-level variation in therapists’ attitudes toward and use of measurement-based care
Williams, N. J., Vega, N. R., Esp, S. M., Watts, A., & Marcus, S. C. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01206-1 · Cited by 21 · see citing works
Digital mental health treatment implementation playbook: successful practices from implementation experiences in American healthcare organizations
Mohr, D. C., Silverman, A. L., Youn, S. J., Areán, P. A., Bertagnolli, A., Carl, J. R., Carlton, T., Chaudhary, N., Cooper, D. E., DeVito, S., et al. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1509387 · Cited by 20 · see citing works
Evaluation of an On-Demand Mental Health System for Depression Symptoms: Retrospective Observational Study
Kunkle, S., Yip, M., Watson, Ξ., & Hunt, J. B. (2020) · Journal of Medical Internet Research · doi:10.2196/17902 · Cited by 20 · see citing works
A Roadmap for Measurement-based Care Implementation in Intensive Outpatient Treatment Settings for Children and Adolescents
Childs, A. W., & Connors, E. H. (2021) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2021.1975518 · Cited by 21 · see citing works
Machine-Learning-Based Prediction of Client Distress From Session Recordings
Kuo, P. B., Tanana, M., Goldberg, S. B., Caperton, D. D., Narayanan, S. S., Atkins, D. C., & Imel, Z. E. (2023) · Clinical Psychological Science · doi:10.1177/21677026231172694 · Cited by 20 · see citing works
Performance of the PHQ-9 across conditions and comorbidities: Findings from the Veterans Outcome Assessment survey
Katz, I. R., Liebmann, E. P., Resnick, S. G., & Hoff, R. A. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.07.108 · Cited by 20 · see citing works
It Is Time to Flip the Script and Leverage the Point of Care to Discover Ways of Improving Treatment Outcomes for Posttraumatic Stress Disorder: Commentary on “A Sobering Look at Treatment Effectiveness of Military-Related Posttraumatic Stress Disorder” (Levi et al., 2021)
Litz, B. T. (2022) · Clinical Psychological Science · doi:10.1177/21677026221101068 · Cited by 19 · see citing works
Barriers and facilitators to implementing measurement-based care for depression in Shanghai, China: a situational analysis
Murphy, J., Michalak, E. E., Liu, J., Colquhoun, H. L., Burton, H., Yang, X., Yang, T., Wang, X., Fei, Y., He, Y., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03442-5 · Cited by 20 · see citing works
A modified measurement-based care approach to improve mental health treatment engagement among racial and ethnic minoritized youth.
Connors, E. H., Arora, P. G., Resnick, S. G., & McKay, M. M. (2022) · Psychological Services · doi:10.1037/ser0000617 · Cited by 19 · see citing works
Developing an Implementation Model for ADHD Intervention in Community Clinics: Leveraging Artificial Intelligence and Digital Technology
Sibley, M. H., Bickman, L., Atkins, D. C., Tanana, M., Coxe, S. J., Ortiz, M., Martin, P., King, J., Monroy, J. M., Ponce, T., et al. (2023) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2023.02.001 · Cited by 20 · see citing works
The Impact of Measurement-Based Care in Psychiatry: An Integrative Review
DeSimone, J., & Hansen, B. R. (2023) · Journal of the American Psychiatric Nurses Association · doi:10.1177/10783903231177707 · Cited by 19 · see citing works
Real-world behavioral dataset from two fully remote smartphone-based randomized clinical trials for depression
Pratap, A., Homiar, A., Waninger, L., Herd, C., Suver, C., Volponi, J. J., Anguera, J. A., & Areán, P. A. (2022) · Scientific Data · doi:10.1038/s41597-022-01633-7 · Cited by 20 · see citing works
Exploration, Preparation, and Implementation of Standardized Assessment in a Multi-agency School Behavioral Health Network
Connors, E., Lawson, G. M., Wheatley-Rowe, D., & Hoover, S. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01082-7 · Cited by 19 · see citing works
Applying behaviour change theory to understand the barriers to implementing routine outcome monitoring
Bear, H. A., Dalzell, K., Edbrooke-Childs, J. H., & Wolpert, M. (2021) · British Journal of Clinical Psychology · doi:10.1111/bjc.12322 · Cited by 18 · see citing works
The effectiveness of enhanced evidence-based care for depressive disorders: a meta-analysis of randomized controlled trials
Xiao, L., Qi, H., Zheng, W., Xiang, Y., Carmody, T. J., Mayes, T. L., Trivedi, M. H., & Wang, G. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01638-7 · Cited by 18 · see citing works
Standardized Versus Tailored Implementation of Measurement-Based Care for Depression in Community Mental Health Clinics
Lewis, C. C., Marti, C. N., Scott, K., Walker, M. R., Boyd, M. R., Puspitasari, A. J., Mendel, P. J., & Kroenke, K. (2022) · Psychiatric Services · doi:10.1176/appi.ps.202100284 · Cited by 18 · see citing works
Self-citation
Successful ingredients of effective Collaborative Care programs in low- and middle-income countries: A rapid review
Whitfield, J., Owens, S., Bhat, A. S., Felker, B. L., Jewell, T. E., & Chwastiak, L. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2022.60 · Cited by 20 · see citing works
Using Digital Measurement–Based Care to Address Symptoms of Inattention, Hyperactivity, and Opposition in Youth: Retrospective Analysis of Bend Health
Lawrence‐Sidebottom, D., Huffman, L. G., Huberty, J., Beatty, C. C., Roots, M., Roots, K., Parikh, A., Guerra, R., & Weiser, J. (2023) · JMIR Formative Research · doi:10.2196/46578 · Cited by 20 · see citing works
Perceptions of mental health providers of the barriers and facilitators of using and engaging youth in digital mental-health-enabled measurement based care
Bassi, E. M., Bright, K. S., Norman, L., Pintson, K., Daniel, S., Sidhu, S., Gondziola, J., Bradley, J., Fersovitch, M., Stamp, L. K., et al. (2024) · Digital Health · doi:10.1177/20552076241253093 · Cited by 19 · see citing works
Addiction Medicine Practice-Based Research Network (AMNet): Assessment Tools and Quality Measures
Clarke, D. E., Ibrahim, A., Doty, B., Patel, S., Gibson, D., Pagano, A., Thompson, L. R., Goldstein, A. B., Vocci, F. J., & Schwartz, R. P. (2021) · Substance Abuse and Rehabilitation · doi:10.2147/sar.s305972 · Cited by 18 · see citing works
Community Implementation of MI-Enhanced Behavior Therapy for Adolescent ADHD: Linking Fidelity to Effectiveness
Sibley, M. H., Bickman, L., Coxe, S. J., Graziano, P. A., & Martin, P. (2020) · Behavior Therapy · doi:10.1016/j.beth.2020.10.007 · Cited by 17 · see citing works

Implementation of Measurement-Based Care in Mental Health Services: A Systematic Literature Review
Burr, C. M., Hahn, S., Carr, A. M., & Schneeberger, A. R. (2026) · Psychiatric Services · doi:10.1176/appi.ps.20250065
Enabling Behavioral Health Measurement-Based Care With Technology
Brown, M. D., & Carreno-Davidson, J. T. (2020) · Routledge eBooks · doi:10.4324/9780429020537-1 · Cited by 3 · see citing works
A Survey of Behavioral Health Care Providers on Use and Barriers to Use of Measurement-Based Care
Keepers, B. C., Easterly, C., Dennis, N. M., Domino, M. E., & Bhalla, I. P. (2023) · Psychiatric Services · doi:10.1176/appi.ps.202100735 · Cited by 17 · see citing works
Measurement-Based Care in Psychiatry
Waldrop, J., & McGuinness, T. M. (2017) · Journal of Psychosocial Nursing and Mental Health Services · doi:10.3928/02793695-20170818-01 · Cited by 43 · see citing works
Beyond the Checkbox: Developing Measurement-Based Care as a Clinical Skill in PCBH
Serrano, N., Bosak, K., Green-Otero, S., Hemesath, K., Cordes, C. C., Sieber, W. J., & Haddick, D. (2025) · Journal of Health Service Psychology · doi:10.1007/s42843-025-00142-6 · Cited by 1 · see citing works

Authors: Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., Simon, G., & Kroenke, K.
Affiliations: Kaiser Permanente Washington Health Research Institute (US)
University of California, Los Angeles (US)
Mayo Clinic (US)
Indiana University Bloomington (US)
Ohio University (US)
West Virginia University (US)
Brown University (US)
University of Washington (US)
Vanderbilt University (US)
Regenstrief Institute (US)
ORCID: Lewis, Cara C.
Boyd, Meredith
Puspitasari, Ajeng
Howard, Jacqueline
Kassab, Hannah
Scott, Kelli
Lyon, Aaron
Douglas, Susan
Kroenke, Kurt
Venue: JAMA Psychiatry
Publisher: American Medical Association (AMA)
Published: 2019-03-01
Volume: 76
Issue: 3
Pages: 324
ISSN: 2168-622X (ISSN-L)
DOI: 10.1001/jamapsychiatry.2018.3329
PMC: PMC6584602
OpenAlex: W2904026243
Cited by: 605
References: 90
Citations by year: 2026: 91 · 2025: 97 · 2024: 110 · 2023: 80 · 2022: 75 · 2021: 92 · 2020: 49 · 2019: 11
FWCI: 6.87
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: JAMA Psychiatry (publishedVersion)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Mental Health (F31MH111134, R01MH103310)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
Keywords: measurement-based care, behavioral health, implementation barriers, implementation fidelity, psychotherapy, electronic health records interoperability, learning collaborative, local champions, reimbursement policy
MeSH terms: Mental Disorders, Humans, Mental Health Services, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Implementing Measurement-Based Care in Behavioral Health: A Review

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks