Cited by 606Health Policy Implementation SciencePsychotherapy Techniques and ApplicationsPsychiatric care and mental health services

The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.

Implementing Measurement-Based Care in Behavioral Health: A Review

Open access

Lewis, Cara C., Boyd, Meredith, Puspitasari, Ajeng, Navarro, Elena, Howard, Jacqueline, Kassab, Hannah, Hoffman, Mira, Scott, Kelli, Lyon, Aaron, Douglas, Susan, Simon, Greg, Kroenke, Kurt·2019·JAMA Psychiatry

DOI 10.1001/jamapsychiatry.2018.3329PMC PMC6584602

Open this paper in CoChat — free account

Abstract

Importance: Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up. Observations: Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives. Conclusions and Relevance: This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1001/jamapsychiatry.2018.3329

Cites

89 of 89 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898
Self-citation
Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Clinical versus mechanical prediction: a meta-analysis
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.1.19 · Cited by 1,640
Accelerating the Diffusion of Innovations Using Opinion Leaders
Valente, T. W., & Davis, R. (1999) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271629956600105 · Cited by 720
Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system.
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657 · cited 2×
“Measurement-based care can be separated into 4 core components: (1) a routinely administered symptom, outcome, or process measure (ie, PRO), ideally before each clinical encounter; (2) practitioner review of data; (3) patient review of data; and (4) collaborative reevaluation of the treatment plan informed by data.”
Is it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608
A Tipping Point for Measurement-Based Care
Fortney, J. C., Unützer, J., Wrenn, G. L., Pyne, J. M., Smith, G. R., Schoenbaum, M., & Harbin, H. T. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500439 · Cited by 592
Effects of pay for performance in health care: A systematic review of systematic reviews
Eijkenaar, F., Emmert, M., Scheppach, M., & Schöffski, O. (2013) · Health Policy · doi:10.1016/j.healthpol.2013.01.008 · Cited by 562
Incorporating Patient-Reported Outcomes Into Health Care To Engage Patients And Enhance Care
Lavallee, D. C., Chenok, K. E., Love, R. M., Petersen, C. C., Holve, E., Segal, C. D., & Franklin, P. D. (2016) · Health Affairs · doi:10.1377/hlthaff.2015.1362 · Cited by 549
Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494
Using Measurement-Based Care to Enhance Any Treatment
Scott, K., & Lewis, C. C. (2015) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.01.010 · Cited by 461
Self-citation
Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435
The Effects of Providing Therapists With Feedback on Patient Progress During Psychotherapy: Are Outcomes Enhanced?
Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001) · Psychotherapy Research · doi:10.1080/713663852 · Cited by 433
Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial
Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011) · Psychiatric Services · doi:10.1176/appi.ps.002052011 · Cited by 421
Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting.
Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016062 · Cited by 375
Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice.
Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003) · Journal of Counseling Psychology · doi:10.1037/0022-0167.50.1.59 · Cited by 374
Measurement-based care versus standard care for major depression: A randomized controlled trial with blind raters
Guo, T., Xiang, Y.-T., Xiao, L., Hu, C.-Q., Chiu, H. F. K., Ungvari, G. S., Correll, C. U., Lai, K. Y. C., Feng, L., Geng, Y., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14050652 · Cited by 308
Enhancing psychotherapy outcomes via providing feedback on client progress: a replication
Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.324 · Cited by 306
Clinicians and outcome measurement: What's the use?
Garland, A. F., Kruse, M. I., & Aarons, G. A. (2003) · The Journal of Behavioral Health Services & Research · doi:10.1007/bf02287427 · Cited by 298
Enhancing outcome for potential treatment failures: Therapist–client feedback and clinical support tools
Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E. J., Nielsen, S. L., Slade, K., & Lutz, W. (2007) · Psychotherapy Research · doi:10.1080/10503300600702331 · Cited by 286
A Measurement Feedback System (MFS) Is Necessary to Improve Mental Health Outcomes
Hamilton, J. D., & Bickman, L. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181825af8 · Cited by 276
Monitoring Treatment Progress and Providing Feedback is Viewed Favorably but Rarely Used in Practice
Jensen‐Doss, A., Haimes, E. M. B., Smith, A. M., Lyon, A. R., Lewis, C. C., Stanick, C., & Hawley, K. M. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0763-0 · Cited by 266
Self-citation
Patient-reported Outcomes (PROs)
Snyder, C. F., Jensen, R. E., Segal, J. B., & Wu, A. W. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1d84 · Cited by 265
Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults
Kendrick, T., El-Gohary, M., Stuart, B. L., Gilbody, S. M., Churchill, R. C., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A. L., de Jong, K., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011119.pub2 · Cited by 252
Does a continuous feedback system improve psychotherapy outcome?
Reese, R. J., Norsworthy, L. A., & Rowlands, S. (2009) · Psychotherapy · doi:10.1037/a0017901 · Cited by 241
Free, Brief, and Validated: Standardized Instruments for Low-Resource Mental Health Settings
Beidas, R. S., Stewart, R. E., Walsh, L., Lucas, S., Downey, M. M., Jackson, K., Fernandez, T., & Mandell, D. S. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.02.002 · Cited by 240
Psychiatrists in the UK do not use outcomes measures: National survey
Gilbody, S. M., House, A. O., & Sheldon, T. A. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.2.101 · Cited by 234
Closing the false divide: sustainable approaches to integrating mental health services into primary care
Kroenke, K., & Unutzer, J. (2017) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3967-9 · Cited by 231
Self-citation
The therapeutic effects of providing patient progress information to therapists and patients
Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004) · Psychotherapy Research · doi:10.1093/ptr/kph027 · Cited by 230
Does providing feedback on patient-reported outcomes to healthcare professionals result in better outcomes for patients? A systematic review
Boyce, M., & Browne, J. P. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0390-0 · Cited by 228
The Role of Technical Advances in the Adoption and Integration of Patient-reported Outcomes in Clinical Care
Jensen, R. E., Rothrock, N. E., DeWitt, E. M., Spiegel, B. M. R., Tucker, C. A., Crane, H. M., Forrest, C. B., Patrick, D. L., Fredericksen, R. J., Shulman, L. M., et al. (2015) · Medical Care · doi:10.1097/mlr.0000000000000289 · Cited by 222
Patients' and doctors' views on depression severity questionnaires incentivised in UK quality and outcomes framework: qualitative study
Dowrick, C., Leydon, G. M., McBride, A., Howe, A., Burgess, H., Clarke, P., Maisey, S., & Kendrick, T. (2009) · BMJ · doi:10.1136/bmj.b663 · Cited by 213
Routine outcome monitoring in the Netherlands: practical experiences with a web‐based strategy for the assessment of treatment outcome in clinical practice
de Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E. M., & Zitman, F. G. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.696 · Cited by 195
Why Don't Psychiatrists Use Scales to Measure Outcome When Treating Depressed Patients?
Zimmerman, M., & McGlinchey, J. B. (2008) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v69n1209 · Cited by 179 · cited 1×
“CONCLUSIONS AND RELEVANCE This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC’s core components; (2) develop criterion standard methods for monitoring fidelity and reporting qual…”
Effect of client feedback on couple psychotherapy outcomes.
Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010) · Psychotherapy · doi:10.1037/a0021182 · Cited by 178
Feedback from Outcome Measures and Treatment Effectiveness, Treatment Efficiency, and Collaborative Practice: A Systematic Review
Gondek, D., Edbrooke-Childs, J. H., Fink, E., Deighton, J., & Wolpert, M. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0710-5 · Cited by 169
Quality Improvement With Pay-for-Performance Incentives in Integrated Behavioral Health Care
Unützer, J., Chan, Y.-F., Hafer, E., Knaster, J., Shields, A., Powers, D., & Veith, R. C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300555 · Cited by 167
Why Some Clinicians Use Outcome Measures and Others Do Not
Hatfield, D. R., & Ogles, B. M. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0110-y · Cited by 164
Improving Community-Based Mental Health Care for Children: Translating Knowledge into Action
Garland, A. F., Haine‐Schlagel, R., Brookman-Frazee, L. I., Baker-Ericzén, M. J., Trask, E. V., & Fawley-King, K. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0450-8 · Cited by 154
Using Feedback From Patient-Reported Outcome Measures in Mental Health Services: A Scoping Study and Typology
Krägeloh, C. U., Czuba, K., Billington, D. R., Kersten, P., & Siegert, R. J. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201400141 · Cited by 142
Implementing a Measurement Feedback System: A Tale of Two Sites
Bickman, L., Douglas, S. R., de Andrade, A. R. V., Tomlinson, M. M., Gleacher, A. A., Olin, S.-C. S., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0647-8 · Cited by 139
Self-citation
Patient-Reported Outcomes Assessment in Cancer Trials: Taking Stock, Moving Forward
Lipscomb, J., Reeve, B. B., Clauser, S. B., Abrams, J. S., Bruner, D. W., Burke, L. B., Denicoff, A. M., Ganz, P. A., Gondek, K., Minasian, L. M., et al. (2007) · Journal of Clinical Oncology · doi:10.1200/jco.2007.12.4644 · Cited by 135
Implementation teams: A new lever for organizational change
Higgins, M. C., Weiner, J. M., & Young, L. V. (2012) · Journal of Organizational Behavior · doi:10.1002/job.1773 · Cited by 123
Patient-reported outcome measures: literature review
Williams, K., Sansoni, J., Morris, D., Grootemaat, P. E., & Thompson, C. J. (2016) · Research Online (University of Wollongong) · Cited by 117
Understanding Clinicians’ Diagnostic Practices: Attitudes Toward the Utility of Diagnosis and Standardized Diagnostic Tools
Jensen‐Doss, A., & Hawley, K. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-011-0334-3 · Cited by 112
Challenges and Opportunities in Measuring the Quality of Mental Health Care
Kilbourne, A. M., Keyser, D. J., & Pincus, H. A. (2010) · The Canadian Journal of Psychiatry · doi:10.1177/070674371005500903 · Cited by 110
A Self-Report Symptom and Problem Rating Scale to Increase Inpatients' Involvement in Treatment
Eisen, S. V., Dickey, B., & Sederer, L. I. (2000) · Psychiatric Services · doi:10.1176/appi.ps.51.3.349 · Cited by 106
Uses and Abuses of Patient Reported Outcome Measures (PROMs): Potential Iatrogenic Impact of PROMs Implementation and How It Can Be Mitigated
Wolpert, M. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-013-0509-1 · Cited by 104
The application of a feedback-informed approach in psychological service with youth: Systematic review and meta-analysis
Tam, H. E., & Ronan, K. R. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.04.005 · Cited by 97
Implementing a Measurement Feedback System in Community Mental Health Clinics: A Case Study of Multilevel Barriers and Facilitators
Gleacher, A. A., Olin, S.-C. S., Nadeem, E., Pollock, M., Ringle, V. A. M., Bickman, L., Douglas, S. R., & Hoagwood, K. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0642-0 · Cited by 96
Self-citation
Capabilities and Characteristics of Digital Measurement Feedback Systems: Results from a Comprehensive Review
Lyon, A. R., Lewis, C. C., Boyd, M. R., Hendrix, E., & Liu, F. F. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0719-4 · Cited by 91
Self-citation
Progress monitoring in mental health and addiction treatment: A means of improving care.
Goodman, J. D., McKay, J. R., & DePhilippis, D. (2013) · Professional Psychology Research and Practice · doi:10.1037/a0032605 · Cited by 90
Improving the efficiency of psychological treatment using outcome feedback technology
Delgadillo, J., Overend, K., Lucock, M. P., Groom, M., Kirby, N., McMillan, D., Gilbody, S. M., Lutz, W., Rubel, J. A., & de Jong, K. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.09.011 · Cited by 89
Efficacy of client feedback in group psychotherapy with soldiers referred for substance abuse treatment
Schuman, D. L., Slone, N. C., Reese, R. J., & Duncan, B. L. (2014) · Psychotherapy Research · doi:10.1080/10503307.2014.900875 · Cited by 87
A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs
Crits-Christoph, P. F., Ring‐Kurtz, S., Hamilton, J. L., Lambert, M. J., Gallop, R., McClure, B., Kulaga, A., & Rotrosen, J. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.09.003 · Cited by 81
Pay for Performance in Behavioral Health
Bremer, R. W., Scholle, S. H., Keyser, D. J., Houtsinger, J. K., & Pincus, H. A. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.12.1419 · Cited by 80
Evaluating the efficacy of client feedback in group psychotherapy.
Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015) · Group Dynamics Theory Research and Practice · doi:10.1037/gdn0000026 · Cited by 75
Implementing measurement-based care (iMBC) for depression in community mental health: a dynamic cluster randomized trial study protocol
Lewis, C. C., Scott, K., Marti, C. N., Marriott, B. R., Kroenke, K., Putz, J. W., Mendel, P. J., & Rutkowski, D. (2015) · Implementation Science · doi:10.1186/s13012-015-0313-2 · Cited by 73
Self-citation
Improving the efficiency of cognitive-behavioural therapy by using formal client feedback
Janse, P. D., de Jong, K., van Dijk, M. K., Hutschemaekers, G. J. M., & Verbraak, M. J. P. M. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1152408 · Cited by 70
Taking PROs and patient-centered care seriously: incremental and disruptive ideas for incorporating PROs in oncology practice
Donaldson, M. S. (2008) · Quality of Life Research · doi:10.1007/s11136-008-9414-6 · Cited by 64
Client Progress Monitoring and Feedback in School-Based Mental Health
Borntrager, C. F., & Lyon, A. R. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.03.007 · Cited by 64
Self-citation
The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems
Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., & McCauley, E. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0637-x · Cited by 63
Self-citation
Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study
Simon, W., Lambert, M. J., Busath, G. L., Vazquez, A., Berkeljon, A., Hyer, K., Granley, M., & Berrett, M. E. (2013) · Psychotherapy Research · doi:10.1080/10503307.2013.787497 · Cited by 61
Using Patient Reported Outcome Measures to Improve Service Effectiveness (UPROMISE): Training clinicians to Use Outcome Measures in Child Mental Health
Edbrooke-Childs, J. H., Wolpert, M., & Deighton, J. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0600-2 · Cited by 59
Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice
Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Göllner, R., & Tritt, K. (2013) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2013.07.003 · Cited by 58
Patient-reported outcomes are changing the landscape in oncology care: challenges and opportunities for payers.
Zagadailov, E. A., Fine, M. J., & Shields, A. L. (2013) · PubMed Central · Cited by 51
A Digital Feedback System to Support Implementation of Measurement-Based Care by School-Based Mental Health Clinicians
Lyon, A. R., Pullmann, M. D., Whitaker, K. M., Ludwig, K. A., Wasse, J. K., & McCauley, E. (2017) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2017.1280808 · Cited by 43
Self-citation
Measurement-Based Care in Psychiatry
Waldrop, J., & McGuinness, T. M. (2017) · Journal of Psychosocial Nursing and Mental Health Services · doi:10.3928/02793695-20170818-01 · Cited by 43
Adverse Effects of Outcome Monitoring Feedback in Patients With Personality Disorders: A Randomized Controlled Trial in Day Treatment and Inpatient Settings
de Jong, K., Segaar, J. A., Ingenhoven, T., Busschbach, J. J. V., & Timman, R. (2017) · Journal of Personality Disorders · doi:10.1521/pedi_2017_31_297 · Cited by 42
Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content
Douglas, S. R., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R., & Bickman, L. (2015) · Psychotherapy Research · doi:10.1080/10503307.2015.1059966 · Cited by 41
Self-citation
Factors Influencing Consumer Outcome Monitoring in Implementation of Evidence-Based Practices: Results from the National EBP Implementation Project
Marty, D., Rapp, C., McHugo, G. J., & Whitley, R. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0157-4 · Cited by 41
Deriving Implementation Strategies for Outcome Monitoring Feedback from Theory, Research and Practice
de Jong, K. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0589-6 · Cited by 41
A Peer Review Feedback Method of Promoting Compliance with Preventive Care Guidelines in a Resident Ambulatory Care Clinic
Goebel, L. J. (1997) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30309-1 · Cited by 40
Context-dependent accountability strategies to improve the transfer of training: A proposed theoretical model and research propositions
Grossman, R., & Burke‐Smalley, L. A. (2017) · Human Resource Management Review · doi:10.1016/j.hrmr.2017.08.001 · Cited by 40
Self-Compassion Mediates the Relationship Between Mindfulness and Borderline Personality Disorder Symptoms
Scheibner, H. J., Daniels, A., Guendelman, S., Utz, F., & Bermpohl, F. (2017) · Journal of Personality Disorders · doi:10.1521/pedi_2017_31_331 · Cited by 40
Increasing psychotherapists' adoption and implementation of the evidence-based practice of progress monitoring
Persons, J. B., Koerner, K., Eidelman, P., Thomas, C., & Liu, H. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.11.004 · Cited by 38
A Systematic Overview of Measurement-Based Care in the Treatment of Childhood and Adolescent Depression
Elmquist, J., Melton, T., Croarkin, P. E., & McClintock, S. M. (2010) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000386908.07160.91 · Cited by 37
Implementing measurement based care in community mental health: a description of tailored and standardized methods
Lewis, C. C., Puspitasari, A. J., Boyd, M. R., Scott, K., Marriott, B. R., Hoffman, M., Navarro, E., & Kassab, H. D. (2018) · BMC Research Notes · doi:10.1186/s13104-018-3193-0 · Cited by 37
Self-citation
Extreme deviations from expected recovery curves and their associations with therapeutic alliance, social support, motivation, and life events in psychosomatic in-patient therapy
Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., & Tritt, K. (2015) · Psychotherapy Research · doi:10.1080/10503307.2014.981682 · Cited by 35
Feedback-informed treatment in emergency psychiatry; a randomised controlled trial
van Oenen, F. J., Schipper, S., Van, R., Schoevers, R. A., Visch, I., Peen, J., & Dekker, J. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0811-z · Cited by 35
Progress Monitoring in an Integrated Health Care System: Tracking Behavioral Health Vital Signs
Steinfeld, B. I., Franklin, A., Mercer, B. M., Fraynt, R. J., & Simon, G. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0648-7 · Cited by 31
Self-citation
The relationship between progress feedback and therapeutic outcome in student counselling: A randomised control trial
Murphy, K. P., Rashleigh, C. M., & Timulák, L. (2012) · Counselling Psychology Quarterly · doi:10.1080/09515070.2012.662349 · Cited by 30
Using Mental Health Outcome Measures in Everyday Clinical Practice
Patterson, P., Matthey, S., & Baker, M. K. (2006) · Australasian Psychiatry · doi:10.1080/j.1440-1665.2006.02266.x · Cited by 30
A Curriculum in Measurement-Based Care: Screening and Monitoring of Depression in a Psychiatric Resident Clinic
Arbuckle, M. R., Weinberg, M., Kistler, S. C., Cabaniss, D. L., Isaacs, A., Sederer, L. I., & Essock, S. M. (2013) · Academic Psychiatry · doi:10.1176/appi.ap.12080152 · Cited by 18
Cognitive functioning and cortisol suppression in recurrent major depression
Hansson, P. B., Murison, R. C. C., Lund, A., & Hammar, Å. (2013) · PsyCh Journal · doi:10.1002/pchj.29 · Cited by 14
Introduction to the special section on child and adolescent psychotherapy research
Midgley, N., Capella, C., Goodman, G., Lis, A., Noom, M. J., Tishby, O., & Weitkamp, K. (2017) · Psychotherapy Research · doi:10.1080/10503307.2017.1380864 · Cited by 14
A conceptual model for generating and validating in-session clinical judgments
Jacinto, S., Lewis, C. C., Braga, J. N., & Scott, K. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1169329 · Cited by 5
Self-citation

Flagged first, then by citations

1 of the 90 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

Glasziou, 2012, Pay for performance: how to make it worth doing., BMJ, 345, 22

Sorted by citations

Mental health and clinical psychological science in the time of COVID-19: Challenges, opportunities, and a call to action
Gruber, J., Prinstein, M. J., Clark, L. A., Rottenberg, J., Abramowitz, J. S., Albano, A. M., Aldao, A., Borelli, J. L., Chung, T., Davila, J., et al. (2021) · American Psychologist · doi:10.1037/amp0000707 · Cited by 697
Canadian Network for Mood and Anxiety Treatments (CANMAT) 2023 Update on Clinical Guidelines for Management of Major Depressive Disorder in Adults: Réseau canadien pour les traitements de l'humeur et de l'anxiété (CANMAT) 2023 : Mise à jour des lignes directrices cliniques pour la prise en charge du trouble dépressif majeur chez les adultes
Lam, R. W. M., Kennedy, S. H., Adams, G. C., Bahji, A., Beaulieu, S., Bhat, V., Blier, P., Blumberger, D. M., Brietzke, E. M., Chakrabarty, T., et al. (2024) · The Canadian Journal of Psychiatry · doi:10.1177/07067437241245384 · Cited by 435
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251
Hazardous drinking and alcohol use disorders
MacKillop, J. M., Agabio, R., Ewing, S. W. F., Heilig, M. A., Kelly, J. F., Leggio, L., Lingford-Hughes, A. R., Palmer, A. A., Parry, C. D. H., Ray, L. A., et al. (2022) · Nature Reviews Disease Primers · doi:10.1038/s41572-022-00406-1 · Cited by 251
Clinical Practice Guideline for the Assessment and Treatment of Children and Adolescents With Major and Persistent Depressive Disorders
Walter, H. J., Abright, A. R., Bukstein, O. G., Diamond, J., Keable, H., Ripperger-Suhler, J. A., & Rockhill, C. (2022) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2022.10.001 · Cited by 221

See all 606

Authors: Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., Simon, G., & Kroenke, K.
Affiliations: Kaiser Permanente Washington Health Research Institute (US)
University of California, Los Angeles (US)
Mayo Clinic (US)
Indiana University Bloomington (US)
Ohio University (US)
West Virginia University (US)
Brown University (US)
University of Washington (US)
Vanderbilt University (US)
Regenstrief Institute (US)
ORCID: Lewis, Cara C.
Boyd, Meredith
Puspitasari, Ajeng
Howard, Jacqueline
Kassab, Hannah
Scott, Kelli
Lyon, Aaron
Douglas, Susan
Kroenke, Kurt
Venue: JAMA Psychiatry
Publisher: American Medical Association (AMA)
Published: 2019-03-01
Volume: 76
Issue: 3
Pages: 324
ISSN: 2168-622X (ISSN-L)
DOI: 10.1001/jamapsychiatry.2018.3329
PMC: PMC6584602
OpenAlex: W2904026243
Cited by: 605
References: 90
Citations by year: 2026: 91 · 2025: 97 · 2024: 110 · 2023: 80 · 2022: 75 · 2021: 92 · 2020: 49 · 2019: 11
FWCI: 6.87
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: JAMA Psychiatry (publishedVersion)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Mental Health (F31MH111134, R01MH103310)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
Keywords: measurement-based care, behavioral health, implementation barriers, implementation fidelity, psychotherapy, electronic health records interoperability, learning collaborative, local champions, reimbursement policy
MeSH terms: Mental Disorders, Humans, Mental Health Services, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Implementing Measurement-Based Care in Behavioral Health: A Review

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks