Cited by 606Health Policy Implementation SciencePsychotherapy Techniques and ApplicationsPsychiatric care and mental health services

The DOI matches its Crossref record; 89 of the 90 references it cites were found in a registry or an index.

Implementing Measurement-Based Care in Behavioral Health: A Review

Open access

Lewis, Cara C., Boyd, Meredith, Puspitasari, Ajeng, Navarro, Elena, Howard, Jacqueline, Kassab, Hannah, Hoffman, Mira, Scott, Kelli, Lyon, Aaron, Douglas, Susan, Simon, Greg, Kroenke, Kurt·2019·JAMA Psychiatry

DOI 10.1001/jamapsychiatry.2018.3329PMC PMC6584602

Open this paper in CoChat — free account

Abstract

Importance: Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up. Observations: Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives. Conclusions and Relevance: This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1001/jamapsychiatry.2018.3329

Cites

89 of 89 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898
Self-citation
Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
Clinical versus mechanical prediction: a meta-analysis
Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.1.19 · Cited by 1,640
Accelerating the Diffusion of Innovations Using Opinion Leaders
Valente, T. W., & Davis, R. (1999) · The Annals of the American Academy of Political and Social Science · doi:10.1177/000271629956600105 · Cited by 720
Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system.
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657 · cited 2×
“Measurement-based care can be separated into 4 core components: (1) a routinely administered symptom, outcome, or process measure (ie, PRO), ideally before each clinical encounter; (2) practitioner review of data; (3) patient review of data; and (4) collaborative reevaluation of the treatment plan informed by data.”
Is it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608
A Tipping Point for Measurement-Based Care
Fortney, J. C., Unützer, J., Wrenn, G. L., Pyne, J. M., Smith, G. R., Schoenbaum, M., & Harbin, H. T. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500439 · Cited by 592
Effects of pay for performance in health care: A systematic review of systematic reviews
Eijkenaar, F., Emmert, M., Scheppach, M., & Schöffski, O. (2013) · Health Policy · doi:10.1016/j.healthpol.2013.01.008 · Cited by 562

Show all 90 references

Research works printed but not linked: 1

Glasziou, 2012, Pay for performance: how to make it worth doing., BMJ, 345, 22

Sorted by citations

Mental health and clinical psychological science in the time of COVID-19: Challenges, opportunities, and a call to action
Gruber, J., Prinstein, M. J., Clark, L. A., Rottenberg, J., Abramowitz, J. S., Albano, A. M., Aldao, A., Borelli, J. L., Chung, T., Davila, J., et al. (2021) · American Psychologist · doi:10.1037/amp0000707 · Cited by 697
Canadian Network for Mood and Anxiety Treatments (CANMAT) 2023 Update on Clinical Guidelines for Management of Major Depressive Disorder in Adults: Réseau canadien pour les traitements de l'humeur et de l'anxiété (CANMAT) 2023 : Mise à jour des lignes directrices cliniques pour la prise en charge du trouble dépressif majeur chez les adultes
Lam, R. W. M., Kennedy, S. H., Adams, G. C., Bahji, A., Beaulieu, S., Bhat, V., Blier, P., Blumberger, D. M., Brietzke, E. M., Chakrabarty, T., et al. (2024) · The Canadian Journal of Psychiatry · doi:10.1177/07067437241245384 · Cited by 435
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251
Hazardous drinking and alcohol use disorders
MacKillop, J. M., Agabio, R., Ewing, S. W. F., Heilig, M. A., Kelly, J. F., Leggio, L., Lingford-Hughes, A. R., Palmer, A. A., Parry, C. D. H., Ray, L. A., et al. (2022) · Nature Reviews Disease Primers · doi:10.1038/s41572-022-00406-1 · Cited by 251
Clinical Practice Guideline for the Assessment and Treatment of Children and Adolescents With Major and Persistent Depressive Disorders
Walter, H. J., Abright, A. R., Bukstein, O. G., Diamond, J., Keable, H., Ripperger-Suhler, J. A., & Rockhill, C. (2022) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2022.10.001 · Cited by 221
Perceived benefits and limitations of using patient-reported outcome measures in clinical practice with individual patients: a systematic review of qualitative studies
Campbell, R., Ju, A., King, M. T., & Rutherford, C. (2022) · Quality of Life Research · doi:10.1007/s11136-021-03003-z · Cited by 188
Improving mental health services: a 50-year journey from randomized experiments to artificial intelligence and precision mental health
Bickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184
Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations
Barkham, M., de Jong, K., Delgadillo, J., & Lutz, W. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2181114 · Cited by 210
Collaborative mental health care: A narrative review
Reist, C., Petiwala, I., Latimer, J., Raffaelli, S. B., Chiang, M., Eisenberg, D., & Campbell, S. (2022) · Medicine · doi:10.1097/md.0000000000032554 · Cited by 162
Population-Based Approaches to Mental Health: History, Strategies, and Evidence
Purtle, J., Nelson, K. L., Counts, N. Z., & Yudell, M. (2020) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040119-094247 · Cited by 169
Minimally important differences and severity thresholds are estimated for the PROMIS depression scales from three randomized clinical trials
Kroenke, K., Stump, T. E., Chen, C. X., Kean, J., Bair, M. J., Damush, T. M., Krebs, E. E., & Monahan, P. O. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.101 · Cited by 131
Self-citation
The Needs-to-Goals Gap: How informant discrepancies in youth mental health assessments impact service delivery
Reyes, A. D. L., Talbott, E., Power, T. J., Michel, J. J., Cook, C. R., Racz, S. J., & Fitzpatrick, O. M. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102114 · Cited by 131
Understanding the Role of Clinical Champions and Their Impact on Clinician Behavior Change: The Need for Causal Pathway Mechanisms
Morena, A., Gaias, L. M., & Larkin, C. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.896885 · Cited by 129
A Development Pathway Towards Precision Mental Health Care
Delgadillo, J., & Lutz, W. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1048 · Cited by 108
Findings from World Mental Health Surveys of the perceived helpfulness of treatment for patients with major depressive disorder
Harris, M. G., Kazdin, A. E., Chiu, W. T., Sampson, N. A., Aguilar-Gaxiola, S., Al-Hamzawi, A., Alonso, J., Altwaijri, Y., Andrade, L. H., Cardoso, G., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1107 · Cited by 100
Self-citation
Comparative Responsiveness and Minimally Important Difference of Common Anxiety Measures
Kroenke, K., Baye, F. M., & Lourens, S. G. (2019) · Medical Care · doi:10.1097/mlr.0000000000001185 · Cited by 97
Self-citation
The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability
Lyon, A. R., Coifman, J., Cook, H., McRee, E., Liu, F. F., Ludwig, K. A., Dorsey, S., Koerner, K., Munson, S. A., & McCauley, E. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00183-0 · Cited by 94
Self-citation
The Coronavirus Impact Scale: Construction, Validation, and Comparisons in Diverse Clinical Samples
Stoddard, J., Reynolds, E. K., Paris, R., Haller, S. P., Johnson, S. B., Zik, J. B., Elliotte, E., Maru, M., Jaffe, A., Mallidi, A., et al. (2023) · JAACAP Open · doi:10.1016/j.jaacop.2023.03.003 · Cited by 86
Toward a Unified Framework for Positive Psychology Interventions: Evidence-Based Processes of Change in Coaching, Prevention, and Training
Ciarrochi, J., Hayes, S. C., Oades, L. G., & Hofmann, S. G. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.809362 · Cited by 104
Assessing the accuracy of automatic speech recognition for psychotherapy
Miner, A. S., Haque, A., Fries, J., Fleming, S. L., Wilfley, D. E., Wilson, G. T., Milstein, A. S., Jurafsky, D., Arnow, B. A., Agras, W. S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0285-8 · Cited by 87
Measurement-based Care as a Practice Improvement Tool: Clinical and Organizational Applications in Youth Mental Health
Jensen‐Doss, A., Douglas, S. R., Phillips, D. A., Gencdur, O., Zalman, A., & Gomez, N. E. (2020) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2020.1784062 · Cited by 71
Self-citation
What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals
Connors, E. H., Douglas, S. R., Jensen‐Doss, A., Landes, S. J., Lewis, C. C., McLeod, B. D., Stanick, C., & Lyon, A. R. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01063-w · Cited by 74
Self-citation
Evidence Base for Measurement-Based Care in Child and Adolescent Psychiatry
Parikh, A., Fristad, M. A., Axelson, D., & Krishna, R. (2020) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2020.06.001 · Cited by 64
TARGET JNL: Neuropsychiatric Disease and Treatment Clinically Significant Changes in the 17- and 6-Item Hamilton Rating Scales for Depression: A STAR*D Report
Rush, A. J., South, C. C., Jain, S. B., Agha, R. S., Zhang, M., Shrestha, S., Khan, Z., Hassan, M., & Trivedi, M. H. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s305331 · Cited by 62
To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth
McLeod, B. D., Jensen‐Doss, A., Lyon, A. R., Douglas, S. R., & Beidas, R. S. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2042698 · Cited by 60
Self-citation
Natural language processing markers for psychosis and other psychiatric disorders: emerging themes and research agenda from a Cross-Linguistic Workshop
Corona Hernández, H., Corcoran, C., Achim, A. M., de Boer, J. N., Boerma, T., Brederoo, S. G., Cecchi, G. A., Ciampelli, S., Elvevåg, B., Fusaroli, R., et al. (2023) · Schizophrenia Bulletin · doi:10.1093/schbul/sbac215 · Cited by 56
Implementing Measurement-Based Care for Depression: Practical Solutions for Psychiatrists and Primary Care Physicians
Hong, R. H., Murphy, J., Michalak, E. E., Chakrabarty, T., Wang, Z., Parikh, S. V., Culpepper, L., Yatham, L. N., Lam, R. W. M., & Chen, J. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s283731 · Cited by 58
Multimodal Mental Health Digital Biomarker Analysis From Remote Interviews Using Facial, Vocal, Linguistic, and Cardiovascular Patterns
Jiang, Z., Seyedi, S. S., Griner, E. L., Abbasi, A., Rad, A. B., Kwon, H., Cotes, R. O., & Clifford, G. D. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3352075 · Cited by 89
Common measures or common metrics? A plea to harmonize measurement results
de Beurs, E., Boehnke, J. R., & Fried, E. I. (2022) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2742 · Cited by 55
Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review
de Jong, K., Douglas, S. R., Wolpert, M., Delgadillo, J., Aas, B., Bovendeerd, B., Carlier, I. V. E., Compare, A., Edbrooke-Childs, J. H., Janse, P. D., et al. (2024) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-024-01381-3 · Cited by 66
Self-citation
Peak-end bias in retrospective recall of depressive symptoms on the PHQ-9.
Horwitz, A. G., Zhao, Z., & Sen, S. (2023) · Psychological Assessment · doi:10.1037/pas0001219 · Cited by 63
Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions
McAleavey, A. A., de Jong, K., Nissen‐Lie, H. A., Boswell, J. F., Moltu, C., & Lutz, W. (2024) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-024-01351-9 · Cited by 78
Provider Perspectives on Integrating Sensor-Captured Patient-Generated Data in Mental Health Care
Ng, A., Kornfield, R., Schueller, S. M., Zalta, A. K., Brennan, M. B., & Reddy, M. C. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359217 · Cited by 51
Rapid Adoption and Implementation of Telehealth Group Psychotherapy During COVID 19: Practical Strategies and Recommendations
Puspitasari, A. J., Heredia, D., Gentry, M., Sawchuk, C., Theobald, B., Moore, W., Tiede, M., Galardy, C., & Schak, K. (2021) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2021.05.002 · Cited by 45
Self-citation
Randomized Trial of an Organizational Implementation Strategy to Improve Measurement-Based Care Fidelity and Youth Outcomes in Community Mental Health
Williams, N. J., Marcus, S. C., Ehrhart, M. G., Sklar, M., Esp, S. M., Carandang, K. M., Vega, N. R., Gomes, A. E., Brookman-Frazee, L. I., & Aarons, G. A. (2023) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2023.11.010 · Cited by 46
Discussing measurement-based care with patients: An analysis of clinician-patient dyads
Holliday, S. B., Hepner, K. A., Farmer, C. M., Mahmud, A., Kimerling, R. E., Smith, B. N., & Rosen, C. S. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1776413 · Cited by 41
Diagnostic operating characteristics of PROMIS scales in screening for depression
Kroenke, K., Stump, T. E., Kean, J. T., Krebs, E. E., Damush, T. M., Bair, M. J., & Monahan, P. O. (2021) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2021.110532 · Cited by 43
Self-citation
Future Challenges in Psychotherapy Research for Personality Disorders
Kramer, U., Eubanks, C. F., Bertsch, K., Herpertz, S. C., McMain, S., Mehlum, L. I., Renneberg, B., & Zimmermann, J. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01379-4 · Cited by 46
Client perspectives on psychotherapy failure
Knox, S., Miller, C., Twidwell, R. E., & Knowlton, G. (2022) · Psychotherapy Research · doi:10.1080/10503307.2022.2110020 · Cited by 44
Concordance between clinician-rated and patient reported outcome measures of depressive symptoms in treatment resistant depression
Hershenberg, R., McDonald, W. M., Crowell, A., Riva-Posse, P., Craighead, W. E., Mayberg, H. S., & Dunlop, B. W. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.108 · Cited by 40
Digitization of Measurement-Based Care Pathways in Mental Health Through REDCap and Electronic Health Record Integration: Development and Usability Study
Hawley, S., Yu, J., Bogetic, N., Potapova, N., Wakefield, C., Thompson, M., Kloiber, S. M., Hill, S., Jankowicz, D., & Rotenberg, D. J. (2021) · Journal of Medical Internet Research · doi:10.2196/25656 · Cited by 37
Measuring ICD shock anxiety: Status update on the Florida Shock Anxiety Scale after over a decade of use
Tripp, C., Huber, N. L., Kuhl, E. A., & Sears, S. F. (2019) · Pacing and Clinical Electrophysiology · doi:10.1111/pace.13793 · Cited by 37
Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences
Solstad, S. M., Kleiven, G. S., Castonguay, L. G., & Moltu, C. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1788741 · Cited by 35
Is Treatment Working? Detecting Real Change in the Treatment of Child and Adolescent Depression
Liu, F. F., & Adrian, M. C. (2019) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2019.02.011 · Cited by 34
Patient, family and provider views of measurement-based care in an early-psychosis intervention programme
Cuperfain, A. B., Hui, K., Berkhout, S., Foussias, G., Gratzer, D., Kidd, S. A., Kozloff, N., Kurdyak, P. A., Linaksita, B., Miranda, D., et al. (2021) · BJPsych Open · doi:10.1192/bjo.2021.1005 · Cited by 33
A Novel and Integrated Digitally Supported System of Care for Depression and Anxiety: Findings From an Open Trial
Wolitzky-Taylor, K. B., LeBeau, R. T., Arnaudova, I., Barnes‐Horowitz, N. M., Gong-Guy, E., Fears, S. C., Congdon, E. L., Freimer, N. B., & Craske, M. G. (2023) · JMIR Mental Health · doi:10.2196/46200 · Cited by 34
Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial
Williams, N. J., Ehrhart, M. G., Aarons, G. A., Esp, S. M., Sklar, M., Carandang, K. M., Vega, N. R., Brookman-Frazee, L. I., & Marcus, S. C. (2024) · Implementation Science · doi:10.1186/s13012-024-01356-w · Cited by 39
Predicting treatment effects in unipolar depression: A meta-review
Gillett, G., Tomlinson, A., Efthimiou, O., & Cipriani, A. (2020) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2020.107557 · Cited by 34
Feasibility and Initial Outcomes of a Group-Based Teletherapy Psychiatric Day Program for Adults With Serious Mental Illness: Open, Nonrandomized Trial in the Context of COVID-19
Puspitasari, A. J., Heredia, D., Coombes, B. J., Geske, J. R., Gentry, M. T., Moore, W. R., Sawchuk, C. N., & Schak, K. M. (2021) · JMIR Mental Health · doi:10.2196/25542 · Cited by 36
Self-citation
What do clinicians want? Understanding frontline addiction treatment clinicians’ preferences and priorities to improve the design of measurement-based care technology
Tauscher, J. S., Cohn, E. B., Johnson, T. R., Diteman, K. D., Ries, R. K., Atkins, D. C., & Hallgren, K. A. (2021) · Addiction Science & Clinical Practice · doi:10.1186/s13722-021-00247-5 · Cited by 34
Attitudes Towards the Use of Routine Outcome Monitoring of Psychological Therapies Among Mental Health Providers: The EBPAS–ROM
Rye, M., Rognmo, K., Aarons, G. A., & Skre, I. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00968-5 · Cited by 32
Trauma Informed Interventions to Reduce Seclusion, Restraint and Restrictive Practices Amongst Staff Caring for Children and Adolescents with Challenging Behaviours: A Systematic Review
Kelly, P., Saab, M. M., Hurley, E. J., Heffernan, M., Goodwin, J., Mulud, Z. A., O’Malley, M., O’Mahony, J., Curtin, M., Groen, G., et al. (2023) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-023-00524-2 · Cited by 42
Advancing clinical neuroscience through enhanced tools: Pediatric social anxiety as an example
Smith, A. R., Kircanski, K., Brotman, M. A., Quyen, B., Subar, A. R., Silk, J. S., Engel, S. G., Crosby, R. D., Harrewijn, A., White, L. K., et al. (2019) · Depression and Anxiety · doi:10.1002/da.22937 · Cited by 32
The Digital Clinic: An Innovative Mental Health Care Delivery Model Utilizing Hybrid Synchronous and Asynchronous Treatment
Macrynikola, N., Nguyen, N. S., Lane, E., Yen, S., & Torous, J. B. (2023) · NEJM Catalyst · doi:10.1056/cat.23.0100 · Cited by 30
Predicting outcomes of psychotherapy for depression with electronic health record data
Coley, R. Y., Boggs, J. M., Beck, A., & Simon, G. E. (2021) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2021.100198 · Cited by 29
Self-citation
Changes in affective and cognitive distortion symptoms of depression are reciprocally related during cognitive behavior therapy.
Persons, J., Marker, C., & Bailey, E. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104338 · Cited by 22
Manifestation of depression in speech overlaps with characteristics used to represent and recognize speaker identity
Dumpala, S. H., Dikaios, K., Rodriguez, S., Langley, R., Rempel, S., Uher, R., & Oore, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-35184-7 · Cited by 32
Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed‐methods quality improvement project
Wert, M. J. V., Malik, M. A., Memel, B., Moore, R., Buccino, D. L., Hackerman, F., Kumari, S., Everett, A. S., & Narrow, W. E. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13457 · Cited by 29
Integrating User-Centered Design and Behavioral Science to Design a Mobile Intervention for Obesity and Binge Eating: Mixed Methods Analysis
Graham, A. K., Munson, S. A., Reddy, M. C., Neubert, S. W., Green, E. A., Chang, A., Spring, B. J., Mohr, D. C., & Wildes, J. E. (2020) · JMIR Formative Research · doi:10.2196/23809 · Cited by 28
How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care
Lyon, A. R., Liu, F. F., Connors, E. H., King, K. M., Coifman, J. I., Cook, H., McRee, E., Ludwig, K., Law, A., Dorsey, S., et al. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00325-y · Cited by 28
Self-citation
Integrated Digital Mental Health Care: A Vision for Addressing Population Mental Health Needs
Lim, C. T., Fuchs, C. H., & Torous, J. B. (2024) · International Journal of General Medicine · doi:10.2147/ijgm.s449474 · Cited by 32
Implementation of Measurement-Based Care in Mental Health Service Settings for Youth: A Systematic Review
Whitmyre, E. D., Esposito-Smythers, C. L., López, R., Goldberg, D. G., Liu, F. F., & Defayette, A. B. (2024) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-024-00498-z · Cited by 31
Integrating Routine Screening for Opioid Use Disorder into Primary Care Settings: Experiences from a National Cohort of Clinics
Austin, E. J., Briggs, E. S., Ferro, L., Barry, P., Heald, A., Curran, G. M., Saxon, A. J., Fortney, J. C., Ratzliff, A., & Williams, E. C. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07675-2 · Cited by 27
Measurement-based care and psychological assessment: Using measurement to enhance psychological treatment.
Resnick, S. G., Oehlert, M. E., Hoff, R. A., & Kearney, L. K. (2020) · Psychological Services · doi:10.1037/ser0000491 · Cited by 28
Communication strategies to facilitate the implementation of new clinical practices: a qualitative study of community mental health therapists
ALBRIGHT, K. J., Navarro, E., Jarad, I., Boyd, M. R., Powell, B. J., & Lewis, C. C. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab139 · Cited by 30
Self-citation
Implementation strategies to promote measurement-based care in schools: evidence from mental health experts across the USA
Connors, E. H., Lyon, A. R., Garcia, K. A., Sichel, C. E., Hoover, S., Weist, M. D., & Tebes, J. K. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00319-w · Cited by 27
Self-citation
Setting measurement‐based care in motion: practical lessons in the implementation and integration of measurement‐based care in psychiatry clinical practice
Martin-Cook, K., Palmer, L., Thornton, L., Rush, A. J., Tamminga, C. A., & Ibrahim, H. M. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s308615 · Cited by 25
Challenges in Investigating the Effective Components of Feedback from Routine Outcome Monitoring (ROM) in Youth Mental Health Care
van Sonsbeek, M. A. M. S., Hutschemaekers, G. J. M., Veerman, J. W., Vermulst, A. A., Kleinjan, M., & Tiemens, B. G. (2020) · Child & Youth Care Forum · doi:10.1007/s10566-020-09574-1 · Cited by 24
Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency
Sale, R., Bearman, S. K., Woo, R., & Baker, N. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01076-5 · Cited by 23
A framework to make PROMs relevant to patients: qualitative study of communication preferences of PROMs
Lai, C. H., Shapiro, L. M., Amanatullah, D. F., Chou, L. B., Gardner, M. J., Hu, S. S., Safran, M. R., & Kamal, R. N. (2021) · Quality of Life Research · doi:10.1007/s11136-021-02972-5 · Cited by 25
A systematic review of brief, freely accessible, and valid self-report measures for substance use disorders and treatment
Stewart, R. E., Cardamone, N. C., Schachter, A., Becker, C., McKay, J. R., & Becker‐Haimes, E. M. (2022) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2022.109729 · Cited by 24
Validation of the PCL-5, PHQ-9, and GAD-7 in a Sample of Veterans
Ahmadi, A., Ponder, W. N., Carbajal, J., Schuman, D. L., Whitworth, J., Yockey, R. A., & Galusha, J. M. (2023) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000002898 · Cited by 24
Using the Beck Depression Inventory to Assess Anhedonia: A Scale Validation Study
Cogan, A. B., Persons, J. B., & Kring, A. M. (2023) · Assessment · doi:10.1177/10731911231164628 · Cited by 25
Progress feedback in psychotherapy: Advantages, challenges, and future directions
Janse, P. D., van Sonsbeek, M. A. M. S., Bovendeerd, B., & de Jong, K. (2025) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2025.102110 · Cited by 22
Strategies to enhance communication with telemental health measurement-based care (tMBC).
Douglas, S. R., Jensen‐Doss, A., Ordorica, C., & Comer, J. S. (2020) · Practice Innovations · doi:10.1037/pri0000119 · Cited by 22
Self-citation
Beyond the Therapist’s Office: Merging Measurement-Based Care and Digital Medicine in the Real World
Chiauzzi, E. J., & Wicks, P. J. (2021) · Digital Biomarkers · doi:10.1159/000517748 · Cited by 23
The Patient Mania Questionnaire (PMQ-9): a Brief Scale for Assessing and Monitoring Manic Symptoms
Cerimele, J. M., Russo, J., Bauer, A. M., Hawrilenko, M., Pyne, J. M., Dalack, G. W., Kroenke, K., Unützer, J., & Fortney, J. C. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06947-7 · Cited by 21
Self-citation
Loss of PTSD Diagnosis in Response to Evidence-Based Treatments
Milligan, T., Smolenski, D. J., Lara‐Ruiz, J., & Kelber, M. S. (2025) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2025.0695 · Cited by 23
Using Digital Measurement–Based Care for the Treatment of Anxiety and Depression in Children and Adolescents: Observational Retrospective Analysis of Bend Health Data
Huffman, L. G., Lawrence‐Sidebottom, D., Huberty, J., Roots, M., Roots, K., Parikh, A., Guerra, R., & Weiser, J. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/46154 · Cited by 23
Organization-level variation in therapists’ attitudes toward and use of measurement-based care
Williams, N. J., Vega, N. R., Esp, S. M., Watts, A., & Marcus, S. C. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01206-1 · Cited by 21
Digital mental health treatment implementation playbook: successful practices from implementation experiences in American healthcare organizations
Mohr, D. C., Silverman, A. L., Youn, S. J., Areán, P. A., Bertagnolli, A., Carl, J. R., Carlton, T., Chaudhary, N., Cooper, D. E., DeVito, S., et al. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1509387 · Cited by 21
Evaluation of an On-Demand Mental Health System for Depression Symptoms: Retrospective Observational Study
Kunkle, S., Yip, M., Watson, Ξ., & Hunt, J. B. (2020) · Journal of Medical Internet Research · doi:10.2196/17902 · Cited by 19
A Roadmap for Measurement-based Care Implementation in Intensive Outpatient Treatment Settings for Children and Adolescents
Childs, A. W., & Connors, E. H. (2021) · Evidence-Based Practice in Child and Adolescent Mental Health · doi:10.1080/23794925.2021.1975518 · Cited by 21
Machine-Learning-Based Prediction of Client Distress From Session Recordings
Kuo, P. B., Tanana, M., Goldberg, S. B., Caperton, D. D., Narayanan, S. S., Atkins, D. C., & Imel, Z. E. (2023) · Clinical Psychological Science · doi:10.1177/21677026231172694 · Cited by 23
Performance of the PHQ-9 across conditions and comorbidities: Findings from the Veterans Outcome Assessment survey
Katz, I. R., Liebmann, E. P., Resnick, S. G., & Hoff, R. A. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.07.108 · Cited by 22
It Is Time to Flip the Script and Leverage the Point of Care to Discover Ways of Improving Treatment Outcomes for Posttraumatic Stress Disorder: Commentary on “A Sobering Look at Treatment Effectiveness of Military-Related Posttraumatic Stress Disorder” (Levi et al., 2021)
Litz, B. T. (2022) · Clinical Psychological Science · doi:10.1177/21677026221101068 · Cited by 19
Barriers and facilitators to implementing measurement-based care for depression in Shanghai, China: a situational analysis
Murphy, J., Michalak, E. E., Liu, J., Colquhoun, H. L., Burton, H., Yang, X., Yang, T., Wang, X., Fei, Y., He, Y., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03442-5 · Cited by 20
A modified measurement-based care approach to improve mental health treatment engagement among racial and ethnic minoritized youth.
Connors, E. H., Arora, P. G., Resnick, S. G., & McKay, M. M. (2022) · Psychological Services · doi:10.1037/ser0000617 · Cited by 19
Developing an Implementation Model for ADHD Intervention in Community Clinics: Leveraging Artificial Intelligence and Digital Technology
Sibley, M., Bickman, L., Atkins, D., Tanana, M. J., Coxe, S., Ortiz, M., Martin, P., King, J., Monroy, J. M., Ponce, T., et al. (2023) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2023.02.001 · Cited by 17
The Impact of Measurement-Based Care in Psychiatry: An Integrative Review
DeSimone, J., & Hansen, B. R. (2023) · Journal of the American Psychiatric Nurses Association · doi:10.1177/10783903231177707 · Cited by 19
Real-world behavioral dataset from two fully remote smartphone-based randomized clinical trials for depression
Pratap, A., Homiar, A., Waninger, L., Herd, C., Suver, C., Volponi, J. J., Anguera, J. A., & Areán, P. A. (2022) · Scientific Data · doi:10.1038/s41597-022-01633-7 · Cited by 22
Exploration, Preparation, and Implementation of Standardized Assessment in a Multi-agency School Behavioral Health Network
Connors, E., Lawson, G. M., Wheatley-Rowe, D., & Hoover, S. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01082-7 · Cited by 20
Applying behaviour change theory to understand the barriers to implementing routine outcome monitoring
Bear, H. A., Dalzell, K., Edbrooke-Childs, J. H., & Wolpert, M. (2021) · British Journal of Clinical Psychology · doi:10.1111/bjc.12322 · Cited by 18
The effectiveness of enhanced evidence-based care for depressive disorders: a meta-analysis of randomized controlled trials
Xiao, L., Qi, H., Zheng, W., Xiang, Y., Carmody, T. J., Mayes, T. L., Trivedi, M. H., & Wang, G. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01638-7 · Cited by 18
Standardized Versus Tailored Implementation of Measurement-Based Care for Depression in Community Mental Health Clinics
Lewis, C. C., Marti, C. N., Scott, K., Walker, M. R., Boyd, M. R., Puspitasari, A. J., Mendel, P. J., & Kroenke, K. (2022) · Psychiatric Services · doi:10.1176/appi.ps.202100284 · Cited by 18
Self-citation
Successful ingredients of effective Collaborative Care programs in low- and middle-income countries: A rapid review
Whitfield, J., Owens, S., Bhat, A. S., Felker, B. L., Jewell, T. E., & Chwastiak, L. (2023) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2022.60 · Cited by 20
Using Digital Measurement–Based Care to Address Symptoms of Inattention, Hyperactivity, and Opposition in Youth: Retrospective Analysis of Bend Health
Lawrence‐Sidebottom, D., Huffman, L. G., Huberty, J., Beatty, C. C., Roots, M., Roots, K., Parikh, A., Guerra, R., & Weiser, J. (2023) · JMIR Formative Research · doi:10.2196/46578 · Cited by 20
Perceptions of mental health providers of the barriers and facilitators of using and engaging youth in digital mental-health-enabled measurement based care
Bassi, E. M., Bright, K. S., Norman, L., Pintson, K., Daniel, S., Sidhu, S., Gondziola, J., Bradley, J., Fersovitch, M., Stamp, L. K., et al. (2024) · Digital Health · doi:10.1177/20552076241253093 · Cited by 21
Addiction Medicine Practice-Based Research Network (AMNet): Assessment Tools and Quality Measures
Clarke, D. E., Ibrahim, A., Doty, B., Patel, S., Gibson, D., Pagano, A., Thompson, L. R., Goldstein, A. B., Vocci, F. J., & Schwartz, R. P. (2021) · Substance Abuse and Rehabilitation · doi:10.2147/sar.s305972 · Cited by 18
Community Implementation of MI-Enhanced Behavior Therapy for Adolescent ADHD: Linking Fidelity to Effectiveness
Sibley, M. H., Bickman, L., Coxe, S. J., Graziano, P. A., & Martin, P. (2020) · Behavior Therapy · doi:10.1016/j.beth.2020.10.007 · Cited by 17

Authors: Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., Simon, G., & Kroenke, K.
Affiliations: Kaiser Permanente Washington Health Research Institute (US)
University of California, Los Angeles (US)
Mayo Clinic (US)
Indiana University Bloomington (US)
Ohio University (US)
West Virginia University (US)
Brown University (US)
University of Washington (US)
Vanderbilt University (US)
Regenstrief Institute (US)
ORCID: Lewis, Cara C.
Boyd, Meredith
Puspitasari, Ajeng
Howard, Jacqueline
Kassab, Hannah
Scott, Kelli
Lyon, Aaron
Douglas, Susan
Kroenke, Kurt
Venue: JAMA Psychiatry
Publisher: American Medical Association (AMA)
Published: 2019-03-01
Volume: 76
Issue: 3
Pages: 324
ISSN: 2168-622X (ISSN-L)
DOI: 10.1001/jamapsychiatry.2018.3329
PMC: PMC6584602
OpenAlex: W2904026243
Cited by: 605
References: 90
Citations by year: 2026: 91 · 2025: 97 · 2024: 110 · 2023: 80 · 2022: 75 · 2021: 92 · 2020: 49 · 2019: 11
FWCI: 6.87
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: JAMA Psychiatry (publishedVersion)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Mental Health (F31MH111134, R01MH103310)
Topics: Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
Keywords: measurement-based care, behavioral health, implementation barriers, implementation fidelity, psychotherapy, electronic health records interoperability, learning collaborative, local champions, reimbursement policy
MeSH terms: Mental Disorders, Humans, Mental Health Services, Treatment Outcome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Implementing Measurement-Based Care in Behavioral Health: A Review

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks