The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
A Tipping Point for Measurement-Based Care
Abstract
OBJECTIVE: Measurement-based care involves the systematic administration of symptom rating scales and use of the results to drive clinical decision making at the level of the individual patient. This literature review examined the theoretical and empirical support for measurement-based care. METHODS: Articles were identified through search strategies in PubMed and Google Scholar. Additional citations in the references of retrieved articles were identified, and experts assembled for a focus group conducted by the Kennedy Forum were consulted. RESULTS: Fifty-one relevant articles were reviewed. There are numerous brief structured symptom rating scales that have strong psychometric properties. Virtually all randomized controlled trials with frequent and timely feedback of patient-reported symptoms to the provider during the medication management and psychotherapy encounters significantly improved outcomes. Ineffective approaches included one-time screening, assessing symptoms infrequently, and feeding back outcomes to providers outside the context of the clinical encounter. In addition to the empirical evidence about efficacy, there is mounting evidence from large-scale pragmatic trials and clinical demonstration projects that measurement-based care is feasible to implement on a large scale and is highly acceptable to patients and providers. CONCLUSIONS: In addition to the primary gains of measurement-based care for individual patients, there are also potential secondary and tertiary gains to be made when individual patient data are aggregated. Specifically, aggregated symptom rating scale data can be used for professional development at the provider level and for quality improvement at the clinic level and to inform payers about the value of mental health services delivered at the health care system level.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Vos, T., Flaxman, A. D., Naghavi, M., Lozano, R., Michaud, C., Ezzati, M., Shibuya, K., Salomon, J. A., Abdalla, S., Aboyans, V., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61729-2 · Cited by 8,291
Trivedi, M. H., Rush, A. J., Wisniewski, S. R., Nierenberg, A. A., Warden, D., Ritz, L., Norquist, G., Howland, R. H., Lebowitz, B., McGrath, P. J., et al. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.1.28 · Cited by 3,879
Unützer, J., Katon, W., Callahan, C. M., Williams, Jr., Hunkeler, E., Harpole, L., Hoffing, M., Della Penna, R. D., Noël, P. H., Lin, E. H. B., et al. (2002) · JAMA · doi:10.1001/jama.288.22.2836 · Cited by 2,405
Self-citationFrank, E. (1991) · Archives of General Psychiatry · doi:10.1001/archpsyc.1991.01810330075011 · Cited by 1,959
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657
A lab test and algorithms for identifying clients at risk for treatment failure
Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20108 · Cited by 542
Miklowitz, D. J., Otto, M. W., Frank, E., Reilly-Harrington, N. A., Wisniewski, S. R., Kogan, J. N., Nierenberg, A. A., Calabrese, J. R., Marangell, L. B., Gyulai, L., et al. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.4.419 · Cited by 537
Sachs, G. S., Thase, M. E., Otto, M. W., Bauer, M., Miklowitz, D., Wisniewski, S. R., Lavori, P., Lebowitz, B., Rudorfer, M., Frank, E., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(03)00165-3 · Cited by 533
Using Measurement-Based Care to Enhance Any Treatment
Scott, K., & Lewis, C. C. (2015) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.01.010 · Cited by 461
Roy-Byrne, P., Craske, M. G., Sullivan, G., Rose, R. D., Edlund, M. J., Lang, A. J., Bystritsky, A., Welch, S. S., Chavira, D. A., Golinelli, D., et al. (2010) · JAMA · doi:10.1001/jama.2010.608 · Cited by 452
Screening and case-finding instruments for depression: a meta-analysis
Gilbody, S., Sheldon, T., & House, A. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.070281 · Cited by 443
Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011) · Psychiatric Services · doi:10.1176/appi.ps.002052011 · Cited by 421
Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003) · Journal of Counseling Psychology · doi:10.1037//0022-0167.50.1.59 · Cited by 374
Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016062 · Cited by 347
Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.656 · Cited by 321
Collaborative care for bipolar disorder, Part II: impact on clinical outcome, function, and costs.
Bauer, M. S., McBride, L., Williford, W. O., Glick, H., Kinosian, B., Altshuler, L., Beresford, T., Kilbourne, A. M., & Sajatovic, M. (2006) · Psychiatric Services · doi:10.1176/ps.2006.57.7.937 · Cited by 312
Guo, T., Xiang, Y.-T., Xiao, L., Hu, C.-Q., Chiu, H. F. K., Ungvari, G. S., Correll, C. U., Lai, K. Y. C., Feng, L., Geng, Y., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14050652 · Cited by 308
Enhancing psychotherapy outcomes via providing feedback on client progress: a replication
Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.324 · Cited by 306
Fortney, J. C., Pyne, J. M., Mouden, S. B., Mittal, D., Hudson, T. J., Schroeder, G. W., Williams, D. K., Bynum, C. A., Mattox, R., & Rost, K. M. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12050696 · Cited by 296
Self-citationOutcome in psychotherapy: The past and important advances.
Lambert, M. J. (2013) · Psychotherapy · doi:10.1037/a0030682 · Cited by 286
Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007) · Psychotherapy Research · doi:10.1080/10503300600702331 · Cited by 268
Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis
Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.053967 · Cited by 265
Long-term Effectiveness and Cost of a Systematic Care Program for Bipolar Disorder
Simon, G. E., Ludman, E. J., Bauer, M. S., Unützer, J., & Operskalski, B. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.500 · Cited by 263
Self-citationPractice-Based Evidence Study Design for Comparative Effectiveness Research
Horn, S. D., & Gassaway, J. (2007) · Medical Care · doi:10.1097/mlr.0b013e318070c07b · Cited by 257
Feedback to clinicians: Theory, research, and practice
Sapyta, J., Riemer, M., & Bickman, L. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20107 · Cited by 253
Crismon, M. L., Trivedi, M., Pigott, T. A., Rush, A. J., Hirschfeld, R. M. A., Kahn, D. A., DeBattista, C., Nelson, J. C., Nierenberg, A. A., Sackeim, H. A., et al. (1999) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v60n0302 · Cited by 250
The therapeutic effects of providing patient progress information to therapists and patients
Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004) · Psychotherapy Research · doi:10.1093/ptr/kph027 · Cited by 230
Does a continuous feedback system improve psychotherapy outcome?
Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/a0017901 · Cited by 218
Dowrick, C., Leydon, G. M., McBride, A., Howe, A., Burgess, H., Clarke, P., Maisey, S., & Kendrick, T. (2009) · BMJ · doi:10.1136/bmj.b663 · Cited by 213
Strategies to Improve the Management of Depression in Primary Care
Unützer, J., & Park, M. (2012) · Primary Care: Clinics in Office Practice · doi:10.1016/j.pop.2012.03.010 · Cited by 197
Self-citationIndividualized Outcome Measures: A Review of the Literature
Donnelly, C., & Carswell, A. (2002) · Canadian Journal of Occupational Therapy · doi:10.1177/000841740206900204 · Cited by 182
Why Don't Psychiatrists Use Scales to Measure Outcome When Treating Depressed Patients?
Zimmerman, M., & McGlinchey, J. B. (2008) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v69n1209 · Cited by 179
Measurement-Based Care in Psychiatric Practice: A Policy Framework for Implementation
Harding, K. J. K., Rush, A. J., Arbuckle, M., Trivedi, M. H., & Pincus, H. A. (2011) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.10r06282whi · Cited by 175
Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.594 · Cited by 173
Quality Improvement With Pay-for-Performance Incentives in Integrated Behavioral Health Care
Unützer, J., Chan, Y.-F., Hafer, E., Knaster, J., Shields, A., Powers, D., & Veith, R. C. (2012) · American Journal of Public Health · doi:10.2105/ajph.2011.300555 · Cited by 167
Self-citationEffect of client feedback on couple psychotherapy outcomes.
Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/a0021182 · Cited by 167
Why Some Clinicians Use Outcome Measures and Others Do Not
Hatfield, D. R., & Ogles, B. M. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0110-y · Cited by 162
Krägeloh, C. U., Czuba, K., Billington, D. R., Kersten, P., & Siegert, R. J. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201400141 · Cited by 161
Use of standardised outcome measures in adult mental health services: Randomised controlled trial
Slade, M., McCrone, P., Kuipers, E., Leese, M., Cahill, S., Parabiaghi, A., Priebe, S., & Thornicroft, G. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.015412 · Cited by 147
Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.698918 · Cited by 137
. Comparison of self-report and clinician ratings on two inventories of depressive symptomatology.
Rush, A. J., Carmody, T. J., Ibrahim, H. M., Trivedi, M. H., Biggs, M. M., Shores-Wilson, K., Crismon, M. L., Toprac, M. G., & Kashner, T. M. (2006) · Psychiatric Services · doi:10.1176/ps.2006.57.6.829 · Cited by 128
Rollman, B. L., Hanusa, B. H., Lowe, H., Gilbert, T., Kapoor, W. N., & Schulberg, H. C. (2002) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2002.10421.x · Cited by 125
Strategies for improving treatment of bipolar disorder: integration of measurement and management
Sachs, G. S. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2004.00409.x · Cited by 123
A Self-Report Symptom and Problem Rating Scale to Increase Inpatients' Involvement in Treatment
Eisen, S. V., Dickey, B., & Sederer, L. I. (2000) · Psychiatric Services · doi:10.1176/appi.ps.51.3.349 · Cited by 115
Does depression screening improve depression outcomes in primary care?
Thombs, B. D., & Ziegelstein, R. C. (2014) · BMJ · doi:10.1136/bmj.g1253 · Cited by 104
Oslin, D. W., Sayers, S. L., Ross, J., Kane, V., Have, T. T., Conigliaro, J. C., & Cornelius, J. R. (2003) · Psychosomatic Medicine · doi:10.1097/01.psy.0000097335.35776.fb · Cited by 102
Effects of sustained audit/feedback on self-reported health status of primary care patients
Fihn, S. D., McDonell, M. B., Diehr, P. H., Anderson, S. M., Bradley, K. A., Au, D. H., Spertus, J. A., Burman, M. L., Reiber, G. E., Kiefe, C. I., et al. (2004) · The American Journal of Medicine · doi:10.1016/j.amjmed.2003.10.026 · Cited by 86
Pomerantz, A. S., Kearney, L. K., Wray, L. O., Post, E. P., & McCarthy, J. F. (2014) · Psychological Services · doi:10.1037/a0036638 · Cited by 68
Implementing standardized assessments in clinical care: Now's the time
Valenstein, M., Adler, D. A., Berlant, J., Dixon, L. B., Dulit, R. A., Goldman, B., Hackman, A., Oslin, D. W., Siris, S. G., & Sonis, W. A. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.10.1372 · Cited by 64
Katzelnick, D. J., Duffy, F. F., Chung, H., Regier, D. A., Rae, D. S., & Trivedi, M. H. (2011) · Psychiatric Services · doi:10.1176/ps.62.8.pss6208_0929 · Cited by 63
Schmidt, U. H., Landau, S., Pombo‐Carril, M. G., Bara‐Carril, N., Reid, Y., Murray, K. A., Treasure, J. L., & Katzman, M. A. (2006) · British Journal of Clinical Psychology · doi:10.1348/014466505x29143 · Cited by 63
Clinical Inertia in Depression Treatment
Henke, R. M., Zaslavsky, A. M., McGuire, T. G., Ayanian, J. Z., & Rubenstein, L. V. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819a5da0 · Cited by 58
Risk-Adjusting Outcomes of Mental Health and Substance-Related Care: A Review of the Literature
Hermann, R. C., Rollins, C. K., & Chan, J. (2007) · Harvard Review of Psychiatry · doi:10.1080/10673220701307596 · Cited by 57
Zimmerman, M. A., & McGlinchey, J. B. (2008) · Annals of Clinical Psychiatry · doi:10.1080/10401230802177680 · Cited by 51
Priebe, S., McCabe, R., Bullenkamp, J., Hansson, L., Rössler, W., Torres-Gonzales, F., & Wiersma, D. (2002) · Epidemiologia e Psichiatria Sociale · doi:10.1017/s1121189x00005728 · Cited by 45
Routine outcome measurement by mental health-care providers: is it worth doing?
Bilsker, D., & Goldner, E. M. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11610-2 · Cited by 45
Johnson‐Lawrence, V., Zivin, K., Szymanski, B. R., Pfeiffer, P. N., & McCarthy, J. F. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201100365 · Cited by 39
Murphy, K. P., Rashleigh, C. M., & Timulák, L. (2012) · Counselling Psychology Quarterly · doi:10.1080/09515070.2012.662349 · Cited by 35
Hansson, H., Rundberg, J., Österling, A., Öjehagen, A., & Berglund, M. (2012) · Nordic Journal of Psychiatry · doi:10.3109/08039488.2012.736534 · Cited by 35
Goldstein, L. A., Gibbons, M. B. C., Thompson, S. M., Scott, K., Heintz, L., Green, P. A., Thompson, D., & Crits-Christoph, P. F. (2010) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-010-9229-4 · Cited by 26
The Imperative of Outcome Assessment in Psychiatry
Sederer, L. I., Hermann, R. C., & Dickey, B. (1995) · American Journal of Medical Quality · doi:10.1177/0885713x9501000303 · Cited by 20
State of the science of mental health and substance abuse patient outcomes assessment
Smith, G. R. (1996) · New Directions for Mental Health Services · doi:10.1002/yd.23319960307 · Cited by 15
Self-citationKarpenko, V., & Owens, J. S. (2012) · Community Mental Health Journal · doi:10.1007/s10597-012-9515-0 · Cited by 10
Research works printed but not linked: 3
- Melek S, 2014, Economic Impact of Integrated Medical-Behavioral Healthcare: Implications for Psychiatry
- 10.1037/0022-0167.50.1.59 · doi:10.1037/0022-0167.50.1.59 · Paper page
- 10.18553/jmcp.2005.11.9.774 · doi:10.18553/jmcp.2005.11.9.774
Cited by
Digital Phenotyping: Technology for a New Science of Behavior
Insel, T. R. (2017) · JAMA · doi:10.1001/jama.2017.11295 · Cited by 833
The Lancet Commission on the future of care and clinical research in autism
Lord, C., Charman, T., Havdahl, A., Carbone, P., Anagnostou, E., Boyd, B., Carr, T., de Vries, P. J., Dissanayake, C., Divan, G., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)01541-5 · Cited by 924
Implementing Measurement-Based Care in Behavioral Health: A Review
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3329 · Cited by 605
Measuring and improving the quality of mental health care: a global perspective
Kilbourne, A. M., Beck, K., Spaeth‐Rublee, B., Ramanuj, P., O'Brien, R. W., Tomoyasu, N., & Pincus, H. A. (2018) · World Psychiatry · doi:10.1002/wps.20482 · Cited by 457
Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring.
Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018) · Psychotherapy · doi:10.1037/pst0000167 · Cited by 392
Metadata
- Authors
- Fortney, J. C., Unützer, J., Wrenn, G., Pyne, J. M., Smith, G. R., Schoenbaum, M., & Harbin, H. T.
- Venue
- Psychiatric Services
- Published
- 2017-02-01
- Volume
- 68
- Issue
- 2
- Pages
- 179-188
- ISSN
- 0022-1597 (ISSN-L)
- 1075-2730
- 1557-9700
- OpenAlex
- W2508555717
- Cited by
- 558
- References
- 64
- FWCI
- 42.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.