The merits of implementing routine outcome monitoring in clinical practice.
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
A growing body of research (e.g., Shimokawa, Lambert, & Smart, 2010) provides evidence for a set of practices that have come to be known as routine outcome monitoring (ROM). ROM consists of using (mainly) self‐report measures of mental health functioning at the inception of treatment and frequently thereafter over the course of treatment. The purpose of such monitoring is to provide feedback to therapists (and clients) about client progress and, more importantly, possible impending treatment failure (i.e., worsening, nonresponse, premature dropout, and/or discontinuation due to perceived lack of benefit from treatment). The use of measured mental health status feedback appears to work by enhancing therapist responsiveness and collaboration with the client, just as monitoring blood sugar helps a physician and patient to manage diabetes. In this article, we wish to further define ROM and differentiate between practices associated with ROM approaches. We compare and contrast the two most widely disseminated and intensively studied systems—the Outcome Questionnaire (OQ)‐System (Lambert, 2010; Lambert et al., 2013; www. oqmeasures.com) and the Partners for Change Outcome Management System (PCOMS; Duncan & Reese, 2015; www.centerforclinicalexcellence.com, www.heartandsoulofchange.com; pcoms.com). These two systems have been applied with thousands of client samples and treatment settings and modalities. We also highlight barriers to their use and potential solutions to some of the substantial implementation issues that arise when they are instigated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
Ericsson, K. A. (2006) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/cbo9780511816796.038 · Cited by 1,629 · cited 1×
“Persons speculate that the process can also serve the larger purpose of building therapist expertise over time as feedback informs the clinician about what works and what does not work in treatment (in a general sense), as well as specifically with each client (Ericsson, 2006).”
BackgroundThe psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783
Self-citationShimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657 · cited 1×
“Using these methods, Shimokawa et al. (2010) found the OQ‐System using Clinical Support Tools reduced deterioration rates in at‐risk cases from the base rate in TAU of 21% to about 6%, while the rate of reliable improvement more than doubled from 21% to 50%.”
MethodSelf-citationBarkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., Benson, L., Connell, J., Audin, K., & McGrath, G. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.2.184 · Cited by 532 · cited 2×
“Implementation might also be a priority for organizations interested in compensation or demonstration and promotion of data‐driven, first‐rate care as there are methods other than ROM, such as the use of quality assessment and reimbursement for quality of care, that can use data from ROM practices as their quality ind…”
BackgroundMethodImplementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494 · cited 1×
“Boswell et al. (2015) also recommended strategies to employ in the implementation of ROM that included transparency and clarity regarding ROM and its use, establishing benchmarks, providing formal training and guidance, employing local champions, and incentivizing routine outcome data collection…”
MethodSelf-citationBickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011) · Psychiatric Services · doi:10.1176/appi.ps.002052011 · Cited by 421
An investigation of self-assessment bias in mental health providers
Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012) · Psychological Reports · doi:10.2466/02.07.17.pr0.110.2.639-644 · Cited by 394
Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.656 · Cited by 321
The Decision to Adopt Evidence-Based and Other Innovative Mental Health Practices: Risky Business?
Panzano, P. C., & Roth, D. (2006) · Psychiatric Services · doi:10.1176/appi.ps.57.8.1153 · Cited by 115 · cited 2×
“Panzano and Roth’s (2006) discovery that perceived risk is malleable, and that the effects of risk management capacity operate through perceived risk seems particularly advantageous to ROM practices.”
Background
Cited by
Etzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/18100 · Cited by 356
“of the effects of routine outcome monitoring in routinely applied iCBT [169], as this monitoring could help evaluate participants’ progress throughout the course of treatment, using standardized outcome measures to elicit clients as part of a measurement-based care delivery approach in routine mental and behavioral he…”
MethodStade, E. C., Stirman, S. W., Ungar, L. H., Boland, C. L., Schwartz, H. A., Yaden, D. B., Sedoc, J., DeRubeis, R. J., Willer, R., & Eichstaedt, J. C. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00056-z · Cited by 391
“ClinicalLLMsoughttointegrate psychodiagnostic assessment and diagnosis, facilitating intervention selectionandoutcome monitoring 75 .”
MethodHerzog, P., Lauff, S., Rief, W., & Brakemeier, E. (2019) · Brain and Behavior · doi:10.1002/brb3.1447 · Cited by 95
Common measures or common metrics? A plea to harmonize measurement results
de Beurs, E., Boehnke, J. R., & Fried, E. I. (2022) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2742 · Cited by 55
Metadata
- Authors
- Lambert, M. J., & Harmon, K. L.
- Venue
- Clinical Psychology: Science and Practice
- Published
- 2018-12
- Volume
- 25
- Issue
- 4
- ISSN
- 0969-5893 (ISSN-L)
- 1468-2850
- OpenAlex
- W2905110776
- Cited by
- 74
- References
- 10
- FWCI
- 7.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The merits of implementing routine outcome monitoring in clinical practice. https://app.cochat.ai/papers/10.1111/cpsp.12268
- The paper
- Lambert, M. J., & Harmon, K. L. (2018). The merits of implementing routine outcome monitoring in clinical practice. Clinical Psychology: Science and Practice. https://doi.org/10.1111/cpsp.12268
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.