Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Objective To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice.Method A narrative review of the three phases of ROMdata collection, feeding back data, and adapting therapyand an overview of patient outcomes from 11 meta-analytic studies.Results Patients support ROM when its purpose is clear and integrated within therapy.Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful.Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53).Effects are additive to standard effects of psychological therapies.Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM.Conclusion ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care.CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · cited 1×
“Introduction Since the mid-1900s, statistical (i.e., actuarial) models have been claimed (Meehl, 1954) and evidenced (Ægisdóttir et al., 2006) to be more accurate than clinical judgements, since psychological therapists are known to be overconfident in evaluating their own effectiveness (Walfish et…”
BackgroundShimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657 · cited 6×
“…al., 2015; Mackrill & Sørensen, 2020) and at least 11 meta-analyses (Bergman et al., 2018; De Jong et al., 2021; Kendrick et al., 2016; Knaup et al., 2009; Lambert et al., 2003, 2018; Østergård et al., 2020; Pejtersen et al., 2020; Rognstad et al., 2022; Shimokawa et al., 2010; Tam & Ronan, 2017).”
InfluentialIs it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608 · cited 4×
“ESs regarding improvement for NOT patients with feedback vs. treatment as usual (TAU) have been reported in seven meta-analyses (De Jong et al., 2021; Kendrick et al., 2016; Lambert et al., 2003, 2018; Østergård et al., 2020; Rognstad et al., 2022; Shimokawa et al., 2010).”
InfluentialImplementing Measurement-Based Care in Behavioral Health: A Review
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3329 · Cited by 605 · cited 1×
“…both positive and null findings, the literature is almost unanimous in identifying implementation as the main barrier for successful ROM with obstacles grouped into three main categories: (1) the people, (2) organizational aspects, and (3) systems (Lewis et al., 2019; Van Wert et al., 2021).”
Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1059 · Cited by 573
Self-citationImplementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494
Realizing the Mass Public Benefit of Evidence-Based Psychological Therapies: The IAPT Program
Clark, D. M. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050817-084833 · Cited by 492 · cited 2×
“, 2019), England (Clark, 2018), and Norway (Knapstad et al.”
BackgroundAn investigation of self-assessment bias in mental health providers
Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012) · Psychological Reports · doi:10.2466/02.07.17.pr0.110.2.639-644 · Cited by 394
Cited by
Schramm, E., Elsaesser, M., Jenkner, C., Hautzinger, M., & Herpertz, S. C. (2024) · World Psychiatry · doi:10.1002/wps.21204 · Cited by 34
“However, monitoring and feedback systems have been reported to increase the efficacy of psychotherapies by further personalizing and adapting interventions to the patients’ response 53,54 .”
Background
Metadata
- Authors
- Barkham, M., De Jong, K., Delgadillo, J., & Lutz, W.
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2023-03-17
- Volume
- 33
- Issue
- 7
- Pages
- 841-855
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W4327695169
- Cited by
- 169
- References
- 15
- FWCI
- 46.35
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations. https://app.cochat.ai/papers/10.1080/10503307.2023.2181114
- The paper
- Barkham, M., De Jong, K., Delgadillo, J., & Lutz, W. (2023). Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations. Psychotherapy Research. https://doi.org/10.1080/10503307.2023.2181114
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.