The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Outcome monitoring feedback has become popular, but its effect on treatment outcome has been mixed. Feedback seems most effective for patients who are not progressing well ("not on track" (NOT) cases). There are some indications that patient feedback has an additional effect and that feedback effects differentiate between short- and long-term therapy. This study aimed to evaluate the effect of outcome monitoring feedback to therapists and patients on outcome in short- and long-term psychotherapy. METHODS: Patients (n = 475) were randomly assigned to three conditions: Feedback to therapist (FbT), feedback to therapist and patient (FbTP), and no feedback (NFb). Feedback consisted of progress charts based on the Outcome Questionnaire and a feedback message. RESULTS: In short-term therapies (<35 weeks) FbT and FbTP was preventive of negative change for NOT cases. In long-term therapy only FbTP had a small positive effect on the rate of change. Feedback did not result in better outcomes at treatment ending, although there was a trend for FbTP to have fewer deteriorated cases. CONCLUSIONS: Benefits of feedback were strongest for cases that were not progressing well in short-term therapies when both the patient and therapist received feedback on the patients' progress. Contrary to previous findings, we also found a small effect of feedback to therapists and patients in long-term therapies. Feedback to both patients and therapists may be more effective than feedback to therapists alone due to implementation issues or empowerment of the patient.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · cited 1×
“Outcome monitoring feedback has become increasingly popular and has been adopted by many mental health care providers all over the world (e.g., Evans et al., 2002; Howard, Moras, Brill, Correspondence concerning this article should be addressed to Kim de Jong, Erasmus University Medical Center,…”
BackgroundShimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657 · cited 4×
“Their studies typically demonstrate that feedback is most effective for NOT cases (Lambert et al., 2003; Shimokawa et al., 2010).”
BackgroundInfluentialIs it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608 · cited 4×
“Consistent with previous studies (Lambert et al., 2003), the strongest effects of feedback in our study were found in NOT cases in short-term therapies, so providing feedback is mainly recommended in those cases.”
BackgroundResultInfluentialImpact of patient‐reported outcome measures on routine practice: a structured review
Marshall, S., Haywood, K., & Fitzpatrick, R. (2006) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00650.x · Cited by 602
Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1059 · Cited by 573
Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006) · Medical Teacher · doi:10.1080/01421590600622665 · Cited by 500
Cited by
de Jong, K., Conijn, J. M., Gallagher, R. A. V., Reshetnikova, A. S., Heij, M., & Lutz, M. C. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102002 · Cited by 417
Self-citationCollecting and delivering progress feedback: A meta-analysis of routine outcome monitoring.
Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018) · Psychotherapy · doi:10.1037/pst0000167 · Cited by 392
Harvey, A. G., & Gumport, N. B. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.02.004 · Cited by 221
“Indeed, the use of progress monitoring results in fewer patients deteriorating during or after treatment (De Jong et al., 2013).”
BackgroundGual-Montolio, P., Martínez-Borba, V., Bretón-López, J. M., Osma, J., & Suso-Ribera, C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17093170 · Cited by 38
Sembill, A., Vocks, S., Kosfelder, J., & Schöttke, H. (2019) · Psychotherapy Research · doi:10.1080/10503307.2017.1405170 · Cited by 24
Metadata
- Authors
- De Jong, K., Timman, R., Hakkaart-Van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., & Busschbach, J. V.
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2014-01-06
- Volume
- 24
- Issue
- 6
- Pages
- 629-639
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W2142438153
- Cited by
- 100
- References
- 14
- FWCI
- 13.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial. https://app.cochat.ai/papers/10.1080/10503307.2013.871079
- The paper
- De Jong, K., Timman, R., Hakkaart-Van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., & Busschbach, J. V. (2014). The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial. Psychotherapy Research. https://doi.org/10.1080/10503307.2013.871079
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.