Routine outcome monitoring in the Netherlands: practical experiences with a web‐based strategy for the assessment of treatment outcome in clinical practice
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Routine outcome monitoring (ROM) is a method devised to systematically collect data on the effectiveness of treatments in everyday clinical practice. ROM involves documenting the outcome of treatments through repeated assessments. Assistants are employed who perform a baseline assessment comprising a standardized diagnostic interview, administration of rating scales and completion of several self‐report measures by the patient. At fixed time intervals, assessments are repeated. Dedicated Web‐based software has been developed to assist in this task. ROM informs therapists and patients on the severity of the complaints at intake, and the waxing and waning of symptoms over the course of treatment. Researchers can use ROM for effectiveness research, and managers can use it for benchmarking. The use of ROM for research is illustrated by presenting data on the diagnostic status of patients participating in ROM and data on treatment outcome of a subgroup of patients (with panic disorder) in our database. The results show that implementation of ROM is feasible, and after some initial reservations, most therapists now consider ROM to be a necessary and important adjunct to the clinical treatment. In addition, ROM furthers research as the data can be used to study the phenomenology of psychiatric disorders and the outcome of treatments delivered in everyday practice. Copyright © 2010 John Wiley & Sons, Ltd. Key Practitioner Message: • A form of tracking the progress of treatment through routine outcome monitoring (ROM) is described. • Implementation of ROM appears feasible and can be carried out in large institutions as well as smaller practices. • Providing feedback about outcome in an appealing format is highly valued by both therapists and patients. • ROM data enable investigation of the effectiveness of treatments in everyday clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Screening for serious mental illness in the general population
Kessler, R. C., Barker, P. R., Colpe, L. J., Epstein, J. F., Gfroerer, J. C., Hiripi, E., Howes, M. J., Normand, S.-L. T., Manderscheid, R. W., Walters, E. E., et al. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.2.184 · Cited by 5,692
The Global Assessment Scale: A Procedure for Measuring Overall Severity of Psychiatric Disturbance
Endicott, J. (1976) · Archives of General Psychiatry · doi:10.1001/archpsyc.1976.01770060086012 · Cited by 4,982 · cited 1×
“ROM assistants administer the MINI-Plus interview and rating scales such as the Clinical Global Impression (CGI; Guy, 1976) and the Global Assessment of Functioning (GAF; Endicott, Spitzer, Fleiss, & Cohen, 1976), and write a brief report (one to two pages) on the main fi ndings for the therapist.”
MethodMulticenter Collaborative Panic Disorder Severity Scale
Shear, M. K., Brown, T. A., Barlow, D. H., Money, R., Sholomskas, D. E., Woods, S. W., Gorman, J. M., & Papp, L. A. (1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.11.1571 · Cited by 1,001 · cited 1×
“To further illustrate the potential of ROM, we investigated the treatment outcome of patients with panic disorder using the Panic Disorder Severity Scale (PDSS) as an observer rater instrument for the assessment of the intensity of panic disorder symptoms (Shear et al., 1997).”
MethodBarlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2000) · JAMA · doi:10.1001/jama.283.19.2529 · Cited by 953
Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.3.300 · Cited by 853
Burgess, P. M., Pirkis, J. E., Slade, T. N., Johnston, A. K., Meadows, G. N., & Gunn, J. M. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902970858 · Cited by 318
Use of standardised outcome measures in adult mental health services: Randomised controlled trial
Slade, M., McCrone, P., Kuipers, E., Leese, M., Cahill, S., Parabiaghi, A., Priebe, S., & Thornicroft, G. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.015412 · Cited by 147 · cited 1×
“Slade et al. (2006) evaluated in their controlled study the effects of three monthly feed-back to patients treated in a community mental health centre.”
Background
Cited by
Implementing Measurement-Based Care in Behavioral Health: A Review
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3329 · Cited by 605
Routine outcome monitoring and feedback on physical or mental health status: evidence and theory
Carlier, I. V. E., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J. A., & Zitman, F. G. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01543.x · Cited by 275
Self-citationResearch, Data, and Evidence-Based Treatment Use in State Behavioral Health Systems, 2001–2012
Bruns, E. J., Kerns, S. E. U., Pullmann, M. D., Hensley, S. W., Lutterman, T., & Hoagwood, K. E. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500014 · Cited by 167
van der Lem, R., van der Wee, N. J. A., van Veen, T., & Zitman, F. G. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000330890 · Cited by 63
Self-citationThe generalizability of antidepressant efficacy trials to routine psychiatric out-patient practice
van der Lem, R., van der Wee, N. J. A., van Veen, T., & Zitman, F. G. (2011) · Psychological Medicine · doi:10.1017/s0033291710002175 · Cited by 63
Self-citation
Metadata
- Authors
- de Beurs, E., den Hollander‐Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E., & Zitman, F. G.
- Venue
- Clinical Psychology & Psychotherapy
- Publisher
- Wiley
- Published
- 2011-01
- Volume
- 18
- Issue
- 1
- Pages
- 1-12
- ISSN
- 1063-3995 (ISSN-L)
- 1099-0879
- OpenAlex
- W2037518985
- Cited by
- 195
- References
- 7
- FWCI
- 13.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Routine outcome monitoring in the Netherlands: practical experiences with a web‐based strategy for the assessment of treatment outcome in clinical practice. https://app.cochat.ai/papers/10.1002/cpp.696
- The paper
- de Beurs, E., den Hollander‐Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E., & Zitman, F. G. (2011). Routine outcome monitoring in the Netherlands: practical experiences with a web‐based strategy for the assessment of treatment outcome in clinical practice. Clinical Psychology & Psychotherapy. https://doi.org/10.1002/cpp.696
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.