An Updated Meta-Analysis of Randomized Controlled Evidence for the Effectiveness of Community Treatment Orders
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index; 6 of the 11 sources its claims cite were checked for support.
Abstract
Objectives: It is unclear whether community treatment orders (CTOs) for people with severe mental illnesses can reduce health service use, or improve clinical and social outcomes. Randomized controlled trials of CTOs are rare because of ethical and logistical concerns. This meta-analysis updates available evidence. Method: A systematic literature search was performed of the Cochrane Schizophrenia Group Register, Science Citation Index, PubMed, MEDLINE, and Embase to November 2013. Inclusion criteria were studies comparing CTOs with standard care including those where control subjects received voluntary care, for most of the trial. Results: Three studies provided 749 subjects for the meta-analysis. Two compared compulsory treatment with entirely voluntary care, while the third had control subjects receiving voluntary treatment for the bulk of the time. Compared with control subjects, CTOs did not reduce readmissions (risk ratio 0.98, 95% CI 0.82 to 1.16) or bed days (mean difference [MD] −16.36; 95% CI −40.8 to 8.05) in the subsequent 12 months ( n = 749). Moreover, there were no significant differences in psychiatric symptoms (standardized MD −0.03; 95% CI −0.25 to 0.19; n = 331) or the Global Assessment of Functioning (MD −1.36; 95% CI −4.07 to 1.35; n = 335). Only including the 2 studies that compared compulsory treatment with entirely voluntary care made no difference to the results. Conclusions: CTOs may not lead to significant differences in readmission, social functioning, or symptomatology, compared with standard care. Their use should be kept under review.
Overview
CoChat Summary
## TL;DR
This meta-analysis of randomized controlled trials found that community treatment orders (CTOs) did not reduce readmissions, bed days, psychiatric symptoms, or global functioning over 12 months. The evidence base was small—3 studies with 749 participants—and the authors conclude that CTO use should remain under review.
## Key findings
- 3 studies / 749 subjects were included in the meta-analysis.
- CTOs did not reduce readmissions in the subsequent 12 months; the abstract reports risk ratio 0.98 (95% CI 0.82 to 1.16).
- CTOs did not reduce bed days; the paper reports mean difference −16.36 (95% CI −40.8 to 8.05) with I² = 73% for this outcome.
- There were no significant differences in psychiatric symptoms (SMD −0.03; 95% CI −0.25 to 0.19; n = 331) or global functioning on the GAF (MD −1.36; 95% CI −4.07 to 1.35; n = 335).
## Methods
- Systematic literature search of the Cochrane Schizophrenia Group Register, Science Citation Index, PubMed, MEDLINE, and Embase through November 2013.
- Included randomized controlled trials comparing compulsory CTOs with standard care, including trials where control subjects received voluntary care for most of the trial.
- Outcomes were readmission and bed days at 12 months (primary), plus psychiatric morbidity and social functioning (secondary); analyses used random effects models, with risk ratio, mean difference, or standardized mean difference as appropriate.
## Limitations
- The paper explicitly states the small number of studies as the main limitation; it says this makes generalizability to other jurisdictions unclear.
- The authors note uncertainty about whether the OCTET study was CTO vs voluntary care or 2 forms of compulsory treatment; however, they also state that excluding that study made no difference.
- Evidence quality was limited by selection bias in all 3 RCTs, and the text notes higher attrition for secondary outcomes and significant statistical heterogeneity for bed days.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 1 Not valid · 6 Not checked · 24 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Unlike the US studies, patients with a history of violence were not excluded.”
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
Our copy's 'Patients and trial design' section enumerates OCTET's eligibility criteria (detained inpatient, aged 18-65, diagnosis of psychosis, not subject to any other legal restrictions, able to consent, deemed suitable for supervised outpatient care) and includes no exclusion for a history of violence; Table 1 (baseline characteristics) likewise shows 43-44% with a criminal conviction and 27-28% previously imprisoned, consistent with such patients not being screened out. However, the paper nowhere states this affirmatively — the claim rests on the absence of a criterion from the eligibility list — and our copy makes no comparison with the US trials' exclusion criteria (the New York City and North Carolina studies are cited only for readmission rates and sample-size assumptions). The 'unlike the US studies' half of the sentence is therefore not supported by this source. (LLM, conf=0.65)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although the length of initial compulsory outpatient treatment differed significantly between the 2 groups (medians of 183 days, compared with 8 days), Section 17 patients averaged 4 months on some form of compulsory treatment over the course of the study.”
What the sources say
- Supportedcites [7] source
Table 3 (Discussion, p. of table 3) reports for the Section 17 group (n=167) 'Days under any legal compulsion during follow-up' mean 134.6 (SD 114.1), median 102 (IQR 31-212), i.e. roughly 4 months on average over the 12-month follow-up, and the Results section confirms this total includes randomised Section 17 leave, CTOs taken by crossover patients, and any subsequent CTO or Section 17 episodes. The preceding clause of the citing sentence (medians 183 vs 8 days for initial compulsory outpatient treatment) matches the Abstract and Results verbatim. 'Some form of compulsory treatment over the course of the study' is a fair paraphrase of 'days under any legal compulsion during follow-up'; only mild rounding is involved (mean 134.6 days ≈ 4.4 months). (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Although the length of initial compulsory outpatient treatment differed significantly between the 2 groups (medians of 183 days, compared with 8 days), Section 17 patients averaged 4 months on some form of compulsory treatment over the course of the study.”
What the sources say
- Supportedcites [7] source
The Abstract (p. 1) of the OCTET trial states verbatim what the claim attributes to it: at 12 months 'the length of initial compulsory outpatient treatment differed significantly between the two groups (median 183 days CTO group vs 8 days Section 17 group, p<0•001)'. Table 3 in the Results/Discussion ('Days in community under randomised legal compulsion' median 183 [IQR 0-299] for CTO vs 8 [0-37] for Section 17, p<0•0001) corroborates both medians and the significance. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, patients were only included if they were thought to be equally suitable for a relatively short Section 17 or a CTO.”
What the sources say
- Supportedcites [7] source
The Discussion says eligibility was restricted to patients deemed suitable for discharge either to Section 17 leave or to a CTO. The Procedures section describes Section 17 leave as a brief-period practice, and the Discussion notes that clinicians routinely using protracted Section 17 leave as an alternative did not recruit to the trial. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“OCTET was a study of clinician-initiated, rather than court-ordered, treatment studied in the American RCTs and thus more relevant to other jurisdictions, such as Australia, Canada, and New Zealand.”
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The Patients and trial design and Discussion sections describe OCTET as a trial in which clinicians decided whether patients were suitable for, and initiated, supervised outpatient care. The Introduction identifies two earlier RCTs as being from the USA, but our copy does not say they studied court-ordered treatment. That contrast is therefore not fully supported. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
11 more claims
Create a free account to see all 37 claims and to verify the 5 references still open.
- It may state two separate claims as one. 9
- Probably not a substantial claim. 14
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Abstract
“A systematic literature search was performed of the Cochrane Schizophrenia Group Register, Science Citation Index, PubMed, MEDLINE, and Embase to November 2013.”
§ Abstract
“Une recherche systématique de la littérature a été menée dans les Cochrane Schizophrenia Group Register, Science Citation Index, PubMed, MEDLINE, et Embase jusqu’en avril 2013.”
Citations
Cites
Community treatment orders for patients with psychosis (OCTET): a randomised controlled trial
Burns, T., Rugkåsa, J., Molodynski, A., Dawson, J., Yeeles, K., Vazquez-Montes, M., Voysey, M., Sinclair, J., & Priebe, S. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60107-5 · Cited by 347
Swartz, M. S., Swanson, J. W., Wagner, H. R., Burns, B. J., Hiday, V. A., & Borum, R. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.12.1968 · Cited by 340
Compulsory community and involuntary outpatient treatment for people with severe mental disorders
Kisely, S. R., & Campbell, L. A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004408.pub4 · Cited by 321
Self-citationAssessing the New York City involuntary outpatient commitment pilot program
Steadman, H. J., Gounis, K., Dennis, D., Hopper, K., Roche, B., Swartz, M., & Robbins, P. C. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.3.330 · Cited by 312
Swanson, J. W., Swartz, M. S., Wagner, H. R., Burns, B. J., Borum, R., & Hiday, V. A. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.176.4.324 · Cited by 265
A Randomized Controlled Trial of Outpatient Commitment in North Carolina
Swartz, M. S., Swanson, J. W., Hiday, V. A., Wagner, H. R., Burns, B. J., & Borum, R. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.3.325 · Cited by 191
Compulsory community and involuntary outpatient treatment for people with severe mental disorders
Kisely, S. R., Campbell, L. A., & Preston, N. J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004408.pub3 · Cited by 149
Self-citationKisely, S. R., Campbell, L. A., Scott, A., Preston, N. J., & Xiao, J. (2006) · Psychological Medicine · doi:10.1017/s0033291706008592 · Cited by 63
Self-citationOCTET does not demonstrate a lack of effectiveness for community treatment orders
Curtis, D. (2014) · Psychiatric Bulletin · doi:10.1192/pb.bp.113.044800 · Cited by 21
Research works printed but not linked: 2
- Steadman HJ, 1998, Final report: Research study of the New York City involuntary outpatient commitment pilot program
- Higgins JPT, 2011, Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011].
Cited by
Compulsory community and involuntary outpatient treatment for people with severe mental disorders
Kisely, S. R., & Campbell, L. A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004408.pub4 · Cited by 321
Self-citationBarbui, C., Purgato, M., Abdulmalik, J., Caldas-de-Almeida, J. M., Eaton, J., Gureje, O., Hanlon, C., Nosè, M., Ostuzzi, G., Saraceno, B., et al. (2021) · The British Journal of Psychiatry · doi:10.1192/bjp.2020.144 · Cited by 148
Compulsory community and involuntary outpatient treatment for people with severe mental disorders.
Kisely, S. R., Campbell, L. A., & O'Reilly, R. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004408.pub5 · Cited by 123
Self-citationEffectiveness of community treatment orders: The international evidence
Rugkåsa, J. (2016) · The Canadian Journal of Psychiatry · doi:10.1177/0706743715620415 · Cited by 98
“Only a small number of studies, however, investigate CTO outcomes with such a high level of rigour: 3 RCTs,(19-21) 2 systematic reviews,(2,6) 1 Cochrane review,(22) and 2 meta-analyses.(23,24) Most published outcome studies to date use nonrandomized methods.”
BackgroundResultBurns, T., Yeeles, K., Koshiaris, C., Vazquez-Montes, M., Molodynski, A., Puntis, S., Vergunst, F., Forrest, A., Mitchell, A., Burns, K., et al. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00231-x · Cited by 42
Metadata
- Authors
- Kisely, S., & Hall, K.
- Affiliations
- Dalhousie University (CA)
- The University of Queensland (AU)
- Corresponding author
- Kisely, Steve
- ORCID
- Kisely, Steve
- Venue
- The Canadian Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2014-10
- Volume
- 59
- Issue
- 10
- Pages
- 561-564
- ISSN
- 0706-7437 (ISSN-L)
- 1497-0015
- PMC
- PMC4197791
- OpenAlex
- W68756369
- Cited by
- 49
- References
- 9
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 5 · 2023: 2 · 2021: 3 · 2020: 7 · 2019: 4 · 2018: 3 · 2017: 8 · 2016: 7 · 2015: 4 · 2014: 1
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Update notices
- correction (2017-05-19)
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The Canadian Journal of Psychiatry (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Healthcare Decision-Making and Restraints
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- community treatment orders, involuntary treatment, severe mental illness, schizophrenia, involuntary psychiatric treatment, hospital readmission, hospital bed days, psychiatric symptoms, social functioning, Global Assessment of Functioning, voluntary care
- MeSH terms
- Mental Disorders, Commitment of Mentally Ill, Commitment of Persons with Psychiatric Disorders, Community Mental Health Services, Hospitalization, Humans, Randomized Controlled Trials as Topic, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Updated Meta-Analysis of Randomized Controlled Evidence for the Effectiveness of Community Treatment Orders. https://app.cochat.ai/papers/10.1177/070674371405901010
- The paper
- Kisely, S., & Hall, K. (2014). An Updated Meta-Analysis of Randomized Controlled Evidence for the Effectiveness of Community Treatment Orders. The Canadian Journal of Psychiatry. https://doi.org/10.1177/070674371405901010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.