The DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index; 45 of the 95 sources its claims cite were checked for support.
The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses
Open accessAbstract
Aims: Community treatment orders have been introduced in many jurisdictions with increasing use over time. We conducted a rapid umbrella review to synthesise the quantitative and qualitative evidence from systematic reviews and/or meta-analyses of their potential harms and benefits. Methods: A systematic search of Medline, PubMed, Embase and PsycINFO for relevant systematic reviews and/or meta-analyses. Where available, participants on community treatment orders were compared with controls receiving voluntary psychiatric treatment. This review is registered with PROSPERO (CRD42023398767) and the Open Science Framework ( https://osf.io/zeq35 ). Results: In all, 17 publications from 14 studies met the inclusion criteria. Quantitative synthesis of data from different systematic reviews was not possible. There were mixed findings on the effects of community treatment orders on health service use, and clinical, psychosocial or forensic outcomes. Whereas uncontrolled evidence suggested benefits, results were more equivocal from controlled studies and randomised controlled trials showed no effect. Any changes in health service use took several years to become apparent. There was evidence that better targeting of community treatment order use led to improved outcomes. Although there were other benefits, such as in mortality, findings were mostly rated as suggestive using predetermined and standardised criteria. Qualitative findings suggested that family members and clinicians were generally positive about the effect of community treatment orders but those subjected to them were more ambivalent. Any possible harms were under-researched, particularly in quantitative designs. Conclusions: The evidence for the benefits of community treatment orders remains inconclusive. At the very least, use should be better targeted to people most likely to benefit. More quantitative research on harms is indicated.
Overview
CoChat Summary
TL;DR
This rapid umbrella review of 17 publications from 14 systematic reviews/meta-analyses found inconclusive evidence for community treatment orders, with benefits in uncontrolled studies attenuating in controlled studies and disappearing in randomised controlled trials. The only consistent quantitative benefit was increased community contacts, while harms such as perceived coercion were under-researched.
Key findings
- Across 17 publications from 14 studies, with potentially up to 247,630 participants, findings were mixed for health service use, clinical, psychosocial and forensic outcomes: uncontrolled before-and-after evidence suggested benefits, controlled before-and-after results were more equivocal, and RCTs showed no effect.
- Community contacts consistently increased in uncontrolled and controlled before-and-after meta-analyses (e.g. Kisely et al. 2023: MD = 15.66, 95% CI [13.31, 18.00], p < 0.00001; Kisely et al. 2021: MD = 15.39, 95% CI [8.78, 22.01], p < 0.00001), rated class II highly suggestive, but RCTs showed no significant difference.
- Mortality was significantly lower in the CTO group in 3 out of 5 studies, but non-significant in two others, no longer significant after adjustment for community contacts in one study, and a later schizophrenia study found no difference; evidence for most outcomes was weak to suggestive.
- Qualitative findings suggested family members and clinicians were generally positive about CTOs, while people subjected to them were more ambivalent; perceived coercion was higher in CTO cases on standardised scales, though one meta-analysis only just failed significance (p = 0.06), and harms were under-researched quantitatively.
Methods
- Rapid umbrella review registered with PROSPERO (CRD42023398767) and the Open Science Framework; searched PubMed/Medline, Embase and PsycINFO from inception to 19 January 2024 with no language restrictions, including systematic reviews and/or meta-analyses of quantitative and qualitative research on CTOs for severe mental illness, excluding inpatient, forensic, criminal justice and substance-use compulsory treatment.
- From 1470 citations, 37 full texts were assessed plus 11 from reference searches; 30 were excluded, leaving 17 papers from 14 studies, with potentially up to 247,630 participants.
- Data were extracted from the systematic reviews, quality was assessed with the NIH tool, evidence was graded using adapted Fusar-Poli and Radua criteria, and findings were synthesised narratively with vote-counting because meta-analysis across reviews was not possible due to overlapping data and absent adjusted study-specific data.
Limitations
- The paper states that most included systematic reviews were of observational studies, often using administrative health data subject to recording bias and lacking social functioning information; cases and controls may have differed in unadjustable ways; quantitative harms data were limited; qualitative respondents were not presented with less coercive alternatives such as advance directives; high heterogeneity and few contributing studies limited publication-bias assessment and produced weak or suggestive evidence; overlapping findings prevented cross-review meta-analysis; and several included reviews were authored by one of the umbrella review’s authors (S.K.).
- Evident from the text: only one included systematic review had data from a jurisdiction outside North America, Europe, Australia or New Zealand (Taiwan), limiting generalisability, and many constituent meta-analyses had high heterogeneity (e.g. I² values of 84–99% for several outcomes).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
39 Valid · 2 Not valid · 27 Not checked · 84 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“CTOs had no effects on court appearances.”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
What the sources say
- Partly supportedcites Kisely et al. (2023) sourceExperimental — accuracy not yet measured
The Results (Secondary outcomes) report that one study found CTOs were not associated with fewer subsequent court appearances than controls after adjustment for several variables. That supports a narrower statement than “no effects”: the paper reports one study’s finding about reductions, not an absence of any effect on court appearances. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Mortality was significantly lower in the CTO group in 3 out of 5 studies.”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
What the sources say
- Partly supportedcites Segal (2020) sourceExperimental — accuracy not yet measured
The Results section, under “Mortality (Table II.A.1–5)” (page unavailable), identifies five studies and says three case-controlled studies found an association between outpatient civil commitment and reduced all-cause mortality risk. It does not state that those three reductions were statistically significant; it explicitly reports no significant difference in a fourth study and more deaths in the non-commitment group in the fifth. (LLM, conf=0.82)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In terms of numbers needed to treat for an additional beneficial outcome, it would take 142 orders to prevent one readmission.”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
What the sources say
- Supportedcites Kisely et al. (2017) and Kisely and Hall (2014) source
Section 3.1 (p. 26) explicitly states that the number needed to treat for an additional beneficial outcome is 142 orders to prevent one readmission. The review also says there was no clear difference in readmission by 12 months between participants on community treatment orders and controls, so this figure should not be read as evidence of a demonstrated benefit. (LLM, conf=0.95)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“CTOs were not associated with significantly better outcomes for any of the measures compared with voluntary care or brief supervised discharge.”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
What the sources say
- Supportedcites Kisely et al. (2017) and Kisely and Hall (2014) source
The Comparison 3 section (p. 27) reports non-significant results for health-service and participant-level outcomes when the trials were combined, with standard care encompassing voluntary care and supervised discharge. The Main results (p. 6) likewise report no difference in the measured outcomes against briefer supervised discharge and no change in the combined results. (LLM, conf=0.91)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“On meta-regression, jurisdictions with high rates of CTO use were less likely to show reductions in readmission rates or bed-days than those with lower rates.”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
What the sources say
- Supportedcites Kisely et al. (2023) source
The Results section (‘Effect of CTOs on in-patient outcomes’) reports that, in the meta-regression, jurisdictions with higher CTO use had worse outcomes for bed-days and readmission than jurisdictions with lower use. The paper’s Results summary states the citing sentence’s conclusion directly. The Discussion notes that the bed-days result was no longer statistically significant in sensitivity analyses, a qualification not addressed by the citing sentence. (LLM, conf=0.94)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
66 more claims · 12 with their cited sources checked
Create a free account to see all 152 claims and to verify the 3 references still open.
- It may state two separate claims as one. 54
- Probably not a substantial claim. 44
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results > Effects of CTOs on health service, clinical and psychosocial outcomes
“this had fallen by 2 days to a saving of only 3.75 bed-days per admission between 2010 and 2017 (Segal et al., 2022).”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Discussion
“Importantly, any effect had almost halved to 2.75 days in the most recent work possibly reflecting long-term reductions in length of stay in general (Segal et al., 2022).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
“Of these 37 full-text papers were potentially relevant and assessed for eligibility and an additional 11 through forward and backward searches of their reference lists (Figure 1).”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
“The full-text screen eliminated 30 studies for reasons outlined in Figure 1, leaving 17 papers from 14 studies to be included in this umbrella review.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results > Effects of CTOs on health service, clinical and psychosocial outcomes
“CTOs significantly increased outpatient and community contacts in all the SRs using data from UBA and CBA designs (Tables 3 and 5).”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
“SMD = 0.24 (−0.07 to 0.55), p = 0.12”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
“Table 3 gives the full list of excluded SRs and the corresponding reasons, while online Supplement 2 contains the full citations.”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
“Table: Table 3. Quantitative systematic review results.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results > Effects of CTOs on health service, clinical and psychosocial outcomes
“All nine SRs had data on inpatient outcomes from UBA studies, CBA designs or RCTs.”
§ The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses > Results
“Community contacts, emergency visits, violence defined as monthly reported community incidents and arrests”
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The cochrane database of systematic reviews
Geddes, J. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,989
Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline
Campbell, M., McKenzie, J. E., Sowden, A., Katikireddi, S. V., Brennan, S. E., Ellis, S., Hartmann-Boyce, J., Ryan, R., Shepperd, S., Thomas, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6890 · Cited by 4,628 · cited 1×
“Where it was not possible to combine meta-analyses from different SRs, we vote-counted studies to determine the overall direction of findings for each outcome (Campbell et al., 2020).”
MethodAromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000055 · Cited by 2,587 · cited 1×
“…data extraction technique; a description of any overlap in meta-analyses of the same outcomes; estimations of common effect sizes where applicable; and assessments of study quality and heterogeneity (Aromataris et al., 2015; Fusar-Poli and Radua, 2018; Hunt et al., 2018; Pollock et al., 2019).”
MethodFirth, J., Solmi, M., Wootton, R. E., Vancampfort, D., Schuch, F. B., Hoare, E., Gilbody, S., Torous, J., Teasdale, S. B., Jackson, S. E., et al. (2020) · World Psychiatry · doi:10.1002/wps.20773 · Cited by 1,242 · cited 1×
“Scores were categorised as good (7–8), fair (4–6) or poor (0–3), in accordance with previous SRs (Firth et al., 2020).”
ResultCochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews
Garritty, C., Gartlehner, G., Nussbaumer-Streit, B., King, V. J., Hamel, C., Kamel, C., Affengruber, L., & Stevens, A. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.10.007 · Cited by 1,141 · cited 2×
“In line with the recommendations of Cochrane Rapid Reviews Methods Group, one reviewer (T.Z.) extracted narrative data from studies, which a second reviewer (S.K.) checked for correctness and completeness (Garritty et al., 2021).”
Ten simple rules for conducting umbrella reviews
Fusar-Poli, P., & Radua, J. (2018) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300014 · Cited by 724 · cited 2×
“Finally, we assessed the level of quantitative evidence using criteria adapted from Fusar-Poli and Radua (2018):”
MethodCompulsory community and involuntary outpatient treatment for people with severe mental disorders
Kisely, S. R., & Campbell, L. A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004408.pub4 · Cited by 321
Self-citationHunt, H., Pollock, A., Campbell, P., Estcourt, L., & Brunton, G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0695-8 · Cited by 314 · cited 1×
“…data extraction technique; a description of any overlap in meta-analyses of the same outcomes; estimations of common effect sizes where applicable; and assessments of study quality and heterogeneity (Aromataris et al., 2015; Fusar-Poli and Radua, 2018; Hunt et al., 2018; Pollock et al., 2019).”
MethodThe effectiveness of compulsory drug treatment: A systematic review
Werb, D., Kamarulzaman, A., Meacham, M. C., Rafful, C., Fischer, B., Strathdee, S. A., & Wood, E. (2016) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2015.12.005 · Cited by 260 · cited 1×
“For instance, interventions are delivered in residential settings and/or as a result of contact with the criminal justice system (Coleman et al., 2021; Werb et al., 2016).”
Background
Research works printed but not linked: 2
- House of Commons and House of Lords, 2023, Joint Committee on the Draft Mental Health Bill.2022. Mental Health Bill. Report of Session 2022–23
- Segal SP, 2022, Schizophrenia Bulletin Open, 16
Cited by
Kisely, S. R., Bull, C. F., Zirnsak, T., Edan, V., Gould, M., Lawn, S., Light, E. M., Maylea, C., Newton‐Howes, G., Ryan, C. J., et al. (2025) · BJPsych Open · doi:10.1192/bjo.2025.23 · Cited by 9
Self-citationPariseau-Legault, P., Pelosse, D., Bernheim, E., Goulet, M.-H., Ouellet, G., Labrecque-Lebeau, L., Jacob, J.-D., & Holmes, D. (2025) · Clinical Nursing Research · doi:10.1177/10547738251321067 · Cited by 6
“Moreover, the harms of such measures on patients remain understudied (Haines et al., 2024; Kisely et al., 2024), and many argue that psychiatric coercion cannot be justified ethically, legally, or clinically (Hempeler et al., 2024; Martin & Gurbai, 2019; Richter, 2024).”
Kisely, S. R., Bull, C. F., Newton‐Howes, G., Zirnsak, T., Edan, V., Lawn, S., Light, E. M., Maylea, C., Ryan, C. J., Weller, P., et al. (2025) · The British Journal of Psychiatry · doi:10.1192/bjp.2025.10317 · Cited by 7
“8,9 The same applied to clinical, psychosocial and forensic outcomes.”
InfluentialSelf-citationBull, C. F., Sara, G. E., Ryan, C. J., Brophy, L. M., Zirnsak, T., Newton‐Howes, G., Maylea, C., Light, E. M., Lawn, S., Weller, P., et al. (2026) · BJPsych Open · doi:10.1192/bjo.2026.10987 · Cited by 5
“4,5 In contrast, controlled studies, including randomised controlled trials (RCTs), have generally reported limited or non-significant effects on outcomes such as hospital readmissions, treatment engagement and psychosocial functioning.”
Self-citationKisely, S. R., Bull, C. F., & Gill, N. (2025) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796025000058 · Cited by 7
Self-citation
Metadata
- Authors
- Kisely, S., Zirnsak, T., Corderoy, A., Ryan, C. J., & Brophy, L.
- Affiliations
- Griffith University (AU)
- La Trobe University (AU)
- UNSW Sydney (AU)
- The University of Sydney (AU)
- Corresponding author
- Kisely, Steve
- Venue
- Australian & New Zealand Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2024-04-22
- Volume
- 58
- Issue
- 7
- Pages
- 555-570
- ISSN
- 0004-8674 (ISSN-L)
- 1440-1614
- PMC
- PMC11193324
- OpenAlex
- W4395045208
- Cited by
- 25
- References
- 51
- Citations by year
- 2026: 12 · 2025: 11 · 2024: 2
- FWCI
- 2.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Australian & New Zealand Journal of Psychiatry (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Figshare (submittedVersion, cc-by-nc)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc)
- Griffith Research Online (submittedVersion, cc-by-nc)
- La Trobe University
- Funders
- Victorian Government’s Independent Review Panel of Compulsory Treatment Criteria & Alignment with Decision-making Laws in Mental Health Legislation
- Australian Research Council (DP230100967)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Healthcare Decision-Making and Restraints
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Keywords
- community treatment orders, involuntary psychiatric treatment, forensic mental health, mental illness, health care utilization, clinical outcomes, psychosocial outcomes, mortality, family perspectives
- MeSH terms
- Systematic Reviews as Topic, Mental Disorders, Community Mental Health Services, Humans, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses. https://app.cochat.ai/papers/10.1177/00048674241246436
- The paper
- Kisely, S., Zirnsak, T., Corderoy, A., Ryan, C. J., & Brophy, L. (2024). The benefits and harms of community treatment orders for people diagnosed with psychiatric illnesses: A rapid umbrella review of systematic reviews and meta-analyses. Australian & New Zealand Journal of Psychiatry. https://doi.org/10.1177/00048674241246436
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
