The Cost-Effectiveness of a Novel Online Social Therapy to Maintain Treatment Effects From First-Episode Psychosis Services: Results From the Horyzons Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Background: Digital interventions have potential applications in promoting long-term recovery and improving outcomes in first-episode psychosis (FEP). This study aimed to evaluate the cost-effectiveness of Horyzons, a novel online social therapy to support young people aged 16–27 years following discharge from FEP services, compared with treatment as usual (TAU) from a healthcare sector and a societal perspective. Study design: A cost-effectiveness analysis (CEA), based on the change in social functioning, and a cost-utility analysis (CUA) using quality-adjusted life years were undertaken alongside a randomized controlled trial. Intervention costs were determined from study records; resources used by patients were collected from a resource-use questionnaire and administrative data. Mean costs and outcomes were compared at 18 months and incremental cost-effectiveness ratios were calculated. Uncertainty analysis using bootstrapping and sensitivity analyses was conducted. Study results: The sample included 170 participants: Horyzons intervention group (n = 86) and TAU (n = 84). Total costs were significantly lower in the Horyzons group compared with TAU from both the healthcare sector (–AU$4789.59; P < .001) and the societal perspective (–AU$5131.14; P < .001). In the CEA, Horyzons was dominant, meaning it was less costly and resulted in better social functioning. In the CUA, the Horyzons intervention resulted in fewer costs but also yielded fewer QALYs. However, group differences in outcomes were not statistically significant. When young people engaged more with the platform, costs were shown to decrease and outcomes improved. Conclusions: The Horyzons intervention offers a cost-effective approach for improving social functioning in young people with FEP after discharge from early intervention services.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, the Moderated Online Social Therapy (MOST) offers intervention for youth diagnosed with early-stage psychosis, depression, help-seeking young people, and carers in a coherent platform [124–126].”
From Towards a youth mental health paradigm: a perspective and roadmap (2023) · cites this paper as [126]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Digital health interventions have been shown to reduce the rate of hospital admissions and emergency service use and be both cost-saving and cost-effective for young people with serious mental ill-health over 18 months compared with treatment as usual (TAU).15 16”
From A mindfulness-based, cognitive, social, digital relapse-prevention intervention for youth with depression in Australia: study protocol for a randomised controlled trial of Rebound (2024) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Results from several pilot studies and a clinical trial showed that MOST was engaging over prolonged periods of time; safe; nonstigmatising; endorsed and valued by young people, clinicians, and services; effective in improving vocational recovery and reducing use of hospital services in youth psychosis; cost-saving; and cost-effective, with four clinical trials underway.”
From The Lancet Psychiatry Commission on youth mental health (2024) · cites this paper as [369]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Sanders, G. D., Neumann, P. J., Basu, A., Brock, D. W., Feeny, D., Krahn, M., Kuntz, K. M., Meltzer, D. O., Owens, D. K., Prosser, L. A., et al. (2016) · JAMA · doi:10.1001/jama.2016.12195 · Cited by 3,069 · cited 4×
“Additionally, this study adopted two perspectives as recommended, 32 capturing not only healthcare costs but also broader societal costs.”
MethodInfluentialvan Os, J., & Kapur, S. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60995-8 · Cited by 1,971
The World Health Organization Health and Work Performance Questionnaire (HPQ)
Kessler, R. C., Barber, C., Beck, A., Berglund, P., Cleary, P. D., McKenas, D., Pronk, N., Simon, G., Stang, P., Ustun, T. B., et al. (2003) · Journal of Occupational and Environmental Medicine · doi:10.1097/01.jom.0000052967.43131.51 · Cited by 1,148
EPPIC: An Evolving System of Early Detection and Optimal Management
McGorry, P. D., Edwards, J., Mihalopoulos, C., Harrigan, S. M., & Jackson, H. J. (1996) · Schizophrenia Bulletin · doi:10.1093/schbul/22.2.305 · Cited by 937
Self-citationFaria, R., Gomes, M., Epstein, D., & White, I. R. (2014) · PharmacoEconomics · doi:10.1007/s40273-014-0193-3 · Cited by 673 · cited 1×
“46 In total, we imputed 50 datasets that reflected the percentage of cumulative missing values.”
BackgroundEarly intervention in psychosis: concepts, evidence and future directions
MCGORRY, P. D., KILLACKEY, E., & YUNG, A. (2008) · World Psychiatry · doi:10.1002/j.2051-5545.2008.tb00182.x · Cited by 581
Self-citationAlvarez-Jimenez, M., Priede, A., Hetrick, S. E., Bendall, S., Killackey, E., Parker, A. G., McGorry, P. D., & Gleeson, J. F. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2012.05.007 · Cited by 511
Self-citationPeople living with psychotic illness in 2010: the second Australian national survey of psychosis
Morgan, V. A., Waterreus, A., Jablensky, A., Mackinnon, A., McGrath, J. J., Carr, V., Bush, R., Castle, D., Cohen, M., Harvey, C., et al. (2012) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867412449877 · Cited by 504 · cited 2×
“6 It was assumed that 50% would meet the eligibility criteria for Horyzons and 50% would agree to use the intervention.”
BackgroundSelf-citationHusereau, D., Drummond, M., Augustovski, F., de Bekker-Grob, E., Briggs, A. H., Carswell, C., Caulley, L., Chaiyakunapruk, N., Greenberg, D., Loder, E., et al. (2022) · BMC Medicine · doi:10.1186/s12916-021-02204-0 · Cited by 450
Alvarez-Jimenez, M., Alcazar-Corcoles, M. A., González-Blanch, C., Bendall, S., McGorry, P. D., & Gleeson, J. F. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.03.021 · Cited by 351
Self-citationEconomic evaluations of Internet interventions for mental health: a systematic review
Donker, T., Blankers, M., Hedman, E., Ljótsson, B., Petrie, K., & Christensen, H. (2015) · Psychological Medicine · doi:10.1017/s0033291715001427 · Cited by 316 · cited 1×
“19,22 Therefore, the aim of this study was to evaluate the cost-effectiveness of Horyzons from a healthcare sector and a societal perspective in comparison with treatment as usual (TAU) over 18 months following a young person’s discharge from a specialized FEP service.”
BackgroundSocial functioning as an outcome measure in schizophrenia studies
Burns, T., & Patrick, D. (2007) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2007.01108.x · Cited by 305
headspace: Australia's National Youth Mental Health Foundation — where young minds come first
McGorry, P. D., Tanti, C., Stokes, R., Hickie, I. B., Carnell, K., Littlefield, L. K., & Moran, J. (2007) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2007.tb01342.x · Cited by 272
Self-citationSocial anxiety and the shame of psychosis: A study in first episode psychosis
Birchwood, M., Trower, P., Brunet, K., Gilbert, P., Iqbal, Z., & Jackson, C. (2007) · Behaviour Research and Therapy · doi:10.1016/j.brat.2006.07.011 · Cited by 248
Nasrallah, H., Morosini, P., & Gagnon, D. D. (2008) · Psychiatry Research · doi:10.1016/j.psychres.2007.11.012 · Cited by 243 · cited 1×
“26 The PSP is a reliable and validated tool and is recommended for measuring social functioning in psychosis.”
MethodOn the HORYZON: Moderated online social therapy for long-term recovery in first episode psychosis
Alvarez-Jimenez, M., Bendall, S., Lederman, R., Wadley, G., Chinnery, G., Vargas, S., Larkin, M., Killackey, E., McGorry, P. D., & Gleeson, J. F. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2012.10.009 · Cited by 224 · cited 1×
“20 A recent online psychosocial intervention (Horyzons) aims to foster long term recovery in FEP and bridge the gap between specialized intervention and standard treatment.”
BackgroundSelf-citationBriggs, A. H., & Gray, A. M. (1999) · BMJ · doi:10.1136/bmj.319.7210.635 · Cited by 206
Early intervention in psychosis
Singh, S. P. (2010) · British Journal of Psychiatry · doi:10.1192/bjp.bp.109.075804 · Cited by 194
The Societal Cost of Schizophrenia: A Systematic Review
Jin, H., & Mosweu, I. (2017) · PharmacoEconomics · doi:10.1007/s40273-016-0444-6 · Cited by 193
Effect of early intervention on 5-year outcome in non-affective psychosis
Gafoor, R., Nitsch, D., McCrone, P., Craig, T. K. J., Garety, P. A., Power, P., & McGuire, P. (2010) · British Journal of Psychiatry · doi:10.1192/bjp.bp.109.066050 · Cited by 167
Substance misuse in first-episode psychosis: 15-month prospective follow-up study
Wade, D., Harrigan, S., Edwards, J., Burgess, P. M., Whelan, G., & McGorry, P. D. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.017236 · Cited by 158
Self-citationCarlborg, A., Winnerbäck, K., Jönsson, E. G., Jokinen, J., & Nordström, P. (2010) · Expert Review of Neurotherapeutics · doi:10.1586/ern.10.82 · Cited by 154
Moderated online social therapy: Designing and evaluating technology for mental health
Lederman, R., Wadley, G., Gleeson, J., Bendall, S., & Álvarez-Jiménez, M. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2513179 · Cited by 151 · cited 1×
“24,25 The MOST model integrates: (1) interactive online therapy (“Pathways and Steps”), (2) peer-to-peer online social networking (“the café”), (3) peer moderation, and (4) expert support by mental health clinicians (eg, clinical psychologist, and social workers) and vocational workers trained in…”
MethodSelf-citationGomes, M., Murray, E., & Raftery, J. P. (2022) · PharmacoEconomics · doi:10.1007/s40273-022-01130-0 · Cited by 139
Symptom and functional outcomes for a 5year early intervention program for psychoses
Norman, R. M. G., Manchanda, R., MALLA, A. K., Windell, D., Harricharan, R., & Northcott, S. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2011.04.006 · Cited by 131
Alvarez‐Jimenez, M., Koval, P., Schmaal, L., Bendall, S., O'Sullivan, S., Cagliarini, D., D'Alfonso, S., Rice, S., Valentine, L., Penn, D. L., et al. (2021) · World Psychiatry · doi:10.1002/wps.20858 · Cited by 130
Self-citationModelling utility weights for the Assessment of Quality of Life (AQoL)-8D
Richardson, J., Sinha, K., Iezzi, A., & Khan, M. A. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0686-8 · Cited by 127 · cited 2×
“28 The AQoL-8D performs best in the mental health context 29,30 and comprises 35 items that assess eight domains of QoL, including independent living, relationships, mental health, coping, pain, senses, self-worth, and life satisfaction.”
BackgroundMethodAlvarez-Jimenez, M., Gleeson, J. F., Bendall, S., Penn, D. L., Yung, A. R., Ryan, R. M., Eleftheriadis, D., D'Alfonso, S., Rice, S., Miles, C., et al. (2018) · Schizophrenia Research · doi:10.1016/j.schres.2018.07.022 · Cited by 118
Self-citationGlobal research priorities for youth mental health
Mei, C., Fitzsimons, J., Allen, N., Alvarez‐Jimenez, M., Amminger, G. P., Browne, V., Cannon, M., Davis, M., Dooley, B., Hickie, I. B., et al. (2020) · Early Intervention in Psychiatry · doi:10.1111/eip.12878 · Cited by 117
Self-citationChallenges in measuring and valuing productivity costs, and their relevance in mood disorders
Lensberg, B. R., Drummond, Danchenko, Despiégel, N., & François, C. (2013) · ClinicoEconomics and Outcomes Research · doi:10.2147/ceor.s44866 · Cited by 114
Alvarez-Jimenez, M., Rice, S., D'Alfonso, S., Leicester, S., Bendall, S., Pryor, I., Russon, P., McEnery, C., Santesteban-Echarri, O., Da Costa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/17155 · Cited by 106
Self-citationE–Mental Health Self-Management for Psychotic Disorders: State of the Art and Future Perspectives
van der Krieke, L., Wunderink, L., Emerencia, A. C., de Jonge, P., & Sytema, S. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300050 · Cited by 98
The Measurement of Indirect Costs in the Health Economics Evaluation Literature:A Review
Jacobs, P., & Fassbender, K. (1998) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300012095 · Cited by 82
Quality of life in patients who have remitted from their first episode of psychosis
Cotton, S., Gleeson, J., Álvarez‐Jiménez, M., & McGorry, P. D. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.05.027 · Cited by 80
Self-citationMihalopoulos, C., Chen, G., Iezzi, A., Khan, M. A., & Richardson, J. (2014) · British Journal of Psychiatry · doi:10.1192/bjp.bp.113.136036 · Cited by 78
Self-citationMavranezouli, I., Brazier, J. E., Rowen, D., & Barkham, M. (2012) · Medical Decision Making · doi:10.1177/0272989x12464431 · Cited by 70
Accuracy of patient recall for self‐reported doctor visits: Is shorter recall better?
Dalziel, K., Li, J., Scott, A., & Clarke, P. (2018) · Health Economics · doi:10.1002/hec.3794 · Cited by 70
Alvarez-Jimenez, M., Bendall, S., Koval, P., Rice, S., Cagliarini, D., Valentine, L., D’Alfonso, S., Miles, C., Russon, P., Penn, D. L., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024104 · Cited by 69 · cited 2×
“21 Horyzons integrates peer-to-peer online social networking with theory-driven, evidence-informed therapeutic interventions targeting social functioning, vocational recovery, and relapse prevention supported by peer workers, clinicians, and vocational professionals, with the aim of supporting…”
BackgroundSelf-citationHerniman, S. E., Allott, K., Phillips, L., Wood, S. J., Uren, J., Mallawaarachchi, S. R., & Cotton, S. (2019) · Psychological Medicine · doi:10.1017/s0033291719002344 · Cited by 67
Keetharuth, A. D., Rowen, D., Bjørner, J. B., & Brazier, J. E. (2020) · Value in Health · doi:10.1016/j.jval.2020.10.012 · Cited by 61
Chang, W. C., Chu, A. O. K., Kwong, V. W. Y., Wong, C. S. M., Hui, C. L. M., Chan, S. K. W., Lee, E. H. M., & Chen, E. Y. H. (2018) · Schizophrenia Research · doi:10.1016/j.schres.2018.01.021 · Cited by 52
Four quadrants of the cost-effectiveness plane: some considerations on the south-west quadrant
Klok, R. M., & Postma, M. J. (2004) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.4.6.599 · Cited by 39
Saha, S., Whiteford, H., & McGrath, J. J. (2013) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867413513341 · Cited by 28
Engel, L., Chen, G., Richardson, J. R. J., & Mihalopoulos, C. (2018) · Quality of Life Research · doi:10.1007/s11136-018-1936-y · Cited by 28
Self-citationLoneliness and its association with health service utilization in people with a psychotic disorder
Badcock, J. C., Prinzio, P. D., Waterreus, A. J., Neil, A. L., & Morgan, V. A. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2020.05.059 · Cited by 26
O’Sullivan, S., Schmaal, L., D’Alfonso, S., Toenders, Y. J., Valentine, L., McEnery, C., Bendall, S., Nelson, B., Gleeson, J., & Álvarez‐Jiménez, M. (2022) · JMIR Mental Health · doi:10.2196/29211 · Cited by 24
Self-citationIshay, G. H., Zisman‐Ilani, Y., & Roe, D. (2023) · Early Intervention in Psychiatry · doi:10.1111/eip.13347 · Cited by 12 · cited 1×
“33,34 We calculated costs by multiplying volumes of health services by related unit costs (Supplementary Table 2).”
MethodDevlin, N. J., & Scuffham, P. (2020) · Australian Health Review · doi:10.1071/ah20057 · Cited by 11
Cited by
The Lancet Psychiatry Commission on youth mental health
McGorry, P. D., Mei, C., Dalal, N., Alvarez-Jimenez, M., Blakemore, S.-J., Browne, V., Dooley, B., Hickie, I. B., Jones, P. B., McDaid, D., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00163-9 · Cited by 663
Self-citationTowards a youth mental health paradigm: a perspective and roadmap
Uhlhaas, P. J., Davey, C. G., Mehta, U. M., Shah, J., Torous, J., Allen, N. B., Avenevoli, S., Bella-Awusah, T., Chanen, A., Chen, E. Y. H., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02202-z · Cited by 318
“For example, the Moderated Online Social Therapy (MOST) offers intervention for youth diagnosed with early-stage psychosis, depression, help-seeking young people, and carers in a coherent platform [124 – 126].”
BackgroundSelf-citationSEMA3: A free smartphone platform for daily life surveys
O'Brien, S. T., Dozo, N., Hinton, J. D. X., Moeck, E. K., Susanto, R., Jayaputera, G., Sinnott, R., Vu, D. Q., Álvarez‐Jiménez, M., Gleeson, J., et al. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02445-w · Cited by 83
Self-citationA meta-analysis of persuasive design, engagement, and efficacy in 92 RCTs of mental health apps
Valentine, L., Hinton, J. D. X., Bajaj, K., Boyd, L., O’Sullivan, S., Sorenson, R. P., Bell, I., Vega, M. S., Liu, P., Peters, W., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01567-5 · Cited by 56
Self-citationÁlvarez‐Jiménez, M., Nicholas, J., Valentine, L., Liu, P., Mangelsdorf, S. N., Baker, S., Gilbertson, T., O'Loughlin, G., McEnery, C., McGorry, P. D., et al. (2024) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13751 · Cited by 41
Self-citation
Metadata
- Authors
- Engel, L., Alvarez-Jimenez, M., Cagliarini, D., D’Alfonso, S., Faller, J., Valentine, L., Koval, P., Bendall, S., O’Sullivan, S., Rice, S., Miles, C., Penn, D. L., Phillips, J., Russon, P., Lederman, R., Killackey, E., Lal, S., Maree Cotton, S., Gonzalez-Blanch, C., Herrman, H., McGorry, P. D., Gleeson, J. F. M., & Mihalopoulos, C.
- Affiliations
- Monash University (AU)
- Orygen , Parkville, VIC , Australia
- The University of Melbourne (AU)
- University of North Carolina at Chapel Hill (US)
- University of Technology Sydney (AU)
- Douglas Mental Health University Institute (CA)
- Centre for Youth Mental Health, University of Melbourne , Melbourne, VIC , Australia
- Australian Catholic University (AU)
- Deakin University (AU)
- Corresponding author
- Engel, Lidia
- ORCID
- Venue
- Schizophrenia Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-06-01
- Volume
- 50
- Issue
- 2
- Pages
- 427-436
- ISSN
- 0586-7614 (ISSN-L)
- 1745-1701
- PMC
- PMC10919787
- OpenAlex
- W4378953860
- Cited by
- 34
- References
- 49
- Citations by year
- 2026: 10 · 2025: 11 · 2024: 8 · 2023: 4
- FWCI
- 8.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Schizophrenia Bulletin (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Carolina Digital Repository (University of North Carolina at Chapel Hill) (submittedVersion, cc-by-nc-nd)
- Lirias (submittedVersion, cc-by-nc-nd)
- Figshare (submittedVersion, cc-by-nc-nd)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc-nd)
- UNC Libraries
- Funders
- Mental Illness Research Fund
- Australian National Health and Medical Research Council
- Telstra Foundation
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Keywords
- first-episode psychosis
- MeSH terms
- Cost-Effectiveness Analysis, Adolescent, Cost-Benefit Analysis, Humans, Psychotic Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.