Development and validation of multivariable prediction models of remission, recovery, and quality of life outcomes in people with first episode psychosis: a machine learning approach
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Outcomes for people with first-episode psychosis are highly heterogeneous. Few reliable validated methods are available to predict the outcome for individual patients in the first clinical contact. In this study, we aimed to build multivariable prediction models of 1-year remission and recovery outcomes using baseline clinical variables in people with first-episode psychosis. METHODS: In this machine learning approach, we applied supervised machine learning, using regularised regression and nested leave-one-site-out cross-validation, to baseline clinical data from the English Evaluating the Development and Impact of Early Intervention Services (EDEN) study (n=1027), to develop and internally validate prediction models at 1-year follow-up. We assessed four binary outcomes that were recorded at 1 year: symptom remission, social recovery, vocational recovery, and quality of life (QoL). We externally validated the prediction models by selecting from the top predictor variables identified in the internal validation models the variables shared with the external validation datasets comprised of two Scottish longitudinal cohort studies (n=162) and the OPUS trial, a randomised controlled trial of specialised assertive intervention versus standard treatment (n=578). FINDINGS: The performance of prediction models was robust for the four 1-year outcomes of symptom remission (area under the receiver operating characteristic curve [AUC] 0·703, 95% CI 0·664-0·742), social recovery (0·731, 0·697-0·765), vocational recovery (0·736, 0·702-0·771), and QoL (0·704, 0·667-0·742; p<0·0001 for all outcomes), on internal validation. We externally validated the outcomes of symptom remission (AUC 0·680, 95% CI 0·587-0·773), vocational recovery (0·867, 0·805-0·930), and QoL (0·679, 0·522-0·836) in the Scottish datasets, and symptom remission (0·616, 0·553-0·679), social recovery (0·573, 0·504-0·643), vocational recovery (0·660, 0·610-0·710), and QoL (0·556, 0·481-0·631) in the OPUS dataset. INTERPRETATION: In our machine learning analysis, we showed that prediction models can reliably and prospectively identify poor remission and recovery outcomes at 1 year for patients with first-episode psychosis using baseline clinical variables at first clinical contact. FUNDING: Lundbeck Foundation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Skevington, S. M., Lotfy, M., & O'Connell, K. A. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000018486.91360.00 · Cited by 4,686
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652 · cited 1×
“7 Two models developed for outcome prediction in psychosis using baseline variables have been published.”
BackgroundPrediction models need appropriate internal, internal-external, and external validation
Steyerberg, E. W., & Harrell, F. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.04.005 · Cited by 1,304
Cross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676
An Individualized Risk Calculator for Research in Prodromal Psychosis
Cannon, T. D., Yu, C., Addington, J., Bearden, C. E., Cadenhead, K. S., Cornblatt, B. A., Heinssen, R., Jeffries, C. D., Mathalon, D. H., McGlashan, T. H., et al. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.15070890 · Cited by 574 · cited 1×
“…and recovery (social and vocational recovery and QoL), in recognition of the fact that intervention strategies might be distinct for each outcome, 31 even though each of our models was able to accurately predict other outcomes significantly better than chance, albeit with reduced performance.”
ResultCytokine function in medication-naive first episode psychosis: A systematic review and meta-analysis
Upthegrove, R., Manzanares-Teson, N., & Barnes, N. M. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.03.005 · Cited by 501
Self-citationLally, J., Ajnakina, O., Stubbs, B., Cullinane, M., Murphy, K. C., Gaughran, F., & Murray, R. M. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.117.201475 · Cited by 335
Santesteban-Echarri, O., Paino, M., Rice, S., González-Blanch, C., McGorry, P., Gleeson, J., & Alvarez-Jimenez, M. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.09.007 · Cited by 268
Gumley, A. I., Schwannauer, M., Macbeth, A., Fisher, R., Clark, S., Rattrie, L., Fraser, G., McCabe, R., Blair, A., Davidson, K., et al. (2014) · British Journal of Psychiatry · doi:10.1192/bjp.bp.113.126722 · Cited by 63
Self-citation
Cited by
The promise of machine learning in predicting treatment outcomes in psychiatry
Chekroud, A. M., Bondar, J., Delgadillo, J., Doherty, G., Wasil, A., Fokkema, M., Cohen, Z., Belgrave, D., DeRubeis, R., Iniesta, R., et al. (2021) · World Psychiatry · doi:10.1002/wps.20882 · Cited by 531
Bickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184
“In contrast, a predictive study of 1027 people with first-episode psychosis used AI to successfully predict poor remission and recovery one year later based only on baseline data (Leighton et al. 2019).”
ResultReal-world digital implementation of the Psychosis Polyrisk Score (PPS): A pilot feasibility study
Oliver, D., Spada, G., Englund, A., Chesney, E., Radua, J., Reichenberg, A., Uher, R., McGuire, P., & Fusar-Poli, P. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2020.04.015 · Cited by 27
Metadata
- Authors
- Leighton, S. P., Upthegrove, R., Krishnadas, R., Benros, M. E., Broome, M. R., Gkoutos, G. V., Liddle, P. F., Singh, S. P., Everard, L., Jones, P. B., Fowler, D., Sharma, V., Freemantle, N., Christensen, R. H. B., Albert, N., Nordentoft, M., Schwannauer, M., Cavanagh, J., Gumley, A. I., Birchwood, M., & Mallikarjun, P. K.
- Venue
- The Lancet Digital Health
- Publisher
- Elsevier BV
- Published
- 2019-10
- Volume
- 1
- Issue
- 6
- Pages
- e261-e270
- ISSN
- 2589-7500 (ISSN-L)
- OpenAlex
- W2972963860
- Cited by
- 49
- References
- 10
- FWCI
- 3.69
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and validation of multivariable prediction models of remission, recovery, and quality of life outcomes in people with first episode psychosis: a machine learning approach. https://app.cochat.ai/papers/10.1016/s2589-7500(19)30121-9
- The paper
- Leighton, S. P., Upthegrove, R., Krishnadas, R., Benros, M. E., Broome, M. R., Gkoutos, G. V., Liddle, P. F., Singh, S. P., Everard, L., Jones, P. B., Fowler, D., Sharma, V., Freemantle, N., Christensen, R. H. B., Albert, N., Nordentoft, M., Schwannauer, M., Cavanagh, J., Gumley, A. I., . . . Mallikarjun, P. K. (2019). Development and validation of multivariable prediction models of remission, recovery, and quality of life outcomes in people with first episode psychosis: a machine learning approach. The Lancet Digital Health. https://doi.org/10.1016/s2589-7500(19)30121-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.