Transdiagnostic individualized clinically-based risk calculator for the automatic detection of individuals at-risk and the prediction of psychosis: external replication in 2,430,333 US patients
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
The real-world impact of psychosis prevention is reliant on effective strategies for identifying individuals at risk. A transdiagnostic, individualized, clinically-based risk calculator to improve this has been developed and externally validated twice in two different UK healthcare trusts with convincing results. The prognostic performance of this risk calculator outside the UK is unknown. All individuals who accessed primary or secondary health care services belonging to the IBM® MarketScan® Commercial Database between January 2015 and December 2017, and received a first ICD-10 index diagnosis of nonorganic/nonpsychotic mental disorder, were included. According to the risk calculator, age, gender, ethnicity, age-by-gender, and ICD-10 cluster diagnosis at index date were used to predict development of any ICD-10 nonorganic psychotic disorder. Because patient-level ethnicity data were not available city-level ethnicity proportions were used as proxy. The study included 2,430,333 patients with a mean follow-up of 15.36 months and cumulative incidence of psychosis at two years of 1.43%. There were profound differences compared to the original development UK database in terms of case-mix, psychosis incidence, distribution of baseline predictors (ICD-10 cluster diagnoses), availability of patient-level ethnicity data, follow-up time and availability of specialized clinical services for at-risk individuals. Despite these important differences, the model retained accuracy significantly above chance (Harrell’s C = 0.676, 95% CI: 0.672–0.679). To date, this is the largest international external replication of an individualized prognostic model in the field of psychiatry. This risk calculator is transportable on an international scale to improve the automatic detection of individuals at risk of psychosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Benchimol, E. I., Smeeth, L., Guttmann, A., Harron, K., Moher, D., Petersen, I., Sørensen, H. T., von Elm, E., Langan, S. M., & RECORD Working Committee (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001885 · Cited by 5,749
Can we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773
Szucs, D., & Ioannidis, J. P. A. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000797 · Cited by 761
Cross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676
Collins, G. S., Ogundimu, E. O., & Altman, D. G. (2016) · Statistics in Medicine · doi:10.1002/sim.6787 · Cited by 665
Debray, T. P. A., Vergouwe, Y., Koffijberg, H., Nieboer, D., Steyerberg, E. W., & Moons, K. G. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.06.018 · Cited by 597
Improving outcomes of first‐episode psychosis: an overview
Fusar‐Poli, P., McGorry, P. D., & Kane, J. M. (2017) · World Psychiatry · doi:10.1002/wps.20446 · Cited by 575
Self-citationAn Individualized Risk Calculator for Research in Prodromal Psychosis
Cannon, T. D., Yu, C., Addington, J., Bearden, C. E., Cadenhead, K. S., Cornblatt, B. A., Heinssen, R., Jeffries, C. D., Mathalon, D. H., McGlashan, T. H., et al. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.15070890 · Cited by 574
What causes psychosis? An umbrella review of risk and protective factors
Radua, J., Ramella‐Cravaro, V., Ioannidis, J. P. A., Reichenberg, A., Phiphopthatsanee, N., Amir, T., Yenn Thoo, H., Oliver, D., Davies, C., Morgan, C., et al. (2018) · World Psychiatry · doi:10.1002/wps.20490 · Cited by 553
Self-citationBeyond the “at risk mental state” concept: transitioning to transdiagnostic psychiatry
McGorry, P. D., Hartmann, J. A., Spooner, R., & Nelson, B. (2018) · World Psychiatry · doi:10.1002/wps.20514 · Cited by 488
Cited by
Preventive psychiatry: a blueprint for improving the mental health of young people
Fusar‐Poli, P., Correll, C. U., Arango, C., Berk, M., Patel, V., & Ioannidis, J. P. A. (2021) · World Psychiatry · doi:10.1002/wps.20869 · Cited by 497
Self-citationSalazar de Pablo, G., Radua, J., Pereira, J., Bonoldi, I., Arienti, V., Besana, F., Soardo, L., Cabras, A., Fortea, L., Catalan, A., et al. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.0830 · Cited by 375
Self-citationOliver, D., Arribas, M., Radua, J., Salazar de Pablo, G., De Micheli, A., Spada, G., Mensi, M. M., Kotlicka-Antczak, M., Borgatti, R., Solmi, M., et al. (2022) · Molecular Psychiatry · doi:10.1038/s41380-022-01611-w · Cited by 49
“Clinically-based, individualised, automated, transdiagnostic risk calculator for psychosis in secondary mental healthcare with good performance has been developed [90], replicated across several national [90–92] and international [93] replications, and already implemented in clinical routine [70, 94, 95].”
MethodSelf-citationFusar-Poli, P., Oliver, D., Spada, G., Estrade, A., & McGuire, P. (2021) · Schizophrenia Research · doi:10.1016/j.schres.2020.11.031 · Cited by 6
Metadata
- Authors
- Oliver, D., Wong, C. M. J., Bøg, M., Jönsson, L., Kinon, B. J., Wehnert, A., Jørgensen, K. T., Irving, J., Stahl, D., McGuire, P., Raket, L. L., & Fusar-Poli, P.
- Venue
- Translational Psychiatry
- Published
- 2020-10-29
- Volume
- 10
- Issue
- 1
- Pages
- 364-364
- ISSN
- 2158-3188 (ISSN-L)
- OpenAlex
- W3095877464
- Cited by
- 26
- References
- 25
- FWCI
- 2.23
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Transdiagnostic individualized clinically-based risk calculator for the automatic detection of individuals at-risk and the prediction of psychosis: external replication in 2,430,333 US patients. https://app.cochat.ai/papers/10.1038/s41398-020-01032-9
- The paper
- Oliver, D., Wong, C. M. J., Bøg, M., Jönsson, L., Kinon, B. J., Wehnert, A., Jørgensen, K. T., Irving, J., Stahl, D., McGuire, P., Raket, L. L., & Fusar-Poli, P. (2020). Transdiagnostic individualized clinically-based risk calculator for the automatic detection of individuals at-risk and the prediction of psychosis: external replication in 2,430,333 US patients. Translational Psychiatry. https://doi.org/10.1038/s41398-020-01032-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.