The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.
Deconstructing Pretest Risk Enrichment to Optimize Prediction of Psychosis in Individuals at Clinical High Risk
Open accessAbstract
IMPORTANCE: Pretest risk estimation is routinely used in clinical medicine to inform further diagnostic testing in individuals with suspected diseases. To our knowledge, the overall characteristics and specific determinants of pretest risk of psychosis onset in individuals undergoing clinical high risk (CHR) assessment are unknown. OBJECTIVES: To investigate the characteristics and determinants of pretest risk of psychosis onset in individuals undergoing CHR assessment and to develop and externally validate a pretest risk stratification model. DESIGN, SETTING, AND PARTICIPANTS: Clinical register-based cohort study. Individuals were drawn from electronic, real-world, real-time clinical records relating to routine mental health care of CHR services in South London and the Maudsley National Health Service Trust in London, United Kingdom. The study included nonpsychotic individuals referred on suspicion of psychosis risk and assessed by the Outreach and Support in South London CHR service from 2002 to 2015. Model development and validation was performed with machine-learning methods based on Least Absolute Shrinkage and Selection Operator for Cox proportional hazards model. MAIN OUTCOMES AND MEASURES: Pretest risk of psychosis onset in individuals undergoing CHR assessment. Predictors included age, sex, age × sex interaction, race/ethnicity, socioeconomic status, marital status, referral source, and referral year. RESULTS: A total of 710 nonpsychotic individuals undergoing CHR assessment were included. The mean age was 23 years. Three hundred ninety-nine individuals were men (56%), their race/ethnicity was heterogenous, and they were referred from a variety of sources. The cumulative 6-year pretest risk of psychosis was 14.55% (95% CI, 11.71% to 17.99%), confirming substantial pretest risk enrichment during the recruitment of individuals undergoing CHR assessment. Race/ethnicity and source of referral were associated with pretest risk enrichment. The predictive model based on these factors was externally validated, showing moderately good discrimination and sufficient calibration. It was used to stratify individuals undergoing CHR assessment into 4 classes of pretest risk (6-year): low, 3.39% (95% CI, 0.96% to 11.56%); moderately low, 11.58% (95% CI, 8.10% to 16.40%); moderately high, 23.69% (95% CI, 16.58% to 33.20%); and high, 53.65% (95% CI, 36.78% to 72.46%). CONCLUSIONS AND RELEVANCE: Significant risk enrichment occurs before individuals are assessed for a suspected CHR state. Race/ethnicity and source of referral are associated with pretest risk enrichment in individuals undergoing CHR assessment. A stratification model can identify individuals at differential pretest risk of psychosis. Identification of these subgroups may inform outreach campaigns and subsequent testing and eventually optimize psychosis prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, it is apparent that unstructured recruitment processes and risk enrichment procedures in samples undergoing CHR-P assessment have a substantial role in determining the actual level of risk for psychosis in these individuals 107-109 , leading to underpowered and non-significant trials 95 .”
From Lack of evidence to favor specific preventive interventions in psychosis: a network meta‐analysis (2018) · cites this paper as [108]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Nonparametric Estimation from Incomplete Observations
Kaplan, E. L., & Meier, P. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-4380-9_25 · Cited by 45,239
Nonparametric Estimation from Incomplete Observations
Kaplan, E. L., & Meier, P. (1958) · Journal of the American Statistical Association · doi:10.1080/01621459.1958.10501452 · Cited by 39,158
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388
Collins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,319
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267
Analysis of probability as an aid in the clinical diagnosis of coronary artery disease.
Diamond, G. A., & Forrester, J. S. (1979) · New England Journal of Medicine · doi:10.1056/nejm197906143002402 · Cited by 2,664
Fihn, S. D., Gardin, J. M., Abrams, J., Berra, K., Blankenship, J. C., Dallas, A. P., Douglas, P. S., Foody, J. M., Gerber, T. C., Hinderliter, A. L., et al. (2012) · Circulation · doi:10.1161/cir.0b013e3182776f83 · Cited by 2,419
Mapping the Onset of Psychosis: The Comprehensive Assessment of At-Risk Mental States
Yung, A. R., Yung, A. R., Yuen, H. P., McGorry, P. D., Phillips, L., Kelly, D., Dell’Olio, M., Francey, S. M., Cosgrave, E., Killackey, E. J., et al. (2005) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/j.1440-1614.2005.01714.x · Cited by 2,284
Fletcher, G. F., Ades, P. A., Kligfield, P., Arena, R., Balady, G. J., Bittner, V. A., Coke, L. A., Fleg, J. L., Forman, D. E., Gerber, T. C., et al. (2013) · Circulation · doi:10.1161/cir.0b013e31829b5b44 · Cited by 2,235
The English indices of deprivation 2004
Noble, M., Wright, G., Dibben, C., Smith, G., McLennan, D., Anttila, C., Barnes, H., Mokhtar, C., Noble, S., & Gardner, J. (2004) · Cited by 1,494
Predicting Psychosis: Meta-analysis of Transition Outcomes in Individuals at High Clinical Risk
Fusar-Poli, P. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1472 · Cited by 1,361
Self-citationExternal validation of a Cox prognostic model: principles and methods
Royston, P. J., & Altman, D. G. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-33 · Cited by 911
Risk factors for psychosis in an ultra high-risk group: psychopathology and clinical features
Yung, A. R., Phillips, L., Yuen, H. P., & McGorry, P. D. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(03)00192-0 · Cited by 778
Predicting Psychosis: Meta-analysis of Transition Outcomes in Individuals at High Clinical Risk
Buckley, P. (2013) · Yearbook of Psychiatry and Applied Mental Health · doi:10.1016/j.ypsy.2012.07.042 · Cited by 774
Monitoring and Care of Young People at Incipient Risk of Psychosis
Yung, A. R., McGorry, P. D., McFarlane, C. A., Jackson, H. J., Patton, G. C., & Rakkar, A. (1996) · Schizophrenia Bulletin · doi:10.1093/schbul/22.2.283 · Cited by 773
Survival Analysis: A Practical Approach.
Smith, P. J., Parmar, M., & David, M. (1996) · Journal of the American Statistical Association · doi:10.2307/2291609 · Cited by 737
How to develop a more accurate risk prediction model when there are few events
Pavlou, M., Ambler, G., Seaman, S. R., Guttmann, O. P., Elliot, P. M., King, M., & Omar, R. (2015) · BMJ · doi:10.1136/bmj.h3868 · Cited by 698
Fusar-Poli, P., Nelson, B., Valmaggia, L., Yung, A. R., & McGuire, P. K. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs136 · Cited by 589
Self-citationKirkbride, J. B., Errázuriz, A., Croudace, T. J., Morgan, C., Jackson, D., Boydell, J. E., Murray, R. M., & Jones, P. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031660 · Cited by 588
EPA guidance on the early intervention in clinical high risk states of psychoses
Schmidt, S. J., Schultze-Lutter, F., Schimmelmann, B. G., Maric, N. P., Salokangas, R. K. R., Riecher-Rössler, A., van der Gaag, M., Meneghelli, A., Nordentoft, M., Marshall, M., et al. (2015) · European Psychiatry · doi:10.1016/j.eurpsy.2015.01.013 · Cited by 585
Pryor, D. B., Shaw, L., McCants, C. B., Lee, K. L., Mark, D. B., Harrell, F. E., Muhlbaier, L. H., & Califf, R. M. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-118-2-199301150-00001 · Cited by 503
Perera, G., Broadbent, M. T. M., Callard, F. J., Chang, C., Downs, J. M., Dutta, R., Fernandes, A. C., Hayes, R. D., Henderson, M., Jackson, R., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-008721 · Cited by 492
Stewart, R., Soremekun, M., Perera, G., Broadbent, M., Callard, F., Denis, M., Hotopf, M., Thornicroft, G., & Lovestone, S. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-51 · Cited by 445
THE NATURAL DURATION OF CANCER
Lazarus-Barlow, W. S., & Leeming, J. H. (1924) · BMJ · doi:10.1136/bmj.2.3320.266 · Cited by 428
EPA guidance on the early detection of clinical high risk states of psychoses
Schultze‐Lutter, F., Michel, C., Schmidt, S. J., SCHIMMELMANN, B. G., Marić, N. P., Salokangas, R. K. R., Riecher‐Rössler, A., van der Gaag, M., Nordentoft, M., Raballo, A., et al. (2015) · European Psychiatry · doi:10.1016/j.eurpsy.2015.01.010 · Cited by 405
Assessing calibration of prognostic risk scores
Crowson, C. S., Atkinson, E. J., & Therneau, T. M. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280213497434 · Cited by 295
Fusar-Poli, P., Rocchetti, M., Sardella, A., Avila, A., Brandizzi, M., Caverzasi, E., Politi, P., Ruhrmann, S., & McGuire, P. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.157115 · Cited by 272
Self-citationFusar‐Poli, P., Cappucciati, M., Rutigliano, G., Schultze‐Lutter, F., Bonoldi, I., Borgwardt, S., Riecher‐Rössler, A., Addington, J., Perkins, D., Woods, S. W., et al. (2015) · World Psychiatry · doi:10.1002/wps.20250 · Cited by 234
Self-citationFusar‐Poli, P., Yung, A. R., McGorry, P. D., & van Os, J. (2013) · Psychological Medicine · doi:10.1017/s0033291713000184 · Cited by 219
Self-citationFusar-Poli, P., Schultze-Lutter, F., Cappucciati, M., Rutigliano, G., Bonoldi, I., Stahl, D., Borgwardt, S., Riecher-Rössler, A., Addington, J., Perkins, D. O., et al. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv162 · Cited by 219
Self-citationFusar‐Poli, P., Byrne, M., Badger, S., Valmaggia, L., & McGuire, P. K. (2012) · European Psychiatry · doi:10.1016/j.eurpsy.2012.08.002 · Cited by 197
Self-citationPsychoses, ethnicity and socio-economic status
Kirkbride, J. B., Barker, D., Cowden, F., Stamps, R., Yang, M., Jones, P. B., & Coid, J. W. (2008) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.107.041566 · Cited by 175
Personality Traits of Alcohol-dependent Women
Azbarova, A. (2015) · European Psychiatry · doi:10.1016/s0924-9338(15)30322-9 · Cited by 171
THE NATURAL DURATION OF CANCER.
(1926) · The Lancet · doi:10.1016/s0140-6736(01)26538-6 · Cited by 163
Detecting the Psychosis Prodrome Across High-Risk Populations Using Neuroanatomical Biomarkers
Koutsouleris, N., Riecher‐Rössler, A., Meisenzahl, E. M., Smieskova, R., Studerus, E., Kambeitz‐Ilankovic, L., von Saldern, S., Cabral, C., Reiser, M. F., Falkai, P., et al. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu078 · Cited by 158
Pelayo‐Terán, J. M., Pérez‐Iglesias, R., Ramírez-Bonilla, M., González‐Blanch, C., Martínez‐García, O., Pardo‐García, G., Rodríguez-Sánchez, J. M., Roiz‐Santiáñez, R., Tordesillas‐Gutiérrez, D., Mata, I. F., et al. (2008) · Early Intervention in Psychiatry · doi:10.1111/j.1751-7893.2008.00074.x · Cited by 152
Attenuated Psychosis Syndrome: Ready for DSM-5.1?
Fusar‐Poli, P., Carpenter, W. T., Woods, S. W., & McGlashan, T. H. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153645 · Cited by 136
Self-citationSchultze‐Lutter, F., Klosterkötter, J., & Ruhrmann, S. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.02.010 · Cited by 132
Schmidt, A., Cappucciati, M., Raduà, J., Rutigliano, G., Rocchetti, M., Dell’Osso, L., Politi, P., Borgwardt, S., Reilly, T. J., Valmaggia, L., et al. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw098 · Cited by 131
Self-citationNieman, D. H., Ruhrmann, S., Dragt, S., Soen, F., van Tricht, M. J., Koelman, J. H. T. M., Bour, L. J., Velthorst, E., Becker, H. E., Weiser, M., et al. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt145 · Cited by 103
Quantifying discrimination of Framingham risk functions with different survival C statistics
Pencina, M. J., D’Agostino, R. B., & Song, L. (2012) · Statistics in Medicine · doi:10.1002/sim.4508 · Cited by 95
Clayton, P. A., McDonald, S. P., Snyder, J. J., Salkowski, N., & Chadban, S. (2014) · American Journal of Transplantation · doi:10.1111/ajt.12761 · Cited by 90
Speed of Psychosis Progression in People at Ultra-High Clinical Risk: A Complementary Meta-analysis
Kempton, M. J., Bonoldi, I., Valmaggia, L., McGuire, P., & Fusar-Poli, P. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.0094 · Cited by 73
Self-citationFusar-Poli, P., Frascarelli, M., Valmaggia, L., Byrne, M., Stahl, D., Rocchetti, M., Codjoe, L., Weinberg, L., Tognin, S., Xenaki, L., et al. (2015) · Psychological Medicine · doi:10.1017/s003329171400244x · Cited by 73
Self-citationWiltink, S., Velthorst, E., Nelson, B., McGorry, P. D., & Yung, A. R. (2013) · Early Intervention in Psychiatry · doi:10.1111/eip.12105 · Cited by 71
Predicting psychosis: Meta-analysis of transition outcomes in individuals at high clinical risk
Fusar‐Poli, P., (13453125), I. B., (13100928), A. Y., (10229771), S. B., (10229795), M. K., (10229789), L. V., (13453800), F. B., (13453803), E. C., & (10229804), P. M. (2024) · Figshare · Cited by 70
Self-citationFusar‐Poli, P., & Schultze‐Lutter, F. (2016) · Evidence-Based Mental Health · doi:10.1136/eb-2015-102295 · Cited by 66
Self-citationThe Longitudinal Youth at Risk Study (LYRIKS)--an Asian UHR perspective.
Lee, J., Rekhi, G., Mitter, N., Bong, Y. L., Kraus, M., Lam, M., Rapisarda, A., Lee, T.-S., Subramaniam, M., Chong, S., et al. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.09.025 · Cited by 63
Lasalvia, A., Bonetto, C., Tosato, S., Zanatta, G., Cristofalo, D., Salazzari, D., Lazzarotto, L., Bertani, M., Bissoli, S., Santi, K. D., et al. (2014) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.113.134445 · Cited by 62
Services for people at high risk improve outcomes in patients with first episode psychosis
Fusar‐Poli, P., Díaz‐Caneja, C. M., Patel, R., Valmaggia, L., Byrne, M., Garety, P. A., Shetty, H., Broadbent, M. T. M., Stewart, R. J., & McGuire, P. K. (2015) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12480 · Cited by 57
Self-citationWelsh, P., & Tiffin, P. A. (2013) · Child Psychiatry & Human Development · doi:10.1007/s10578-013-0380-z · Cited by 53
Green, C. E. L., McGuire, P. K., Ashworth, M. J., & Valmaggia, L. (2010) · Psychological Medicine · doi:10.1017/s0033291710000723 · Cited by 29
Self-citationIntensive community outreach for those at ultra high risk of psychosis: dilution, not solution
Fusar‐Poli, P., Schultze‐Lutter, F., & Addington, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00491-5 · Cited by 28
Self-citationAlmeida, J. G., Fonseca, P., Dias, T., Ladeiras‐Lopes, R., Bettencourt, N., Ribeiro, J., & Gama, V. (2016) · Clinical Cardiology · doi:10.1002/clc.22515 · Cited by 28
Multiple curves plotted with stcurv command
Cleves, M. A. (2000) · Stata technical bulletin · Cited by 5
Hou, Z., Lü, B., Gao, Y., Yu, F.-F., Cao, H., Jiang, S., Roy, S. K., & Budoff, M. J. (2012) · Academic Radiology · doi:10.1016/j.acra.2012.06.005 · Cited by 4
Nieman, D. H., Ruhrmann, S., van Tricht, M. J., Koelman, H. H. T. M., LINSZEN, D. H., & de Haan, L. (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx021.234 · Cited by 3
Cited by
Sorted by citations
Machine learning in mental health: a scoping review of methods and applications
Shatte, A. B. R., Hutchinson, D. M., & Teague, S. J. (2019) · Psychological Medicine · doi:10.1017/s0033291719000151 · Cited by 1,047
Improving outcomes of first‐episode psychosis: an overview
Fusar‐Poli, P., McGorry, P. D., & Kane, J. M. (2017) · World Psychiatry · doi:10.1002/wps.20446 · Cited by 575
Self-citationWhat causes psychosis? An umbrella review of risk and protective factors
Radua, J., Ramella‐Cravaro, V., Ioannidis, J. P. A., Reichenberg, A., Phiphopthatsanee, N., Amir, T., Yenn Thoo, H., Oliver, D., Davies, C., Morgan, C., et al. (2018) · World Psychiatry · doi:10.1002/wps.20490 · Cited by 553
Self-citationPreventive psychiatry: a blueprint for improving the mental health of young people
Fusar‐Poli, P., Correll, C. U., Arango, C., Berk, M., Patel, V., & Ioannidis, J. P. A. (2021) · World Psychiatry · doi:10.1002/wps.20869 · Cited by 497
Self-citationPrevention of Psychosis: Advances in Detection, Prognosis, and Intervention
Fusar-Poli, P., Salazar de Pablo, G., Correll, C. U., Meyer-Lindenberg, A., Millan, M. J., Borgwardt, S., Galderisi, S., Bechdolf, A., Pfennig, A., Kessing, L. V., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.4779 · Cited by 476
Self-citation
Metadata
- Authors
- Fusar-Poli, P., Rutigliano, G., Stahl, D., Schmidt, A., Ramella-Cravaro, V., Hitesh, S., & McGuire, P.
- Affiliations
- King's College London, Institute of Psychiatry, Psychology, and Neuroscience, London, United Kingdom2Outreach and Support in South London service, South London and the Maudsley National Health Service Foundation Trust, London, United Kingdom
- University of Pisa (IT)
- King's College London (GB)
- King's College London, Institute of Psychiatry, Psychology, and Neuroscience, London, United Kingdom4Department of Neurosciences, Psychology, Drug Research and Child Health, University of Florence, Florence, Italy
- South London and the Maudsley National Health Service Foundation Trust, Biomedical Research Centre Nucleus, London, United Kingdom
- Venue
- JAMA Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2016-12-01
- Volume
- 73
- Issue
- 12
- Pages
- 1260
- ISSN
- 2168-622X (ISSN-L)
- OpenAlex
- W2541736368
- Cited by
- 121
- References
- 59
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 6 · 2023: 7 · 2022: 8 · 2021: 18 · 2020: 16 · 2019: 20 · 2018: 20 · 2017: 12 · 2016: 3
- FWCI
- 16.32
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- JAMA Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- edoc (University of Basel) (acceptedVersion)
- CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion)
- Research Portal (King's College London) (submittedVersion, other-oa)
- Funders
- National Science Foundation
- National Alliance for Research on Schizophrenia and Depression
- National Institute for Health and Care Research
- King's College London
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
- Medical Research Council (MR/N026063/1)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
- Health Sciences › Medicine › Psychiatry and Mental health › Bipolar Disorder and Treatment
- Keywords
- psychosis onset prediction, clinical high risk, risk stratification model, race and ethnicity, referral sources, external validation, LASSO Cox regression, psychosis prevention, socioeconomic status, sex differences, sex-age interaction, mental health services
- MeSH terms
- Adult, Female, Follow-Up Studies, Humans, London, Male, Patient Acceptance of Health Care, Psychotic Disorders, Referral and Consultation, Cohort Studies, Proportional Hazards Models, Risk Assessment, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
