The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
An Individualized Risk Calculator for Research in Prodromal Psychosis
Open accessAbstract
OBJECTIVE: Approximately 20%-35% of individuals 12-35 years old who meet criteria for a prodromal risk syndrome convert to psychosis within 2 years. However, this estimate ignores the fact that clinical high-risk cases vary considerably in risk. The authors sought to create a risk calculator, based on profiles of risk indicators, that can ascertain the probability of conversion to psychosis in individual patients. METHOD: The study subjects were 596 clinical high-risk participants from the second phase of the North American Prodrome Longitudinal Study who were followed up to the time of conversion to psychosis or last contact (up to 2 years). The predictors examined were limited to those that are supported by previous studies and are readily obtainable in general clinical settings. Time-to-event regression was used to build a multivariate model predicting conversion, with internal validation using 1,000 bootstrap resamples. RESULTS: The 2-year probability of conversion to psychosis was 16%. Higher levels of unusual thought content and suspiciousness, greater decline in social functioning, lower verbal learning and memory performance, slower speed of processing, and younger age at baseline each contributed to individual risk for psychosis. Stressful life events, trauma, and family history of schizophrenia were not significant predictors. The multivariate model achieved a concordance index of 0.71 and, as reported in an article by Carrión et al., published concurrently with this one, was validated in an independent external data set. The results are instantiated in a web-based risk prediction tool envisioned to be most useful in research protocols involving the psychosis prodrome. CONCLUSIONS: A risk calculator comparable in accuracy to those for cardiovascular disease and cancer is available to predict individualized conversion risks in newly ascertained clinical high-risk cases. Given that the risk calculator can be validly applied only for patients who screen positive on the Structured Clinical Interview for Psychosis Risk Syndromes, which requires training to administer, its most immediate uses will be in research on psychosis risk factors and in research-driven clinical (prevention) trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“clinical [81], cognitive [82], and neuroimaging measures [83] constitute possible biomarkers that significantly increase accuracy for predicting clinical outcomes in CHR-P participants”
From Towards a youth mental health paradigm: a perspective and roadmap (2023) · cites this paper as [81]
In the citing paper
“596 (18.5, US); 0.71 (C- index) 291”
From Preventive psychiatry: a blueprint for improving the mental health of young people (2021) · cites this paper as [291]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Lee, T. H., Marcantonio, E. R., Mangione, C. M., Thomas, E. J., Polanczyk, C. A., Cook, E. F., Sugarbaker, D. J., Donaldson, M. C., Poss, R., Ho, K. K. L., et al. (1999) · Circulation · doi:10.1161/01.cir.100.10.1043 · Cited by 3,771
Keefe, R. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2003.09.011 · Cited by 1,573
Uno, H., Cai, T., Pencina, M. J., D'Agostino, R. B., & Wei, L. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4154 · Cited by 1,535 · cited 1×
“5 (no discrimination) to 1 (perfect discrimination), but tailored for censored data (30).”
BackgroundThe Psychosis High-Risk State: A Comprehensive State-of-the-Art Review
Fusar-Poli, P., Borgwardt, S., Bechdolf, A., Addington, J., Riecher-Rössler, A., Schultze-Lutter, F., Keshavan, M., Wood, S., Ruhrmann, S., Seidman, L. J., et al. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.269 · Cited by 1,483 · cited 4×
“Greater severity of SIPS items P1 and P2 (Unusual Thought Content and Suspiciousness) are strongly predictive of psychosis in CHR samples (3, 4).”
BackgroundResultInfluentialSelf-citationPredicting Psychosis: Meta-analysis of Transition Outcomes in Individuals at High Clinical Risk
Fusar-Poli, P. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1472 · Cited by 1,361
Cannon, T. D., Cadenhead, K., Cornblatt, B., Woods, S. W., Addington, J., Walker, E., Seidman, L. J., Perkins, D., Tsuang, M., McGlashan, T., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2007.3 · Cited by 1,269 · cited 4×
“Greater severity of SIPS items P1 and P2 (unusual thought content and suspiciousness) are strongly predictive of psychosis in clinical high-risk samples (3, 4).”
BackgroundInfluentialSelf-citationExemplification of a Method for Scaling Life Events: The PERI Life Events Scale
Dohrenwend, B. S., Askenasy, A. R., Krasnoff, L., & Dohrenwend, B. P. (1978) · Journal of Health and Social Behavior · doi:10.2307/2136536 · Cited by 1,211 · cited 2×
“Proper training in the administration and scoring of the other measures included in the risk calculator (i.e., Symbol-Coding, HVLT-R, GSF-S, RILES, CTAS) is also required.”
MethodMcGorry, P. D., Yung, A. R., Phillips, L. J., Yuen, H. P., Francey, S., Cosgrave, E. M., Germano, D., Bravin, J., McDonald, T., Blair, A., et al. (2002) · Archives of General Psychiatry · doi:10.1001/archpsyc.59.10.921 · Cited by 1,056
Amminger, G. P., Schäfer, M. R., Papageorgiou, K., Klier, C. M., Cotton, S. M., Harrigan, S. M., Mackinnon, A., McGorry, P. D., & Berger, G. E. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.192 · Cited by 896
Miller, T. J., McGlashan, T. H., Rosen, J. L., Somjee, L., Markovich, P. J., Stein, K., & Woods, S. W. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.5.863 · Cited by 873 · cited 1×
“Participants met SIPS criteria (13) for the presence of one Cannon et al.”
MethodSelf-citationChildhood abuse as a risk factor for psychotic experiences
Janssen, I., Krabbendam, L., Bak, M., Hanssen, M., Vollebergh, W., de Graaf, R., & van Os, J. (2004) · Acta Psychiatrica Scandinavica · doi:10.1046/j.0001-690x.2003.00217.x · Cited by 762 · cited 2×
“Proper training in the administration and scoring of the other measures included in the risk calculator (i.e., Symbol-Coding, HVLT-R, GSF-S, RILES, CTAS) is also required.”
MethodSchizophrenia as a Disorder of Developmentally Reduced Synaptic Connectivity
McGlashan, T. H. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.7.637 · Cited by 655
Self-citationRuhrmann, S., Schultze-Lutter, F., Salokangas, R. K. R., Heinimaa, M., Linszen, D., Dingemans, P., Birchwood, M., Patterson, P., Juckel, G., Heinz, A., et al. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.206 · Cited by 632 · cited 1×
“, model optimization) and did not present a web-based tool for extending individualized risk estimation to future patients (3, 24, 32).”
MethodCornblatt, B. A., Auther, A. M., Niendam, T., Smith, C. W., Zinberg, J., Bearden, C. E., & Cannon, T. D. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbm029 · Cited by 630 · cited 2×
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript Scale of Functioning-Social (GFS-S) (25).”
Self-citationCannon, T. D., Chung, Y., He, G., Sun, D., Jacobson, A., van Erp, T. G. M., McEwen, S., Addington, J., Bearden, C. E., Cadenhead, K., et al. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.05.023 · Cited by 599
Self-citationThe Psychosis-Risk Syndrome: Handbook for Diagnosis and Follow-Up
McGlashan, T. H., Walsh, B. C., & Woods, S. W. (2010) · Cited by 566
Self-citationMcGlashan, T. H., Zipursky, R. B., Perkins, D., Addington, J., Miller, T., Woods, S. W., A. Hawkins, K., E. Hoffman, R., Preda, A., Epstein, I., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.5.790 · Cited by 556 · cited 1×
“Resultsof twosmall trials with antipsychotic drugs do not support a prophylactic effect on conversion risk beyond the period of active treatment (38, 39).”
BackgroundSelf-citationKirkbride, J. B., Fearon, P., Morgan, C., Dazzan, P., Morgan, K., Tarrant, J., Lloyd, T., Holloway, J., Hutchinson, G., Leff, J. P., et al. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.3.250 · Cited by 520 · cited 1×
“Age at ascertainment was included to help account for variation inageat onset ofpsychosis (14) and inprocesses that undergo developmental modification during the age range of our sample (15–17).”
At Clinical High Risk for Psychosis: Outcome for Nonconverters
Addington, J., Cornblatt, B. A., Cadenhead, K. S., Cannon, T. D., McGlashan, T. H., Perkins, D. O., Seidman, L. J., Tsuang, M. T., Walker, E. F., Woods, S. W., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10081191 · Cited by 475
Self-citationEarly interventions to prevent psychosis: systematic review and meta-analysis
Stafford, M. R., Jackson, H., Mayo-Wilson, E., Morrison, A. P., & Kendall, T. (2013) · BMJ · doi:10.1136/bmj.f185 · Cited by 456 · cited 1×
“Psychosocial interventions such as cognitive-behavior therapy and family-focused psychoeducation may be beneficial in deflecting the course of illness severity and chronicity (41, 42); however, it remains unclear whether such approaches can prevent onset of illness.”
BackgroundSeidman, L. J. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.66 · Cited by 409 · cited 1×
“Several studies have found that slower processing speed and lower verbal learning andmemory functioning are predictive of psychosis (18, 19) and in meta-analyses have among the largest effect sizes among converters to psychosis (20).”
BackgroundSelf-citationvan der Gaag, M., Smit, F., Bechdolf, A., French, P., Linszen, D. H., Yung, A. R., McGorry, P., & Cuijpers, P. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.07.004 · Cited by 384 · cited 1×
“Collectively, the results support the view that any targeted intervention, whether biological or psychological in approach, is associatedwithbetter outcomes than less targetedcontrol conditions (37).”
Sullivan, P. F. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020212 · Cited by 321
North American Prodrome Longitudinal Study (NAPLS 2): Overview and recruitment
Addington, J., Cadenhead, K. S., Cornblatt, B. A., Mathalon, D. H., McGlashan, T. H., Perkins, D. O., Seidman, L. J., Tsuang, M. T., Walker, E. F., Woods, S. W., et al. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2012.09.012 · Cited by 272 · cited 1×
“We have previously reported on the methods for evaluation of subjects and data collection (10).”
MethodSelf-citationComparisons of nomograms and urologists' predictions in prostate cancer
Ross, P. L., Gerigk, C., Gonen, M., Yossepowitch, O., Cagiannos, I., Sogani, P. C., Scardino, P. T., & Kattan, M. W. (2002) · Seminars in Urologic Oncology · doi:10.1053/suro.2002.32490 · Cited by 247
Self-citationPerkins, D. O., Jeffries, C. D., Addington, J., Bearden, C. E., Cadenhead, K. S., Cannon, T. D., Cornblatt, B. A., Mathalon, D. H., McGlashan, T. H., Seidman, L. J., et al. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu099 · Cited by 238 · cited 1×
“Some promising leads on the use of biological assays to predict psychosis among clinical high-risk patients have emerged using empirically based discovery approaches, including machine learning algorithms for gray matter variations in structural brain images (33) and “greedy” regression algorithms for proteomic/metabo…”
BackgroundSelf-citationEfficacy of Using Cognitive Status in Predicting Psychosis: A 7-Year Follow-Up
Riecher-Rössler, A., Pflueger, M. O., Aston, J., Borgwardt, S. J., Brewer, W. J., Gschwandtner, U., & Stieglitz, R.-D. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.07.020 · Cited by 234 · cited 1×
“A number of studies have found that slower processing speed and lower verbal learning and memory functioning are predictive of psychosis (19, 20) and in meta-analyses, have among the largest effect sizes amongst converters to psychosis (21).”
BackgroundSpecht, M. C., Kattan, M. W., Gonen, M., Fey, J., & Van Zee, K. J. (2005) · Annals of Surgical Oncology · doi:10.1245/aso.2005.06.037 · Cited by 230
Self-citationNeurocognition in the Psychosis Risk Syndrome: A Quantitative and Qualitative Review
J. Giuliano, A., Li, H., I. Mesholam-Gately, R., M. Sorenson, S., A. Woodberry, K., & J. Seidman, L. (2012) · Current Pharmaceutical Design · doi:10.2174/138161212799316019 · Cited by 223 · cited 1×
“A number of studies have found that slower processing speed and lower verbal learning and memory functioning are predictive of psychosis (19, 20) and in meta-analyses, have among the largest effect sizes amongst converters to psychosis (21).”
BackgroundSelf-citationMiklowitz, D. J., O’Brien, M. P., Schlosser, D. A., Addington, J., Candan, K. A., Marshall, C., Domingues, I., Walsh, B. C., Zinberg, J. L., De Silva, S. D., et al. (2014) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2014.04.020 · Cited by 200 · cited 1×
“Psychosocial interventions such as cognitive behavior therapy and family-focused psychoeducation may be beneficial in deflecting the course of illness severity and chronicity (42, 43); however, it remains unclear whether such approaches can prevent onset of illness.”
BackgroundSelf-citationPfeiffer, R. M., Park, Y., Kreimer, A. R., Lacey, J. V., Pee, D., Greenlee, R. T., Buys, S. S., Hollenbeck, A., Rosner, B., Gail, M. H., et al. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001492 · Cited by 189
Developmental changes in cortisol secretion in normal and at-risk youth
WALKER, E. F., WALDER, D. J., & REYNOLDS, F. (2001) · Development and Psychopathology · doi:10.1017/s0954579401003169 · Cited by 183
Self-citationCarrión, R. E., Cornblatt, B. A., Burton, C. Z., Tso, I. F., Auther, A. M., Adelsheim, S., Calkins, R., Carter, C. S., Niendam, T., Sale, T. G., et al. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.15121565 · Cited by 170 · cited 2×
“In a companion article (30), Carrión et al.”
BackgroundMethodSelf-citationCornblatt, B. A., Carrión, R. E., Auther, A. M., McLaughlin, D., Olsen, R. H., John, M., & Correll, C. U. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.13121686 · Cited by 163 · cited 3×
“For example, a recent report (24) using a smaller (N=92) and nonoverlapping sample of CHR cases from one of the NAPLS sites developed a classifier that included three of predictors included in the NAPLS 2 risk calculator (suspiciousness, verbal memory deficits, and decline in social functioning).”
MethodResultSelf-citationSchlosser, D. A., Jacobson, S., Chen, Q., Sugar, C. A., Niendam, T. A., Li, G., Bearden, C. E., & Cannon, T. D. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr098 · Cited by 159 · cited 1×
“Given that in approximately one-third of clinical high-risk cases, the symptoms that determined their initial risk status remit within 6–12months of ascertainment (35, 36), it should be possible to develop a complementary tool to predict a new case’s likelihood of remission from a clinical high-risk syndrome.”
BackgroundSelf-citationDetecting the Psychosis Prodrome Across High-Risk Populations Using Neuroanatomical Biomarkers
Koutsouleris, N., Riecher-Rössler, A., Meisenzahl, E. M., Smieskova, R., Studerus, E., Kambeitz-Ilankovic, L., von Saldern, S., Cabral, C., Reiser, M., Falkai, P., et al. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu078 · Cited by 158 · cited 1×
“Some promising leads on the use of biological assays to predict psychosis among CHR cases have emerged using empirically-based discovery approaches, including machine learning algorithms for gray matter variations in structural brain images (34) and so-called “greedy” regression algorithms for proteomic/metabolic plas…”
BackgroundThe arrival of preemptive psychiatry
Insel, T. R. (2007) · Early Intervention in Psychiatry · doi:10.1111/j.1751-7893.2007.00017.x · Cited by 97 · cited 1×
“Given limitations of current treatments for schizophrenia, with most patients showing substantial deficits in social and occupational functioning throughout life, there is considerable interest in developing preventive approaches to psychotic disorders (1).”
BackgroundKattan, M. W., Yu, C., Stephenson, A. J., Sartor, O. A., & TOMBAL, B. F. (2013) · Urology · doi:10.1016/j.urology.2012.12.010 · Cited by 53
Self-citationStress and the Prodromal Phase of Psychosis
Holtzman, C. W., Shapiro, D. I., Trotman, H. D., & Walker, E. F. (2012) · Current Pharmaceutical Design · doi:10.2174/138161212799316280 · Cited by 49 · cited 1×
“Stressful life events, along with childhood traumas, have been shown to be predictive of psychosis in prior studies of CHR samples (26).”
ResultSelf-citationDoc, What Are My Chances? A Conversation About Prognostic Uncertainty
Kattan, M. W. (2010) · European Urology · doi:10.1016/j.eururo.2010.10.041 · Cited by 16 · cited 1×
“Nevertheless, the use of confidence intervals is not likely to be of value in discussing risks with individual patients and their families, as the general concept of a confidence interval relates to likelihoods under future sampling rather than to an individual case, and the calculated risk is the best estimate for th…”
BackgroundSelf-citation
Research works printed but not linked: 2
- First M, 1995, Structured Clinical Interview for DSM-IV Axis I Disorders, Patient Edition
- Brandt J, 1998, Hopkins Verbal Learning Test–Revised (HVLT-R)
Cited by
Machine Learning Approaches for Clinical Psychology and Psychiatry
Dwyer, D. B., Falkai, P., & Koutsouleris, N. (2018) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045037 · Cited by 966
Preventive psychiatry: a blueprint for improving the mental health of young people
Fusar‐Poli, P., Correll, C. U., Arango, C., Berk, M., Patel, V., & Ioannidis, J. P. A. (2021) · World Psychiatry · doi:10.1002/wps.20869 · Cited by 497
Beyond the “at risk mental state” concept: transitioning to transdiagnostic psychiatry
McGorry, P. D., Hartmann, J. A., Spooner, R., & Nelson, B. (2018) · World Psychiatry · doi:10.1002/wps.20514 · Cited by 488
Prevention of Psychosis: Advances in Detection, Prognosis, and Intervention
Fusar-Poli, P., Salazar de Pablo, G., Correll, C. U., Meyer-Lindenberg, A., Millan, M. J., Borgwardt, S., Galderisi, S., Bechdolf, A., Pfennig, A., Kessing, L. V., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.4779 · Cited by 476
Moving From Static to Dynamic Models of the Onset of Mental Disorder: A Review
Nelson, B., McGorry, P. D., Wichers, M., Wigman, J. T. W., & Hartmann, J. A. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0001 · Cited by 376
Metadata
- Authors
- Cannon, T. D., Yu, C., Addington, J., Bearden, C. E., Cadenhead, K. S., Cornblatt, B. A., Heinssen, R., Jeffries, C. D., Mathalon, D. H., McGlashan, T. H., Perkins, D. O., Seidman, L. J., Tsuang, M. T., Walker, E. F., Woods, S. W., & Kattan, M. W.
- Affiliations
- Cleveland Clinic (US)
- ORCID
- Venue
- American Journal of Psychiatry
- Published
- 2016-10-01
- Volume
- 173
- Issue
- 10
- Pages
- 980-988
- ISSN
- 0002-953X (ISSN-L)
- 1535-7228
- PMC
- PMC5048498
- OpenAlex
- W2466834759
- Cited by
- 574
- References
- 41
- Citations by year
- 2026: 21 · 2025: 54 · 2024: 40 · 2023: 63 · 2022: 49 · 2021: 52 · 2020: 75 · 2019: 97 · 2018: 69 · 2017: 39 · 2016: 15
- FWCI
- 65.11
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Institutes of Health (UL1TR001863)
- National Institute of Mental Health (U01MH066134, U01MH081928, U01MH081902, U01MH082022, U01MH066069, U01MH076989, R01MH076989, U01MH081984, U01MH081857, U01MH082004, U01MH081944, P50MH066286, U01MH081988)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
- Health Sciences › Medicine › Psychiatry and Mental health › Bipolar Disorder and Treatment
- Keywords
- prodromal psychosis, clinical high risk for psychosis, transition to psychosis, risk prediction, unusual thought content, suspicion, verbal learning and memory, processing speed, age of onset, North American Prodrome Longitudinal Study
- MeSH terms
- Adolescent, Humans, Longitudinal Studies, Predictive Value of Tests, Psychiatric Status Rating Scales, Psychotic Disorders, Risk Factors, Early Diagnosis, Prodromal Symptoms
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.