Cited by 49Schizophrenia research and treatmentPsychopathy, Forensic Psychiatry, Sexual OffendingBipolar Disorder and Treatment

Prognostic accuracy and clinical utility of psychometric instruments for individuals at clinical high-risk of psychosis: a systematic review and meta-analysis

Open access
Oliver, Dominic, Arribas, Maite, Radua, Joaquim, Salazar de Pablo, Gonzalo, De Micheli, Andrea, Spada, Giulia, Mensi, Martina Maria, Kotlicka-Antczak, Magdalena +7 more·2022·Molecular Psychiatry

Abstract

Accurate prognostication of individuals at clinical high-risk for psychosis (CHR-P) is an essential initial step for effective primary indicated prevention. We aimed to summarise the prognostic accuracy and clinical utility of CHR-P assessments for primary indicated psychosis prevention. Web of Knowledge databases were searched until 1st January 2022 for longitudinal studies following-up individuals undergoing a psychometric or diagnostic CHR-P assessment, reporting transition to psychotic disorders in both those who meet CHR-P criteria (CHR-P + ) or not (CHR-P-). Prognostic accuracy meta-analysis was conducted following relevant guidelines. Primary outcome was prognostic accuracy, indexed by area-under-the-curve (AUC), sensitivity and specificity, estimated by the number of true positives, false positives, false negatives and true negatives at the longest available follow-up time. Clinical utility analyses included: likelihood ratios, Fagan's nomogram, and population-level preventive capacity (Population Attributable Fraction, PAF). A total of 22 studies (n = 4 966, 47.5% female, age range 12-40) were included. There were not enough meta-analysable studies on CHR-P diagnostic criteria (DSM-5 Attenuated Psychosis Syndrome) or non-clinical samples. Prognostic accuracy of CHR-P psychometric instruments in clinical samples (individuals referred to CHR-P services or diagnosed with 22q.11.2 deletion syndrome) was excellent: AUC = 0.85 (95% CI: 0.81-0.88) at a mean follow-up time of 34 months. This result was driven by outstanding sensitivity (0.93, 95% CI: 0.87-0.96) and poor specificity (0.58, 95% CI: 0.50-0.66). Being CHR-P + was associated with a small likelihood ratio LR + (2.17, 95% CI: 1.81-2.60) for developing psychosis. Being CHR-P- was associated with a large LR- (0.11, 95%CI: 0.06-0.21) for developing psychosis. Fagan's nomogram indicated a low positive (0.0017%) and negative (0.0001%) post-test risk in non-clinical general population samples. The PAF of the CHR-P state is 10.9% (95% CI: 4.1-25.5%). These findings consolidate the use of psychometric instruments for CHR-P in clinical samples for primary indicated prevention of psychosis. Future research should improve the ability to rule in psychosis risk.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41380-022-01611-w

Cites

101 of 101 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 102 references couldn’t be matched to a known paper.

Research works printed but not linked: 8

  1. [7]McGlashan TH, Walsh B, Woods S. The psychosis-risk syndrome: handbook for diagnosis and follow-up. New York:Oxford University Press; 2010.
  2. [11]Schultze-Lutter F, Koch E. Schizophrenia proneness instrument, child and youth version (SPI-CY). Rom:Fioriti; 2010. 23473813
  3. [19]Stroup DF Berlin JA Morton SC Olkin I Williamson GD Rennie D Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group J Am Med Assoc 2000 283 2008 12 10789670
  4. [21]Riecher-Rössler A Aston J Ventura J Merlo M Borgwardt S Gschwandtner U [The Basel Screening Instrument for Psychosis (BSIP): development, structure, reliability and validity] Fortschr Der Neurologie-Psychiatr 2008 76 207 16 18393134
  5. [30]Hosmer W, Lemeshow S. Applied Survival Analysis: Regression Modeling of Time to Event Data. New York, NY:Wiley & Sons;1999.
  6. [42]Kotlicka-Antczak M Pawełczyk T Rabe-Jabłońska J Pawełczyk A PORT (Programme of Recognition and Therapy): the first Polish recognition and treatment programme for patients with an at-risk mental state Early Intervention Psychiatry 2015 9 339 42 24725353
  7. [84]Fusar-Poli P Sullivan SA Shah JL Uhlhaas PJ Improving the Detection of Individuals at Clinical Risk for Psychosis in the Community Prim Secondary Care: Integr Evid-Based Approach Front Psychiatry 2019 10 774 PMC6822017 31708822
  8. [98]Kempton MJ Bonoldi I Valmaggia L McGuire P Fusar-Poli P Speed of Psychosis Progression in People at Ultra-High Clinical Risk JAMA Psychiatry 2015 72 622 25901658

Cited by

Sorted by citations

Authors
Oliver, D., Arribas, M., Radua, J., Salazar de Pablo, G., De Micheli, A., Spada, G., Mensi, M. M., Kotlicka-Antczak, M., Borgatti, R., Solmi, M., Shin, J. I., Woods, S. W., Addington, J., McGuire, P., & Fusar-Poli, P.
Affiliations
  • King's College London (GB)
  • University of Pavia (IT)
  • University of Ottawa (CA)
  • Yonsei University (KR)
  • Yale University (US)
  • University of Calgary (CA)
  • National Health Service (GB)
Corresponding author
Oliver, Dominic
Venue
Molecular Psychiatry
Published
2022-06-03
Volume
27
Issue
9
Pages
3670-3678
ISSN
  • 1359-4184 (ISSN-L)
  • 1476-5578
OpenAlex
W4281707390
Cited by
49
References
102
Citations by year
2026: 11 · 2025: 15 · 2024: 12 · 2023: 11
FWCI
1.63
Type
journal article
Language
en
Open access
Locations
  • Molecular Psychiatry (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • YUHSpace (Yonsei University Medical Library) (submittedVersion, cc-by-nc-nd)
Funders
Wellcome Trust (215793/Z/19/Z)
Topics
  • Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
  • Social Sciences › Psychology › Clinical Psychology › Psychopathy, Forensic Psychiatry, Sexual Offending
  • Health Sciences › Medicine › Psychiatry and Mental health › Bipolar Disorder and Treatment
Keywords
clinical high risk for psychosis, prognostic accuracy, psychometric scale, psychosis prevention, transition to psychosis, likelihood ratios, population attributable fraction, sensitivity and specificity, attenuated psychosis syndrome, primary prevention, risk assessment tools, clinical utility, longitudinal follow-up study
MeSH terms
Adolescent, Adult, Child, Female, Humans, Male, Prognosis, Psychometrics, Psychotic Disorders, Sensitivity and Specificity, Diagnostic and Statistical Manual of Mental Disorders, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review