Are Screening Instruments Valid for Psychotic-Like Experiences? A Validation Study of Screening Questions for Psychotic-Like Experiences Using In-Depth Clinical Interview
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Individuals who report psychotic-like experiences are at increased risk of future clinical psychotic disorder. They constitute a unique "high-risk" group for studying the developmental trajectory to schizophrenia and related illnesses. Previous research has used screening instruments to identify this high-risk group, but the validity of these instruments has not yet been established. We administered a screening questionnaire with 7 items designed to assess psychotic-like experiences to 334 adolescents aged 11-13 years. Detailed clinical interviews were subsequently carried out with a sample of these adolescents. We calculated sensitivity and specificity and positive predictive value (PPV) and negative predictive value (NPV) for each screening question for the specific symptom it enquired about and also in relation to any psychotic-like experience. The predictive power varied substantially between items, with the question on auditory hallucinations ("Have you ever heard voices or sounds that no one else can hear?") providing the best predictive power. For interview-verified auditory hallucinations specifically, this question had a PPV of 71.4% and an NPV of 90.4%. When assessed for its predictive power for any psychotic-like experience (including, but not limited to, auditory hallucinations), it provided a PPV of 100% and an NPV of 88.4%. Two further questions-relating to visual hallucinations and paranoid thoughts-also demonstrated good predictive power for psychotic-like experiences. Our results suggest that it may be possible to screen the general adolescent population for psychotic-like experiences with a high degree of accuracy using a short self-report questionnaire.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It has also been suggested that delusional ideation represents a measure of psychosis-proneness, i.e., a potential predisposing trait to psychosis, in particular when a high degree of delusional thought is accompanied by hallucinatory phenomena and other psychotic-like experiences (Kelleher et al., 2011; Smeets et al., 2013).”
From “I was trying to save the world”: delusion-like ideation and associated impacts reported by Western practitioners of Buddhist meditation (2025) · cites this paper as Kelleher et al., 2011
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
KAUFMAN, J., BIRMAHER, B., BRENT, D., RAO, U., FLYNN, C., MORECI, P., WILLIAMSON, D., & RYAN, N. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199707000-00021 · Cited by 10,148
van Os, J., Linscott, R. J., Myin-Germeys, I., Delespaul, P., & Krabbendam, L. (2009) · Psychological Medicine · doi:10.1017/s0033291708003814 · Cited by 2,343 · cited 2×
“Research on long-term outcomes suggests that individuals who report psychotic-like experiences are at significantly increased risk of clinical psychotic disorders.(1,4,9) Among a New Zealand birth cohort, Poulton et al(1) found that 11-year olds who reported psychotic symptoms were at a 5- to 16-fold specific increase…”
BackgroundChambers, W. J. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790300064008 · Cited by 1,269 · cited 1×
“Diagnostic auditory hallucinations include the experience of hearing one or more voices saying at least one word other than one’s own name.(24) Accordingly, 71% (n = 12) of the participants in the definite group reported diagnostic auditory hallucinations (see table 2).”
BackgroundCannon, T. D., Cadenhead, K., Cornblatt, B., Woods, S. W., Addington, J., Walker, E., Seidman, L. J., Perkins, D., Tsuang, M., McGlashan, T., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2007.3 · Cited by 1,269
Poulton, R., Caspi, A., Moffitt, T. E., Cannon, M., Murray, R., & Harrington, H. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.11.1053 · Cited by 1,141 · cited 2×
“Research on long-term outcomes suggests that individuals who report psychotic-like experiences are at significantly increased risk of clinical psychotic disorders.(1,4,9) Among a New Zealand birth cohort, Poulton et al(1) found that 11-year olds who reported psychotic symptoms were at a 5- to 16-fold specific increase…”
BackgroundSelf-citationPsychosis prediction: 12-month follow up of a high-risk ("prodromal") group
Yung, A. R., Phillips, L. J., Yuen, H. P., Francey, S. M., McFarlane, C. A., Hallgren, M., & McGorry, P. D. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(02)00167-6 · Cited by 1,136
Evidence that three dimensions of psychosis have a distribution in the general population
STEFANIS, N. C., HANSSEN, M., SMIRNIS, N. K., AVRAMOPOULOS, D. A., EVDOKIMIDIS, I. K., STEFANIS, C. N., VERDOUX, H., & VAN OS, J. (2002) · Psychological Medicine · doi:10.1017/s0033291701005141 · Cited by 956
Strauss (1969) revisited: a psychosis continuum in the general population?
van Os, J., Hanssen, M., Bijl, R. V., & Ravelli, A. (2000) · Schizophrenia Research · doi:10.1016/s0920-9964(99)00224-8 · Cited by 893
Monitoring and Care of Young People at Incipient Risk of Psychosis
Yung, A. R., McGorry, P. D., McFarlane, C. A., Jackson, H. J., Patton, G. C., & Rakkar, A. (1996) · Schizophrenia Bulletin · doi:10.1093/schbul/22.2.283 · Cited by 772
The incidence and outcome of subclinical psychotic experiences in the general population
Hanssen, M., Bak, M., Bijl, R., Vollebergh, W., & Van Os, J. (2005) · British Journal of Clinical Psychology · doi:10.1348/014466505x29611 · Cited by 443 · cited 2×
“Research on long-term outcomes suggests that individuals who report psychotic-like experiences are at significantly increased risk of clinical psychotic disorders.(1,4,9) Among a New Zealand birth cohort, Poulton et al(1) found that 11-year olds who reported psychotic symptoms were at a 5- to 16-fold specific increase…”
BackgroundWoods, S. W., Addington, J., Cadenhead, K. S., Cannon, T. D., Cornblatt, B. A., Heinssen, R., Perkins, D. O., Seidman, L. J., Tsuang, M. T., Walker, E. F., et al. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp027 · Cited by 404
The Schizophrenia Prodrome Revisited: A Neurodevelopmental Perspective
Cornblatt, B. A., Lencz, T., Smith, C. W., Correll, C. U., Auther, A. M., & Nakayama, E. (2003) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a007036 · Cited by 377 · cited 1×
“Ascertainment bias, whereby psychosis-prone families are more likely to engage in psychosis studies, was minimized by the fact that this study was not presented to participants as a study of psychosis but rather as part of a study on adolescent brain development, improving the generalizability of our findings.(26)”
BackgroundAddington, J., Cadenhead, K. S., Cannon, T. D., Cornblatt, B., McGlashan, T. H., Perkins, D. O., Seidman, L. J., Tsuang, M., Walker, E. F., Woods, S. W., et al. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbl075 · Cited by 298
Welham, J., Scott, J., Williams, G., Najman, J., Bor, W., O'Callaghan, M., & McGrath, J. (2009) · Psychological Medicine · doi:10.1017/s0033291708003760 · Cited by 288
IQ and non-clinical psychotic symptoms in 12-year-olds: results from the ALSPAC birth cohort
Horwood, J., Salvi, G., Thomas, K., Duffy, L., Gunnell, D., Hollis, C., Lewis, G., Menezes, P., Thompson, A., Wolke, D., et al. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.051904 · Cited by 272 · cited 1×
“Horwood et al(21) also found that endorsement of their screener questions did not generally predict genuine psychotic symptoms when followed up by further probe questions.(21) Positive predictive power for most questions was no more than 50%.”
BackgroundKelleher, I., Harley, M., Lynch, F., Arseneault, L., Fitzpatrick, C., & Cannon, M. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.049536 · Cited by 266
Self-citationWiles, N. J., Zammit, S., Bebbington, P., Singleton, N., Meltzer, H., & Lewis, G. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.012179 · Cited by 245
LAURENS, K., HODGINS, S., MAUGHAN, B., MURRAY, R., RUTTER, M., & TAYLOR, E. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2006.11.006 · Cited by 240
SCOTT, J., CHANT, D., ANDREWS, G., & McGRATH, J. (2006) · Psychological Medicine · doi:10.1017/s0033291705006392 · Cited by 195
Shevlin, M. E., Murphy, J., Dorahy, M. J., & Adamson, G. (2006) · Schizophrenia Research · doi:10.1016/j.schres.2006.09.014 · Cited by 131
McGlashan, T. H., Miller, T. J., & Woods, S. W. (2001) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a006896 · Cited by 123
Hallucinatory Experiences in a Community Sample of Japanese Children
Yoshizumi, T., Murase, S., Honjo, S., Kaneko, H., & Murakami, T. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000126937.44875.6b · Cited by 111
Sex differences in psychosis: normal or pathological?
SPAUWEN, J., Krabbendam, L., Lieb, R., Wïttchen, H., & van Os, J. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(03)00063-x · Cited by 103
Simons, C. J. P., Jacobs, N., Jolles, J., van Os, J., & Krabbendam, L. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.01.008 · Cited by 44
Making progress in schizophrenia research
Heckers, S. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn046 · Cited by 42 · cited 1×
“The need for rich phenomenological data has recently been highlighted as vital to the progress of schizophrenia research.(25) Little work has been carried”
Background
Cited by
Linscott, R. J., & van Os, J. (2013) · Psychological Medicine · doi:10.1017/s0033291712001626 · Cited by 1,181
“Self-report instruments have been shown to accurately predict interviewascertained PE (Kelleher et al. 2011).”
BackgroundKelleher, I., Connor, D., Clarke, M. C., Devlin, N., Harley, M., & Cannon, M. (2012) · Psychological Medicine · doi:10.1017/s0033291711002960 · Cited by 686
Self-citationArseneault, L., Cannon, M., Fisher, H. L., Polanczyk, G., Moffitt, T. E., & Caspi, A. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10040567 · Cited by 584
Self-citationPsychotic-like experiences in the general population: characterizing a high-risk group for psychosis
Kelleher, I., & Cannon, M. (2011) · Psychological Medicine · doi:10.1017/s0033291710001005 · Cited by 569
Self-citationIsing, H. K., Veling, W., Loewy, R. L., Rietveld, M. W., Rietdijk, J., Dragt, S., Klaassen, R. M. C., Nieman, D. H., Wunderink, L., Linszen, D. H., et al. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs068 · Cited by 460
Metadata
- Authors
- Kelleher, I., Harley, M., Murtagh, A., & Cannon, M.
- Affiliations
- Royal College of Surgeons in Ireland (IE)
- Venue
- Schizophrenia Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-06-19
- Volume
- 37
- Issue
- 2
- Pages
- 362-369
- ISSN
- 0586-7614 (ISSN-L)
- 1745-1701
- PMC
- PMC3044617
- OpenAlex
- W2097890485
- Cited by
- 352
- References
- 25
- Citations by year
- 2026: 9 · 2025: 18 · 2024: 21 · 2023: 23 · 2022: 26 · 2021: 23 · 2020: 28 · 2019: 21 · 2018: 29 · 2017: 19 · 2016: 13 · 2015: 26 · 2014: 20 · 2013: 20 · 2012: 33
- FWCI
- 11.54
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Schizophrenia Bulletin (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Lenus, The Irish Health Repository (Dr Steevens Hospital Library) (submittedVersion)
- Funders
- Health Research Board
- Royal College of Surgeons in Ireland
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Life Sciences › Neuroscience › Cognitive Neuroscience › Hallucinations in medical conditions
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Keywords
- psychotic-like experiences, screening tool
- MeSH terms
- Adolescent, Mental Disorders, Child, Delusions, Female, Hallucinations, Humans, Interview, Psychological, Ireland, Male, Mass Screening, Paranoid Behavior, Psychometrics, Psychotic Disorders, Surveys and Questionnaires, Reference Values, Reproducibility of Results, Comorbidity, Risk Assessment, Early Diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.