Development of a computerized adaptive screening tool for overall psychopathology (“p”)
Open accessAbstract
A substantial body of work supports the existence of a general psychopathology factor ("p"). Psychometrically, this is important because it implies that there is a psychological phenomenon (overall psychopathology) that can be measured and potentially used in clinical research or treatment. The present study aimed to construct, calibrate, and begin to validate a computerized adaptive (CAT) screener for "p". In a large community sample (N = 4544; age 11-21), we modeled 114 clinical items using a bifactor multidimensional item response theory (MIRT) model and constructed a fully functional (and public) CAT for assessing "p" called the Overall mental illness (OMI) screener. In a random, non-overlapping sample (N = 1019) with extended phenotyping (neuroimaging) from the same community cohort, adaptive versions of the OMI screener (10-, 20-, and 40-item) were simulated and compared to the full 114-item test in their ability to predict demographic characteristics, common mental disorders, and brain parameters. The OMI screener performed almost as well as the full test, despite being only a small fraction of the length. For prediction of 13 mental disorders, the mid-length (20-item) adaptive version showed mean area under the receiver operating characteristic curve of 0.76, compared to 0.79 for the full version. For prediction of brain parameters, mean absolute standardized relationship was 0.06 for the 20-item adaptive version, compared to 0.07 for the full form. This brief, public tool may facilitate the rapid and accurate measurement of overall psychopathology in large-scale studies and in clinical practice.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A p rapid screening assessment was calibrated and validated; the area under the ROC curve was 0.76, suggesting some generalizability for the instrument.
“The area under the curve was 0.76, sug- gesting some generalizability for the instrument.”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [41]
Despite evidence for the p factor across multiple disorders, many investigators caution against its existence across every disorder.
“Despite evidence for the p factor across multiple disorders, many investigators caution against its existence across every disorder (32,33,41).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [41]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 89 · Cited by 44
Research works printed but not linked: 2
- Chalmers RP, 2012 mirt: A Multidimensional Item Response Theory Package for theREnvironment. Journal of Statistical Software 48.
- Weiss DJ, Gibbons RD, 2007 Computerized adaptive testing with the bifactor model, in Weiss DJ (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing IACAT.
- Authors
- Moore, T. M., Calkins, M. E., Satterthwaite, T. D., Roalf, D. R., Rosen, A. F. G., Gur, R. C., & Gur, R. E.
- Affiliations
- University of Pennsylvania (US)
- Philadelphia VA Medical Center (US)
- Corresponding author
- Moore, Tyler M.
- ORCID
- Venue
- Journal of Psychiatric Research
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 116
- Pages
- 26-33
- ISSN
- 0022-3956 (ISSN-L)
- PMC
- PMC6649661
- OpenAlex
- W2947989809
- Cited by
- 44
- References
- 89
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 5 · 2023: 9 · 2022: 6 · 2021: 9 · 2020: 6 · 2019: 3
- FWCI
- 7.05
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Psychiatric Research (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Lifespan Brain Institute
- National Institute of Mental Health (MH089983, MH019112, MH096891, MH107235, MH107703)
- Dowshen Program for Neuroscience
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- general psychopathology factor, computerized adaptive testing, common mental disorders, neuroimaging, screening tool validation, test length reduction, community sample
- MeSH terms
- Adolescent, Algorithms, Mental Disorders, Brain, Child, Diagnosis, Computer-Assisted, Female, Humans, Interview, Psychological, Magnetic Resonance Imaging, Male, Psychiatric Status Rating Scales, Psychometrics, Psychopathology, ROC Curve, Cohort Studies, Area Under Curve, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review