Accuracy of online survey assessment of mental disorders and suicidal thoughts and behaviors in Spanish university students. Results of the WHO World Mental Health- International College Student initiative
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To assess the accuracy of WMH-ICS online screening scales for evaluating four common mental disorders (Major Depressive Episode[MDE], Mania/Hypomania[M/H], Panic Disorder[PD], Generalized Anxiety Disorder[GAD]) and suicidal thoughts and behaviors[STB] used in the UNIVERSAL project. METHODS: Clinical diagnostic reappraisal was carried out on a subsample of the UNIVERSAL project, a longitudinal online survey of first year Spanish students (18-24 years old), part of the WHO World Mental Health-International College Student (WMH-ICS) initiative. Lifetime and 12-month prevalence of MDE, M/H, PD, GAD and STB were assessed with the Composite International Diagnostic Interview-Screening Scales [CIDI-SC], the Self-Injurious Thoughts and Behaviors Interview [SITBI] and the Columbia-Suicide Severity Rating Scale [C-SSRS]. Trained clinical psychologists, blinded to responses in the initial survey, administered via telephone the Mini-International Neuropsychiatric Interview [MINI]. Measures of diagnostic accuracy and McNemar χ2 test were calculated. Sensitivity analyses were conducted to maximize diagnostic capacity. RESULTS: A total of 287 students were included in the clinical reappraisal study. For 12-month and lifetime mood disorders, sensitivity/specificity were 67%/88.6% and 65%/73.3%, respectively. For 12-month and lifetime anxiety disorders, these were 76.8%/86.5% and 59.6%/71.1%, and for 12-month and lifetime STB, 75.9%/94.8% and 87.2%/86.3%. For 12-month and lifetime mood disorders, anxiety disorders and STB, positive predictive values were in the range of 18.1-55.1% and negative predictive values 90.2-99.0%; likelihood ratios positive were in the range of 2.1-14.6 and likelihood ratios negative 0.1-0.6. All outcomes showed adequate areas under the curve [AUCs] (AUC>0.7), except M/H and PD (AUC = 0.6). Post hoc analyses to select optimal diagnostic thresholds led to improved concordance for all diagnoses (AUCs>0.8). CONCLUSION: The WMS-ICS survey showed reasonable concordance with the MINI telephone interviews performed by mental health professionals, when utilizing optimized cut-off scores. The current study provides initial evidence that the WMS-ICS survey might be useful for screening purposes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157 · cited 8×
“Lifetime and 12- month prevalence of MDE, M/H, PD, GAD and STB were assessed with the Composite International Diagnostic Interview-Screening Scales [CIDI-SC], the Self-Injurious Thoughts and Behaviors Interview [SITBI] and the Columbia-Suicide Severity Rating Scale [C-SSRS].”
MethodResultInfluentialLecrubier, Y., Sheehan, D., Weiller, E., Amorim, P., Bonora, I., Sheehan, K. H., Janavs, J., & Dunbar, G. (1997) · European Psychiatry · doi:10.1016/s0924-9338(97)83296-8 · Cited by 3,513 · cited 2×
“After responding to the online survey, a sub-sample of eligible students was invited to participate in a telephone clinical interview using the Mini International Neuropsychiatric Interview (MINI)[14].”
BackgroundMethodAge of onset of mental disorders: a review of recent literature
Kessler, R. C., Amminger, G. P., Aguilar-Gaxiola, S., Alonso, J., Lee, S., & ??st??n, T. B. (2007) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e32816ebc8c · Cited by 3,457 · cited 2×
“College years period is well-known as a peak period to develop first onset on mental disorders[3,4].”
BackgroundSelf-citationThe global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013
Steel, Z., Marnane, C., Iranpour, C., Chey, T., Jackson, J. W., Patel, V., & Silove, D. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu038 · Cited by 2,846
Health Measurement Scales: A practical guide to their development and use
Streiner, D. L., Norman, G. R., & Cairney, J. (2014) · doi:10.1093/med/9780199685219.001.0001 · Cited by 2,564
Auerbach, R. P., Collaborators, W. W.-I., Mortier, P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., Demyttenaere, K., Ebert, D. D., Green, J. G., et al. (2018) · Journal of Abnormal Psychology · doi:10.1037/abn0000362 · Cited by 2,522 · cited 5×
“More detailed description of the WMH-ICS initiative can be found elsewhere[25,31,32].”
BackgroundMethodInfluentialSelf-citationThe global burden of mental disorders: An update from the WHO World Mental Health (WMH) surveys
Kessler, R. C., Aguilar-Gaxiola, S., Alonso, J., Chatterji, S., Lee, S., Ormel, J., Üstün, T. B., & Wang, P. S. (2009) · Epidemiologia e Psichiatria Sociale · doi:10.1017/s1121189x00001421 · Cited by 1,895
Self-citationDiagnostic tests 4: likelihood ratios
Deeks, J. J., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.329.7458.168 · Cited by 1,600
Blanco, C., Okuda, M., Wright, C., Hasin, D. S., Grant, B. F., Liu, S.-M., & Olfson, M. (2008) · Archives of General Psychiatry · doi:10.1001/archpsyc.65.12.1429 · Cited by 1,582
College Students: Mental Health Problems and Treatment Considerations
Pedrelli, P., Nyer, M., Yeung, A., Zulauf, C., & Wilens, T. (2015) · Academic Psychiatry · doi:10.1007/s40596-014-0205-9 · Cited by 1,325
Cited by
Li, Y., Scherer, N., Felix, L., & Kuper, H. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246454 · Cited by 536
Karyotaki, E., Cuijpers, P., Albor, Y., Alonso, J., Auerbach, R. P., Bantjes, J., Bruffaerts, R., Ebert, D. D., Hasking, P., Kiekens, G., et al. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01759 · Cited by 389
Self-citationCrockett, M. A., Martínez, V., Mac-Ginty, S., Langer, Á. I., Gaete, J., Núñez, D., & Léniz, I. (2025) · International Journal of LGBTQ+ Youth Studies · doi:10.1080/19361653.2024.2347962 · Cited by 2
Metadata
- Authors
- Ballester, L., Alayo, I., Vilagut, G., Almenara, J., Cebrià, A. I., Echeburúa, E., Gabilondo, A., Gili, M., Lagares, C., Piqueras, J. A., Roca, M., Soto-Sanz, V., Blasco, M. J., Castellví, P., Forero, C. G., Bruffaerts, R., Mortier, P., Auerbach, R. P., Nock, M. K., Sampson, N., Kessler, R. C., Alonso, J., & on behalf of the UNIVERSAL study group
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-09-05
- Volume
- 14
- Issue
- 9
- Pages
- e0221529
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2971392955
- Cited by
- 59
- References
- 22
- FWCI
- 9.67
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Accuracy of online survey assessment of mental disorders and suicidal thoughts and behaviors in Spanish university students. Results of the WHO World Mental Health- International College Student initiative. https://app.cochat.ai/papers/10.1371/journal.pone.0221529
- The paper
- Ballester, L., Alayo, I., Vilagut, G., Almenara, J., Cebrià, A. I., Echeburúa, E., Gabilondo, A., Gili, M., Lagares, C., Piqueras, J. A., Roca, M., Soto-Sanz, V., Blasco, M. J., Castellví, P., Forero, C. G., Bruffaerts, R., Mortier, P., Auerbach, R. P., Nock, M. K., . . . on behalf of the UNIVERSAL study group. (2019). Accuracy of online survey assessment of mental disorders and suicidal thoughts and behaviors in Spanish university students. Results of the WHO World Mental Health- International College Student initiative. PLOS ONE. https://doi.org/10.1371/journal.pone.0221529
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.