The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Prediction of psychosis across protocols and risk cohorts using automated language analysis
Open accessAbstract
Language and speech are the primary source of data for psychiatrists to diagnose and treat mental disorders. In psychosis, the very structure of language can be disturbed, including semantic coherence (e.g., derailment and tangentiality) and syntactic complexity (e.g., concreteness). Subtle disturbances in language are evident in schizophrenia even prior to first psychosis onset, during prodromal stages. Using computer‐based natural language processing analyses, we previously showed that, among English‐speaking clinical (e.g., ultra) high‐risk youths, baseline reduction in semantic coherence (the flow of meaning in speech) and in syntactic complexity could predict subsequent psychosis onset with high accuracy. Herein, we aimed to cross‐validate these automated linguistic analytic methods in a second larger risk cohort, also English‐speaking, and to discriminate speech in psychosis from normal speech. We identified an automated machine‐learning speech classifier – comprising decreased semantic coherence, greater variance in that coherence, and reduced usage of possessive pronouns – that had an 83% accuracy in predicting psychosis onset (intra‐protocol), a cross‐validated accuracy of 79% of psychosis onset prediction in the original risk cohort (cross‐protocol), and a 72% accuracy in discriminating the speech of recent‐onset psychosis patients from that of healthy individuals. The classifier was highly correlated with previously identified manual linguistic predictors. Our findings support the utility and validity of automated natural language processing methods to characterize disturbances in semantics and syntax across stages of psychotic disorder. The next steps will be to apply these methods in larger risk cohorts to further test reproducibility, also in languages other than English, and identify sources of variability. This technology has the potential to improve prediction of psychosis outcome among at‐risk youths and identify linguistic targets for remediation and preventive intervention. More broadly, automated linguistic analysis can be a powerful tool for diagnosis and treatment across neuropsychiatry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880
A Generalized Solution of the Orthogonal Procrustes Problem
Schönemann, P. H. (1966) · Psychometrika · doi:10.1007/bf02289451 · Cited by 2,040
Miller, T. J., McGlashan, T. H., Rosen, J. L., Cadenhead, K., Ventura, J., McFarlane, W., Perkins, D. O., Pearlson, G. D., & Woods, S. W. (2003) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a007040 · Cited by 1,798
Dementia Praecox oder Gruppe der Schizophrenien
Bleuler, E. (1911) · Cited by 1,429
Andreasen, N. C. (1979) · Archives of General Psychiatry · doi:10.1001/archpsyc.1979.01780120045006 · Cited by 746
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673
Self-citationA Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex
Haxby, J. V., Guntupalli, J. S., Connolly, A. C., Halchenko, Y. O., Conroy, B. R., Gobbini, M. I., Hanke, M., & Ramadge, P. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.026 · Cited by 648
Thought, Language, and Communication Disorders: II. Diagnostic Significance
Andreasen, N. C. (1979) · Archives of General Psychiatry · doi:10.1001/archpsyc.1979.01780120055007 · Cited by 521
Part-of-Speech Tagging Guidelines for the Penn Treebank Project (3rd Revision)
Santorini, B. (1990) · ScholarlyCommons (University of Pennsylvania) · Cited by 434
Long-term Follow-up of a Group at Ultra High Risk (“Prodromal”) for Psychosis: The PACE 400 Study
Nelson, B., Yuen, H. P., Wood, S. J., Lin, A., Spiliotacopoulos, D., Bruxner, A., Broussard, C., Simmons, M., Foley, D. L., Brewer, W. J., et al. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1270 · Cited by 433
Thought, Language, and Communication in Schizophrenia: Diagnosis and Prognosis
Andreasen, N. C., & Grove, W. M. (1986) · Schizophrenia Bulletin · doi:10.1093/schbul/12.3.348 · Cited by 385
Quantifying incoherence in speech: An automated methodology and novel application to schizophrenia
Elvevåg, B., Foltz, P. W., Weinberger, D. R., & Goldberg, T. E. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.001 · Cited by 363
Coupled neural systems underlie the production and comprehension of naturalistic narrative speech
Silbert, L. J., Honey, C. J., Simony, E., Poeppel, D., & Hasson, U. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323812111 · Cited by 352
Speech Graphs Provide a Quantitative Measure of Thought Disorder in Psychosis
Mota, N. B., Vasconcelos, N. A. P., Lemos, N., Pieretti, A. C., Kinouchi, O., Cecchi, G. A., Copelli, M., & Ribeiro, S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0034928 · Cited by 265
Self-citationNorth American Prodrome Longitudinal Study (NAPLS 2): The Prodromal Symptoms
Addington, J., Liu, L., Buchy, L., Cadenhead, K. S., Cannon, T. D., Cornblatt, B. A., Perkins, D. O., Seidman, L. J., Tsuang, M. T., Walker, E. F., et al. (2015) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000290 · Cited by 229
Self-citationNippold, M. A., Ward-Lonergan, J. M., & Fanning, J. L. (2005) · Language, Speech, and Hearing Services in Schools · doi:10.1044/0161-1461(2005/012 · Cited by 200
Roche, E., Creed, L., MacMahon, D., Brennan, D., & Clarke, M. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu129 · Cited by 173
A Comparative Study of Manic vs Schizophrenic Speech Disorganization
Hoffman, R. E. (1986) · Archives of General Psychiatry · doi:10.1001/archpsyc.1986.01800090017003 · Cited by 167
Cornblatt, B. A., Carrión, R. E., Auther, A. M., McLaughlin, D., Olsen, R. H., John, M., & Correll, C. U. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.13121686 · Cited by 163
Elvevåg, B., Foltz, P. W., Rosenstein, M., & DeLisi, L. E. (2009) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2009.05.002 · Cited by 144
García, A. M., Carrillo, F., Orozco-Arroyave, J. R., Trujillo, N., Vargas Bonilla, J. F., Fittipaldi, S., Adolfi, F., Nöth, E., Sigman, M., Fernández Slezak, D., et al. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.07.008 · Cited by 144
Self-citationBearden, C., Wu, K., Caplan, R., & Cannon, T. D. (2011) · Journal of the American Academy of Child and Adolescent Psychiatry · doi:10.1016/j.jaac.2011.03.021 · Cited by 121
Self-citationThe Kiddie Formal Thought Disorder Rating Scale: Clinical Assessment, Reliability, and Validity
Caplan, R., Guthrie, D., Fish, B., Tanguay, P. E., & DAVID-LANDO, G. (1989) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-198905000-00018 · Cited by 106
Kuperberg, G. R. (2010) · Language and Linguistics Compass · doi:10.1111/j.1749-818x.2010.00217.x · Cited by 100
How useful are corpus-based methods for extrapolating psycholinguistic variables?
Mandera, P., Keuleers, E., & Brysbaert, M. (2015) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.988735 · Cited by 92
A Window into the Intoxicated Mind? Speech as an Index of Psychoactive Drug Effects
Bedi, G., Cecchi, G., Slezak, D. F., Carrillo, F., Sigman, M., & de Wit, H. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.80 · Cited by 90
Self-citationDeVylder, J., Muchomba, F. M., Gill, K. E., Ben‐David, S., Walder, D. J., Malaspina, D., & Corcoran, C. M. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.08.008 · Cited by 83
Self-citationBuck, B., & Penn, D. L. (2015) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000354 · Cited by 76
A new approach to discourse analysis in psychiatry, applied to a schizophrenic patient's speech
Noël-Jorand, M. C., Reinert, M., Giudicelli, S., & Dassa, D. (1997) · Schizophrenia Research · doi:10.1016/s0920-9964(97)00022-4 · Cited by 65
Literal and Metaphorical Senses in Compositional Distributional Semantic Models
Gutierrez, E., Shutova, E., Marghetis, T., & Bergen, B. K. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1018 · Cited by 64
Message disruptions during syntactic processing in schizophrenia
Hoffman, R. E., Hogben, G. L., Smith, H., & Calhoun, W. F. (1985) · Journal of Communication Disorders · doi:10.1016/0021-9924(85)90020-6 · Cited by 57
Ashburner, J., & Friston, K. J. (2007) · Elsevier eBooks · doi:10.1016/b978-012372560-8/50004-8 · Cited by 57
Gooding, D. C., Ott, S. L., Roberts, S. A., & Erlenmeyer‐Kimling, L. (2012) · Psychological Medicine · doi:10.1017/s0033291712001791 · Cited by 55
The Subjective Experience of Youths at Clinically High Risk of Psychosis: A Qualitative Study
Ben‐David, S., Birnbaum, M. L., Eilenberg, M. E., et al. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300527 · Cited by 36
Natural Language Processing and Linguistic Fieldwork
Bird, S. (2009) · Computational Linguistics · doi:10.1162/coli.35.3.469 · Cited by 32
Baker, J. T., Pennant, L., Baltrušaitis, T., Vijay, S., Liebson, E. S., Öngür, D., & Morency, L. (2016) · Iproceedings · doi:10.2196/iproc.6136 · Cited by 10
Jorge‐Botana, G., Olmos, R., & Luzón, J. M. (2017) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1457 · Cited by 9
Cited by
Precision medicine, AI, and the future of personalized health care
Johnson, K. B., Wei, W., Weeraratne, D., Frisse, M. E., Misulis, K., Rhee, K., Zhao, J., & Snowdon, J. L. (2021) · Clinical and Translational Science · doi:10.1111/cts.12884 · Cited by 1,854
Machine learning and natural language processing in mental health: systematic review
Le Glaz, A., Haralambous, Y., Kim-Dufor, D.-H., Lenca, P., Billot, R., Ryan, T. C., Marsh, J., DeVylder, J., Walter, M., Berrouiguet, S., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/15708 · Cited by 576
“…(PTSD; 3 cases) [47,63,64]; neurodevelopmental disorders (3 cases) [42,58,93]; psychotic spectrum disorders, including schizophrenia (3 cases) [39,95,100]; anxiety (2 cases) [41,98]; personality disorder (1 case) [85]; eating disorders (2 cases) [89,96]; and bipolar disorder (2 cases) [37,102].”
Machine learning in healthcare
Habehh, H., & Gohel, S. (2021) · Current Genomics · doi:10.2174/1389202922666210705124359 · Cited by 544
Lee, E. E., Torous, J., De Choudhury, M., Depp, C. A., Graham, S. A., Kim, H.-C., Paulus, M. P., Krystal, J. H., & Jeste, D. V. (2021) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.02.001 · Cited by 429
D’Alfonso, S. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.04.005 · Cited by 408
Metadata
- Authors
- Corcoran, C. M., Carrillo, F., Fernández‐Slezak, D., Bedi, G., Klim, C., Javitt, D. C., Bearden, C. E., & Cecchi, G. A.
- Venue
- World Psychiatry
- Publisher
- Wiley
- Published
- 2018-01-19
- Volume
- 17
- Issue
- 1
- Pages
- 67-75
- ISSN
- 1723-8617 (ISSN-L)
- 2051-5545
- OpenAlex
- W2791063712
- Cited by
- 381
- References
- 38
- FWCI
- 26.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.