Quantifying incoherence in speech: An automated methodology and novel application to schizophrenia
Open accessAbstract
Incoherent discourse, with a disjointed flow of ideas, is a cardinal symptom in several psychiatric and neurological conditions. However, measuring incoherence has often been complex and subjective. We sought to validate an objective, intrinsically reliable, computational approach to quantifying speech incoherence. Patients with schizophrenia and healthy control volunteers were administered a variety of language tasks. The speech generated was transcribed and the coherence computed using Latent Semantic Analysis (LSA). The discourse was also analyzed with a standard clinical measure of thought disorder. In word association and generation tasks LSA derived coherence scores were sensitive to differences between patients and controls, and correlated with clinical measures of thought disorder. In speech samples LSA could be used to localize where in sentence production incoherence occurs, predict levels of incoherence as well as whether discourse "belonged" to a patient or control. In conclusion, LSA can be used to assay disordered language production so as to both complement human clinical ratings as well as experimentally parse this incoherence in a theory-driven manner.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Mota et al. identified structural speech-graph features that serve as objective language measures containing clinically relevant information such as flight of thoughts and poverty of speech.
“The researchers were able to identify structural features of the generated graphs (such as loop density, distance between words of interest, etc.) that serve as objective language measures containing clinically relevant information (e.g. flight of thoughts, poverty of speech, etc.).”
From A Review of Automated Speech and Language Features for Assessment of Cognitive and Thought Disorders (2020) · cites this paper as [22]
Structural features of speech graphs, such as loop density and distance between words of interest, are clinically relevant objective language measures that provide insight into cognitive function.
“The researchers in this work suggest that structural graph features, i.e. loop density, distance (number of nodes) between words of interest, etc.) serve as clinically relevant objective language measures that give insight into cognitive function.”
From A Review of Automated Speech and Language Features for Assessment of Cognitive and Thought Disorders (2020) · cites this paper as [22]
Mota et al. visualized and quantified logorrhea in mania as denser speech-graph networks and alogia in schizophrenia as greater nodes per word and average total degree per node.
“Using these features, the researchers were able to visualize and quantify concepts such as the logorrhea (excessive wordiness and incoherence) associated with mania, evidenced by denser networks. Similarly, the alogia (poverty of speech) typical of schizophrenia was also visible in the generated speech-graph networks, as evidenced by a greater number of nodes per word and average total degree per”
From A Review of Automated Speech and Language Features for Assessment of Cognitive and Thought Disorders (2020) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · see citing works
The Brief Psychiatric Rating Scale.
Overall, J. E., & Gorham, D. R. (1962) · Psychological Reports · doi:10.2466/pr0.1962.10.3.799 · Cited by 11,090 · see citing works
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282 · see citing works
An introduction to latent semantic analysis
Landauer, T. K., Foltz, P. W., & Laham, D. (1998) · Discourse Processes · doi:10.1080/01638539809545028 · Cited by 4,880 · see citing works
Self-citationDementia Praecox or the Group of Schizophrenias
(1951) · Journal of the American Medical Association · doi:10.1001/jama.1951.02920270079043 · Cited by 4,407 · see citing works
Jurafsky, D. S., & Martin, J. (2000) · Cited by 4,132 · see citing works
Dementia Praecox and Paraphrenia.
(1972) · Annals of Internal Medicine · doi:10.7326/0003-4819-76-6-1058_8 · Cited by 2,906 · see citing works
Proceedings of the 35th Annual Meeting of the Cognitive Science Society
Culbertson, J., & Wilson, C. (2013) · Cited by 1,125 · see citing works
Discourse Production and Comprehension
Wertsch, J. V., & Freedle, R. O. (1978) · The American Journal of Psychology · doi:10.2307/1421524 · Cited by 909 · see citing works
The measurement of textual coherence with latent semantic analysis
Foltz, P. W., Kintsch, W., & Landauer, T. K. (1998) · Discourse Processes · doi:10.1080/01638539809545029 · Cited by 764 · see citing works
Self-citationSources of coherence in reading
Lorch, R. F., & O’Brien, E. J. (1995) · Cited by 426 · see citing works
Thought, Language, and Communication in Schizophrenia: Diagnosis and Prognosis
Andreasen, N. C., & Grove, W. M. (1986) · Schizophrenia Bulletin · doi:10.1093/schbul/12.3.348 · Cited by 386 · see citing works
Scale for the Assessment of Thought, Language, and Communication (TLC)
Andreasen, N. C. (1986) · Schizophrenia Bulletin · doi:10.1093/schbul/12.3.473 · Cited by 373 · see citing works
Verbal hallucinations and language production processes in schizophrenia
Hoffman, R. E. (1986) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00046781 · Cited by 359 · see citing works
DeLisi, L. E. (2001) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a006889 · Cited by 330 · see citing works
Negative Features, Retrieval Processes and Verbal Fluency in Schizophrenia
Allen, H., Liddle, P. F., & Frith, C. (1993) · The British Journal of Psychiatry · doi:10.1192/bjp.163.6.769 · Cited by 290 · see citing works
Landauer, T. K., Laham, D., Rehder, B., & Schreiner, M. (1997) · Cited by 275 · see citing works
Introductory Textbook of Psychiatry
(2020) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615373758 · Cited by 249 · see citing works
Letter and category fluency in schizophrenic patients: a meta-analysis
Bokat, C. E., & Goldberg, T. E. (2003) · Schizophrenia Research · doi:10.1016/s0920-9964(02)00282-7 · Cited by 234 · see citing works
Self-citationHandbook of discourse processes
Graesser, A. C., Gernsbacher, M. A., & Goldman, S. R. (2010) · Routledge eBooks · doi:10.4324/9781410607348 · Cited by 191 · see citing works
Comparative Studies of Thought Disorders
Shenton, M. E. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800130023004 · Cited by 159 · see citing works
Manschreck, T. C., Maher, B. A., & Ader, D. N. (1981) · The British Journal of Psychiatry · doi:10.1192/bjp.139.1.7 · Cited by 144 · see citing works
Introductory Textbook of Psychiatry
Andreasen, N. C., & TUCKER, G. J. (1991) · American Journal of Psychiatry · doi:10.1176/ajp.148.5.670 · Cited by 130 · see citing works
Comparative Studies of Thought Disorders
Solovay, M. R. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800130015003 · Cited by 125 · see citing works
Thought Pathology in Manic and Schizophrenic Patients
Harrow, M. (1982) · Archives of General Psychiatry · doi:10.1001/archpsyc.1982.04290060027006 · Cited by 112 · see citing works
Docherty, N. M. (2005) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.114.2.269 · Cited by 95 · see citing works
Schizophrenic Thought Disorder at Followup: Its Persistence and Prognostic Significance
Harrow, M., & Marengo, J. T. (1986) · Schizophrenia Bulletin · doi:10.1093/schbul/12.3.373 · Cited by 89 · see citing works
Language production and thought disorder in schizophrenia.
Barch, D. M., & Berenbaum, H. (1996) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.105.1.81 · Cited by 79 · see citing works
McKenna, P. J., & Oh, T. M. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511544057 · Cited by 78 · see citing works
Episodic and Residual Thought Pathology in Chronic Schizophrenics: Effect of Neuroleptics
Spohn, H. E., Coyne, L., Larson, J., et al. (1986) · Schizophrenia Bulletin · doi:10.1093/schbul/12.3.394 · Cited by 77 · see citing works
Breier, A. F., & Berg, P. H. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00040-2 · Cited by 73 · see citing works
Schizophrenic Speech – Making Sense of Bathroots and Ponds that Fall in Doorways
Christensen, T. (2005) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2005.00642.x · Cited by 62 · see citing works
Language production and thought disorder in schizophrenia.
Barch, D. M., & Berenbaum, H. (1996) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.105.1.81 · Cited by 60 · see citing works
Thought disorder in schizophrenia. Testing models through confirmatory factor analysis
Cuesta, M. J., & Peralta, V. (1999) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s004060050066 · Cited by 48 · see citing works
The Longitudinal Course of Thought Disorder in Geriatric Patients With Chronic Schizophrenia
Bowie, C. R., Tsapelas, I., Friedman, J. I., Parrella, M. J., WHITE, L. E., & Harvey, P. D. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.4.793 · Cited by 48 · see citing works
Semantic Dysfunction in Women With Schizotypal Personality Disorder
Niznikiewicz, M. A., Shenton, M. E., Voglmaier, M. M., Nestor, P. G., Dickey, C. C., Frumin, M., Seidman, L. J., Allen, C. G., & McCarley, R. W. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.10.1767 · Cited by 39 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- Jastak S, Wilkinson GS. The Wide Range Achievement Test-Revised administration manual. Rev. ed. Wilmington, Del: Jastak; 1984. [Google Scholar]
- Wechsler D. Wechsler Adult Intelligence Scale-Revised. San Antonio, Texas: Psychological Corporation; 1981. [Google Scholar]
- Zwaan RA, Singer M. Text comprehension. In: Graesser AC, Gernsbacher MA, Goldman SR, editors. Handbook of discourse processes. Mahwah, NJ: Lawrence Erlbaum Publishing; 2003. [Google Scholar]
Cited by
Sorted by citations
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673 · see citing works
Language as a biomarker for psychosis: a natural language processing approach
Corcoran, C. M., Mittal, V. A., Bearden, C. E., E. Gur, R., Hitczenko, K., Bilgrami, Z., Savic, A., Cecchi, G. A., & Wolff, P. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2020.04.032 · Cited by 186 · see citing works
Mota, N. B., Copelli, M., & Ribeiro, S. (2017) · npj Schizophrenia · doi:10.1038/s41537-017-0019-3 · Cited by 157 · see citing works
Automatic detection of Incoherent speech for diagnosing schizophrenia
Iter, D., Yoon, J., & Jurafsky, D. (2018) · Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic · doi:10.18653/v1/w18-0615 · Cited by 115 · see citing works
A Review of Automated Speech and Language Features for Assessment of Cognitive and Thought Disorders
Voleti, R., Liss, J. M., & Berisha, V. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2952087 · Cited by 96 · see citing works
Willits, J. A., Rubin, T., Jones, M. N., Minor, K. S., & Lysaker, P. H. (2018) · Schizophrenia Research · doi:10.1016/j.schres.2017.11.014 · Cited by 46 · see citing works
Eyigoz, E., Courson, M., Sedeño, L., Rogg, K., Orozco-Arroyave, J. R., Nöth, E., Skodda, S., Trujillo, N., Rodríguez, M., Rusz, J., et al. (2020) · Cortex · doi:10.1016/j.cortex.2020.08.020 · Cited by 44 · see citing works
Quillivic, R., Gayraud, F., Auxéméry, Y., Vanni, L., Peschanski, D., Eustache, F., Dayan, J., & Mesmoudi, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-61557-7 · Cited by 24 · see citing works
- Authors
- Elvevåg, B., Foltz, P. W., Weinberger, D. R., & Goldberg, T. E.
- Affiliations
- National Institutes of Health (US)
- New Mexico State University (US)
- Corresponding author
- Elvevåg, Brita
- Venue
- Schizophrenia Research
- Publisher
- Elsevier BV
- Published
- 2007-07
- Volume
- 93
- Issue
- 1-3
- Pages
- 304-316
- ISSN
- 0920-9964 (ISSN-L)
- PMC
- PMC1995127
- OpenAlex
- W2003128044
- Cited by
- 363
- References
- 36
- Citations by year
- 2026: 32 · 2025: 32 · 2024: 33 · 2023: 34 · 2022: 51 · 2021: 28 · 2020: 33 · 2019: 31 · 2018: 14 · 2017: 14 · 2016: 9 · 2015: 7 · 2014: 9 · 2013: 11
- FWCI
- 4.23
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Schizophrenia Research (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Mental Health (Z01MH002712)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Keywords
- schizophrenia
- MeSH terms
- Adult, Communication, Diagnosis, Computer-Assisted, Female, Humans, Interview, Psychological, Male, Middle Aged, Reference Values, Schizophrenia, Schizophrenic Language, Schizophrenic Psychology, Semantics, Sensitivity and Specificity, Software, Speech Production Measurement, Thinking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review