Natural language processing markers for psychosis and other psychiatric disorders: emerging themes and research agenda from a Cross-Linguistic Workshop
Open accessAbstract
This workshop summary on natural language processing (NLP) markers for psychosis and other psychiatric disorders presents some of the clinical and research issues that NLP markers might address and some of the activities needed to move in that direction. We propose that the optimal development of NLP markers would occur in the context of research efforts to map out the underlying mechanisms of psychosis and other disorders. In this workshop, we identified some of the challenges to be addressed in developing and implementing NLP markers-based Clinical Decision Support Systems (CDSSs) in psychiatric practice, especially with respect to psychosis. Of note, a CDSS is meant to enhance decision-making by clinicians by providing additional relevant information primarily through software (although CDSSs are not without risks). In psychiatry, a field that relies on subjective clinical ratings that condense rich temporal behavioral information, the inclusion of computational quantitative NLP markers can plausibly lead to operationalized decision models in place of idiosyncratic ones, although ethical issues must always be paramount.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · see citing works
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019 · see citing works
Four ethical priorities for neurotechnologies and AI
Yuste, R., Goering, S., Arcas, B. A. Y., Bi, G., Carmena, J. M., Carter, A., Fins, J. J., Friesen, P., Gallant, J., Huggins, J. E., et al. (2017) · Nature · doi:10.1038/551159a · Cited by 678 · see citing works
Implementing Measurement-Based Care in Behavioral Health: A Review
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3329 · Cited by 605 · see citing works
Prediction of psychosis across protocols and risk cohorts using automated language analysis
Corcoran, C. M., Carrillo, F., Slezak, D. F., Bedi, G., Klim, C. C., Javitt, D. C., Bearden, C. E., & Cecchi, G. (2018) · World Psychiatry · doi:10.1002/wps.20491 · Cited by 381 · see citing works
Self-citationLanguage in the aging brain: The network dynamics of cognitive decline and preservation
Shafto, M. A., & TYLER, L. K. (2014) · Science · doi:10.1126/science.1254404 · Cited by 361 · see citing works
Etiology in psychiatry: embracing the reality of poly‐gene‐environmental causation of mental illness
Uher, R., & Zwicker, A. (2017) · World Psychiatry · doi:10.1002/wps.20436 · Cited by 331 · see citing works
Vocal Acoustic Biomarkers of Depression Severity and Treatment Response
Mundt, J. C., Vogel, A. P., Feltner, D. E., & Lenderking, W. R. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.03.015 · Cited by 325 · see citing works
From promise to practice: towards the realisation of AI-informed mental health care
Koutsouleris, N., Hauser, T. U., Skvortsova, V., & De Choudhury, M. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00153-4 · Cited by 251 · see citing works
Recommendations for Responsible Development and Application of Neurotechnologies
Goering, S., Klein, E. P., Sullivan, L. S., Wexler, A., y Arcas, B. A., Bi, G., Carmena, J. M., Fins, J. J., Friesen, P., Gallant, J. L., et al. (2021) · Neuroethics · doi:10.1007/s12152-021-09468-6 · Cited by 236 · see citing works
Digital biomarkers: Convergence of digital health technologies and biomarkers
Vasudevan, S., Saha, A., Tarver, M. E., & Patel, B. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00583-z · Cited by 184 · see citing works
Voice patterns in schizophrenia: A systematic review and Bayesian meta-analysis
Parola, A., Simonsen, A., Bliksted, V., & Fusaroli, R. (2019) · Schizophrenia Research · doi:10.1016/j.schres.2019.11.031 · Cited by 141 · see citing works
Self-citationEarly Language Milestones and Specific Language Impairment
Rudolph, J. M., & Leonard, L. B. (2016) · Journal of Early Intervention · doi:10.1177/1053815116633861 · Cited by 117 · see citing works
Anomalies in language as a biomarker for schizophrenia
de Boer, J. N., Brederoo, S., Voppel, A., & Sommer, I. E. (2020) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000595 · Cited by 117 · see citing works
Self-citationBirnbaum, M., Ernala, S. K., Rizvi, A., Arenare, E., Meter, A. V., de Choudhury, M., & Kane, J. M. (2019) · npj Schizophrenia · doi:10.1038/s41537-019-0085-9 · Cited by 96 · see citing works
Oxford Handbook of Digital Ethics
(2021) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.001.0001 · Cited by 88 · see citing works
Smartphone-centred wearable sensors network for monitoring patients with bipolar disorder
Puiatti, A., Mudda, S., Giordano, S., & Mayora, O. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6090613 · Cited by 75 · see citing works
Self-citationShain, C., Blank, I., Fedorenko, E. G., Gibson, E. A. F., & Schuler, W. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1894-21.2022 · Cited by 73 · see citing works
More than a biomarker: could language be a biosocial marker of psychosis?
Palaniyappan, L. K. (2021) · Schizophrenia · doi:10.1038/s41537-021-00172-1 · Cited by 72 · see citing works
Self-citationAcoustic and language analysis of speech for suicidal ideation among US veterans
Belouali, A., Gupta, S., Sourirajan, V., Yu, J., Allen, N. J., Alaoui, A., Dutton, M. A., & Reinhard, M. J. (2021) · BioData Mining · doi:10.1186/s13040-021-00245-y · Cited by 67 · see citing works
Huang, K.-Y., Wu, C., Su, M.-H., & Kuo, Y.-T. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2803178 · Cited by 65 · see citing works
Carrillo, F., Sigman, M., Slezak, D. F., Ashton, P., Fitzgerald, L., Stroud, J., Nutt, D., & Carhart-Harris, R. L. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.01.006 · Cited by 57 · see citing works
Fusaroli, R., Grossman, R. B., Bilenberg, N., Cantio, C., Jepsen, J. R. M., & Weed, E. (2021) · Autism Research · doi:10.1002/aur.2661 · Cited by 53 · see citing works
Self-citationSilva, A., Limongi, R., Mackinley, M., Ford, S. D., Alonso-Sánchez, M. F., & Palaniyappan, L. K. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.06.011 · Cited by 48 · see citing works
Self-citationBilgrami, Z. R., Sarac, C., Srivastava, A., Herrera, S. N., Azis, M., Haas, S. S., Shaik, R., Parvaz, M. A., Mittal, V. A., Cecchi, G., et al. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.01.019 · Cited by 47 · see citing works
Self-citationChandler, C., Foltz, P. W., & Elvevåg, B. (2022) · Schizophrenia Bulletin · doi:10.1093/schbul/sbac038 · Cited by 47 · see citing works
Self-citationBirnbaum, M., Norel, R., Meter, A. V., Ali, A. F., Arenare, E., Eyigoz, E., Agurto, C., Germano, N., Kane, J., & Cecchi, G. (2020) · npj Schizophrenia · doi:10.1038/s41537-020-00125-0 · Cited by 44 · see citing works
Self-citationLanguage as shaped by the environment: linguistic construal in a collaborative spatial task
Nölle, J., Fusaroli, R., Mills, G. J., & Tylén, K. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0404-9 · Cited by 41 · see citing works
Self-citationNi, Y., Barzman, D. H., Bachtel, A., Griffey, M., Osborn, A. J., & Sorter, M. T. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104137 · Cited by 41 · see citing works
Negative symptoms and speech pauses in youths at clinical high risk for psychosis
Stanislawski, E. R., Bilgrami, Z. R., Sarac, C., et al. (2021) · Schizophrenia · doi:10.1038/s41537-020-00132-1 · Cited by 35 · see citing works
Foltz, P. W., Chandler, C., Diaz-Asper, C. M., Cohen, A. S., Rodriguez, Z. B., Holmlund, T. B., & Elvevåg, B. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.07.011 · Cited by 32 · see citing works
Self-citationThe genetic architecture of language functional connectivity
Mekki, Y., Guillemot, V., Lemaître, H., Carrión-Castillo, A., Forkel, S. J., Frouin, V., & Philippe, C. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118795 · Cited by 31 · see citing works
Decision Models and Technology Can Help Psychiatry Develop Biomarkers
Barron, D. S., Baker, J. T., Budde, K. S., Bzdok, D., Eickhoff, S. B., Friston, K. J., Fox, P. T., Geha, P., Heisig, S., Holmes, A. J., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.706655 · Cited by 19 · see citing works
Weak biases emerging from vocal tract anatomy shape the repeated transmission of vowels
Dediu, D., Janssen, R., & Moisik, S. R. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0663-x · Cited by 18 · see citing works
Is Collaborative Open Science Possible With Speech Data in Psychiatric Disorders?
Palaniyappan, L. K., Alonso-Sánchez, M. F., & MacWhinney, B. (2022) · Schizophrenia Bulletin · doi:10.1093/schbul/sbac058 · Cited by 17 · see citing works
Self-citationBrederoo, S., Nadema, F. G., Goedhart, F. G., Voppel, A., de Boer, J. N., Wouts, J., Koops, S., & Sommer, I. E. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.08.019 · Cited by 15 · see citing works
Self-citationWhereof one cannot speak: How language and capture of visual attention interact
Goller, F., Choi, S., Hong, U., & Ulrich Ansorge, A. (2019) · Cognition · doi:10.1016/j.cognition.2019.104023 · Cited by 13 · see citing works
Fusaroli, M., Simonsen, A., Borrie, S. A., Low, D. M., Parola, A., Raschi, E., Poluzzi, E., & Fusaroli, R. (2023) · Journal of Speech Language and Hearing Research · doi:10.1044/2023_jslhr-22-00739 · Cited by 13 · see citing works
Self-citationHauglid, M. K. (2022) · Schizophrenia Bulletin · doi:10.1093/schbul/sbac008 · Cited by 9 · see citing works
Self-citationHolmlund, T. B., Chandler, C., Foltz, P. W., Diaz-Asper, C. M., Cohen, A. S., Rodriguez, Z. B., & Elvevåg, B. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.09.020 · Cited by 8 · see citing works
Self-citationKey Issues and Future Directions: The Neural Architecture for Language
Hagoort, P., & Beckmann, C. F. (2019) · The MIT Press eBooks · doi:10.7551/mitpress/10841.003.0045 · Cited by 5 · see citing works
Explainable Machine Learning, Patient Autonomy, and Clinical Reasoning
Keeling, G., & Nyrup, R. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.013.27 · Cited by 3 · see citing works
Barbero (2014) · doi:10.1016/j · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Quillivic, R., Auxéméry, Y., Gayraud, F., Dayan, J., & Mesmoudi, S. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf075 · Cited by 3 · see citing works
- Authors
- Corona Hernández, H., Corcoran, C., Achim, A. M., de Boer, J. N., Boerma, T., Brederoo, S. G., Cecchi, G. A., Ciampelli, S., Elvevåg, B., Fusaroli, R., Giordano, S., Hauglid, M., van Hessen, A., Hinzen, W., Homan, P., de Kloet, S. F., Koops, S., Kuperberg, G. R., Maheshwari, K., Mota, N. B., Parola, A., Rocca, R., Sommer, I. E. C., Truong, K., Voppel, A. E., van Vugt, M., Wijnen, F., & Palaniyappan, L.
- Affiliations
- Department of Biomedical Sciences of Cells and Systems, University Medical Center Groningen, University of Groningen , Groningen , Netherlands
- Icahn School of Medicine at Mount Sinai (US)
- Université Laval (CA)
- Utrecht University (NL)
- University Medical Center Groningen (NL)
- IBM (United States) (US)
- UiT The Arctic University of Norway (NO)
- Aarhus University (DK)
- University of Applied Sciences and Arts of Southern Switzerland (CH)
- Department of Languages, Literature and Communication, Institute for Language Sciences, Utrecht University , Utrecht , Netherlands
- Institució Catalana de Recerca i Estudis Avançats (ES)
- University of Zurich (CH)
- Neurocast BV , Amsterdam , Netherlands
- Tufts University (US)
- Institute of Psychiatry, Federal University of Rio de Janeiro , Rio de Janeiro , Brazil
- University of Twente (NL)
- Bernoulli Institute of Mathematics, Computer Science and Artificial Intelligence, University of Groningen , Groningen , Netherlands
- Western University (CA)
- Corresponding author
- Palaniyappan, Lena
- ORCID
- Corcoran, Cheryl
- Achim, Amélie M
- de Boer, Janna N
- Boerma, Tessel
- Brederoo, Sanne G
- Cecchi, Guillermo A
- Ciampelli, Silvia
- Elvevåg, Brita
- Fusaroli, Riccardo
- Giordano, Silvia
- Hinzen, Wolfram
- Homan, Philipp
- Koops, Sanne
- Kuperberg, Gina R
- Maheshwari, Kritika
- Parola, Alberto
- Rocca, Roberta
- Sommer, Iris E C
- Truong, Khiet
- Voppel, Alban E
- Wijnen, Frank
- Palaniyappan, Lena
- Venue
- Schizophrenia Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-03-01
- Volume
- 49
- Issue
- Supplement_2
- Pages
- S86-S92
- ISSN
- 0586-7614 (ISSN-L)
- 1745-1701
- OpenAlex
- W4353018225
- Semantic Scholar
- 68961625cc5cefafc867bf9737fb75f8c411fdb9
- Cited by
- 56
- References
- 43
- Citations by year
- 2026: 15 · 2025: 27 · 2024: 11 · 2023: 3
- FWCI
- 16.52
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Schizophrenia Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion, cc-by-nc-nd)
- University of Twente Research Information (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, other-oa)
- Research Repository (Delft University of Technology) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Consejo Nacional de Ciencia y Tecnología
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Keywords
- psychosis
- MeSH terms
- Mental Disorders, Humans, Linguistics, Natural Language Processing, Psychotic Disorders, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
