The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Interdisciplinary approach to identify language markers for post-traumatic stress disorder using machine learning and deep learning
Open accessAbstract
Post-traumatic stress disorder (PTSD) lacks clear biomarkers in clinical practice. Language as a potential diagnostic biomarker for PTSD is investigated in this study. We analyze an original cohort of 148 individuals exposed to the November 13, 2015, terrorist attacks in Paris. The interviews, conducted 5–11 months after the event, include individuals from similar socioeconomic backgrounds exposed to the same incident, responding to identical questions and using uniform PTSD measures. Using this dataset to collect nuanced insights that might be clinically relevant, we propose a three-step interdisciplinary methodology that integrates expertise from psychiatry, linguistics, and the Natural Language Processing (NLP) community to examine the relationship between language and PTSD. The first step assesses a clinical psychiatrist's ability to diagnose PTSD using interview transcription alone. The second step uses statistical analysis and machine learning models to create language features based on psycholinguistic hypotheses and evaluate their predictive strength. The third step is the application of a hypothesis-free deep learning approach to the classification of PTSD in our cohort. Results show that the clinical psychiatrist achieved a diagnosis of PTSD with an AUC of 0.72. This is comparable to a gold standard questionnaire (Area Under Curve (AUC) ≈ 0.80). The machine learning model achieved a diagnostic AUC of 0.69. The deep learning approach achieved an AUC of 0.64. An examination of model error informs our discussion. Importantly, the study controls for confounding factors, establishes associations between language and DSM-5 subsymptoms, and integrates automated methods with qualitative analysis. This study provides a direct and methodologically robust description of the relationship between PTSD and language. Our work lays the groundwork for advancing early and accurate diagnosis and using linguistic markers to assess the effectiveness of pharmacological treatments and psychotherapies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Meanwhile, the future tense was less commonly analyzed, yet has been considered to reflect anticipatory anxiety or fear about potential future threats, which are significant elements of PTSD symptomatology.40,59”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [40]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Present tense usage often suggests that the traumatic experience is being relived rather than merely remembered (related to criterion B of DSM-5), which can indicate ongoing distress and unresolved trauma.40,77”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [40]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies 40,44,62,64 suggested that longer narratives are associated with more severe PTSD symptoms”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [40]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies 40,69,79,80 have found that less coherent narratives, characterized by disjointed and fragmented storytelling, are associated with more severe PTSD symptoms.”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [40]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Not all the studies found an association between death vocabulary and PTSD symptoms or severity, but many 40,45,47,49,56,57,60,62,[64][65][66] were consistent in indicating that death vocabulary was associated with more PTSD symptoms.”
From Linguistic markers for identifying post-traumatic stress disorder and associated symptoms: a systematic literature review (2025) · cites this paper as [40]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., & Domino, J. L. (2015) · Journal of Traumatic Stress · doi:10.1002/jts.22059 · Cited by 5,233
Disclosure of traumas and immune function: Health implications for psychotherapy.
Pennebaker, J. W., Kiecolt-Glaser, J. K., & Glaser, R. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.56.2.239 · Cited by 1,236
FLAIR: An Easy-to-Use Framework for State-of-the-Art NLP
Akbik, A., Bergmann, T., Blythe, D. A. J., Rasul, K., Schweter, S., & Vollgraf, R. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-4010 · Cited by 1,174
McKnight, P. E., & Najab, J. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0524 · Cited by 934
Temporal patterns of happiness and information in a global social network: hedonometrics and Twitter
Dodds, P. S., Harris, K. D., Kloumann, I. M., Bliss, C. A., & Danforth, C. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026752 · Cited by 809
Research works printed but not linked: 6
- Auxéméry, Y. & Gayraud, F. Identification des marques du traumatisme psychique dans le langage parlé : définition de l’échelle diagnostique « SPLIT-10 ». Ann. Méd.-Psychol. Rev. Psychiatr. 179, 869–888 (2021).
- Gayraud, F. & Auxéméry, Y. Identification of the marks of psychic trauma in spoken language: Definition of the “SPLIT-10” diagnostic scale. Ann. Méd.-Psychol. Rev. Psychiatr. 180, 195–212 (2022).
- Gupta, A., Kaur, M., Bajaj, A. & Khanna, A. Entailment and spectral clustering based single and multiple document summarization. Int. J. Intell. Syst. Appl. 11, 39–51 (2019).
- da Rocha, D. et al. Programme 13-Novembre, un an après. Rev. Neuropsychol. 8, 227–232 (2016).
- Piolat, A., Booth, R. J., Chung, C. K., Davids, M. & La Pennebaker, J. W. version française du dictionnaire pour le LIWC: modalités de construction et exemples d’utilisation. Psychol. Fr. 56, 145–159 (2011).
- Pranckevičius, T. & Marcinkevičius, V. Comparison of Naive Bayes, random forest, decision tree, support vector machines, and logistic regression classifiers for text reviews classification. Balt. J. Mod. Comput. 5, 221 (2017).
Cited by
The relationship between language features and PTSD symptoms: a systematic review and meta-analysis
Yu, Z., Gu, Z., Shen, Y., & Lu, J. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1476978 · Cited by 12
Quillivic, R., Auxéméry, Y., Gayraud, F., Dayan, J., & Mesmoudi, S. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf075 · Cited by 3
Self-citationLinguistic agentivity as a marker of traumatic discourse
Gayraud, F., & Auxéméry, Y. (2025) · European Journal of Trauma & Dissociation · doi:10.1016/j.ejtd.2025.100501 · Cited by 5
Self-citationEmotional Speech Markers of Psychiatric Disturbance in Huntington’s Disease
Chenain, L., Fabre, A., Titeux, H., Morgado, G., Youssov, K., Clavel, C., & Bachoud‐Lévi, A. (2025) · European Psychiatry · doi:10.1192/j.eurpsy.2026.12064 · Cited by 3
Stress Detection Using Natural Language Processing and Machine Learning Over Social Interaction
Rajput, G. K., Chakravarty, A., Saxena, A. K., Kumar, S., Kumar, L., & Goel, A. (2025) · doi:10.1109/cises66934.2025.11265359 · Cited by 2
Metadata
- Authors
- Quillivic, R., Gayraud, F., Auxéméry, Y., Vanni, L., Peschanski, D., Eustache, F., Dayan, J., & Mesmoudi, S.
- Affiliations
- École Pratique des Hautes Études (FR)
- Centre National de la Recherche Scientifique (FR)
- Inserm (FR)
- Corresponding author
- Quillivic, Robin
- ORCID
- Venue
- Scientific Reports
- Published
- 2024-05-30
- Volume
- 14
- Issue
- 1
- Pages
- 12468-12468
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC11139884
- OpenAlex
- W4399155231
- Semantic Scholar
- 0543b8c53c73c258b83fcb7887b58cf13600f77f
- Cited by
- 24
- References
- 63
- Citations by year
- 2026: 10 · 2025: 12 · 2024: 2
- FWCI
- 11.36
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- HAL (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Region île-de-France (CP2021-297)
- Centre National de la Recherche Scientifique
- French General Secretariat for Investment (ANR-10-EQPX-0021-01)
- Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › Psychology › Clinical Psychology › Posttraumatic Stress Disorder Research
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- post-traumatic stress disorder, linguistic markers, psycholinguistics, PTSD diagnosis, natural language processing, deep learning classification, interview transcription, 2015 Paris attacks, linguistic biomarkers
- MeSH terms
- Machine Learning, Deep Learning, Adult, Female, Humans, Language, Male, Middle Aged, Natural Language Processing, Stress Disorders, Post-Traumatic, Biomarkers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interdisciplinary approach to identify language markers for post-traumatic stress disorder using machine learning and deep learning. https://app.cochat.ai/papers/10.1038/s41598-024-61557-7
- The paper
- Quillivic, R., Gayraud, F., Auxéméry, Y., Vanni, L., Peschanski, D., Eustache, F., Dayan, J., & Mesmoudi, S. (2024). Interdisciplinary approach to identify language markers for post-traumatic stress disorder using machine learning and deep learning. Scientific Reports. https://doi.org/10.1038/s41598-024-61557-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.