CoChat

Deep learning-based classification of posttraumatic stress disorder and depression following trauma utilizing visual and auditory markers of arousal and mood

Schultebraucks, Katharina, Yadav, Vijay, Shalev, Arieh Y., Bonanno, George A., Galatzer-Levy, Isaac R. · 2022 · Psychological Medicine

The DOI matches its Crossref record, with a small difference in title or year; 115 of the 117 references it cites were found in a registry or an index.

Abstract

Background Visual and auditory signs of patient functioning have long been used for clinical diagnosis, treatment selection, and prognosis. Direct measurement and quantification of these signals can aim to improve the consistency, sensitivity, and scalability of clinical assessment. Currently, we investigate if machine learning-based computer vision (CV), semantic, and acoustic analysis can capture clinical features from free speech responses to a brief interview 1 month post-trauma that accurately classify major depressive disorder (MDD) and posttraumatic stress disorder (PTSD). Methods N = 81 patients admitted to an emergency department (ED) of a Level-1 Trauma Unit following a life-threatening traumatic event participated in an open-ended qualitative interview with a para-professional about their experience 1 month following admission. A deep neural network was utilized to extract facial features of emotion and their intensity, movement parameters, speech prosody, and natural language content. These features were utilized as inputs to classify PTSD and MDD cross-sectionally. Results Both video- and audio-based markers contributed to good discriminatory classification accuracy. The algorithm discriminates PTSD status at 1 month after ED admission with an AUC of 0.90 (weighted average precision = 0.83, recall = 0.84, and f1-score = 0.83) as well as depression status at 1 month after ED admission with an AUC of 0.86 (weighted average precision = 0.83, recall = 0.82, and f1-sc…

Overview

Integrity signals

Registry

Crossref · 10.1017/s0033291720002718

Cites

115 of 115 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 115 references

Research works printed but not linked: 6

  1. 10.1037/0021-843x.109.1.26 · doi:10.1037/0021-843x.109.1.26 · Paper page
  2. 2013, Diagnostic and statistical manual of mental disorders (DSM-5®)
  3. Eaton, 2004, The use of psychological testing for treatment planning and outcomes assessment: Instruments for adults, 363
  4. Pennebaker, 2015, The development and psychometric properties of LIWC2015
  5. Ekman, 1978, Facial action coding system: Investigator's guide
  6. Carmi, 2020, Management of terrorism induced stress – guideline for the golden hours, 175

Cited by

See all 119

Metadata

Authors
Schultebraucks, K., Yadav, V., Shalev, A. Y., Bonanno, G. A., & Galatzer-Levy, I. R.
Affiliations
  • Columbia University Irving Medical Center (US)
  • AiCure (United States) (US)
  • New York University (US)
  • Columbia University (US)
Corresponding author
Schultebraucks, Katharina
Venue
Psychological Medicine
Published
2020-08-03
Volume
52
Issue
5
Pages
957-967
ISSN
  • 0033-2917 (ISSN-L)
  • 1469-8978
OpenAlex
W3047024470
Cited by
108
References
117
Citations by year
2026: 10 · 2025: 31 · 2024: 24 · 2023: 20 · 2022: 12 · 2021: 8 · 2020: 3
FWCI
10.40
Type
journal article
Language
en
Open access
closed
Locations
  • Psychological Medicine (publishedVersion)
  • PubMed (publishedVersion)
Funders
National Institute of Mental Health (K01MH102415)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Social Sciences › Psychology › Clinical Psychology › Posttraumatic Stress Disorder Research
  • Social Sciences › Psychology › Social Psychology › Mental Health via Writing
Keywords
post-traumatic stress disorder, major depressive disorder, trauma (physical injury), facial emotion recognition, prosody, acoustic analysis, computer vision, natural language processing, digital biomarkers, emergency department patients
MeSH terms
Deep Learning, Arousal, Depression, Depressive Disorder, Major, Major Depressive Disorder, Humans, Stress Disorders, Post-Traumatic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Deep learning-based classification of posttraumatic stress disorder and depression following trauma utilizing visual and auditory markers of arousal and mood. https://app.cochat.ai/papers/10.1017/s0033291720002718
The paper
Schultebraucks, K., Yadav, V., Shalev, A. Y., Bonanno, G. A., & Galatzer-Levy, I. R. (2022). Deep learning-based classification of posttraumatic stress disorder and depression following trauma utilizing visual and auditory markers of arousal and mood. Psychological Medicine. https://doi.org/10.1017/s0033291720002718

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.