The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Dynamic Multimodal Measurement of Depression Severity Using Deep Autoencoding
Open accessAbstract
Depression is one of the most common psychiatric disorders worldwide, with over 350 million people affected. Current methods to screen for and assess depression depend almost entirely on clinical interviews and self-report scales. While useful, such measures lack objective, systematic, and efficient ways of incorporating behavioral observations that are strong indicators of depression presence and severity. Using dynamics of facial and head movement and vocalization, we trained classifiers to detect three levels of depression severity. Participants were a community sample diagnosed with major depressive disorder. They were recorded in clinical interviews (Hamilton Rating Scale for Depression, HRSD) at seven-week intervals over a period of 21 weeks. At each interview, they were scored by the HRSD as moderately to severely depressed, mildly depressed, or remitted. Logistic regression classifiers using leave-one-participant-out validation were compared for facial movement, head movement, and vocal prosody individually and in combination. Accuracy of depression severity measurement from facial movement dynamics was higher than that for head movement dynamics, and each was substantially higher than that for vocal prosody. Accuracy using all three modalities combined only marginally exceeded that of face and head combined. These findings suggest that automatic detection of depression severity from behavioral indicators in patients is feasible and that multimodal measures afford the most powerful detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Projections of Global Mortality and Burden of Disease from 2002 to 2030
Mathers, C. D., & Loncar, D. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030442 · Cited by 11,386 · cited 1×
“D EPRESSION is one of the most common psychological disorders and a leading cause of disease burden [1].”
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736 · cited 1×
“dinal agreement above what would be expected to occur by chance [70].”
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Kotov, R., Gamez, W., Schmidt, F., & Watson, D. (2010) · Psychological Bulletin · doi:10.1037/a0020327 · Cited by 2,677 · cited 1×
“from those without depression in personality factors or in other non-specific ways [40].”
Opensmile: the munich versatile and fast open-source audio feature extractor
Eyben, F., Wöllmer, M., & Schuller, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874246 · Cited by 2,642 · cited 1×
“For each recording, the database includes self-reported BDI, spatiotemporal Local Gabor Binary Patterns (LGBPTOP) video features, and a large set of voice features (a set of low level voice descriptors and functionals extracted using the freely open-source openEAR [23] and openSMILE [24]).”
MethodImproving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588 · cited 2×
“The resulting feature vectors were then normalized by power normalization [54] and l2-norm.”
Antidepressant Drug Effects and Depression Severity: A Patient-Level Meta-analysis
Fournier, J. C., DeRubeis, R. J., Hollon, S. D., Dimidjian, S., Amsterdam, J. D., Shelton, R. C., & Fawcett, J. (2010) · JAMA · doi:10.1001/jama.2009.1943 · Cited by 2,009
Nesse, R. M. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.1.14 · Cited by 891
Psychomotor symptoms of depression
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.1.4 · Cited by 662 · cited 2×
“Psychomotor symptoms such as gross motor activity, facial expressiveness, body movements, and speech timing differ between depressed and normal comparison groups [3], [4], [5].”
Treatment and prevention of depression
Hollon, S. D., Thase, M. E., & Markowitz, J. C. (2002) · Psychological Science in the Public Interest · doi:10.1111/1529-1006.00008 · Cited by 511
Acoustical properties of speech as indicators of depression and suicidal risk
France, D. J., Shiavi, R. G., Silverman, S., Silverman, M., & Wilkes, M. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.846676 · Cited by 504
Allen, N. B., & Badcock, P. B. T. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.6.887 · Cited by 494 · cited 1×
“Evolutionary perspectives on depression [75] similarly propose that depression in this way serves to decrease involvement with other persons.”
Detecting depression from facial actions and vocal prosody
Cohn, J. F., Kruez, T. S., Matthews, I., Yang, Y., Nguyen, M. H., Padilla, M. T., Zhou, F., & De la Torre, F. (2009) · 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops · doi:10.1109/acii.2009.5349358 · Cited by 494
Self-citationOpenEAR — Introducing the munich open-source emotion and affect recognition toolkit
Eyben, F., Wollmer, M., & Schuller, B. (2009) · 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops · doi:10.1109/acii.2009.5349350 · Cited by 418 · cited 1×
“For each recording, the database includes self-reported BDI, spatiotemporal Local Gabor Binary Patterns (LGBP-TOP) video features, and a large set of voice features (a set of low level voice descriptors and functionals extracted using the freely opensource openEAR [23] and openSMILE [24]).”
Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses
Girard, J. M., Cohn, J. F., Mahoor, M. H., Mavadati, S. M., Hammal, Z., & Rosenwald, D. P. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2013.12.007 · Cited by 255 · cited 2×
“In related work, we found that depression severity is associated with reduced head and lower body movement [18], [72]”
Self-citationMeng, H., Huang, D., Wang, H., Yang, H., AI-Shuraifi, M., & Wang, Y. (2013) · Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge · doi:10.1145/2512530.2512532 · Cited by 225 · cited 1×
“Using AVEC and a few non-publicly available resources [25], audiovisual detection of depression has been proposed [26]– [33].”
Vocal and Facial Biomarkers of Depression based on Motor Incoordination and Timing
Williamson, J. R., Quatieri, T. F., Helfer, B. S., Ciccarelli, G., & Mehta, D. D. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661809 · Cited by 209
Model Fusion for Multimodal Depression Classification and Level Detection
Senoussaoui, M., Sarria-Paja, M., Santos, J. F., & Falk, T. H. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661819 · Cited by 80
Depression Estimation Using Audiovisual Features and Fisher Vector Encoding
Jain, V., Crowley, J. L., Dey, A. K., & Lux, A. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661817 · Cited by 78 · cited 1×
“In related work, Jain and colleagues [29], combined visual LBP-TOP features with Dense Trajectories and low level audio descriptors provided in [21].”
Cited by
Deep learning for depression recognition with audiovisual cues: A review
He, L., Niu, M., Tiwari, P., Marttinen, P., Su, R., Jiang, J., Guo, C., Wang, H., Ding, S., Wang, Z., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.10.012 · Cited by 253
A Scoping Review of Machine Learning in Psychotherapy Research
Aafjes-van Doorn, K., Kamsteeg, C., Bate, J., & Aafjes, M. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1808729 · Cited by 179
Objective assessment of depressive symptoms with machine learning and wearable sensors data
Ghandeharioun, A., Fedor, S., Sangermano, L., Ionescu, D., Alpert, J., Dale, C., Sontag, D., & Picard, R. (2017) · 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii.2017.8273620 · Cited by 116
Schultebraucks, K., Yadav, V., Shalev, A. Y., Bonanno, G. A., & Galatzer-Levy, I. R. (2022) · Psychological Medicine · doi:10.1017/s0033291720002718 · Cited by 108
Acoustic differences between healthy and depressed people: a cross-situation study
Wang, J., Zhang, L., Liu, T., Pan, W., Hu, B., & Zhu, T. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2300-7 · Cited by 98
Metadata
- Authors
- Dibeklioglu, H., Hammal, Z., & Cohn, J. F.
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2018-03
- Volume
- 22
- Issue
- 2
- Pages
- 525-536
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W2593853439
- Cited by
- 192
- References
- 20
- FWCI
- 19.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.