The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Depression recognition based on dynamic facial and vocal expression features using partial least square regression
Abstract
Depression is a typical mood disorder, and the persons who are often in this state face the risk in mental and even physical problems. In recent years, there has therefore been increasing attention in machine based depression analysis. In such a low mood, both the facial expression and voice of human beings appear different from the ones in normal states. This paper presents a novel method, which comprehensively models visual and vocal modalities, and automatically predicts the scale of depression. On one hand, Motion History Histogram (MHH) extracts the dynamics from corresponding video and audio data to represent characteristics of subtle changes in facial and vocal expression of depression. On the other hand, for each modality, the Partial Least Square (PLS) regression algorithm is applied to learn the relationship between the dynamic features and depression scales using training data, and then predict the depression scale for an unseen one. Predicted values of visual and vocal clues are further combined at decision level for final decision. The proposed approach is evaluated on the AVEC2013 dataset and experimental results clearly highlight its effectiveness and better performance than baseline results provided by the AVEC2013 challenge organiser.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Face Description with Local Binary Patterns: Application to Face Recognition
Ahonen, T., Hadid, A., & Pietikäinen, M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.244 · Cited by 5,592
Computer Vision: A Modern Approach
Forsyth, D. A., & Ponce, J. (2002) · Cited by 3,728
The recognition of human movement using temporal templates
Bobick, A., & Davis, J. W. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.910878 · Cited by 2,837
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
Survey on speech emotion recognition: Features, classification schemes, and databases
Ayadi, M. M. H. E., Kamel, M. S., & Karray, F. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.09.020 · Cited by 2,139
SIMPLS: An alternative approach to partial least squares regression
de Jong, S. (1993) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(93)85002-x · Cited by 1,905
Scale for the Assessment of Negative Symptoms
Andreasen, N. C. (1982) · PsycTESTS Dataset · doi:10.1037/t12696-000 · Cited by 1,888
Research works printed but not linked: 6
- 10.5555/645312.648916 · DOI
- W. T. Freeman , W. T. Freeman , M. Roth , and M. Roth . Orientation histograms for hand gesture recognition . In IEEE International Workshop on Automatic Face and Gesture Recognition , pages 296 -- 301 , 1994 . W. T. Freeman, W. T. Freeman, M. Roth, and M. Roth. Orientation histograms for hand gesture recognition. In IEEE International Workshop on Automatic Face and Gesture Recognition, pages 296--301, 1994.
- Health & Consumer Protection Directorate General . Improving the mental health of the population: Towards a strategy on mental health for the european union , 2005 . Health & Consumer Protection Directorate General. Improving the mental health of the population: Towards a strategy on mental health for the european union, 2005.
- Health & Consumer Protection Directorate General . Mental health in the EU , 2008 . Health & Consumer Protection Directorate General. Mental health in the EU, 2008.
- S. Salmans . Depression: questions you have - answers you need . People's Medical Society , 1995 . S. Salmans. Depression: questions you have - answers you need. People's Medical Society, 1995.
- 10.5555/520809.796139 · DOI
Cited by
Sorted by citations
Valstar, M., Schuller, B. W., Smith, K., Almaev, T. R., Eyben, F., Krajewski, J., Cowie, R., & Pantić, M. (2014) · International Workshop on Audio/Visual Emotion Challenge (AVEC) · doi:10.1145/2661806.2661807 · Cited by 476
“127 for Valence and Arousal, respectively [20].”
Ma, X., Yang, H., Chen, Q., Huang, D., & Wang, Y. (2016) · International Workshop on Audio/Visual Emotion Challenge (AVEC) · doi:10.1145/2988257.2988267 · Cited by 310
Self-citationVisually Interpretable Representation Learning for Depression Recognition from Facial Images
Zhou, X., Jin, K., Shang, Y., & Guo, G. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2828819 · Cited by 278
“[8] adopted motion history histogram (MHH) [25] based feature to encode motion cue from videos, and the partial least squares (PLS) [30] was”
BackgroundMethodInfluentialAutomated Depression Diagnosis Based on Deep Networks to Encode Facial Appearance and Dynamics
Zhu, Y. M., Shang, Y., Shao, Z., & Guo, G. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2650899 · Cited by 258
“[7] utilized Motion History Histogram (MHH) [25] to characterize motion information of each pixel in the video.”
MethodDeep learning for depression recognition with audiovisual cues: A review
He, L., Niu, M., Tiwari, P., Marttinen, P., Su, R., Jiang, J., Guo, C., Wang, H., Ding, S., Wang, Z., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.10.012 · Cited by 273
“Regarding modality, speech and video samples [14, 94, 113, 17, 96, 97, 99, 100, 101, 104, 121, 122, 123, 149, 150, 16, 151, 152, 153], physiological signals [100, 154, 154, 155, 156, 157, 158, 159, 160], and text [100, 108] have been employed to improve the performance of depression assessment.”
MethodSelf-citation
Metadata
- Authors
- Meng, H., Huang, D., Wang, H., Yang, H., AI-Shuraifi, M., & Wang, Y.
- Affiliations
- Brunel University of London (GB)
- Beihang University (CN)
- Venue
- Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge
- Publisher
- ACM
- Published
- 2013-10-21
- Pages
- 21-30
- OpenAlex
- W1988088279
- Semantic Scholar
- e638499e3649fb69142208c33abf63093c96b00c
- Cited by
- 225
- References
- 47
- Citations by year
- 2026: 7 · 2025: 24 · 2024: 24 · 2023: 21 · 2022: 23 · 2021: 18 · 2020: 18 · 2019: 21 · 2018: 14 · 2017: 16 · 2016: 10 · 2015: 18 · 2014: 11
- FWCI
- 17.63
- Type
- conference paper
- Language
- en
- Open access
- closed
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- depression detection, facial expressions, vocal expression, multimodal fusion, partial least squares regression, depression severity prediction, decision fusion, affective computing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
