AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
The Audio/Visual Emotion Challenge and Workshop (AVEC 2016) "Depression, Mood and Emotion" will be the sixth competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and physiological depression and emotion analysis, with all participants competing under strictly the same conditions. The goal of the Challenge is to provide a common benchmark test set for multi-modal information processing and to bring together the depression and emotion recognition communities, as well as the audio, video and physiological processing communities, to compare the relative merits of the various approaches to depression and emotion recognition under well-defined and strictly comparable conditions and establish to what extent fusion of the approaches is possible and beneficial. This paper presents the challenge guidelines, the common data used, and the performance of the baseline system on the two tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 2×
“To assess inter-rater reliability, we computed the intra-class correlation coefficient (ICC(3,1)) [47], and the Cronbach’s α [7]; ratings are concatenated over all subjects.”
MethodIntraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“In order to keep the complexity low, and estimate the contribution of each modality in the fusion process, we build the fusion model by a simple linear regression of the predictions obtained on the development partition, using Weka 3.7 with default parameters [19].”
MethodInfluentialA concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785 · cited 1×
“Even though all subjects speak French fluently, they have different nationalities (i. e., French, Italian or German), which thus provide some diversity in the expression of emotion.”
BackgroundEkman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
The PHQ-8 as a measure of current depression in the general population
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B. W., Berry, J. T., & Mokdad, A. H. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.026 · Cited by 5,121
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
(2001) · doi:10.1017/cbo9780511546396 · Cited by 4,482
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing
Eyben, F., Scherer, K. R., Schuller, B. W., Sundberg, J., Andre, E., Busso, C., Devillers, L. Y., Epps, J., Laukka, P., Narayanan, S. S., et al. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2457417 · Cited by 1,818 · cited 1×
“Some recommendations for the definition of a minimalistic acoustic standard parameter set have been recently investigated, and have led to the Geneva Minimalistic Acoustic Parameter Set (GeMAPS), and to an extended version (eGeMAPS) [10], which is used here as baseline.”
MethodSelf-citationOpenFace: An open source facial behavior analysis toolkit
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477553 · Cited by 1,747
Dawson, M. E., Schell, A. M., Filion, D. L., & Berntson, G. G. (2009) · Handbook of Psychophysiology · doi:10.1017/cbo9780511546396.007 · Cited by 1,720
Recent developments in openSMILE, the munich open-source multimedia feature extractor
Eyben, F., Weninger, F., Gross, F., & Schuller, B. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502224 · Cited by 1,241
Self-citationAdieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network
Trigeorgis, G., Ringeval, F., Brueckner, R., Marchi, E., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472669 · Cited by 904
Self-citationIntroducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771
Self-citationSchuller, B., Steidl, S., Batliner, A., Vinciarelli, A., Scherer, K., Ringeval, F., Chetouani, M., Weninger, F., Eyben, F., Marchi, E., et al. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-56 · Cited by 731
Self-citationCOVAREP — A collaborative voice analysis repository for speech technologies
Degottex, G., Kane, J., Drugman, T., Raitio, T., & Scherer, S. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853739 · Cited by 695
Self-citation(2010) · doi:10.1002/9780470561119 · Cited by 649
The distress analysis interview corpus of human and computer interviews
Gratch, J., Artstein, R., Lucas, G., Stratou, G., Scherer, S., Nazarian, A., Wood, R., Boberg, J., DeVault, D., Marsella, S., et al. (2014) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/3o7bccg9xequ · Cited by 599 · cited 1×
“The Distress Analysis Interview Corpus - Wizard of Oz (DAIC-WOZ) database is part of a larger corpus, the Distress Analysis Interview Corpus (DAIC) [17], that contains clinical interviews designed to support the diagnosis of psychological distress conditions such as anxiety, depression, and…”
MethodSelf-citationAVEC 2013: the continuous audio/visual emotion and depression recognition challenge
Valstar, M., Schuller, B., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., & Pantic, M. (2013) · Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge · doi:10.1145/2512530.2512533 · Cited by 581
Self-citation(2017) · The SAGE Encyclopedia of Communication Research Methods · doi:10.4135/9781483381411.n178 · Cited by 559
(2014) · doi:10.5555/2615731.2617415 · Cited by 553
The computer expression recognition toolbox (CERT)
Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., & Bartlett, M. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771414 · Cited by 539
AVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge
Valstar, M., Schuller, B., Smith, K., Almaev, T., Eyben, F., Krajewski, J., Cowie, R., & Pantic, M. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661807 · Cited by 472
Self-citationThe first facial expression recognition and analysis challenge
Valstar, M. F., Jiang, B., Mehu, M., Pantic, M., & Scherer, K. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771374 · Cited by 385
Self-citationLIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
An Algorithm for the Principal Component Analysis of Large Data Sets
Halko, N., Martinsson, P.-G., Shkolnisky, Y., & Tygert, M. (2011) · SIAM Journal on Scientific Computing · doi:10.1137/100804139 · Cited by 291
FERA 2015 - second Facial Expression Recognition and Analysis challenge
Valstar, M. F., Almaev, T., Girard, J. M., McKeown, G., Mehu, M., Yin, L., Pantic, M., & Cohn, J. F. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7284874 · Cited by 252
Self-citationPrediction of asynchronous dimensional emotion ratings from audiovisual and physiological data
Ringeval, F., Eyben, F., Kroupi, E., Yuce, A., Thiran, J.-P., Ebrahimi, T., Lalanne, D., & Schuller, B. (2015) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.11.007 · Cited by 202 · cited 4×
“A normalisation technique based on the Evaluator Weighted Estimator [30], is used prior to the computation of the gold-standard, i. e., the average of all ratings for each subject [36].”
BackgroundMethodInfluentialSelf-citationLocal Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition
Almaev, T. R., & Valstar, M. F. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.65 · Cited by 201
Self-citationEvaluation of natural emotions using self assessment manikins
Grimm, M., & Kroschel, K. (2005) · IEEE Workshop on Automatic Speech Recognition and Understanding, 2005. · doi:10.1109/asru.2005.1566530 · Cited by 179
(2015) · doi:10.1145/2808196.2811642 · Cited by 178
Self-citationAIWAC: affective interaction through wearable computing and cloud technology
Chen, M., Zhang, Y., Li, Y., Hassan, M., & Alamri, A. (2015) · IEEE Wireless Communications · doi:10.1109/mwc.2015.7054715 · Cited by 168
He, L., Jiang, D., Yang, L., Pei, E., Wu, P., & Sahli, H. (2015) · Proceedings of the 5th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2808196.2811641 · Cited by 147
Automatic audiovisual behavior descriptors for psychological disorder analysis
Scherer, S. J., Stratou, G., Lucas, G., Mahmoud, M., Boberg, J., Gratch, J. S., Rizzo, A., & Morency, L. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.06.001 · Cited by 142
Self-citationQuantitative analysis of wrist electrodermal activity during sleep
Sano, A., Picard, R. W., & Stickgold, R. (2014) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2014.09.011 · Cited by 141
Scherer, S., Lucas, G. M., Gratch, J., Skip Rizzo, A., & Morency, L.-P. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2440264 · Cited by 127
Self-citationThe INTERSPEECH 2014 computational paralinguistics challenge: cognitive & physical load
Schuller, B. W., Steidl, S., Batliner, A. M., Epps, J., Eyben, F., Ringeval, F., Marchi, E., & Zhang, Y. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-104 · Cited by 122
Self-citationPhysiological Signals and Their Use in Augmenting Emotion Recognition for Human–Machine Interaction
Knapp, R. B., Kim, J., & André, E. (2010) · Cognitive technologies · doi:10.1007/978-3-642-15184-2_9 · Cited by 68
Robust Unsupervised Arousal Rating:A Rule-Based Framework withKnowledge-Inspired Vocal Features
Bone, D., Lee, C.-C., & Narayanan, S. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2326393 · Cited by 66
Cognition and Peripheralist—Centralist Controversies in Motivation and Emotion
SCHACHTER, S. (1975) · Handbook of Psychobiology · doi:10.1016/b978-0-12-278656-3.50022-3 · Cited by 55
Automatic Behaviour Understanding in Medicine
Valstar, M. (2014) · doi:10.1145/2666253.2666260 · Cited by 37
Self-citationRingeval, F., Amiriparian, S., Eyben, F., Scherer, K. R., & Schuller, B. W. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2666271 · Cited by 32
Self-citationOn the Influence of Emotional Feedback on Emotion Awareness and Gaze Behavior
Ringeval, F., Sonderegger, A., Noris, B., Billard, A., Sauer, J., & Lalanne, D. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.80 · Cited by 14
Self-citationAffective media and wearables: surprising findings
Picard, R. W. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2647959 · Cited by 9
Cited by
AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
Mollahosseini, A., Hasani, B., & Mahoor, M. H. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2740923 · Cited by 2,338
Facial Expression Analysis under Partial Occlusion: A Survey
Zhang, L., Verma, B., Tjondronegoro, D., & Chandran, V. (2019) · ACM Computing Surveys · doi:10.1145/3158369 · Cited by 1,258
End-to-End Multimodal Emotion Recognition using Deep Neural Networks
Tzirakis, P., Trigeorgis, G., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2017) · arXiv · doi:10.48550/arxiv.1704.08619 · Cited by 752
Self-citationSpeech Emotion Recognition Using Deep Learning Techniques: A Review
Khalil, R. A., Jones, E., Babar, M. I., Jan, T., Zafar, M. H., & Alhussain, T. (2019) · IEEE Access · doi:10.1109/access.2019.2936124 · Cited by 702
Ringeval, F., Schuller, B., Valstar, M., Cummins, N., Cowie, R., Tavabi, L., Schmitt, M., Alisamir, S., Amiriparian, S., Messner, E.-M., et al. (2019) · Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3347320.3357688 · Cited by 409
Self-citation
Metadata
- Authors
- Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R., & Pantic, M.
- Venue
- Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge
- Publisher
- ACM
- Published
- 2016-10-16
- Pages
- 3-10
- OpenAlex
- W2346454595
- Cited by
- 503
- References
- 45
- FWCI
- 65.03
- Type
- conference paper
- Language
- fr
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.