SEWA DB: A Rich Database for Audio-Visual Emotion and Sentiment Research in the Wild
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 85 of the 89 references it cites were found in a registry or an index.
Abstract
Natural human-computer interaction and audio-visual human behaviour sensing systems, which would achieve robust performance in-the-wild are more needed than ever as digital devices are increasingly becoming an indispensable part of our life. Accurately annotated real-world data are the crux in devising such systems. However, existing databases usually consider controlled settings, low demographic variability, and a single task. In this paper, we introduce the SEWA database of more than 2,000 minutes of audio-visual data of 398 people coming from six cultures, 50 percent female, and uniformly spanning the age range of 18 to 65 years old. Subjects were recorded in two different contexts: while watching adverts and while discussing adverts in a video chat. The database includes rich annotations of the recordings in terms of facial landmarks, facial action units (FAU), various vocalisations, mirroring, and continuously valued valence, arousal, liking, agreement, and prototypic examples of (dis)liking. This database aims to be an extremely valuable resource for researchers in affective computing and automatic human sensing and is expected to push forward the research in human behaviour analysis, including cultural studies. Along with the database, we provide extensive baseline experiments for automatic FAU detection and automatic valence, arousal, and (dis)liking intensity estimation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The SEWA dataset includes 2562 utterances, each annotated with continuous emotion metrics, i.e., valence and arousal.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The participants span a wide age range from 18 to 65 years, offering valuable insights into the variations in emotional expression and recognition across different age groups.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The dataset boasts a gender-balanced pool of participants, with 197 females contributing.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The SEWA dataset [33], a significant contribution to the field of MER, comprises a diverse array of audio–visual data gathered using web cameras and microphones.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [33]
The cited source says what the claim attributes to it.
In the citing paper
“It features over 2000 min of footage capturing the emotional responses of 398 individuals across six distinct cultures, thus providing a comprehensive perspective on multicultural emotional expression.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [33]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
IEMOCAP: Interactive emotional dyadic motion capture database
Busso, C., Bulut, M., Lee, C.-C., Kazemzadeh, A., Mower, E., Kim, S., Chang, J. N., Lee, S., & Narayanan, S. S. (2008) · Language Resources and Evaluation · doi:10.1007/s10579-008-9076-6 · Cited by 3,869
Ekman, P. (1993) · American Psychologist · doi:10.1037/0003-066x.48.4.384 · Cited by 3,441
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
One millisecond face alignment with an ensemble of regression trees
Kazemi, V., & Sullivan, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.241 · Cited by 2,831
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Romaine, S. (2000) · Language in Society · doi:10.1093/oso/9780198731924.003.0003 · Cited by 2,685
Survey on speech emotion recognition: Features, classification schemes, and databases
El Ayadi, M., Kamel, M. S., & Karray, F. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.09.020 · Cited by 2,073
The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing
Eyben, F., Scherer, K. R., Schuller, B. W., Sundberg, J., Andre, E., Busso, C., Devillers, L. Y., Epps, J., Laukka, P., Narayanan, S. S., et al. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2457417 · Cited by 1,818 · cited 5×
“GEMAPS contains a compact set of 18 LLDs, covering spectral, prosodic and voice quality information, cf. Table 7.”
BackgroundMethodInfluentialSelf-citationGross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
What is Meant by Calling Emotions Basic
Ekman, P., & Cordaro, D. (2011) · Emotion Review · doi:10.1177/1754073911410740 · Cited by 1,340
ELAN: a Professional Framework for Multimodality Research
Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., & Sloetjes, H. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5pwa5zpssv4z · Cited by 1,300
Recent developments in openSMILE, the munich open-source multimedia feature extractor
Eyben, F., Weninger, F., Gross, F., & Schuller, B. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502224 · Cited by 1,241
Self-citationEmotion recognition based on physiological changes in music listening
Kim, J., & Andre, E. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.26 · Cited by 1,082
The International Affective Picture System (IAPS) in the Study of Emotion and Attention
Bradley, M. M., & Lang, P. J. (2007) · Handbook of Emotion Elicitation and Assessment · doi:10.1093/oso/9780195169157.003.0003 · Cited by 915
Facial and vocal expressions of emotion
Russell, J. A., Bachorowski, J.-A., & Fernández-Dols, J.-M. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145102 · Cited by 873
DISFA: A Spontaneous Facial Action Intensity Database
Mavadati, S. M., Mahoor, M. H., Bartlett, K., Trinh, P., & Cohn, J. F. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2013.4 · Cited by 793
Toward an affect-sensitive multimodal human-computer interaction
Pantic, M., & Rothkrantz, L. J. M. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817122 · Cited by 791
Rinn, W. E. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.95.1.52 · Cited by 772
Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771
Self-citationSchuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.011 · Cited by 758
Self-citationSchuller, B., Steidl, S., Batliner, A., Vinciarelli, A., Scherer, K., Ringeval, F., Chetouani, M., Weninger, F., Eyben, F., Marchi, E., et al. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-56 · Cited by 731
Self-citationAutomatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition
Sariyanidi, E., Gunes, H., & Cavallaro, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366127 · Cited by 685
McKeown, G., Valstar, M., Cowie, R., Pantic, M., & Schroder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.20 · Cited by 665
(2007) · CRC Press eBooks · doi:10.1201/9781410615862 · Cited by 665
Collecting Large, Richly Annotated Facial-Expression Databases from Movies
Dhall, A., Goecke, R., Lucey, S., & Gedeon, T. (2012) · IEEE MultiMedia · doi:10.1109/mmul.2012.26 · Cited by 663
A Review and Meta-Analysis of Multimodal Affect Detection Systems
D'mello, S. K., & Kory, J. (2015) · ACM Computing Surveys · doi:10.1145/2682899 · Cited by 628
AVEC 2013: the continuous audio/visual emotion and depression recognition challenge
Valstar, M., Schuller, B., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., & Pantic, M. (2013) · Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge · doi:10.1145/2512530.2512533 · Cited by 581
Self-citationANVIL - a generic annotation tool for multimodal dialogue
Kipp, M. (2001) · 7th European Conference on Speech Communication and Technology (Eurospeech 2001) · doi:10.21437/eurospeech.2001-354 · Cited by 570
FEELTRACE: an instrument for recording perceived emotion in real time
Cowie, R., Douglas‐Cowie, E., Savvidou, S. M., & McMahon, E. R. (2000) · Research Portal (Queen's University Belfast) · Cited by 539
An empirical evaluation of supervised learning in high dimensions
Caruana, R., Karampatziakis, N., & Yessenalina, A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390169 · Cited by 524
AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge
Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R., & Pantic, M. (2016) · Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2988257.2988258 · Cited by 503
Self-citationAVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge
Valstar, M., Schuller, B., Smith, K., Almaev, T., Eyben, F., Krajewski, J., Cowie, R., & Pantic, M. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661807 · Cited by 472
Self-citationIncremental Face Alignment in the Wild
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.240 · Cited by 450
Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception.
Bänziger, T., Mortillaro, M., & Scherer, K. R. (2012) · Emotion · doi:10.1037/a0025827 · Cited by 439
Expert system for automatic analysis of facial expressions
Pantic, M., & Rothkrantz, L. J. M. (2000) · Image and Vision Computing · doi:10.1016/s0262-8856(00)00034-2 · Cited by 415 · cited 1×
“instance, this can be very helpful for building rule-based prediction systems [21], [22], or when the targeted population presents major difficulties in handling complex display”
BackgroundThe Vera am Mittag German audio-visual emotional speech database
Grimm, M., Kroschel, K., & Narayanan, S. (2008) · 2008 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2008.4607572 · Cited by 407
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360 · cited 3×
“, [19], [41]) and recent database papers (e.”
BackgroundMethodSelf-citationEMOTION IN HUMAN-COMPUTER INTERACTION
(2007) · The Human-Computer Interaction Handbook · doi:10.1201/9781410615862-13 · Cited by 344
Ambadar, Z., Cohn, J. F., & Reed, L. I. (2009) · Journal of Nonverbal Behavior · doi:10.1007/s10919-008-0059-5 · Cited by 319
The First Facial Landmark Tracking in-the-Wild Challenge: Benchmark and Results
Shen, J., Zafeiriou, S., Chrysos, G. G., Kossaifi, J., Tzimiropoulos, G., & Pantic, M. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.132 · Cited by 292
Self-citationFERA 2015 - second Facial Expression Recognition and Analysis challenge
Valstar, M. F., Almaev, T., Girard, J. M., McKeown, G., Mehu, M., Yin, L., Pantic, M., & Cohn, J. F. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7284874 · Cited by 252 · cited 3×
“In comparison to the baseline results with those in the FERA2015 [62] database, our results obtained here are lower on the overlapping AUs (10 and 17).”
MethodResultInfluentialAFEW-VA database for valence and arousal estimation in-the-wild
Kossaifi, J., Tzimiropoulos, G., Todorovic, S., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.02.001 · Cited by 236 · cited 4×
“ANNEMO [38], and the frame by frame Valence/Arousal Online Annotation Tool [39].”
BackgroundMethodInfluentialSelf-citationAVEC 2012: the continuous audio/visual emotion challenge
Schuller, B., Valster, M., Eyben, F., Cowie, R., & Pantic, M. (2012) · Proceedings of the 14th ACM international conference on Multimodal interaction · doi:10.1145/2388676.2388776 · Cited by 226
Self-citation(2015) · doi:10.1145/2808196.2811642 · Cited by 178
Self-citationIntroducing CURRENNT: the Munich open-source CUDA recurrent neural network toolkit
Weninger, F. J., Bergmann, J. M., & Schuller, B. W. (2015) · Spiral (Imperial College London) · Cited by 177
Self-citationThe INTERSPEECH 2014 computational paralinguistics challenge: cognitive & physical load
Schuller, B. W., Steidl, S., Batliner, A. M., Epps, J., Eyben, F., Ringeval, F., Marchi, E., & Zhang, Y. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-104 · Cited by 168
Self-citationLost Luggage: A Field Study of Emotion–Antecedent Appraisal
Scherer, K. R., & Ceschi, G. (1997) · Motivation and Emotion · doi:10.1023/a:1024498629430 · Cited by 165
Real-time Speech and Music Classification by Large Audio Feature Space Extraction
Eyben, F. (2015) · Springer theses · doi:10.1007/978-3-319-27299-3 · Cited by 164
The Belfast Induced Natural Emotion Database
Sneddon, I., McRorie, M., McKeown, G., & Hanratty, J. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.26 · Cited by 152
Petridis, S., Martínez, B., & Pantić, M. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.08.014 · Cited by 142
Golan, O., Sinai-Gavrilov, Y., & Baron‐Cohen, S. (2015) · Molecular Autism · doi:10.1186/s13229-015-0018-z · Cited by 124
Output-associative RVM regression for dimensional and continuous emotion prediction
Nicolaou, M. A., Güneş, H., & Pantić, M. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2011.12.005 · Cited by 119
Offline Deformable Face Tracking in Arbitrary Videos
Chrysos, G. G., Antonakos, E., Zafeiriou, S. P., & Snape, P. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.126 · Cited by 111
Dimensional affect recognition using Continuous Conditional Random Fields
Baltrusaitis, T., Banda, N., & Robinson, P. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553785 · Cited by 108
Generalized Canonical Time Warping
Zhou, F., & la Torre, F. D. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2414429 · Cited by 103
Schuller, B., Steidl, S., Batliner, A., Hantke, S., Hönig, F., Orozco-Arroyave, J. R., Nöth, E., Zhang, Y., & Weninger, F. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-179 · Cited by 101
Self-citationTranssituational Individual-Specific Biopsychological Classification of Emotions
Walter, S., Kim, J., Hrabal, D., Crawcour, S. C., Kessler, H., & Traue, H. C. (2013) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmca.2012.2216869 · Cited by 78
Robust Unsupervised Arousal Rating:A Rule-Based Framework withKnowledge-Inspired Vocal Features
Bone, D., Lee, C.-C., & Narayanan, S. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2326393 · Cited by 66
Walecki, R., Rudovic, O., Pavlovic, V., & Pantic, M. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163137 · Cited by 65 · cited 2×
“This score is widely used for AU-detection and classification of facial expressions of emotions [41], [60] because of its robustness to the imbalance in positive and negative samples, which is very common in the case of AUs.”
MethodSelf-citationThe SmartKom Multimodal Corpus at BAS
Schiel, F., Steininger, S., & Türk, U. (2002) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/33yzs36hh5o2 · Cited by 64
Cardiff Conversation Database (CCDb): A Database of Natural Dyadic Conversations
Aubrey, A. J., Marshall, D., Rosin, P. L., Vendeventer, J., Cunningham, D. W., & Wallraven, C. (2013) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2013.48 · Cited by 64
Zhang, Z., Ringeval, F., Han, J., Deng, J., Marchi, E., & Schuller, B. W. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-998 · Cited by 58
Self-citationThe MAHNOB Mimicry Database: A database of naturalistic human interactions
Bilakhia, S., Petridis, S., Nijholt, A., & Pantic, M. (2015) · Pattern Recognition Letters · doi:10.1016/j.patrec.2015.03.005 · Cited by 57
Strength modelling for real-worldautomatic continuous affect recognition from audiovisual signals
Han, J., Zhang, Z., Cummins, N., Ringeval, F., & Schuller, B. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2016.11.020 · Cited by 53
Self-citationDynamic Probabilistic CCA for Analysis of Affective Behavior and Fusion of Continuous Annotations
(2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.16 · Cited by 52
Emotion Estimation in Speech Using a 3D Emotion Space Concept
Grimm, M., & Kroschel, K. (2007) · Robust Speech Recognition and Understanding · doi:10.5772/4755 · Cited by 51
From Pixels to Response Maps: Discriminative Image Filtering for Face Alignment in the Wild
Asthana, A., Zafeiriou, S. P., Tzimiropoulos, G., Cheng, S., & Pantić, M. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2362142 · Cited by 46
Robust Correlated and Individual Component Analysis
Panagakis, Y., Nicolaou, M. A., Zafeiriou, S. P., & Pantić, M. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2497700 · Cited by 46
Self-citationWeninger, F. J., Geiger, J. T., Wöllmer, M., Schuller, B. W., & Rigoll, G. (2011) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 40
Self-citationThe INTERSPEECH 2014 Computational paralinguistics challenge: cognitive & physical load
Schuller, B., Steidl, S., Batliner, A., Epps, J., Eyben, F., Ringeval, F., Marchi, E., & Zhang, Y. (2019) · OPUS (Augsburg University) · Cited by 36
Self-citation3D model-based continuous emotion recognition
Chen, H., Li, J., Zhang, F., Li, Y., & Wang, H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298793 · Cited by 34
4D Cardiff Conversation Database (4D CCDb): A 4D database of natural,dyadic conversations
Marshall, A. D., Rosin, P. L., Vandeventer, J., & Aubrey, A. J. (2015) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 23
ikannotate – A Tool for Labelling, Transcription, and Annotation of Emotionally Coloured Speech
Böck, R., Siegert, I., Haase, M., Lange, J., & Wendemuth, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_6 · Cited by 18
A software framework for multimodal humancomputer interaction systems
Shen, J., & Pantić, M. (2009) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2009.5346338 · Cited by 18
Self-citationThe Conflict Escalation Resolution (CONFER) Database
Georgakis, C., Panagakis, Y., Zafeiriou, S. P., & Pantić, M. (2016) · Image and Vision Computing · doi:10.1016/j.imavis.2016.12.001 · Cited by 16
Self-citationFast and Exact Newton and Bidirectional Fitting of Active Appearance Models
Kossaifi, J., Tzimiropoulos, G., & Pantić, M. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2642828 · Cited by 13
Self-citationShen, J., & Pantić, M. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2271563 · Cited by 12
Self-citationFast Newton active appearance models
Kossaifi, J., Tzimiropoulos, G., & Pantić, M. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025284 · Cited by 10
Self-citationFast and exact bi-directional fitting of active appearance models
Kossaifi, J., Tzimiropoulos, G., & Pantić, M. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7350977 · Cited by 10
Self-citationWöllmer, M., Marchi, E., Squartini, S., & Schuller, B. W. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21090-7_58 · Cited by 8
Self-citationAVEC 2014 – The Three Dimensional Affect and Depression Challenge
Valstar, M., Schuller, B. W., Krajewski, J., Cohn, J. F., Cowie, R., & Pantić, M. (2014) · Cited by 8
Self-citation
Research works printed but not linked: 7
- scherer, 2010, Developing an expressive speech labelling tool incorporating the temporal characteristics of emotion, Proc Int Conf Lang Resour Eval, 1172
- meudt, 2012, ATLAS–An annotation tool for HCI data utilizing machine learning methods, Proc 1st Int Conf Affect Pleasurable Design, 5347
- marchi, 2015, Autism and speech, language, and emotion — A survey, Evaluating the Role of Speech Technology in Medical Case Management
- 10.1109/t-affc.2013.4 · DOI · Paper page
- 10.1109/fg.2013.6553805 · DOI · Paper page
- 10.1037/0033-2909.95.1.52 · doi:10.1037/0033-2909.95.1.52 · Paper page
- 10.1145/2661806.2661807 · DOI · Paper page
Cited by
Ringeval, F., Schuller, B., Valstar, M., Cummins, N., Cowie, R., Tavabi, L., Schmitt, M., Alisamir, S., Amiriparian, S., Messner, E.-M., et al. (2019) · Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3347320.3357688 · Cited by 409
Self-citationDawn of the Transformer Era in Speech Emotion Recognition: Closing the Valence Gap
Wagner, J., Triantafyllopoulos, A., Wierstorf, H., Schmitt, M., Burkhardt, F., Eyben, F., & Schuller, B. W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263585 · Cited by 395
Self-citationMEAD: A Large-Scale Audio-Visual Dataset for Emotional Talking-Face Generation
Wang, K., Wu, Q., Song, L., Yang, Z., Wu, W., Qian, C., He, R., Qiao, Y., & Loy, C. C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_42 · Cited by 328
EMOCA: Emotion Driven Monocular Face Capture and Animation
Danecek, R., Black, M., & Bolkart, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01967 · Cited by 238
Estimation of continuous valence and arousal levels from faces in naturalistic conditions
Toisoul, A., Kossaifi, J., Bulat, A., Tzimiropoulos, G., & Pantic, M. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-020-00280-0 · Cited by 232
Self-citation
Metadata
- Authors
- Kossaifi, J., Walecki, R., Panagakis, Y., Shen, J., Schmitt, M., Ringeval, F., Han, J., Pandit, V., Toisoul, A., Schuller, B., Star, K., Hajiyev, E., & Pantic, M.
- Affiliations
- Imperial College London (GB)
- University of Augsburg (DE)
- Université Grenoble Alpes (FR)
- PlayGen (United Kingdom) (GB)
- ORCID
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-03-01
- Volume
- 43
- Issue
- 3
- Pages
- 1022-1040
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2910165986
- Cited by
- 243
- References
- 89
- Citations by year
- 2026: 15 · 2025: 36 · 2024: 43 · 2023: 44 · 2022: 28 · 2021: 40
- FWCI
- 30.82
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- OPUS (Augsburg University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Community Horizon 2020 (H2020/2014- 2020)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- sentiment analysis, affective computing, facial action units, facial landmarks, valence-arousal estimation, cultural diversity, video chat
- MeSH terms
- Adolescent, Adult, Aged, Algorithms, Attitude, Emotions, Face, Female, Humans, Middle Aged, Databases, Factual, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.