Deep Affect Prediction in-the-Wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond
Open accessThe DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Automatic understanding of human affect using visual signals is of great importance in everyday human–machine interactions. Appraising human emotional states, behaviors and reactions displayed in real-world settings, can be accomplished using latent continuous dimensions (e.g., the circumplex model of affect). Valence (i.e., how positive or negative is an emotion) and arousal (i.e., power of the activation of the emotion) constitute popular and effective representations for affect. Nevertheless, the majority of collected datasets this far, although containing naturalistic emotional states, have been captured in highly controlled recording conditions. In this paper, we introduce the Aff-Wild benchmark for training and evaluating affect recognition algorithms. We also report on the results of the First Affect-in-the-wild Challenge (Aff-Wild Challenge) that was recently organized in conjunction with CVPR 2017 on the Aff-Wild database, and was the first ever challenge on the estimation of valence and arousal in-the-wild. Furthermore, we design and extensively train an end-to-end deep neural architecture which performs prediction of continuous emotion dimensions based on visual cues. The proposed deep learning architecture, AffWildNet, includes convolutional and recurrent neural network layers, exploiting the invariant properties of convolutional features, while also modeling temporal dynamics that arise in human behavior via the recurrent layers. The AffWildNet produced state-of-the-art results on the Aff-Wild Challenge. We then exploit the AffWild database for learning features, which can be used as priors for achieving best performances both for dimensional, as well as categorical emotion recognition, using the RECOLA, AFEW-VA and EmotiW 2017 datasets, compared to all other methods designed for the same goal. The database and emotion recognition models are available at http://ibug.doc.ic.ac.uk/resources/first-affect-wild-challenge .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · cited 7×
“Table 6 shows the respective number of units for the GRU and the fully connected layers.”
MethodInfluentialA concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785 · cited 19×
“Table 9 summarizes the CCC and MSE values obtained when applying all developed architectures described in subsections 4.2.2 and 4.2.3, to the Aff-Wild test set.”
BackgroundInfluentialParkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636 · cited 1×
“In the DRC-Net method [36], three neural network-based methods which are based on Inception-ResNet [53] modules redesigned specifically for the task of facial affect estimation are presented and compared.”
MethodLucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303 · cited 2×
“1 For the past twenty years research in automatic analysis of facial behavior was mainly limited to posed behavior which was captured in highly controlled recording conditions [34,40,54,56].”
BackgroundMethodReturn of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Canonical Correlation Analysis: An Overview with Application to Learning Methods
Hardoon, D. R., Szedmak, S., & Shawe-Taylor, J. (2004) · Neural Computation · doi:10.1162/0899766042321814 · Cited by 3,202
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Emotion: A Psychoevolutionary Synthesis
Camras, L., & Plutchik, R. (1980) · The American Journal of Psychology · doi:10.2307/1422394 · Cited by 2,487
Recognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745 · cited 2×
“1 For the past twenty years research in automatic analysis of facial behavior was mainly limited to posed behavior which was captured in highly controlled recording conditions [34,40,54,56].”
BackgroundMethodHandbook of Cognition and Emotion
(1999) · Wiley eBooks · doi:10.1002/0470013494 · Cited by 1,670
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664 · cited 1×
“Examples are the SAL [21], SEMAINE [38], MAHNOB-HCI [52], Belfast naturalistic 2 , Belfast induced [51], DEAP [29], RECOLA [45], SEWA 3 and AFEW-VA [30] databases.”
BackgroundGross, R., Matthews, I., Cohn, J., Kanade, T., & Baker, S. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.08.002 · Cited by 1,621
A 3D Facial Expression Database For Facial Behavior Research
Yin, L., Wei, X., Sun, Y., Wang, J., & Rosato, M. J. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.6 · Cited by 1,171 · cited 1×
“D Emotion Wheel still used in many recent works [27], are the Cohn-Kanade database [34,54], MMI database [40,56], Multi-PIE database [22] and the BU-3D and BU-4D databases [61,62].”
MethodWeb-Based Database for Facial Expression Analysis
Pantic, M., Valstar, M., Rademaker, R., & Maat, L. (2005) · 2005 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2005.1521424 · Cited by 1,039
Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network
Trigeorgis, G., Ringeval, F., Brueckner, R., Marchi, E., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472669 · Cited by 904 · cited 1×
“Our loss function was based on the Concordance Correlation Coefficient (CCC) metric that has been shown to provide better insight on whether the prediction follows the structure of the ground truth annotation [54] [53].”
MethodSelf-citationJoint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition
Jung, H., Lee, S., Yim, J., Park, S., & Kim, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.341 · Cited by 781 · cited 1×
“still used in many recent works [27], are the Cohn-Kanade database [34,54], MMI database [40,56], Multi-PIE database [22] and the BU-3D and BU-4D databases [61, 62].”
MethodIntroducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771 · cited 3×
“Examples are the SAL [21], SEMAINE [38], MAHNOB-HCI [52], Belfast naturalistic 2 , Belfast induced [51], DEAP [29], RECOLA [45], SEWA 3 and AFEW-VA [30] databases.”
BackgroundMethodEnd-to-End Multimodal Emotion Recognition using Deep Neural Networks
Tzirakis, P., Trigeorgis, G., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2017) · arXiv · doi:10.48550/arxiv.1704.08619 · Cited by 752 · cited 1×
“Our loss function was based on the Concordance Correlation Coefficient (CCC) metric that has been shown to provide better insight on whether the prediction follows the structure of the ground truth annotation [54] [53].”
MethodSelf-citationAutomatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition
Sariyanidi, E., Gunes, H., & Cavallaro, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366127 · Cited by 685
McKeown, G., Valstar, M., Cowie, R., Pantic, M., & Schroder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.20 · Cited by 665
Collecting Large, Richly Annotated Facial-Expression Databases from Movies
Dhall, A., Goecke, R., Lucey, S., & Gedeon, T. (2012) · IEEE MultiMedia · doi:10.1109/mmul.2012.26 · Cited by 663
Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning
Ng, H.-W., Nguyen, V. D., Vonikakis, V., & Winkler, S. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830593 · Cited by 657 · cited 1×
“For the second approach we used transfer learning [38], especially of the convolutional and pooling part of the pre-trained networks.”
MethodDescribing the emotional states that are expressed in speech
Cowie, R., & Cornelius, R. R. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00071-7 · Cited by 604
Painful data: The UNBC-McMaster shoulder pain expression archive database
Lucey, P., Cohn, J. F., Prkachin, K. M., Solomon, P. E., & Matthews, I. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771462 · Cited by 599
AVEC 2013: the continuous audio/visual emotion and depression recognition challenge
Valstar, M., Schuller, B., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., & Pantic, M. (2013) · Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge · doi:10.1145/2512530.2512533 · Cited by 581
Self-citationFEELTRACE: an instrument for recording perceived emotion in real time
Cowie, R., Douglas‐Cowie, E., Savvidou, S. M., & McMahon, E. R. (2000) · Research Portal (Queen's University Belfast) · Cited by 539
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527 · cited 1×
“Nevertheless, it is now accepted by the community that the facial expressions of naturalistic behaviors can be radically different from the posed ones [10, 47, 65].”
BackgroundA Note On "A Concordance Correlation Coefficient to Evaluate Reproducibility"
Nickerson, C. A. E. (1997) · Biometrics · doi:10.2307/2533516 · Cited by 510
AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge
Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R., & Pantic, M. (2016) · Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2988257.2988258 · Cited by 503
Self-citationEvidence of convergent validity on the dimensions of affect
Russell, J. A. (1978) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.36.10.1152 · Cited by 495
IEEE Transactions on Affective Computing
(2023) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.5165369 · Cited by 492
Face Detection without Bells and Whistles
Mathias, M., Benenson, R., Pedersoli, M., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_47 · Cited by 491
A high-resolution 3D dynamic facial expression database
Yin, L., Chen, X., Sun, Y., Worm, T., & Reale, M. (2008) · 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition · doi:10.1109/afgr.2008.4813324 · Cited by 488
AVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge
Valstar, M., Schuller, B., Smith, K., Almaev, T., Eyben, F., Krajewski, J., Cowie, R., & Pantic, M. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661807 · Cited by 472
Self-citationAVEC 2017: Real-life Depression, and Affect Recognition Workshop and Challenge
Ringeval, F., Schuller, B., Valstar, M., Gratch, J., Cowie, R., Scherer, S., Mozgai, S., Cummins, N., Schmitt, M., & Pantic, M. (2017) · Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge · doi:10.1145/3133944.3133953 · Cited by 332
Self-citationVideo and Image based Emotion Recognition Challenges in the Wild: EmotiW 2015
Dhall, A., Ramana Murthy, O. V., Goecke, R., Joshi, J., & Gedeon, T. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2829994 · Cited by 305
Aff-Wild: Valence and Arousal ‘In-the-Wild’ Challenge
Zafeiriou, S., Kollias, D., Nicolaou, M. A., Papaioannou, A., Zhao, G., & Kotsia, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.248 · Cited by 297
Self-citationFully Automatic Facial Action Recognition in Spontaneous Behavior
Bartlett, M. S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., & Movellan, J. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.55 · Cited by 290
AVEC 2011–The First International Audio/Visual Emotion Challenge
Schuller, B., Valstar, M., Eyben, F., McKeown, G., Cowie, R., & Pantic, M. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24571-8_53 · Cited by 271
Self-citationAFEW-VA database for valence and arousal estimation in-the-wild
Kossaifi, J., Tzimiropoulos, G., Todorovic, S., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.02.001 · Cited by 236 · cited 8×
“9− 117 secs controlled DEAP [29] 32 40 1 min controlled AFEW-VA [31] < 600 600 0.”
BackgroundMethodResultInfluentialAVEC 2012: the continuous audio/visual emotion challenge
Schuller, B., Valster, M., Eyben, F., Cowie, R., & Pantic, M. (2012) · Proceedings of the 14th ACM international conference on Multimodal interaction · doi:10.1145/2388676.2388776 · Cited by 226
Self-citationAung, M. S. H., Kaltwang, S., Romera-Paredes, B., Martinez, B., Singh, A., Cella, M., Valstar, M., Meng, H., Kemp, A., Shafizadeh, M., et al. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2462830 · Cited by 219
From individual to group-level emotion recognition: EmotiW 5.0
Dhall, A., Goecke, R., Ghosh, S., Joshi, J., Hoey, J., & Gedeon, T. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3143004 · Cited by 218 · cited 3×
“The only challenge, apart from last AVEC (2017) [44], using ’in-the-wild’ data is the series of EmotiW [16–20].”
BackgroundMethodResultInfluentialEmotion Recognition In The Wild Challenge 2014: Baseline, Data and Protocol
Dhall, A., Goecke, R., Joshi, J., Sikka, K., & Gedeon, T. (2014) · Proceedings of the 16th International Conference on Multimodal Interaction · doi:10.1145/2663204.2666275 · Cited by 216
Emotion recognition in the wild challenge 2013
Dhall, A., Goecke, R., Joshi, J., Wagner, M., & Gedeon, T. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531739 · Cited by 178
Survey of resampling techniques for improving classification performance in unbalanced datasets
More, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.06048 · Cited by 174
Temporal multimodal fusion for video emotion classification in the wild
Vielzeuf, V., Pateux, S., & Jurie, F. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3143011 · Cited by 170
Recognition of Affect in the Wild Using Deep Neural Networks
Kollias, D., Nicolaou, M. A., Kotsia, I., Zhao, G., & Zafeiriou, S. P. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.247 · Cited by 168
Self-citationLearning supervised scoring ensemble for emotion recognition in the wild
Hu, P., Cai, D., Wang, S., Yao, A., & Chen, Y. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3143009 · Cited by 162
The Belfast Induced Natural Emotion Database
Sneddon, I., McRorie, M., McKeown, G., & Hanratty, J. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.26 · Cited by 152
EmotiW 2016: video and group-level emotion recognition challenges
Dhall, A., Goecke, R., Joshi, J., Hoey, J., & Gedeon, T. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2997638 · Cited by 147
A Comprehensive Performance Evaluation of Deformable Face Tracking “In-the-Wild”
Chrysos, G. G., Antonakos, E., Snape, P., Asthana, A., & Zafeiriou, S. P. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-0999-5 · Cited by 142
Self-citationAffective Computing and Intelligent Interaction
D’Mello, S., Martin, J.-C., Schuller, B., & Graesser, A. C. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24571-8 · Cited by 122
Self-citationMenpo: A Comprehensive Platform for Parametric Image Alignment and Visual Deformable Models
Alabort-i-Medina, J., Antonakos, E., Booth, J. G., Snape, P., & Zafeiriou, S. P. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654890 · Cited by 118
Self-citationDouglas‐Cowie, E., Cowie, R., Cox, C., Amier, N., & Heylen, D. (2008) · University of Twente Research Information · Cited by 103
Chang, W.-Y., Hsu, S.-H., & Chien, J.-H. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.246 · Cited by 86
Cowie, R., McKeown, G. J., & Douglas‐Cowie, E. (2012) · International Journal of Synthetic Emotions · doi:10.4018/jse.2012010101 · Cited by 85
Knyazev, B. A., Shvetsov, R., Efremova, N., & Kuharenko, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04598 · Cited by 67
AVEC 2015: The 5th International Audio/Visual Emotion Challenge and Workshop
Ringeval, F., Schuller, B., Valstar, M., Cowie, R., & Pantic, M. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806408 · Cited by 50
Self-citationLearning Grimaces by Watching TV
Albanie, S., & Vedaldi, A. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.122 · Cited by 34
Facial Affect Estimation in the Wild Using Deep Residual and Convolutional Networks
Hasani, B., & Mahoor, M. H. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.245 · Cited by 25
Video and image based emotion recognition challenges in the wild : EmotiW 2015
Dhall, A., Ramana Murthy, O. V., Goecke, R., Joshi, J., & Gedeon, T. (2015) · University of Canberra Research Portal · Cited by 25
Estimation of Affective Level in the Wild with Multiple Memory Networks
Li, J., Chen, Y., Xiao, S., Zhao, J. C., Roy, S., Feng, J., Yan, S., & Sim, T. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.244 · Cited by 19
McRorie, M. (2011) · Research Portal (Queen's University Belfast) · Cited by 17
Cited by
Ringeval, F., Schuller, B., Valstar, M., Cummins, N., Cowie, R., Tavabi, L., Schmitt, M., Alisamir, S., Amiriparian, S., Messner, E.-M., et al. (2019) · Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3347320.3357688 · Cited by 409
“For these, we employed a VGG-16 [69] network and a ResNet-50 network [24] that are pre-trained with the Affwild dataset [30].”
MethodSelf-citationKollias, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00259 · Cited by 147
“This Challenge’s corpora include 548 videos in Aff-Wild2 that contain annotations in terms of the the 6 basic expressions, plus the neutral state, plus a category ’other’ that denotes expressions/affective states other than the 6 basic ones.”
MethodInfluentialSelf-citationVideo-based Frame-level Facial Analysis of Affective Behavior on Mobile Devices using EfficientNets
Savchenko, A. V. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00263 · Cited by 50
Multimodal Attention Network for Continuous-Time Emotion Recognition Using Video and EEG Signals
Choi, D. Y., Kim, D.-H., & Song, B. C. (2020) · IEEE Access · doi:10.1109/access.2020.3036877 · Cited by 39
“For example, three-dimensional CNNs [13] and CNN-LSTM–based networks [46] were proposed for FER on the AFEW dataset.”
BackgroundMethodInfluentialUsing Prompts to Guide Large Language Models in Imitating a Real Person's Language Style
Chen, Z., & Moscholios, S. (2024) · arXiv · doi:10.48550/arxiv.2410.03848
Metadata
- Authors
- Kollias, D., Tzirakis, P., Nicolaou, M. A., Papaioannou, A., Zhao, G., Schuller, B., Kotsia, I., & Zafeiriou, S.
- Venue
- International Journal of Computer Vision
- Published
- 2019-02-13
- Volume
- 127
- Issue
- 6-7
- Pages
- 907-929
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W2798536775
- Cited by
- 377
- References
- 71
- FWCI
- 53.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.