ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challenges
Open accessAbstract
This paper describes the third Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. The 3rd ABAW Competition is a continuation of the Competitions held at ICCV 2021, IEEE FG 2020 and IEEE CVPR 2017 Conferences, and aims at automatically analyzing affect. This year the Competition encompasses four Challenges: i) uni-task Valence-Arousal Estimation, ii) uni-task Expression Classification, iii) uni-task Action Unit Detection, and iv) MultiTask-Learning. All the Challenges are based on a common benchmark database, Aff-Wild2, which is a large scale in-the-wild database and the first one to be annotated in terms of valence-arousal, expressions and action units. In this paper, we present the four Challenges, with the utilized Competition corpora, we outline the evaluation metrics and present both the baseline systems and the top performing teams’ per Challenge. Finally we illustrate the obtained results of the baseline systems and of all participating teams. More information regarding the Competition and the leaderboard for each Challenge can be found in the competition’s website: http://ibug.doc.ic.ac.uk/resources/cvpr-2022-3rd-abaw.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Aff-Wild2 contains 548 video clips collected from YouTube in real-world environments, with aligned faces and facial expression annotations, and eight classes of emotions.
“we use the Aff-Wild2 dataset (Kollias and Zafeiriou, 2019; Kollias, 2022), which contains 548 video clips collected from YouTube in realworld environments. Each clip has several frames of aligned faces and each frame is annotated with a facial expression. It has eight classes of emotions (six basic emotions, neutral , and other ).”
From A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (2023) · cites this paper as Kollias, 2022
Section 2.2 (p. 2) reports 548 Aff-Wild2 videos in the expression-recognition corpus, annotated frame by frame for six basic expressions, neutral, and ‘other.’ Sections 2 and 2.5 (pp. 2–3) describe providing aligned face images. The paper does not say these videos came from YouTube, and 548 is the size of the expression-recognition corpus, not a stated total for Aff-Wild2. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
RetinaFace: Single-Shot Multi-Level Face Localisation in the Wild
Deng, J., Guo, J., Ververas, E., Kotsia, I., & Zafeiriou, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00525 · Cited by 1,681 · see citing works
The Expression Of The Emotions In Man And Animals
Darwin, C. D. (1998) · doi:10.1093/oso/9780195112719.001.0001 · Cited by 733 · see citing works
Evidence of convergent validity on the dimensions of affect
Russell, J. A. (1978) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.36.10.1152 · Cited by 495 · see citing works
Facial Action Coding System (FACS)
Ekman, P. (2002) · Medical Entomology and Zoology · Cited by 394 · see citing works
Deep Affect Prediction in-the-Wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond
Kollias, D., Tzirakis, P., Nicolaou, M. A., Papaioannou, A., Zhao, G., Schuller, B. W., Kotsia, I., & Zafeiriou, S. P. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01158-4 · Cited by 388 · see citing works
Self-citationAff-Wild: Valence and Arousal ‘In-the-Wild’ Challenge
Zafeiriou, S. P., Kollias, D., Nicolaou, M. A., Papaioannou, A., Zhao, G., & Kotsia, I. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.248 · Cited by 297 · see citing works
Self-citationAnalysing Affective Behavior in the First ABAW 2020 Competition
Kollias, D., Schulc, A., Hajiyev, E., & Zafeiriou, S. P. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00126 · Cited by 226 · see citing works
Self-citationExpression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFace
Kollias, D., & Zafeiriou, S. (2019) · arXiv · doi:10.48550/arxiv.1910.04855 · Cited by 210 · see citing works
Self-citationAnalysing Affective Behavior in the second ABAW2 Competition
Kollias, D., & Zafeiriou, S. P. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00408 · Cited by 168 · see citing works
Self-citationMultimodal Multi-task Learning for Dimensional and Continuous Emotion Recognition
Chen, S., Jin, Q., Zhao, J., & Wang, S. (2017) · Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge · doi:10.1145/3133944.3133949 · Cited by 147 · see citing works
Aff-Wild2: Extending the Aff-Wild Database for Affect RecognitionPreprint
Kollias, D., & Zafeiriou, S. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07770 · Cited by 142 · see citing works
Self-citationRecognition of Affect in the Wild Using Deep Neural Networks
Kollias, D., Nicolaou, M. A., Kotsia, I., Zhao, G., & Zafeiriou, S. P. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.247 · Cited by 124 · see citing works
Self-citationFace Behavior a la carte: Expressions, Affect and Action Units in a Single NetworkPreprint
Kollias, D., Sharmanska, V., & Zafeiriou, S. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.11111 · Cited by 120 · see citing works
Self-citationA Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition
Praveen, R. G., de Melo, W. C., Ullah, N., Aslam, M. H., Zeeshan, O., Denorme, T., Pedersoli, M., Koerich, A. L., Bacon, S., Cardinal, P., et al. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00278 · Cited by 115 · see citing works
Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face StudyPreprint
Kollias, D., Sharmanska, V., & Zafeiriou, S. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03790 · Cited by 110 · see citing works
Self-citationTransformer-based Multimodal Information Fusion for Facial Expression Analysis
Zhang, W., Qiu, F., Wang, S., Zeng, H., Zhang, Z., An, R., Ma, B., & Ding, Y. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00271 · Cited by 109 · see citing works
Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified FrameworkPreprint
Kollias, D., & Zafeiriou, S. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.15792 · Cited by 107 · see citing works
Self-citationIncremental Boosting Convolutional Neural Network for Facial Action Unit RecognitionPreprint
Han, S., Meng, Z., Khan, A.-S., & Tong, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05395 · Cited by 97 · see citing works
Multitask Emotion Recognition with Incomplete Labels
Deng, D., Chen, Z., & Shi, B. E. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00131 · Cited by 90 · see citing works
Chang, W.-Y., Hsu, S.-H., & Chien, J.-H. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.246 · Cited by 84 · see citing works
Two-Stream Aural-Visual Affect Analysis in the Wild
Kuhnke, F., Rumberg, L., & Östermann, J. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00056 · Cited by 73 · see citing works
A Multi-Task Learning & Generation Framework: Valence-Arousal, Action Units & Primary ExpressionsPreprint
Kollias, D., & Zafeiriou, S. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07771 · Cited by 50 · see citing works
Self-citationCoarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognition
Xue, F., Tan, Z., Zhu, Y. M., Ma, Z., & Guo, G. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00269 · Cited by 46 · see citing works
Multitask Multi-database Emotion Recognition
Vu, M. T., Beurton‐Aimar, M., & Marchand, S. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00406 · Cited by 38 · see citing works
A Multi-task Mean Teacher for Semi-supervised Facial Affective Behavior Analysis
Wang, L., Wang, S., Qi, J., & Suzuki, K. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00402 · Cited by 36 · see citing works
Zhang, S., An, R., Ding, Y., & Guan, C. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00265 · Cited by 30 · see citing works
Time-Continuous Audiovisual Fusion with Recurrence vs Attention for In-The-Wild Affect Recognition
Karas, V., Tellamekala, M. K., Mallol-Ragolta, A., Valstar, M., & Schuller, B. W. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00266 · Cited by 25 · see citing works
Prior Aided Streaming Network for Multi-task Affective Recognitionat the 2nd ABAW2 CompetitionPreprint
Zhang, W., Guo, Z., Chen, K., Li, L., Zhang, Z., & Ding, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03708 · Cited by 23 · see citing works
Facial Expression Recognition with Swin TransformerPreprint
Kim, J.-H., Kim, N., & Won, C. S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13472 · Cited by 22 · see citing works
Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile DevicesPreprint
Savchenko, A. V. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13436 · Cited by 22 · see citing works
Affective Expression Analysis in-the-wild using Multi-Task Temporal Statistical Deep Learning Model
Do, N.-T., Nguyen-Quynh, T.-T., & Kim, S.-H. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00093 · Cited by 21 · see citing works
A Multi-modal and Multi-task Learning Method for Action Unit and Expression RecognitionPreprint
Jin, Y., Zheng, T., Gao, C., & Xu, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.04187 · Cited by 21 · see citing works
Causal affect prediction model using a past facial image sequence
Oh, G., Jeong, E., & Lim, S. (2021) · IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00395 · Cited by 17 · see citing works
Gera, D., & Balasubramanian, S. (2021) · International Journal of Engineering Trends and Technology · doi:10.14445/22315381/ijett-v69i7p231 · Cited by 14 · see citing works
Multi-modal Emotion Estimation for in-the-wild VideosPreprint
Meng, L., Liu, Y., Liu, X., Huang, Z., Cheng, Y., Wang, M., Liu, C., & Jin, Q. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13032 · Cited by 14 · see citing works
An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wildPreprint
Dresvyanskiy, D., Рюмина, Е. В., Kaya, H., Markitantov, M., Karpov, A. A., & Minker, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03692 · Cited by 13 · see citing works
An Ensemble Approach for Facial Expression Analysis in VideoPreprint
Nguyen, H.-H., Huynh, V. T., & Kim, S.-H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.12891 · Cited by 10 · see citing works
Multi-modal Multi-label Facial Action Unit Detection with TransformerPreprint
Wang, L., Wang, S., & Qi, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13301 · Cited by 10 · see citing works
$M^3$T: Multi-Modal Continuous Valence-Arousal Estimation in the WildPreprint
Zhang, Y., Huang, R., Zeng, J., Shan, S., & Chen, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02957 · Cited by 9 · see citing works
Facial Action Unit Recognition With Multi-models EnsemblingPreprint
Jiang, W., Wu, Y., Qiao, F., Meng, L., Deng, Y., & Liu, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13046 · Cited by 8 · see citing works
Facial Expression Recognition based on Multi-head Cross Attention NetworkPreprint
Jeong, J.-Y., Hong, Y.-G., Kim, D., Jung, Y., & Jeong, J.-W. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13235 · Cited by 8 · see citing works
Gera, D., & Balasubramanian, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.14440 · Cited by 7 · see citing works
FAU, Facial Expressions, Valence and Arousal: A Multi-task SolutionPreprint
Deng, D., Chen, Z., & Shi, B. E. (2020) · arXiv (Cornell University) · Cited by 7 · see citing works
Multi-label Transformer for Action Unit DetectionPreprint
Tallec, G., Yvinec, E., Dapogny, A., & Bailly, K. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.12531 · Cited by 7 · see citing works
Spatial and Temporal Networks for Facial Expression Recognition in the Wild VideosPreprint
Mao, S., Fan, X., & Peng, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05160 · Cited by 6 · see citing works
Emotion Recognition for In-the-wild VideosPreprint
Liu, H., Zeng, J., Shan, S., & Chen, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05447 · Cited by 6 · see citing works
Technical Report for Valence-Arousal Estimation on Affwild2 DatasetPreprint
Li, I.-H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.01502 · Cited by 5 · see citing works
Technical Report for Valence-Arousal Estimation in ABAW2 ChallengePreprint
Xie, H.-X., Li, I.-H., Lo, L., Shuai, H.-H., & Cheng, W.-H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03891 · Cited by 5 · see citing works
Multi-label Relation Modeling in Facial Action Units DetectionPreprint
Ji, X., Ding, Y., Li, L., Chen, Y., & Fan, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.01105 · Cited by 5 · see citing works
A Multi-term and Multi-task Analyzing Framework for Affective Analysis in-the-wildPreprint
Youoku, S., Toyoda, Y., Yamamoto, T., Saito, J., Kawamura, R., Mi, X., & Murase, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13885 · Cited by 5 · see citing works
Deng, D., Wu, L., & Shi, B. E. (2021) · arXiv (Cornell University) · Cited by 5 · see citing works
Multi-model Ensemble Learning Method for Human Expression RecognitionPreprint
Yu, J., Cai, Z., He, P., Xie, G., & Ling, Q. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.14466 · Cited by 5 · see citing works
Action Units Recognition Using Improved Pairwise Deep ArchitecturePreprint
Saito, J., Mi, X., Uchida, A., Youoku, S., Yamamoto, T., Murase, K., & Nakayama, O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03143 · Cited by 4 · see citing works
Multiple Emotion Descriptors Estimation at the ABAW3 ChallengePreprint
Deng, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.12845 · Cited by 4 · see citing works
Multi-Label Class Balancing Algorithm for Action Unit DetectionPreprint
Pahl, J., Rieger, I., & Seuß, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03238 · Cited by 3 · see citing works
Audio-visual Attentive Fusion for Continuous Emotion Recognition.Preprint
Zhang, S., Ding, Y., Wei, Z., & Guan, C. (2021) · arXiv (Cornell University) · Cited by 3 · see citing works
An Attention-based Method for Action Unit Detection at the 3rd ABAW CompetitionPreprint
Hoai, D. L., Lim, E., Choi, E., Kim, S., Pant, S., Lee, G.-S., Kim, S.-H., & Yang, H.-J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.12428 · Cited by 2 · see citing works
Facial Action Unit Recognition Based on Transfer LearningPreprint
Wang, S., Chang, Y., & Wang, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.14694 · Cited by 2 · see citing works
Multitask Emotion Recognition Model with Knowledge Distillation and Task DiscriminatorPreprint
Jeong, E., Oh, G., & Lim, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.13072 · Cited by 2 · see citing works
Antoniadis, P., Pikoulis, I., Filntisis, P. P., & Maragos, P. A. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00407
Flagged first, then by citations
11 of the 72 references couldn’t be matched to a known paper.
Research works printed but not linked: 13
- [5][5] Roddy Cowie, Ellen Douglas-Cowie, Susie Savvidou*, Edelle McMahon, Martin Sawey, and Marc Schr¨ oder. 'feeltrace': An instrument for recording perceived emotion in real time. In ISCA tutorial and research workshop (ITRW) on speech and emotion , 2000. -
- [14][14] Nico H Frijda et al. The emotions . Cambridge University Press, 1986. -
- [16][16] Darshan Gera and S Balasubramanian. Affect expression behaviour analysis in the wild using consensual collaborative training. arXiv preprint arXiv:2107.05736 , 2021. - · arXiv
- [17][17] Ian Goodfellow, Yoshua Bengio, and Aaron Courville. Deep learning . MIT press, 2016. -
- [18][18] Shalom Greene, Himanshu Thapliyal, and Allison CabanHolt. A survey of affective computing for stress detection: Evaluating technologies in stress detection for better health. IEEE Consumer Electronics Magazine , 5(4):44-56, 2016. -
- [33][33] Felix Kuhnke, Lars Rumberg, and J¨ orn Ostermann. Twostream aural-visual affect analysis in the wild. arXiv preprint arXiv:2002.03399 , 2020. - · arXiv
- [41][41] Hai X Pham, Yuting Wang, and Vladimir Pavlovic. Generative adversarial talking head: Bringing portraits to life with a weakly supervised neural network. arXiv preprint arXiv:1803.07716 , 2018. - · arXiv
- [42][42] Albert Pumarola, Antonio Agudo, Aleix M Martinez, Alberto Sanfeliu, and Francesc Moreno-Noguer. Ganimation: Anatomically-aware facial animation from a single image. In Proceedings of the European Conference on Computer Vision (ECCV) , pages 818-833, 2018. -
- [45][45] Justus Thies, Michael Zollhofer, Marc Stamminger, Christian Theobalt, and Matthias Nießner. Face2face: Real-time face capture and reenactment of rgb videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 2387-2395, 2016. -
- [46][46] Justus Thies, Michael Zollh¨ ofer, Christian Theobalt, Marc Stamminger, and Matthias Nießner. Headon: real-time reenactment of human portrait videos. ACM Transactions on Graphics (TOG) , 37(4):164, 2018. -
- [49][49] CM Whissel. The dictionary of affect in language, emotion: Theory, research and experience: vol. 4, the measurement of emotions, r. Plutchik and H. Kellerman, Eds., New York: Academic , 1989. -
- [53][53] Sebastian Zepf, Javier Hernandez, Alexander Schmitt, Wolfgang Minker, and Rosalind W Picard. Driver emotion recognition for intelligent vehicles: A survey. ACM Computing Surveys (CSUR) , 53(3):1-30, 2020. -
- [54][54] Su Zhang, Yi Ding, Ziquan Wei, and Cuntai Guan. Audiovisual attentive fusion for continuous emotion recognition. arXiv preprint arXiv:2107.01175 , 2021. - · arXiv
Cited by
Sorted by citations
Advances in Facial Expression Recognition: A Survey of Methods, Benchmarks, Models, and Datasets
Kopalidis, T., Solachidis, V., Vretos, N., & Daras, P. (2024) · Information · doi:10.3390/info15030135 · Cited by 174 · see citing works
A Review of Key Technologies for Emotion Analysis Using Multimodal Information
Zhu, X., Guo, C., Feng, H., Huang, Y., Feng, Y., Wang, X., & Wang, R. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10287-z · Cited by 137 · see citing works
A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition
Praveen, R. G., de Melo, W. C., Ullah, N., Aslam, M. H., Zeeshan, O., Denorme, T., Pedersoli, M., Koerich, A. L., Bacon, S., Cardinal, P., et al. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00278 · Cited by 115 · see citing works
Transformer-based Multimodal Information Fusion for Facial Expression Analysis
Zhang, W., Qiu, F., Wang, S., Zeng, H., Zhang, Z., An, R., Ma, B., & Ding, Y. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00271 · Cited by 109 · see citing works
Kollias, D., Tzirakis, P., Baird, A., Cowen, A., & Zafeiriou, S. P. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00626 · Cited by 102 · see citing works
Self-citationABAW: Learning from Synthetic Data & Multi-task Learning Challenges
Kollias, D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_12 · Cited by 80 · see citing works
Self-citationThe 6th Affective Behavior Analysis in-the-wild (ABAW) Competition
Kollias, D., Tzirakis, P., Cowen, A., Zafeiriou, S. P., Kotsia, I., Baird, A., Gagne, C., Shao, C., & Hu, G. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00461 · Cited by 59 · see citing works
Self-citationZheng, W., Yu, J., Xia, R., & Wang, S. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.861 · Cited by 51 · see citing works
Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognition
Praveen, R. G., & Alam, M. J. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00483 · Cited by 49 · see citing works
Coarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognition
Xue, F., Tan, Z., Zhu, Y. M., Ma, Z., & Guo, G. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00269 · Cited by 46 · see citing works
MixAugment & Mixup: Augmentation Methods for Facial Expression Recognition
Psaroudakis, A., & Kollias, D. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00264 · Cited by 46 · see citing works
Self-citationUncertain Facial Expression Recognition via Multi-Task Assisted Correction
Liu, Y. M., Zhang, X., Kauttonen, J., & Zhao, G. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3301209 · Cited by 45 · see citing works
Video-based Frame-level Facial Analysis of Affective Behavior on Mobile Devices using EfficientNets
Savchenko, A. V. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00263 · Cited by 50 · see citing works
AFFDEX 2.0: A Real-Time Facial Expression Analysis Toolkit
Bishay, M., Preston, K., Strafuss, M., Page, G., Turcot, J., & Mavadati, M. (2023) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg57933.2023.10042673 · Cited by 40 · see citing works
Exploring facial expressions and action unit domains for Parkinson detection
Gomez, L. F., Morales, A., Fiérrez, J., & Orozco‐Arroyave, J. R. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281248 · Cited by 39 · see citing works
Beyond Supervised Learning for Pervasive Healthcare
Gu, X., Deligianni, F., Han, J., Liu, X., Chen, W., Yang, G., & Lo, B. P. L. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2023.3296938 · Cited by 41 · see citing works
Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognition
Zhou, W., Lu, J., Xiong, Z., & Wang, W. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00610 · Cited by 37 · see citing works
Frame Level Emotion Guided Dynamic Facial Expression Recognition with Emotion Grouping
Lee, B., Shin, H., Ku, B., & Ko, H. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00602 · Cited by 36 · see citing works
Joint Multimodal Transformer for Emotion Recognition in the Wild
Waligora, P., Aslam, M. H., Zeeshan, M., Belharbi, S., Koerich, A. L., Pedersoli, M., Bacon, S., & Granger, É. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00465 · Cited by 34 · see citing works
7th ABAW Competition: Multi-task Learning and Compound Expression Recognition
Kollias, D., Zafeiriou, S. P., Kotsia, I., Dhall, A., Ghosh, S., Shao, C., & Hu, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91581-9_3 · Cited by 34 · see citing works
Self-citationGraph-Based Facial Affect Analysis: A Review
Liu, Y. M., Zhang, X., Li, Y., Zhou, J., Li, X., & Zhao, G. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3215918 · Cited by 40 · see citing works
Multi-modal Facial Affective Analysis based on Masked Autoencoder
Zhang, W., Ma, B., Qiu, F., & Ding, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00615 · Cited by 34 · see citing works
Moorthy, S., & Moon, Y.-K. (2025) · Mathematics · doi:10.3390/math13071100 · Cited by 31 · see citing works
Zhang, S., An, R., Ding, Y., & Guan, C. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00265 · Cited by 30 · see citing works
Multimodal Continuous Emotion Recognition: A Technical Report for ABAW5
Zhang, S., Zhao, Z., & Guan, C. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00611 · Cited by 27 · see citing works
Exploring Facial Expression Recognition through Semi-Supervised Pre-training and Temporal Modeling
Yu, J., Wei, Z., Cai, Z., Zhao, G., Zhang, Z., Wang, Y., Xie, G., Zhu, J., Zhu, W., Liu, Q., et al. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00492 · Cited by 27 · see citing works
Time-Continuous Audiovisual Fusion with Recurrence vs Attention for In-The-Wild Affect Recognition
Karas, V., Tellamekala, M. K., Mallol-Ragolta, A., Valstar, M., & Schuller, B. W. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00266 · Cited by 25 · see citing works
Privileged Knowledge Distillation for Dimensional Emotion Recognition in the Wild
Aslam, M. H., Zeeshan, M., Pedersoli, M., Koerich, A. L., Bacon, S., & Granger, É. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00336 · Cited by 25 · see citing works
Valence and Arousal Estimation based on Multimodal Temporal-Aware Features for Videos in the Wild
Meng, L., Liu, Y., Liu, X., Huang, Z., Jiang, W., Zhang, T., Liu, C., & Jin, Q. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00261 · Cited by 24 · see citing works
HSEmotion: High-speed emotion recognition library
Savchenko, A. (2022) · Software Impacts · doi:10.1016/j.simpa.2022.100433 · Cited by 24 · see citing works
MT-EmotiEffNet for Multi-task Human Affective Behavior Analysis and Learning from Synthetic Data
Savchenko, A. V. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_4 · Cited by 24 · see citing works
An Assessment of In-the-Wild Datasets for Multimodal Emotion Recognition
Aguilera, A., Mellado, D., & Rojas, F. (2023) · Sensors · doi:10.3390/s23115184 · Cited by 24 · see citing works
Savchenko, A. V. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00606 · Cited by 24 · see citing works
Exploring Large-scale Unlabeled Faces to Enhance Facial Expression Recognition
Yu, J., Cai, Z., Li, R., Zhao, G., Xie, G., Zhu, J., Zhu, W., Ling, Q., Wang, L., Wang, C., et al. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00616 · Cited by 24 · see citing works
Zhang, Z., An, L., Cui, Z., Xu, A., Dong, T., Jiang, Y., Shi, J., Liu, X., Sun, X., & Wang, M. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00607 · Cited by 23 · see citing works
Li, J., Chen, Y., Zhang, X., Nie, J., Li, Z., Yu, Y., Zhang, Y., Hong, R., & Wang, M. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00620 · Cited by 22 · see citing works
CAGE: Circumplex Affect Guided Expression Inference
Wagner, N., Mätzler, F., Vossberg, S. R., Schneider, H., Pavlitska, S., & Zöllner, J. M. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00471 · Cited by 22 · see citing works
Incongruity-Aware Cross-Modal Attention for Audio-Visual Fusion in Dimensional Emotion Recognition
Praveen, R. G., & Alam, J. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3422823 · Cited by 21 · see citing works
Multi-Task Learning Framework for Emotion Recognition In-the-Wild
Zhang, T., Liu, C., Liu, X., Liu, Y., Meng, L., Sun, L., Jiang, W., Zhang, F., Zhao, J., & Jin, Q. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_11 · Cited by 20 · see citing works
An Ensemble Approach for Facial Behavior Analysis in-the-wild Video
Nguyen, H.-H., Huynh, V. T., & Kim, S.-H. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00281 · Cited by 19 · see citing works
A Unified Approach to Facial Affect Analysis: the MAE-Face Visual Representation
Ma, B., Zhang, W., Qiu, F., & Ding, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00630 · Cited by 15 · see citing works
Robust Light-Weight Facial Affective Behavior Recognition with CLIP
Lin, L., Papabathini, S., Wang, X., & Hu, S. (2024) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr62202.2024.00103 · Cited by 16 · see citing works
EmoStyle: One-Shot Facial Expression Editing Using Continuous Emotion Parameters
Azari, B., & Lim, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00626 · Cited by 15 · see citing works
Zero-Shot Audio-Visual Compound Expression Recognition Method based on Emotion Probability Fusion
Рюмина, Е. В., Markitantov, M., Ryumin, D., Kaya, H., & Karpov, A. A. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00478 · Cited by 16 · see citing works
Jeong, J.-Y., Hong, Y.-G., Kim, D., Jeong, J.-W., Jung, Y., & Kim, S.-H. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00262 · Cited by 14 · see citing works
Affective Behaviour Analysis Using Pretrained Model with Facial Prior
Li, Y., Sun, H., Liu, Z., Han, H., & Shan, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_2 · Cited by 13 · see citing works
An Effective Ensemble Learning Framework for Affective Behaviour Analysis
Zhang, W., Qiu, F., Liu, C., Li, L., Du, H., Guo, T., & Yu, X. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00479 · Cited by 13 · see citing works
Zhou, L., Feng, Z., Wang, H., & Guo, Q. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2247606 · Cited by 12 · see citing works
Mehta, A., & Yang, W. (2023) · International Conference on Video and Image Processing (ICVIP) · doi:10.1145/3639390.3639392 · Cited by 12 · see citing works
Advancements in Affective and Behavior Analysis: The 8th ABAW Workshop and Competition
Kollias, D., Tzirakis, P., Cowen, A., Zafeiriou, S. P., Kotsia, I., Granger, É., Pedersoli, M., Bacon, S., Baird, A., Gagne, C., et al. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00554 · Cited by 12 · see citing works
Self-citationYu, J., Li, R., Cai, Z., Zhao, G., Xie, G., Zhu, J., Zhu, W., Ling, Q., Wang, L., Wang, C., et al. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00614 · Cited by 12 · see citing works
GameVibe: a multimodal affective game corpus
Barthet, M., Kaselimi, M., Pinitas, K., Makantasis, K., Liapis, A., & Yannakakis, G. N. (2024) · Scientific Data · doi:10.1038/s41597-024-04022-4 · Cited by 12 · see citing works
Model Level Ensemble for Facial Action Unit Recognition at the 3rd ABAW Challenge
Jiang, W., Wu, Y. N., Qiao, F., Meng, L., Deng, Y., & Liu, C. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00260 · Cited by 11 · see citing works
Spatial-Temporal Graph-Based AU Relationship Learning for Facial Action Unit Detection
Wang, Z., Song, S., Luo, C., Zhou, Y., Wu, S., Xie, W., & Shen, L. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00627 · Cited by 11 · see citing works
Kollias, D., Psaroudakis, A., Αρσένος, Α., Theofilou, P., Shao, C., Hu, G., & Patras, I. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91581-9_1 · Cited by 11 · see citing works
Self-citationFacial Expression Classification using Fusion of Deep Neural Network in Video
Phan, K. N., Nguyen, H.-H., Huynh, V. T., & Kim, S.-H. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00280 · Cited by 10 · see citing works
Savchenko, A. V., & Sidorova, A. P. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00488 · Cited by 10 · see citing works
Cabacas-Maso, J., Ortega-Beltrán, E., Benito-Altamirano, I., & Ventura, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91581-9_22 · Cited by 10 · see citing works
Mamba-VA: A Mamba-Based Approach for Continuous Emotion Recognition in Valence-Arousal Space
Liang, Y., Wang, Z., Liu, F., Liu, M., & Yao, Y. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00562 · Cited by 11 · see citing works
Empirical Validation of an Agent-Based Model of Emotion Contagion
van Haeringen, E. S., Veltmeijer, E. A., & Gerritsen, C. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3272031 · Cited by 10 · see citing works
Moreno D’Incà, Beyan, C., Niewiadomski, R., Barattin, S., & Sebe, N. (2023) · IEEE Access · doi:10.1109/access.2023.3308047 · Cited by 10 · see citing works
Action unit detection by exploiting spatial-temporal and label-wise attention with transformer
Wang, L., Qi, J., Cheng, J., & Suzuki, K. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00276 · Cited by 10 · see citing works
Savchenko, A. V. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00473 · Cited by 8 · see citing works
Xu, C., Du, Y., Wang, J., Zheng, W., Li, T., & Yuan, Z.-S. (2023) · Computational Intelligence · doi:10.1111/coin.12607 · Cited by 9 · see citing works
Emotion Recognition beyond Pixels: Leveraging Facial Point Landmark Meshes
Arabian, H., Alshirbaji, T. A., Chase, J. G., & Möeller, K. (2024) · Applied Sciences · doi:10.3390/app14083358 · Cited by 9 · see citing works
Deep Adaptation of Adult-Child Facial Expressions by Fusing Landmark Features
Witherow, M. A., Samad, M. D., Diawara, N., Bar, H., & Iftekharuddin, K. M. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3297075 · Cited by 9 · see citing works
BFCP: Pursue Better Forward Compatibility Pretraining for Few-Shot Class-Incremental Learning
Fu, Z., Wang, Z., Xu, X., Guo, W., Chi, Z., Yang, H., & Du, W. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3548465 · Cited by 8 · see citing works
Multimodal emotion recognition method in complex dynamic scenes
Liu, L., Luo, Q., Zhang, W., Zhang, M., & Zhai, B. (2025) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2025.02.004 · Cited by 10 · see citing works
Emotion Recognition Using Transformers with Random Masking
Min, S., Yang, J.-S., & Lim, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00489 · Cited by 8 · see citing works
Emotic Masked Autoencoder on Dual-views with Attention Fusion for Facial Expression Recognition
Nguyen, X.-B., Nguyen, H.-T., Nguyen, T.-H., Do, N.-T., & Dinh, V. Q. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00481 · Cited by 8 · see citing works
Yu, J., Zhu, W., Zhu, J., Cai, Z., Zhao, G., Zhang, Z., Xie, G., Wei, Z., Liu, Q., & Liang, J. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00490 · Cited by 8 · see citing works
Nonverbal Communication Cue Recognition: A Pathway to More Accessible Communication
Shafique, Z., Wang, H., & Tian, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00600 · Cited by 7 · see citing works
A Dual Branch Network for Emotional Reaction Intensity Estimation
Yu, J., Zhu, J., Zhu, W., Cai, Z., Xie, G., Li, R., Zhao, G., Ling, Q., Wang, L., Wang, C., et al. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00617 · Cited by 7 · see citing works
Graph-Based Multi-Feature Fusion Method for Speech Emotion Recognition
Liu, X., Jie, L., & Wang, C. (2024) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s021800142450023x · Cited by 7 · see citing works
Kılıç, A. C., Karakuş, A., & Alptekin, S. E. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.09.323 · Cited by 7 · see citing works
Lei, J., Liu, Z., Zou, Z., Li, T., Xu, J., Wang, S., Yang, G., & Feng, Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_7 · Cited by 7 · see citing works
Xue, F., Sun, Y., & Yang, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00604 · Cited by 7 · see citing works
Jeong, D. C., Shen, T., Liu, H., Kapoor, R., Nguyen, C., Liu, S., & Kitts, C. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342417 · Cited by 6 · see citing works
DEITalk: Speech-Driven 3D Facial Animation with Dynamic Emotional Intensity Modeling
Shen, K., Xia, H., Geng, G., Geng, G., Xia, S., & Ding, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681359 · Cited by 6 · see citing works
An Attention-based Method for Multi-label Facial Action Unit Detection
Hoai, D. L., Lim, E., Choi, E., Kim, S., Pant, S., Lee, G.-S., Kim, S.-H., & Yang, H.-J. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00274 · Cited by 6 · see citing works
Affective Behavior Analysis Using Action Unit Relation Graph and Multi-task Cross Attention
Nguyen, D.-K., Pant, S., Ho, N.-H., Lee, G.-S., Kim, S.-H., & Yang, H.-J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_10 · Cited by 6 · see citing works
Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transport
Aslam, M. H., Zeeshan, M., Belharbi, S., Pedersoli, M., Koerich, A. L., Bacon, S., & Granger, É. (2024) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg59268.2024.10582047 · Cited by 6 · see citing works
Yu, J., Zhang, Z., Wei, Z., Zhao, G., Cai, Z., Wang, Y., Xie, G., Zhu, J., Zhu, W., Liu, Q., et al. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00484 · Cited by 6 · see citing works
Ensemble Spatial and Temporal Vision Transformer for Action Units Detection
Vu, N. T., Huynh, V. T., Nguyen, T.-N., & Kim, S.-H. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00612 · Cited by 6 · see citing works
Savchenko, A. V., & Savchenko, L. V. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00577 · Cited by 5 · see citing works
Yu, J., Zheng, Y., Wang, L., Wang, Y., & Xu, S. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00569 · Cited by 5 · see citing works
SAAML: A Framework for Semi-supervised Affective Adaptation via Metric Learning
Tran, M., Kim, Y., Su, C.-C., Kuo, C.-H., & Soleymani, M. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612286 · Cited by 5 · see citing works
Unimodal Multi-Task Fusion for Emotional Mimicry Intensity Prediction
Hallmen, T., Deuser, F., Oswald, N., & André, E. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00468 · Cited by 5 · see citing works
Okayama, M., & Hasegawa, T. (2025) · IEEE Access · doi:10.1109/access.2025.3565537 · Cited by 5 · see citing works
Leveraging Eye Movement for Instructing Robust Video-Based Facial Expression Recognition
Liu, Y., Wei, L., Liu, K., Chen, Z., Chen, Z., Tang, C., Chen, J., & Shan, S. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3599859 · Cited by 4 · see citing works
Posterior-Based Analysis of Spatio-Temporal Features for Sign Language Assessment
Tarigopula, N., Tornay, S., Sincan, O. M., Bowden, R., & Magimai.-Doss, M. (2025) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2025.3531781 · Cited by 5 · see citing works
SetPeER: Set-Based Personalized Emotion Recognition With Weak Supervision
Tran, M., Yin, Y., & Soleymani, M. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3568024 · Cited by 4 · see citing works
Estimating Multiple Emotion Descriptors by Separating Description and Inference
Deng, D., & Shi, B. E. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00267 · Cited by 4 · see citing works
Multi-modal Emotion Reaction Intensity Estimation with Temporal Augmentation
Qiu, F., Ma, B., Zhang, W., & Ding, Y. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00613 · Cited by 4 · see citing works
Textualized and Feature-Based Models for Compound Multimodal Emotion Recognition in the Wild
Richet, N., Belharbi, S., Aslam, M. H., Schadt, M. E., González-González, M., Cortal, G., Koerich, A. L., Pedersoli, M., Finkel, A., Bacon, S., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91581-9_5 · Cited by 4 · see citing works
Two-Aspect Information Interaction Model for ABAW4 Multi-task Challenge
Sun, H., Lian, Z., Liu, B., Tao, J., Sun, L., Cai, C., & He, Y. L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_13 · Cited by 4 · see citing works
Speech-Visual Emotion Recognition via Modal Decomposition Learning
Bai, L., Chang, R., Chen, G., & Zhou, Y. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3324294 · Cited by 4 · see citing works
Multi-modal Arousal and Valence Estimation under Noisy Conditions
Dresvyanskiy, D., Markitantov, M., Yu, J., Kaya, H., & Karpov, A. A. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00480 · Cited by 4 · see citing works
Semantic Matters: Multimodal Features for Affective Analysis
Hallmen, T., Kampa, R.-N., Deuser, F., Oswald, N., & André, E. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00570 · Cited by 3 · see citing works
Parihar, N., Kanan, Chawla, R., & Fortino, G. (2026) · Discover Robotics · doi:10.1007/s44430-026-00028-2 · Cited by 3 · see citing works
- Authors
- Kollias, D.
- Affiliations
- Queen Mary University of London (GB)
- Corresponding author
- Kollias, Dimitrios
- ORCID
- Kollias, Dimitrios
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 2327-2335
- OpenAlex
- W4292794012
- Cited by
- 147
- References
- 72
- Citations by year
- 2026: 6 · 2025: 41 · 2024: 33 · 2023: 47 · 2022: 20
- FWCI
- 46.11
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- valence-arousal estimation, facial expression recognition, action unit detection, multi-task learning, Aff-Wild2, ABAW challenge, benchmark database
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review