Cited by 148Emotion and Mood RecognitionFace recognition and analysisHuman Pose and Action Recognition

ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challenges

Open access
Kollias, Dimitrios·2022·2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

Abstract

This paper describes the third Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. The 3rd ABAW Competition is a continuation of the Competitions held at ICCV 2021, IEEE FG 2020 and IEEE CVPR 2017 Conferences, and aims at automatically analyzing affect. This year the Competition encompasses four Challenges: i) uni-task Valence-Arousal Estimation, ii) uni-task Expression Classification, iii) uni-task Action Unit Detection, and iv) MultiTask-Learning. All the Challenges are based on a common benchmark database, Aff-Wild2, which is a large scale in-the-wild database and the first one to be annotated in terms of valence-arousal, expressions and action units. In this paper, we present the four Challenges, with the utilized Competition corpora, we outline the evaluation metrics and present both the baseline systems and the top performing teams’ per Challenge. Finally we illustrate the obtained results of the baseline systems and of all participating teams. More information regarding the Competition and the leaderboard for each Challenge can be found in the competition’s website: http://ibug.doc.ic.ac.uk/resources/cvpr-2022-3rd-abaw.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/cvprw56347.2022.00259

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Aff-Wild2 contains 548 video clips collected from YouTube in real-world environments, with aligned faces and facial expression annotations, and eight classes of emotions.

    “we use the Aff-Wild2 dataset (Kollias and Zafeiriou, 2019; Kollias, 2022), which contains 548 video clips collected from YouTube in realworld environments. Each clip has several frames of aligned faces and each frame is annotated with a facial expression. It has eight classes of emotions (six basic emotions, neutral , and other ).”

    From A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (2023) · cites this paper as Kollias, 2022

    Section 2.2 (p. 2) reports 548 Aff-Wild2 videos in the expression-recognition corpus, annotated frame by frame for six basic expressions, neutral, and ‘other.’ Sections 2 and 2.5 (pp. 2–3) describe providing aligned face images. The paper does not say these videos came from YouTube, and 548 is the size of the expression-recognition corpus, not a stated total for Aff-Wild2. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

11 of the 72 references couldn’t be matched to a known paper.

Research works printed but not linked: 13

  1. [5][5] Roddy Cowie, Ellen Douglas-Cowie, Susie Savvidou*, Edelle McMahon, Martin Sawey, and Marc Schr¨ oder. 'feeltrace': An instrument for recording perceived emotion in real time. In ISCA tutorial and research workshop (ITRW) on speech and emotion , 2000. -
  2. [14][14] Nico H Frijda et al. The emotions . Cambridge University Press, 1986. -
  3. [16][16] Darshan Gera and S Balasubramanian. Affect expression behaviour analysis in the wild using consensual collaborative training. arXiv preprint arXiv:2107.05736 , 2021. - · arXiv
  4. [17][17] Ian Goodfellow, Yoshua Bengio, and Aaron Courville. Deep learning . MIT press, 2016. -
  5. [18][18] Shalom Greene, Himanshu Thapliyal, and Allison CabanHolt. A survey of affective computing for stress detection: Evaluating technologies in stress detection for better health. IEEE Consumer Electronics Magazine , 5(4):44-56, 2016. -
  6. [33][33] Felix Kuhnke, Lars Rumberg, and J¨ orn Ostermann. Twostream aural-visual affect analysis in the wild. arXiv preprint arXiv:2002.03399 , 2020. - · arXiv
  7. [41][41] Hai X Pham, Yuting Wang, and Vladimir Pavlovic. Generative adversarial talking head: Bringing portraits to life with a weakly supervised neural network. arXiv preprint arXiv:1803.07716 , 2018. - · arXiv
  8. [42][42] Albert Pumarola, Antonio Agudo, Aleix M Martinez, Alberto Sanfeliu, and Francesc Moreno-Noguer. Ganimation: Anatomically-aware facial animation from a single image. In Proceedings of the European Conference on Computer Vision (ECCV) , pages 818-833, 2018. -
  9. [45][45] Justus Thies, Michael Zollhofer, Marc Stamminger, Christian Theobalt, and Matthias Nießner. Face2face: Real-time face capture and reenactment of rgb videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 2387-2395, 2016. -
  10. [46][46] Justus Thies, Michael Zollh¨ ofer, Christian Theobalt, Marc Stamminger, and Matthias Nießner. Headon: real-time reenactment of human portrait videos. ACM Transactions on Graphics (TOG) , 37(4):164, 2018. -
  11. [49][49] CM Whissel. The dictionary of affect in language, emotion: Theory, research and experience: vol. 4, the measurement of emotions, r. Plutchik and H. Kellerman, Eds., New York: Academic , 1989. -
  12. [53][53] Sebastian Zepf, Javier Hernandez, Alexander Schmitt, Wolfgang Minker, and Rosalind W Picard. Driver emotion recognition for intelligent vehicles: A survey. ACM Computing Surveys (CSUR) , 53(3):1-30, 2020. -
  13. [54][54] Su Zhang, Yi Ding, Ziquan Wei, and Cuntai Guan. Audiovisual attentive fusion for continuous emotion recognition. arXiv preprint arXiv:2107.01175 , 2021. - · arXiv

Cited by

Sorted by citations

Authors
Kollias, D.
Affiliations
Queen Mary University of London (GB)
Corresponding author
Kollias, Dimitrios
Venue
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Publisher
IEEE
Published
2022-06
Pages
2327-2335
OpenAlex
W4292794012
Cited by
147
References
72
Citations by year
2026: 6 · 2025: 41 · 2024: 33 · 2023: 47 · 2022: 20
FWCI
46.11
Type
conference paper
Language
en
Open access
Locations
  • IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
Keywords
valence-arousal estimation, facial expression recognition, action unit detection, multi-task learning, Aff-Wild2, ABAW challenge, benchmark database

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review