CoChat

Facial Expression Recognition: A Survey

Open access

The DOI matches its Crossref record; 130 of the 131 references it cites were found in a registry or an index.

Abstract

Facial Expression Recognition (FER), as the primary processing method for non-verbal intentions, is an important and promising field of computer vision and artificial intelligence, and one of the subject areas of symmetry. This survey is a comprehensive and structured overview of recent advances in FER. We first categorise the existing FER methods into two main groups, i.e., conventional approaches and deep learning-based approaches. Methodologically, to highlight the differences and similarities, we propose a general framework of a conventional FER approach and review the possible technologies that can be employed in each component. As for deep learning-based methods, four kinds of neural network-based state-of-the-art FER approaches are presented and analysed. Besides, we introduce seventeen commonly used FER datasets and summarise four FER-related elements of datasets that may influence the choosing and processing of FER approaches. Evaluation methods and metrics are given in the later part to show how to assess FER algorithms, along with subsequent performance comparisons of different FER approaches on the benchmark datasets. At the end of the survey, we present some challenges and opportunities that need to be addressed in future.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/sym11101189

Cites

130 of 130 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Various emotions and Valence-Arousal Space.
Figure 1 Various emotions and Valence-Arousal Space.CC-BY · From the PDF
Figure 2 Example of facial landmarks (face images are taken from JAFFE dataset [14]).
Figure 2 Example of facial landmarks (face images are taken from JAFFE dataset [14]).CC-BY · From the PDF
Figure 3 Some examples of AUs (images are taken from CK+ dataset [15]).
Figure 3 Some examples of AUs (images are taken from CK+ dataset [15]).CC-BY · From the PDF
Figure 4 Procedure in conventional FER approaches.
Figure 4 Procedure in conventional FER approaches.CC-BY · From the PDF
Figure 5 Extraction of LBP histogram from a facial image.
Figure 5 Extraction of LBP histogram from a facial image.CC-BY · From the PDF
( a ) feature point tracking
( a ) feature point trackingCC-BY · From the PDF
( b ) dense flow tracking
( b ) dense flow trackingCC-BY · From the PDF
Figure 7 Feature points displacement.
Figure 7 Feature points displacement.CC-BY · From the PDF
Image 9
CC-BY · From the PDF
Image 10
CC-BY · From the PDF
Figure 8 Procedure of CNN-based FER approach.
Figure 8 Procedure of CNN-based FER approach.CC-BY · From the PDF
Figure 9 Facial images with different poses.
Figure 9 Facial images with different poses.CC-BY · From the PDF
Figure 10 Examples of six representative datasets related to FER. ( a ) JAFFE [14]; ( b ) KDEF [104]; ( c ) CK+ [15]; ( d ) MMI [105]; ( e ) MPI [106]; ( f ) UNBC [107].
Figure 10 Examples of six representative datasets related to FER. ( a ) JAFFE [14]; ( b ) KDEF [104]; ( c ) CK+ [15]; ( d ) MMI [105]; ( e ) MPI [106]; ( f ) UNBC [107].CC-BY · From the PDF
(a) random cropping (b) mirroring
(a) random cropping (b) mirroringCC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Show all 130 references

Research works printed but not linked: 3

  1. Walecki, 2017, Deep structured learning for facial expression intensity estimation, Image Vis. Comput, 259, 143
  2. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative adversarial nets. Proceedings of the Conference on Neural Information Processing Systems (NIPS), Montreal, QC, Canad.
  3. Lundqvist, 1998, The Karolinska directed emotional faces (KDEF), CD ROM Dep. Clin. Neurosci. Psychol. Sect. Karolinska Inst., 91, 630

Cited by

See all 235

Metadata

Authors
Huang, Y., Chen, F., Lv, S., & Wang, X.
Affiliations
National University of Defense Technology (CN)
Corresponding author
Wang, Xiaodong
Venue
Symmetry
Publisher
MDPI AG
Published
2019-09-20
Volume
11
Issue
10
Pages
1189
ISSN
2073-8994 (ISSN-L)
OpenAlex
W2974043081
Cited by
195
References
131
Citations by year
2026: 18 · 2025: 14 · 2024: 30 · 2023: 33 · 2022: 41 · 2021: 39 · 2020: 18 · 2019: 1
FWCI
29.14
Type
journal article
Language
en
Open access
Locations
  • Symmetry (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Natural Science Foundation of China (61572513)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
Keywords
facial expression recognition, nonverbal communication, neural network architecture, facial expression datasets, evaluation metrics, benchmark dataset, performance comparison

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Facial Expression Recognition: A Survey. https://app.cochat.ai/papers/10.3390/sym11101189
The paper
Huang, Y., Chen, F., Lv, S., & Wang, X. (2019). Facial Expression Recognition: A Survey. Symmetry. https://doi.org/10.3390/sym11101189

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.