Cited by 53Emotion and Mood RecognitionFace recognition and analysisFace and Expression Recognition

Expression Recognition Method Based on a Lightweight Convolutional Neural Network

Open access
Zhao, Guangzhe, Yang, Hanting, Yu, Min·2020·IEEE Access

Abstract

Effective emotion recognition algorithms can help machines better understand people and promote the development of human-computer interaction applications. In recent years, many research efforts have used benchmark expression data to train deep neural network models to achieve state-of-art results. These high-accuracy models usually contain hundreds of layers, so they require complex calculations and may not be suitable for real-world scenarios. This paper proposes a lightweight emotion recognition (LER) model to handle the latency problem under natural conditions. The three main contributions of this paper are as follows. 1) The LER model incorporates a densely connected convolution layer and model compression techniques into a framework that eliminates redundancy parameters. 2) Multichannel input is introduced in our work to preprocess the image data, which improves the learning ability of the model. 3) Experiments show that the proposed LER model has better performance on the FER2013 and FERPLUS datasets compared with other lightweight models. Compared with the VGG13 used in previous work, the LER model achieves higher accuracy and reduces the number of parameters by 97 times. Finally, the FERFIN dataset is created, which had fewer noise data and more accurate labels than the FERPLUS dataset.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/access.2020.2964752

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Compared with the methods in [43] and [44], the proposed method uses fewer resources.

    “Compared with the methods in [43] and [44], the proposed method uses fewer resources.”

    From A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition (2021) · cites this paper as [43]

    In D. Comparison with State-of-the-Art (page unavailable), the paper reports that its DenseNet models have fewer parameters than VGG13 and says they achieve the best tradeoff between accuracy and latency among the models tested. Our copy does not establish that the proposed method uses fewer resources than both methods labeled [43] and [44] in the citing document; those references cannot be identified from the sentence alone. (LLM, conf=0.76)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 44 references couldn’t be matched to a known paper.

Research works printed but not linked: 5

  1. M. Suwa, N. Sugie, and K. Fujimora, ''A preliminary note on pattern recognition of human emotional expression,'' in Proc. Int. Joint Conf. Pattern Recognit., 1978, pp. 408-410.
  2. P. Ekman and W. V. Friesen, Facial Action Coding System: A Technique for the Measurement of Facial Movement. Palo Alto, CA, USA: Consulting Psychologists Press, 1978.
  3. M. Osadchy, M. Miller, and Y. Lecun, ''Synergistic face detection and pose estimation,'' J. Mach. Learn. Res., vol. 8, no. 1, pp. 1197-1215, 2006.
  4. W. Su, S. Boyd, and E. J. Candes, ''A differential equation for modeling Nesterov's accelerated gradient method: Theory and insights,'' in Proc. Adv. Neural Inf. Process. Syst., 2015, vol. 3, no. 1, pp. 2510-2518.
  5. A. Howard, M. Sandler, G. Chu, L.-C. Chen, B. Chen, M. Tan, W. Wang, Y. Zhu, R. Pang, V. Vasudevan, Q. V. Le, and H. Adam, ''Search- ing for MobileNetV3,'' 2019, arXiv:1905.02244. [Online]. Available: http://arxiv.org/abs/1905.02244 · arXiv

Cited by

Sorted by citations

Authors
Zhao, G., Yang, H., & Yu, M.
Affiliations
  • Beijing University of Civil Engineering and Architecture (CN)
  • Guangdong Academy of Medical Sciences (CN)
Venue
IEEE Access
Published
2020
Volume
8
Pages
38528-38537
ISSN
2169-3536 (ISSN-L)
OpenAlex
W2998896153
Cited by
53
References
44
Citations by year
2026: 4 · 2025: 7 · 2024: 12 · 2023: 13 · 2022: 7 · 2021: 9 · 2020: 1
FWCI
7.26
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Natural Science Foundation of China (61871021, 61531006)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
Keywords
facial expression recognition, emotion recognition, lightweight convolutional neural network, model compression, parameter reduction, inference latency, FER2013, human-computer interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review