CoChat

Facial Expression Recognition with Identity and Emotion Joint Learning

Li, Ming, Xu, Hao, Huang, Xingchang, Song, Zhanmei, Liu, Xiaolin, Li, Xin · 2021 · IEEE Transactions on Affective Computing

The DOI matches its Crossref record; 46 of the 47 references it cites were found in a registry or an index.

Abstract

Different subjects may express a specific expression in different ways due to inter-subject variabilities. In this work, besides training deep-learned facial expression feature (emotional feature), we also consider the influence of latent face identity feature such as the shape or appearance of face. We propose an identity and emotion joint learning approach with deep convolutional neural networks (CNNs) to enhance the performance of facial expression recognition (FER) tasks. First, we learn the emotion and identity features separately using two different CNNs with their corresponding training data. Second, we concatenate these two features together as a deep-learned Tandem Facial Expression (TFE) Feature and feed it to the subsequent fully connected layers to form a new model. Finally, we perform joint learning on the newly merged network using only the facial expression training data. Experimental results show that our proposed approach achieves 99.31 and 84.29 percent accuracy on the CK+ and the FER+ database, respectively, which outperforms the residual network baseline as well as many other state-of-the-art methods.

Overview

Integrity signals

Registry

Crossref · 10.1109/taffc.2018.2880201

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 46 references

Research works printed but not linked: 1

  1. torre, 2015, Intraface, Proc IEEE Int Conf Workshops Autom Face Gesture Recognit, 1

Cited by

See all 130

Metadata

Authors
Li, M., Xu, H., Huang, X., Song, Z., Liu, X., & Li, X.
Affiliations
  • Duke Kunshan University (CN)
  • Sun Yat-sen University (CN)
  • Shandong Yingcai University (CN)
Venue
IEEE Transactions on Affective Computing
Published
2021-04-01
Volume
12
Issue
2
Pages
544-550
ISSN
  • 1949-3045 (ISSN-L)
  • 2371-9850
OpenAlex
W2900164843
Cited by
128
References
47
Citations by year
2026: 7 · 2025: 12 · 2024: 25 · 2023: 25 · 2022: 26 · 2021: 18
FWCI
10.81
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Affective Computing (publishedVersion)
Funders
  • National Natural Science Foundation of China (61773413)
  • Natural Science Foundation of Guangzhou City (201707010363)
  • Guangzhou Municipal Science and Technology Project
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
Keywords
facial expression recognition, emotion recognition, joint learning, interindividual variability, facial shape, facial appearance, deep convolutional neural networks, CK+ database

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Facial Expression Recognition with Identity and Emotion Joint Learning. https://app.cochat.ai/papers/10.1109/taffc.2018.2880201
The paper
Li, M., Xu, H., Huang, X., Song, Z., Liu, X., & Li, X. (2021). Facial Expression Recognition with Identity and Emotion Joint Learning. IEEE Transactions on Affective Computing. https://doi.org/10.1109/taffc.2018.2880201

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.