Cited by 74Emotion and Mood RecognitionFace recognition and analysisFace and Expression Recognition

Facial expression recognition in the wild based on multimodal texture features

Open access
Sun, Bo, Li, Liandong, Zhou, Guoyan, He, Jun·2016·Journal of Electronic Imaging

Abstract

Facial expression recognition in the wild is a very challenging task. We describe our work in static and continuous facial expression recognition in the wild. We evaluate the recognition results of gray deep features and color deep features, and explore the fusion of multimodal texture features. For the continuous facial expression recognition, we design two temporal–spatial dense scale-invariant feature transform (SIFT) features and combine multimodal features to recognize expression from image sequences. For the static facial expression recognition based on video frames, we extract dense SIFT and some deep convolutional neural network (CNN) features, including our proposed CNN architecture. We train linear support vector machine and partial least squares classifiers for those kinds of features on the static facial expression in the wild (SFEW) and acted facial expression in the wild (AFEW) dataset, and we propose a fusion network to combine all the extracted features at decision level. The final achievement we gained is 56.32% on the SFEW testing set and 50.67% on the AFEW validation set, which are much better than the baseline recognition rates of 35.96% and 36.08%.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1117/1.jei.25.6.061407

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Researchers report improvements in accuracy by applying intensity normalization (e.g., from 54% to 57% in [94]).

    “Researchers report improvements in accuracy by applying intensity normalization (e.g., from 54% to 57% in [94]; see also [98]).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 41 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Sun, B., Li, L., Zhou, G., & He, J.
Affiliations
Beijing Normal University (CN)
Venue
Journal of Electronic Imaging
Published
2016-06-22
Volume
25
Issue
06
Pages
1-8
ISSN
  • 1017-9909 (ISSN-L)
  • 1560-229X
OpenAlex
W2474193198
Cited by
74
References
41
Citations by year
2026: 1 · 2025: 2 · 2024: 6 · 2023: 6 · 2022: 7 · 2021: 11 · 2020: 14 · 2019: 12 · 2018: 3 · 2017: 10 · 2016: 2
FWCI
12.81
Type
journal article
Language
en
Open access
Locations
Journal of Electronic Imaging (publishedVersion, cc-by)
Funders
  • National Natural Science Foundation of China (61501035)
  • Natural Science Foundation of China (61501035, KJZXCJ2016042)
  • Fundamental Research Funds for the Central Universities (2014KJJCA15)
  • Central Universities of China (2014KJJCA15)
  • Fundamental Research Funds for the Central Universities of China (2014KJJCA15)
  • Ministry of Education (DCA140229)
  • National Education Science Twelfth Five-Year Plan Key Issues of the Ministry of Education (DCA140229)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
Keywords
facial expression recognition, in-the-wild, multimodal fusion, texture features, dense SIFT, spatio-temporal features, deep convolutional neural network features, decision fusion

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review