Cited by 44Emotion and Mood RecognitionFace recognition and analysisFace and Expression Recognition

Estimating smile intensity: A better way

Open access
Girard, Jeffrey M., Cohn, Jeffrey F., De la Torre, Fernando·2015·Pattern Recognition Letters

Published version of a preprint

Abstract

Both the occurrence and intensity of facial expressions are critical to what the face reveals. While much progress has been made towards the automatic detection of facial expression occurrence, controversy exists about how to estimate expression intensity. The most straight-forward approach is to train multiclass or regression models using intensity ground truth. However, collecting intensity ground truth is even more time consuming and expensive than collecting binary ground truth. As a shortcut, some researchers have proposed using the decision values of binary-trained maximum margin classifiers as a proxy for expression intensity. We provide empirical evidence that this heuristic is flawed in practice as well as in theory. Unfortunately, there are no shortcuts when it comes to estimating smile intensity: researchers must take the time to collect and train on intensity ground truth. However, if they do so, high reliability with expert human coders can be achieved. Intensity-trained multiclass and regression models outperformed binary-trained classifier decision values on smile intensity estimation across multiple databases and methods for feature extraction and dimensionality reduction. Multiclass models even outperformed binary-trained classifiers on smile occurrence detection.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.patrec.2014.10.004

Cites

97 of 97 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Cohn JF Ekman P Harrigan JA Rosenthal R Scherer KR Measuring facial action by manual coding, facial EMG, automatic facial image analysis The new handbook of nonverbal behavior research 2005 New York NY Oxford University Press 9 64
  2. Tipping M Sparse Bayesian learning and the relevance vector machine Journal of Machine Learning Research 2001 1 211 244

Cited by

Sorted by citations

Authors
Girard, J. M., Cohn, J. F., & De la Torre, F.
Affiliations
University of Pittsburgh (US)
Corresponding author
Girard, Jeffrey M.
Venue
Pattern Recognition Letters
Publisher
Elsevier BV
Published
2015-11
Volume
66
Pages
13-21
ISSN
0167-8655 (ISSN-L)
OpenAlex
W1994738089
Cited by
44
References
97
Citations by year
2025: 1 · 2024: 1 · 2022: 3 · 2021: 8 · 2020: 5 · 2019: 6 · 2018: 2 · 2017: 8 · 2016: 6 · 2015: 4
FWCI
8.35
Type
journal article
Language
en
Open access
Locations
  • Pattern Recognition Letters (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Science Foundation
  • National Institutes of Health
  • National Institute of Mental Health (R01MH096951)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
Keywords
facial expression intensity, maximum margin classifier, feature extraction, dimensionality reduction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review