Automated facial coding software outperforms people in recognizing neutral faces as neutral from standardized datasets
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Little is known about people's accuracy of recognizing neutral faces as neutral. In this paper, I demonstrate the importance of knowing how well people recognize neutral faces. I contrasted human recognition scores of 100 typical, neutral front-up facial images with scores of an arguably objective judge - automated facial coding (AFC) software. I hypothesized that the software would outperform humans in recognizing neutral faces because of the inherently objective nature of computer algorithms. Results confirmed this hypothesis. I provided the first-ever evidence that computer software (90%) was more accurate in recognizing neutral faces than people were (59%). I posited two theoretical mechanisms, i.e., smile-as-a-baseline and false recognition of emotion, as possible explanations for my findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · cited 3×
“Also worth pointing out is that both AFC software and human raters had only a limited number of categories to choose from – both datasets used the so-called forced-choice method (see Russell, 1994 for criticism).”
InfluentialThe Karolinska Directed Emotional Faces: A validation study
Goeleven, E., De Raedt, R., Leyman, L., & Verschuere, B. (2008) · Cognition & Emotion · doi:10.1080/02699930701626582 · Cited by 793 · cited 1×
“I used all available images of neutral faces in both Karolinska Directed Emotional Faces (KDEF; Goeleven et al., 2008) and Warsaw Set of Emotional Facial Expression Pictures (WSEFEP; Olszanowski et al., 2015) datasets.”
MethodMoving faces, looking places: Validation of the Amsterdam Dynamic Facial Expression Set (ADFES).
van der Schalk, J., Hawk, S. T., Fischer, A. H., & Doosje, B. (2011) · Emotion · doi:10.1037/a0023853 · Cited by 521
Self–focused attention and emotional reactivity: The role of culture
Chentsova-Dutton, Y. E., & Tsai, J. L. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0018534 · Cited by 185 · cited 1×
“…have used FaceReader in a multitude of contexts such as, but not limited to: human–computer interaction (Goldberg, 2014); social psychology (Chentsova-Dutton and Tsai, 2010); consumer science (Chan et al., 2014); advertising (Lewinski et al., 2014b); and multimedia research (Romero-Hall…”
Background
Cited by
Understanding customer experience throughout the customer journey
Lemon, K. N., & Verhoef, P. C. (2016) · Journal of Marketing · doi:10.1509/jm.15.0420 · Cited by 5,765
Automated Text Analysis for Consumer Research
Humphreys, A., & Wang, R. J.-H. (2018) · Journal of Consumer Research · doi:10.1093/jcr/ucx104 · Cited by 636
Synchrony in Psychotherapy: A Review and an Integrative Framework for the Therapeutic Alliance
Koole, S. L., & Tschacher, W. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00862 · Cited by 456
“In future years, comparable software will likely become available for the coding of non-verbal affect (e.g., Huis in ‘t Veld et al., 2014; Lewinski, 2015) and vocalizations (e.g., Lee et al., 2014), modalities that currently still rely on manual coding.”
Method
Metadata
- Authors
- Lewinski, P.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2015-09-11
- Volume
- 6
- Pages
- 1386-1386
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W1789579346
- Cited by
- 81
- References
- 5
- FWCI
- 4.24
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.