The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Automated facial coding: Validation of basic emotions and FACS AUs in FaceReader.
Open accessAbstract
In this study, we validated automated facial coding (AFC) software—FaceReader (Noldus, 2014)—on 2 publicly available and objective datasets of human expressions of basic emotions. We present the matching scores (accuracy) for recognition of facial expressions and the Facial Action Coding System (FACS) index of agreement. In 2005, matching scores of 89% were reported for FaceReader. However, previous research used a version of FaceReader that implemented older algorithms (version 1.0) and did not contain FACS classifiers. In this study, we tested the newest version (6.0). FaceReader recognized 88% of the target emotional labels in the Warsaw Set of Emotional Facial Expression Pictures (WSEFEP) and Amsterdam Dynamic Facial Expression Set (ADFES). The software reached a FACS index of agreement of 0.67 on average in both datasets. The results of this validation test are meaningful only in relation to human performance rates for both basic emotion recognition and FACS coding. The human emotions recognition for the 2 datasets was 85%, therefore FaceReader is as good at recognizing emotions as humans. To receive FACS certification, a human coder must reach an agreement of 0.70 with the master coding of the final test. Even though FaceReader did not attain this score, action units (AUs) 1, 2, 4, 5, 6, 9, 12, 15, and 25 might be used with high accuracy. We believe that FaceReader has proven to be a reliable indicator of basic emotions in the past decade and has a potential to become similarly robust with FACS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334
Pan-cultural elements in facial displays of emotion
Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969) · Science · doi:10.1126/science.164.3875.86 · Cited by 1,775
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · cited 3×
“Such results for humans do not come as a surprise, as in the meta-analysis of recognition studies of facial expressions in humans, Russell (1994) and Nelson and Russell (2013) never reported accuracy higher than 90% and often as low as 60-80%.”
What is Meant by Calling Emotions Basic
Ekman, P., & Cordaro, D. (2011) · Emotion Review · doi:10.1177/1754073911410740 · Cited by 1,340
Building high-level features using large scale unsupervised learning
Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., Le, Q. V., & Ng, A. Y. (2012) · International Conference on Machine Learning · Cited by 822
Moving faces, looking places: Validation of the Amsterdam Dynamic Facial Expression Set (ADFES).
van der Schalk, J., Hawk, S. T., Fischer, A. H., & Doosje, B. (2011) · Emotion · doi:10.1037/a0023853 · Cited by 521
Meta-Analysis of the First Facial Expression Recognition Challenge
Valstar, M. F., Mehu, M., Jiang, B., Pantic, M., & Scherer, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2200675 · Cited by 297
Nelson, N. L., & Russell, J. A. (2013) · Emotion Review · doi:10.1177/1754073912457227 · Cited by 209
Cited by
Facial expression analysis with AFFDEX and FACET: A validation study
Stöckli, S., Schulte-Mecklenbeck, M., Borer, S., & Samson, A. C. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0996-1 · Cited by 294
Emotional contagion in organizational life
Barsade, S. G., Coutifaris, C. G. V., & Pillemer, J. (2018) · Research in Organizational Behavior · doi:10.1016/j.riob.2018.11.005 · Cited by 264
Metadata
- Authors
- Lewinski, P., den Uyl, T. M., & Butler, C.
- Venue
- Journal of Neuroscience, Psychology, and Economics
- Published
- 2014-12
- Volume
- 7
- Issue
- 4
- Pages
- 227-236
- ISSN
- 1937-321X (ISSN-L)
- 2151-318X
- OpenAlex
- W2001315093
- Cited by
- 393
- References
- 25
- FWCI
- 17.74
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automated facial coding: Validation of basic emotions and FACS AUs in FaceReader. https://app.cochat.ai/papers/10.1037/npe0000028
- The paper
- Lewinski, P., den Uyl, T. M., & Butler, C. (2014). Automated facial coding: Validation of basic emotions and FACS AUs in FaceReader. Journal of Neuroscience, Psychology, and Economics. https://doi.org/10.1037/npe0000028
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.