The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Mapping the emotional face. How individual face parts contribute to successful emotion recognition
Open accessAbstract
Which facial features allow human observers to successfully recognize expressions of emotion? While the eyes and mouth have been frequently shown to be of high importance, research on facial action units has made more precise predictions about the areas involved in displaying each emotion. The present research investigated on a fine-grained level, which physical features are most relied on when decoding facial expressions. In the experiment, individual faces expressing the basic emotions according to Ekman were hidden behind a mask of 48 tiles, which was sequentially uncovered. Participants were instructed to stop the sequence as soon as they recognized the facial expression and assign it the correct label. For each part of the face, its contribution to successful recognition was computed, allowing to visualize the importance of different face areas for each expression. Overall, observers were mostly relying on the eye and mouth regions when successfully recognizing an emotion. Furthermore, the difference in the importance of eyes and mouth allowed to group the expressions in a continuous space, ranging from sadness and fear (reliance on the eyes) to disgust and happiness (mouth). The face parts with highest diagnostic value for expression identification were typically located in areas corresponding to action units from the facial action coding system. A similarity analysis of the usefulness of different face parts for expression recognition demonstrated that faces cluster according to the emotion they express, rather than by low-level physical features. Also, expressions relying more on the eyes or mouth region were in close proximity in the constructed similarity space. These analyses help to better understand how human observers process expressions of emotion, by delineating the mapping from facial features to psychological representation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113
Sontrop, J. M., Dixon, S. N., Garg, A. X., Buendia-Jimenez, I., Dohein, O., Huang, S.-H. S., & Clark, W. F. (2013) · American Journal of Nephrology · doi:10.1159/000350377 · Cited by 5,871
The distributed human neural system for face perception
Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01482-0 · Cited by 4,891
Baron‐Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00715 · Cited by 4,555
Baron‐Cohen, S., Wheelwright, S. J., Hill, J., Raste, Y., & Plumb, I. (2001) · PubMed · Cited by 4,313
Understanding face recognition
Bruce, V., & Young, A. (1986) · British Journal of Psychology · doi:10.1111/j.2044-8295.1986.tb02199.x · Cited by 3,912
The NimStim set of facial expressions: Judgments from untrained research participants.
Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., Marcus, D. J., Westerlund, A., Casey, B., & Nelson, C. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.05.006 · Cited by 3,454
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
POSNER, J., RUSSELL, J. A., & PETERSON, B. S. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050340 · Cited by 2,602
Ekman, P. (1992) · Psychological Review · doi:10.1037//0033-295x.99.3.550 · Cited by 2,372
Confidence intervals rather than P values: estimation rather than hypothesis testing.
Gardner, M. J., & Altman, D. G. (1986) · BMJ · doi:10.1136/bmj.292.6522.746 · Cited by 2,010
Gaze fixation and the neural circuitry of face processing in autism
Dalton, K. M., Nacewicz, B. M., Johnstone, T., Schaefer, H. S., Gernsbacher, M. A., Goldsmith, H. H., Alexander, A. L., & Davidson, R. J. (2005) · Nature Neuroscience · doi:10.1038/nn1421 · Cited by 1,543
Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey
Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K., & Bandettini, P. A. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.043 · Cited by 1,344
A mechanism for impaired fear recognition after amygdala damage
Adolphs, R., Gosselin, F., Buchanan, T. W., Tranel, D., Schyns, P., & Damasio, A. R. (2005) · Nature · doi:10.1038/nature03086 · Cited by 1,331
Theory-Testing in Psychology and Physics: A Methodological Paradox
Meehl, P. E. (1967) · Philosophy of Science · doi:10.1086/288135 · Cited by 962
Baron-Cohen, S., Wheelwright, S., & Jolliffe, A. T. (1997) · Visual Cognition · doi:10.1080/713756761 · Cited by 928
Representational geometry: integrating cognition, computation, and the brain
Kriegeskorte, N., & Kievit, R. A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.06.007 · Cited by 911
Compound facial expressions of emotion
Du, S., Tao, Y., & Martinez, A. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1322355111 · Cited by 806
Transmitting and Decoding Facial Expressions
Smith, M. L., Cottrell, G. W., Gosselin, F., & Schyns, P. G. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.00801.x · Cited by 725
Bubbles: a technique to reveal the use of information in recognition tasks
Gosselin, F., & Schyns, P. G. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00097-9 · Cited by 713
Show Me the Features! Understanding Recognition From the Use of Visual Information
Schyns, P. G., Bonnar, L., & Gosselin, F. (2002) · Psychological Science · doi:10.1111/1467-9280.00472 · Cited by 480
Circumplex models of personality and emotions.
(1997) · American Psychological Association eBooks · doi:10.1037/10261-000 · Cited by 461
The Human Face as a Dynamic Tool for Social Communication
Jack, R. E., & Schyns, P. G. (2015) · Current Biology · doi:10.1016/j.cub.2015.05.052 · Cited by 405
Positive facial expressions are recognized faster than negative facial expressions, but why?
Lepp�nen, J. M., & Hietanen, J. K. (2004) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-003-0157-2 · Cited by 373
Representation is representation of similarities
Edelman, S. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98001253 · Cited by 362
Photographs of facial expression: Accuracy, response times, and ratings of intensity
Palermo, R., & Coltheart, M. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206544 · Cited by 280
Toward direct visualization of the internal shape representation space by fMRI
Edelman, S., Grill-Spector, K., Kushnir, T., & Malach, R. (1998) · Psychobiology · doi:10.3758/bf03330618 · Cited by 168
Holistic Gaze Strategy to Categorize Facial Expression of Varying Intensities
Guo, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042585 · Cited by 104
Kontsevich, L. L., & Tyler, C. W. (2004) · Vision Research · doi:10.1016/j.visres.2003.11.027 · Cited by 100
Investigating the brain basis of facial expression perception using multi-voxel pattern analysis
Wegrzyn, M., Riehle, M., Labudda, K., Woermann, F. G., Baumgartner, F., Pollmann, S., Bien, C. G., & Kissler, J. M. (2015) · Cortex · doi:10.1016/j.cortex.2015.05.003 · Cited by 91
Self-citationMatsumoto, D., & Ekman, P. (2008) · Scholarpedia · doi:10.4249/scholarpedia.4237 · Cited by 85
What emotion does the “facial expression of disgust” express?
Pochedly, J. T., Widen, S. C., & Russell, J. A. (2012) · Emotion · doi:10.1037/a0027998 · Cited by 78
Facilitating fashion camouflage art
Feng, R., & Prabhakaran, B. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502121 · Cited by 38
Cited by
Wearing Face Masks Strongly Confuses Counterparts in Reading Emotions
Carbon, C.-C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.566886 · Cited by 443
Facial expression analysis with AFFDEX and FACET: A validation study
Stöckli, S., Schulte-Mecklenbeck, M., Borer, S., & Samson, A. C. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0996-1 · Cited by 294
EMA at SemEval-2018 Task 1: Emotion Mining for Arabic
Badaro, G., El Jundi, O., Khaddaj, A., Maarouf, A., Kain, R., Hajj, H., & El-Hajj, W. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1036 · Cited by 60
Metadata
- Authors
- Wegrzyn, M., Vogt, M., Kireclioglu, B., Schneider, J., & Kissler, J.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-05-11
- Volume
- 12
- Issue
- 5
- Pages
- e0177239
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2612990169
- Cited by
- 340
- References
- 39
- FWCI
- 11.02
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.