Compound facial expressions of emotion
Open accessAbstract
Significance: Though people regularly recognize many distinct emotions, for the most part, research studies have been limited to six basic categories—happiness, surprise, sadness, anger, fear, and disgust; the reason for this is grounded in the assumption that only these six categories are differentially represented by our cognitive and social systems. The results reported herein propound otherwise, suggesting that a larger number of categories is used by humans.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The face signals more than 20 different categories of emotion via contraction or relaxation of muscles.
“signaling more than 20 different categories of emotion via the contraction or relaxation of muscles 1”
From The evolutionary history of the human face (2019) · cites this paper as [1]
Cites
The Nature of Statistical Learning Theory
Vapnik, V. (2000) · Statistics for Engineering and Information Science · doi:10.1007/978-1-4757-3264-1 · Cited by 46,387 · see citing works
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138 · see citing works
The expression of the emotions in man and animals.
Darwin, C. D. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 12,120 · see citing works
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646 · see citing works
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · see citing works
Spline Models for Observational Data.
Müller, H., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,992 · see citing works
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345 · see citing works
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184 · see citing works
The brain basis of emotion: a meta-analytic review
Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012) · Behavioral and Brain Sciences · doi:10.1017/s0140525x11000446 · Cited by 2,320 · cited 1× · see citing works
“We could have used other terms, such as “component” or “cardinal” emotions, but we prefer basic because this terminology is already prevalent in the literature (10); this is not to mean that these categories are more basic than others, because this is an area of intense debate (11).”
MethodMartı́nez, A. M. (1998) · Medical Entomology and Zoology · Cited by 1,982 · see citing works
Pessoa, L., & Adolphs, R. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2920 · Cited by 1,794 · see citing works
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · see citing works
The Expression of the Emotions in Man and Animals
Darwin, C. R., & Lorenz, K. Z. (1965) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226220802.001.0001 · Cited by 1,271 · see citing works
Ebner, N. C., Riediger, M., & Lindenberger, U. (2010) · Behavior Research Methods · doi:10.3758/brm.42.1.351 · Cited by 1,262 · see citing works
Two-dimensional spectral analysis of cortical receptive field profiles
Daugman, J. G. (1980) · Vision Research · doi:10.1016/0042-6989(80)90065-6 · Cited by 1,209 · see citing works
XM2VTSDB: The Extended M2VTS Database
Messer, K., Matas, J., Kittler, J., Luettin, J., & Maître, G. (1999) · Cited by 1,158 · see citing works
Emotion Theory and Research: Highlights, Unanswered Questions, and Emerging Issues
Izard, C. E. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163539 · Cited by 1,100 · see citing works
Automatic classification of single facial images
Lyons, M. J., Budynek, J., & Akamatsu, S. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.817413 · Cited by 1,075 · see citing works
THE STATISTICAL UTILIZATION OF MULTIPLE MEASUREMENTS
Fisher, R. A. (1938) · Annals of Eugenics · doi:10.1111/j.1469-1809.1938.tb02189.x · Cited by 855 · see citing works
Martı́nez, A. M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1008382 · Cited by 816 · see citing works
The social brain in psychiatric and neurological disorders
Kennedy, D. P., & Adolphs, R. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.09.006 · Cited by 798 · see citing works
Multicategory Support Vector Machines
Lee, Y., Lin, Y., & Wahba, G. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000098 · Cited by 753 · see citing works
Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About
Sinha, P., Balas, B., Ostrovsky, Y., & Russell, R. (2006) · Proceedings of the IEEE · doi:10.1109/jproc.2006.884093 · Cited by 674 · see citing works
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.297 · Cited by 632 · see citing works
Categorical perception of facial expressions.
Etcoff, N., & Magee, J. J. (1992) · Cognition · doi:10.1016/0010-0277(92)90002-y · Cited by 587 · see citing works
(2012) · Springer eBooks · doi:10.1007/springerreference_302560 · Cited by 580 · see citing works
Looking at people: sensing for ubiquitous and wearable computing
Pentland, A. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824823 · Cited by 403 · see citing works
Long-lasting modulation of feature integrationby transcranial magnetic stimulation
Scharnowski, F., Ruter, J., Jolij, J., Hermens, F., Kammer, T., & Herzog, M. H. (2009) · Journal of Vision · doi:10.1167/9.6.1 · Cited by 305 · see citing works
Hamm, J., Kohler, C., Gur, R., & Verma, R. (2011) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2011.06.023 · Cited by 296 · see citing works
Differences in facial expressions of four universal emotions
Kohler, C. G., Turner, T. H., Stolar, N., Bilker, W. B., Brensinger, C. M., Gur, R. E., & Gur, R. C. (2004) · Psychiatry Research · doi:10.1016/j.psychres.2004.07.003 · Cited by 276 · see citing works
(2009) · Encyclopedia of Biometrics · doi:10.1007/978-0-387-73003-5_2171 · Cited by 265 · see citing works
Support Vector Machines and the Bayes Rule in Classification
Lin, Y. (2002) · Data Mining and Knowledge Discovery · doi:10.1023/a:1015469627679 · Cited by 229 · see citing works
Toward a Neural Basis for Social Behavior
Stanley, D. A., & Adolphs, R. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.038 · Cited by 213 · see citing works
A video database of moving faces and people
O’Toole, A. J., Ha, J., Snow, S. L., Hurst, D. R., Pappas, M., Ayyad, J., & Abdi, H. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.90 · Cited by 212 · see citing works
Martı́nez, A. M., & Du, S. (2017) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-57021-1_6 · Cited by 173 · see citing works
Self-citationde la Torre, F. N., & Cohn, J. F. (2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0_19 · Cited by 136 · see citing works
Where are linear feature extraction methods applicable?
Martı́nez, A. M., & Zhu, M. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.250 · Cited by 128 · see citing works
Ding, L., & Martı́nez, A. M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.28 · Cited by 125 · see citing works
Kernel Optimization in Discriminant Analysis
You, D., Hamsici, O. C., & Martı́nez, A. M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.173 · Cited by 96 · see citing works
The resolution of facial expressions of emotion
Du, S., & Martı́nez, A. M. (2011) · Journal of Vision · doi:10.1167/11.13.24 · Cited by 83 · see citing works
Self-citationAction unit detection with segment-based SVMs
Simon, T., Nguyen, M. H., la Torre, F. D., & Cohn, J. F. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539998 · Cited by 82 · see citing works
Emotion perception in emotionless face images suggests a norm-based representation
Neth, D., & Martı́nez, A. M. (2009) · Journal of Vision · doi:10.1167/9.1.5 · Cited by 78 · see citing works
Greater sadness reactivity in late life
Seider, B. H., Shiota, M. N., Whalen, P. K., & LEVENSON, R. W. (2010) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq069 · Cited by 77 · see citing works
Matching expression variant faces
Martı́nez, A. M. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00079-8 · Cited by 61 · see citing works
Learning deformable shape manifolds
Rivera, S., & Martı́nez, A. M. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.09.023 · Cited by 27 · see citing works
Visually guided pointing movements are driven by the salience map
Zehetleitner, M., Hegenloh, M., & Müller, H. J. (2011) · Journal of Vision · doi:10.1167/11.1.24 · Cited by 27 · see citing works
Active Appearance Models with Rotation Invariant Kernels
Hamsici, O. C., & Martı́nez, A. M. (2009) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459365 · Cited by 18 · see citing works
Salient and non-salient fiducial detection using a probabilistic graphical model
Benitez-Quiroz, C. F., Rivera, S., Gotardo, P. F. U., et al. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.06.013 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Scheuerman, M. K., Wade, K., Lustig, C., & Brubaker, J. R. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392866 · Cited by 193 · see citing works
Facial Expression Recognition: A Survey
Huang, Y., Chen, F., Lv, S., & Wang, X. (2019) · Symmetry · doi:10.3390/sym11101189 · Cited by 195 · see citing works
Cascade EF-GAN: Progressive Facial Expression Editing With Local Focuses
Wu, R., Zhang, G., Lu, S., & Chen, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00507 · Cited by 121 · see citing works
The evolutionary history of the human face
Lacruz, R. S., Stringer, C. B., Kimbel, W. H., Wood, B., Harvati, K., O’Higgins, P., Bromage, T. G., & Arsuaga, J.-L. (2019) · Nature Ecology & Evolution · doi:10.1038/s41559-019-0865-7 · Cited by 108 · see citing works
Srinivasan, R., & Martinez, A. M. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2887267 · Cited by 94 · see citing works
Le Mau, T., Hoemann, K., Lyons, S. H., Fugate, J. M. B., Brown, E. N., Gendron, M., & Barrett, L. F. (2021) · Nature Communications · doi:10.1038/s41467-021-25352-6 · Cited by 74 · see citing works
Rapid Stress System Drives Chemical Transfer of Fear from Sender to Receiver
de Groot, J. H. B., Smeets, M. A. M., & Semin, G. R. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118211 · Cited by 50 · see citing works
Chen, C., Hensel, L. B., Duan, Y., Ince, R. A. A., Garrod, O. G. B., Beskow, J., Jack, R. E., & Schyns, P. G. (2019) · 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019) · doi:10.1109/fg.2019.8756570 · Cited by 41 · see citing works
Song, X., Zhang, Y., Lu, Z., Xu, L., & Shen, H. (2026) · Computers & Education · doi:10.1016/j.compedu.2026.105578 · Cited by 12 · see citing works
Exploring the Rhetoric of the Emotionally (Un) Intelligent CEO in Times of Crisis
Haag, C., & Wolff, M. (2024) · Research on Emotion in Organizations · doi:10.1108/s1746-979120240000019007 · Cited by 2 · see citing works
- Authors
- Du, S., Tao, Y., & Martinez, A. M.
- Affiliations
- The Ohio State University (US)
- Department of Electrical and Computer Engineering, and Center for Cognitive and Brain Sciences, The Ohio State University, Columbus, OH 43210
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2014-03-31
- Volume
- 111
- Issue
- 15
- Pages
- E1454-62
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC3992629
- OpenAlex
- W1980331490
- Semantic Scholar
- 45deb9d034e5c99de0e36e4c2a9a4f4277d1497f
- Cited by
- 806
- References
- 48
- Citations by year
- 2026: 27 · 2025: 70 · 2024: 86 · 2023: 94 · 2022: 87 · 2021: 87 · 2020: 85 · 2019: 77 · 2018: 58 · 2017: 49 · 2016: 38 · 2015: 36 · 2014: 10 · 2013: 2
- FWCI
- 24.72
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Eye Institute (R01EY020834)
- National Institute on Deafness and Other Communication Disorders (R21DC011081)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- emotional facial expressions, mixed emotions, emotion categories, basic emotions, facial action units, facial expression recognition, face perception, happiness, surprise, anger, sadness, fear, disgust
- MeSH terms
- Adult, Discrimination, Psychological, Emotions, Facial Expression, Facial Muscles, Female, Humans, Male, Models, Biological, Ohio, Photography
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review