Facial expressions of emotions: a methodological contribution to the study of spontaneous and dynamic emotional faces
Abstract
This paper addresses methodological considerations relevant to nonverbal communication of emotion research. In order to gather more information about the interpretations given to spontaneous and dynamic facial expressions, two main objectives guide the present exploratory research. The first one is to obtain naturalistic recordings of emotional expressions in realistic settings that are ‘emotional enough’. The second one is to address the issue of dynamic judgments of facial expressions of emotion, that is real‐time emotional recognition. An innovative device has been created for this specific purpose. Results show that, although the social nature of the eliciting situation is minimal, the experience of some emotions is reflected on the encoders' faces while being covertly videotaped in natural conditions. Moreover, results show the utility to investigate dynamic emotional judgments of spontaneous and dynamic expressions since observers seem to be sensitive to the slightest facial expression change in making their emotional judgments. A promising paradigm is thus proposed for the study of the dynamics of real‐time nonverbal emotional interaction. Copyright © 2007 John Wiley & Sons, Ltd.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In several studies, subjects had to score expression pictures in terms of action tendencies, in which they obtained action readiness ratings that were about as consistent among raters as were their emotion label assignments.
“In several studies, subjects had to score expression pictures in terms of action tendencies, in which they obtained action readiness ratings that were about as consistent among raters as were their emotion label assignments (Tcherkassof et al., 2007).”
From Impulsive action: emotional impulses and their control (2014) · cites this paper as Tcherkassof et al., 2007
Cites
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · see citing works
Facial motion in the perception of faces and of emotional expression.
Bassili, J. N. (1978) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.4.3.373 · Cited by 369 · see citing works
Facial expressions as modes of action readiness
Frijda, N. H., & Tcherkassof, A. (1997) · The Psychology of Facial Expression · doi:10.1017/cbo9780511659911.006 · Cited by 175 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Livingstone, S. R., & Russo, F. (2018) · PLoS ONE · doi:10.1371/journal.pone.0196391 · Cited by 1,955 · see citing works
Effects of Dynamic Aspects of Facial Expressions: A Review
Krumhuber, E. G., Kappas, A., & Manstead, A. (2013) · Emotion Review · doi:10.1177/1754073912451349 · Cited by 436 · see citing works
Scherer, K. R., Clark‐Polner, E., & Mortillaro, M. (2011) · International Journal of Psychology · doi:10.1080/00207594.2011.626049 · Cited by 282 · see citing works
“However, these procedures often produce only relatively weak affect (eg, Laukka, Neiberg, Forsell, Karlsson, & Elenius, 2011 ; Tcherkassof, Bollon, Dubois, Pansu, & Adam, 2007 ).”
Kaulard, K., Cunningham, D., Bülthoff, H., & Wallraven, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032321 · Cited by 168 · see citing works
Impulsive action: emotional impulses and their control
Frijda, N. H., Ridderinkhof, K. R., & Rietveld, E. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00518 · Cited by 79 · see citing works
“In several studies, subjects had to score expression pictures in terms of action tendencies, in which they obtained action readiness ratings that were about as consistent among raters as were their emotion label assignments (Tcherkassof et al., 2007).”
BackgroundA Review of Dynamic Datasets for Facial Expression Research
Krumhuber, E. G., Skora, L. I., Küster, D., & Fou, L. (2016) · Emotion Review · doi:10.1177/1754073916670022 · Cited by 96 · see citing works
McKeown, G. J., & Sneddon, I. (2013) · Psychological Methods · doi:10.1037/a0034282 · Cited by 62 · see citing works
“Tcherkassof et al. (2007), using a forced choice paradigm, have recorded judgments of the presence and duration of emotions while facial expressions are being viewed, and, more recently, Sneddon, McKeown, McRorie, and Vukicevic (2011) have described results based on a method that permits continuous…”
BackgroundMethodCherbonnier, A., & Michinov, N. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106689 · Cited by 45 · see citing works
DynEmo: A video database of natural facial expressions of emotions.
Tcherkassof, A., Dupré, D., Meillon, B., Mandran, N., Dubois, M., & Adam, J.-M. (2013) · The International journal of Multimedia & Its Applications · doi:10.5121/ijma.2013.5505 · Cited by 34 · see citing works
“125 EFEs recordings (Set 2) were continuously rated by observers (hereafter called decoders) using a computer-based tracing tool called Oudjat [23].”
BackgroundMethodInfluentialSelf-citationThe emotion–facial expression link: evidence from human and automatic expression recognition
Tcherkassof, A., & Dupré, D. (2020) · Psychological Research · doi:10.1007/s00426-020-01448-4 · Cited by 34 · see citing works
Self-citationThe Complex Emotion Expression Database: A validated stimulus set of trained actors
Benda, M. S., & Scherf, K. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0228248 · Cited by 28 · see citing works
“Chicago [28] threatening Some 18–40 yrs 158 Black, White CK + [29] contempt Not provided 18–50 yrs 210 Black, White, other Dartmouth [18] content No 6–16 yrs 80 White DuckEES [19] pride, embarrassment Yes 8–18 yrs 36 White, other DynEmo [30] amusement, interest, irritation, worry No “undergraduates” 43 Not provided”
BackgroundEmotional intelligence, personality and the decoding of non-verbal expressions of emotion
Edgar, C., McRorie, M., & Sneddon, I. (2012) · Personality and Individual Differences · doi:10.1016/j.paid.2011.10.024 · Cited by 24 · see citing works
What is missing in the study of emotion expression?
Straulino, E., Scarpazza, C., & Sartori, L. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1158136 · Cited by 22 · see citing works
“A related problem in the study of emotions expressions is that the majority of the literature have employed static facial stimuli (Tcherkassof et al., 2007; McLellan et al., 2010, 2012; Douglas et al., 2012; Li et al., 2012; Dawel et al., 2015).”
BackgroundGuérin-Dugué, A., Roy, R., Kristensen, E., Rivet, B., Vercueil, L., & Tcherkassof, A. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01190 · Cited by 20 · see citing works
Self-citationCulture Shapes the Distinctiveness of Posed and Spontaneous Facial Expressions of Anger and Disgust
Fang, X., Sauter, D. A., Heerdink, M. W., & Kleef, G. A. V. (2022) · Journal of Cross-Cultural Psychology · doi:10.1177/00220221221095208 · Cited by 21 · see citing works
“Empirical work based on Western samples has shown that posed expressions are more intense and prototypical than spontaneous expressions (Tcherkassof et al., 2007).”
BackgroundLutfi, S., Fernández-Martínez, F., Lucas-Cuesta, J. M., Lopez-Lebon, L., & Montero, J. M. (2013) · Speech Communication · doi:10.1016/j.specom.2013.04.005 · Cited by 18 · see citing works
“It has also been reported that perceived and actual states can be rather divergent (Tcherkassof et al., 2007), and the same goes for perceived and self-reported states (Truong et al.”
BackgroundSouto, T., da Silva, H., Leite, Â. M. T., Baptista, A., Queirós, C. M. L., & Marques, A. J. (2019) · Rehabilitation Counseling Bulletin · doi:10.1177/0034355219847284 · Cited by 18 · see citing works
How Pain-Related Facial Expressions Are Evaluated in Relation to Gender, Race, and Emotion
Dildine, T. C., Amir, C. M., Parsons, J., & Atlas, L. (2023) · Affective Science · doi:10.1007/s42761-023-00181-6 · Cited by 15 · see citing works
Oudjat: A configurable and usable annotation tool for the study of facial expressions of emotion
Dupré, D., Akpan, D., Elias, E., Adam, J.-M., Meillon, B., Bonnefond, N., Dubois, M., & Tcherkassof, A. (2015) · Int. J. Hum. Comput. Stud. · doi:10.1016/j.ijhcs.2015.05.010 · Cited by 15 · see citing works
“Oudjat was used according to this design by Tcherkassof et al. (2007) to assess short, dynamic, and spontaneous facial expressions with few emotional labels.”
MethodSelf-citationKang, K., Schneider, D., Schweinberger, S. R., & Mitchell, P. (2018) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsy061 · Cited by 12 · see citing works
Zinkernagel, A., Alexandrowicz, R., Lischetzke, T., & Schmitt, M. J. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1085-9 · Cited by 9 · see citing works
“…System Affect Interpretation Dictionary (FACSAID; Ekman & Hager, 2002), or the Affect Expression Identification System (AFFEX; Izard, Dougherty, & Hembree, 1983) have emphasized the rating of mostly static facial expressions (Cohn & Schmidt, 2004; Tcherkassof, Bollon, Dubois, Pansu, & Adam, 2007).”
BackgroundShort-term Time Structure of Food-related Emotions : Measuring Dynamics of Responses
Jager, G. (2016) · Elsevier eBooks · doi:10.1016/b978-0-08-100508-8.00011-4 · Cited by 9 · see citing works
DON'T DWELL ON IT: THE IMPACT OF RUMINATION ON EMOTIONAL SENSITIVITY
Johnston, L., Carter, J., & Mclellan, T. (2011) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2011.30.5.506 · Cited by 8 · see citing works
A Dynamic Disadvantage? Social Perceptions of Dynamic Morphed Emotions Differ from Videos and Photos
Becker, C., Conduit, R., Chouinard, P., & Laycock, R. (2024) · Journal of nonverbal behavior · doi:10.1007/s10919-023-00448-3 · Cited by 7 · see citing works
“…relied on static images of peak expressions (e.g., Blair et al., 1999 ), technological advancements have led researchers to challenge this approach (Tcherkassof et al., 2007; Wehrle et al., 2000 ), as people perceive static and dynamic faces differently (for reviews, see Alves, 2013 ; Krumhuber et…”
The 4D Space-Time Dimensions of Facial Perception
Burt, A. L., & Crewther, D. P. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01842 · Cited by 10 · see citing works
“Deformable modeling has made a further advancement in facial stimuli design, by digitizing naturalistic, spontaneous movements, rather than the synthesized, artificial movements produced in the past (Wehrle et al., 2000; Tcherkassof et al., 2007).”
BackgroundHaptic Expression and Perception of Spontaneous Stress
Gaffary, Y., Martin, J., & Ammi, M. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2830371 · Cited by 9 · see citing works
“The induction may also elicit blends of several emotions [29].”
BackgroundTcherkassof, A., Mandran, N., Dubois, M., & Bègue, L. (2011) · Psychologie Française · doi:10.1016/j.psfr.2011.06.002 · Cited by 6 · see citing works
Self-citationNamba, S., Makihara, S., Kabir, R. S., Miyatani, M., & Nakao, T. (2016) · Current Psychology · doi:10.1007/s12144-016-9448-9 · Cited by 89 · see citing works
Rodero, E., Larrea, O., & Mas, L. (2022) · El Profesional de la Informacion · doi:10.3145/epi.2022.jul.05 · Cited by 4 · see citing works
Emotional facial expression interface: effects of displayed facial designs
Dupré, D., Dubois, M., Mandran, N., & Tcherkassof, A. (2010) · Ergonomie Et Informatique Avancée · doi:10.1145/1868650.1868657 · Cited by 4 · see citing works
Self-citationPan, Z., Tan, H., Liu, S., & Fang, X. (2025) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2025.104836 · Cited by 3 · see citing works
How to Collect Haptic Expressions of Spontaneous Emotions? Methodological Considerations
Gaffary, Y., Jean-Claude, M., & Ammi, M. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.144 · Cited by 4 · see citing works
The influence of facial interface design on dynamic emotional recognition
Dubois, M., Dupré, D., Adam, J.-M., Tcherkassof, A., Mandran, N., & Meillon, B. (2013) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-012-0103-y · Cited by 3 · see citing works
“Therefore visual communications experiments need to be performed with spontaneous emotional facial expressions (EFEs) [18] in order to understand the influence of their temporal evolution and their authenticity [19,20], and [21].”
BackgroundMethodSelf-citationComputerized Facial Emotion Expression Recognition
Geiger, M., & Wilhelm, O. (2019) · Studies in Neuroscience, Psychology and Behavioral Economics · doi:10.1007/978-3-030-31620-4_3 · Cited by 3
The Role of Dynamics in Visual Adaptation to Emotional Facial Expressions
Korolkova, O. (2016) · The Russian Journal of Cognitive Science · doi:10.47010/15.4.3 · Cited by 3 · see citing works
“Вопрос о том, насколько отличается восприятие спонтанных и произвольных динамических экспрессий и не оцениваются ли последние как «вычурные», наигранные, неискренние, обсуждается достаточно широко (напр., Tcherkassof et al., 2007).”
Carvalho, R. C., Mendes, L., Teixeira, A., Oliveira, M., Sampaio, J., Travassos, B., Barroso, I., & Rodrigues, V. (2024) · International Conference on Software Development for Enhancing Accessibility and Fighting Info-exclusion · doi:10.1145/3696593.3696604 · Cited by 2 · see citing works
“…in an ecological setting may present challenges due to the greater variability and reduced intensity of facial expressions in natural settings [72], as well as the emotional messages conveyed through not only facial expressions but also eye gaze direction, head, shoulders, and body language [73].”
Sousa, D., Ferreira, A., Rodrigues, D., Pereira, H. C., Amaral, J., Crisóstomo, J., Simões, M., Ribeiro, M., Teixeira, M., & Castelo-Branco, M. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1295608 · Cited by 2 · see citing works
“…studies about emotion recognition were driven by static faces, that do not require the visual system to integrate naturalistic movement paths (Tcherkassof et al., 2007; Furl et al., 2010; Harms et al., 2010; Krumhuber et al., 2013; Recio et al., 2014; Monteiro et al., 2017; Simões et al.,…”
BackgroundSouto, T., Conde, A. R., Ferreira, M., Queirós, C., & Figueiredo, V. (2021) · Current Psychology · doi:10.1007/s12144-021-01533-w · Cited by 2 · see citing works
Dawood, A., Turner, S. J., & Perepa, P. (2019) · IEEE Access · doi:10.1109/access.2019.2921914 · Cited by 2 · see citing works
Development of an Interactive Digital Human with Context-Sensitive Facial Expressions
Yang, F., Fang, L., Suo, R., Zhang, J., & Whang, M. (2025) · Italian National Conference on Sensors · doi:10.3390/s25165117 · Cited by 1
“Tcherkassof et al. [30] further proposed recording spontaneous facial responses of subjects under specific contextual stimuli to enhance the naturalness of emotional expressions.”
Conveying Emotions Through CMC: A Comparative Study of Memoji, Emoji, and Human Face
Kim, E., Hong, Y.-S., & Han, K. (2023) · Korean Society for Emotion and Sensibility · doi:10.14695/kjsos.2023.26.4.93 · Cited by 1
“To minimize misunderstandings when using Memojis, it is crucial for designers to strive (Tcherkassof et al., 2007), which makes the static stimuli used in this study more difficult to identify the dynamic features of facial expressions.”
Methodvon Eiff, C. I., Kauk, J., & Schweinberger, S. R. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02249-4 · Cited by 1 · see citing works
A Systematic Review of 128 Spontaneous and Dynamic Facial Expression Databases
Bian, Y., Kim, H., & Krumhuber, E. G. (2026) · Emotion Review · doi:10.1177/17540739261478876
Assessing User Bias in Affect Detection within Context-Based Spoken Dialog Systems
Lutfi, S., Fernández-Martínez, F., Casanova-García, A., Lopez-Lebon, L., & Montero, J. M. (2012) · 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing · doi:10.1109/socialcom-passat.2012.112
“It has also been reported that perceived and actual states can be rather divergent [35].”
BackgroundNevo, S., & Kock, N. (2012) · Hawaii International Conference on System Sciences · doi:10.1109/hicss.2012.120
“expressions, are considered erefore, true rienced [67].”
BackgroundInfluentialShort-term time structure of food-related emotions
Jager, G. (2021) · Emotion Measurement · doi:10.1016/b978-0-12-821124-3.00013-2
- Authors
- Tcherkassof, A., Bollon, T., Dubois, M., Pansu, P., & Adam, J.
- Affiliations
- Université Pierre Mendès France (FR)
- Laboratoire de Psychologie Sociale (FR)
- Université Joseph Fourier (FR)
- Corresponding author
- Tcherkassof, Anna
- Venue
- European Journal of Social Psychology
- Publisher
- Wiley
- Published
- 2007-04-24
- Volume
- 37
- Issue
- 6
- Pages
- 1325-1345
- ISSN
- 0046-2772 (ISSN-L)
- 1099-0992
- OpenAlex
- W1993352391
- Cited by
- 62
- References
- 56
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 7 · 2023: 4 · 2022: 3 · 2021: 5 · 2020: 3 · 2019: 4 · 2018: 5 · 2016: 3 · 2015: 2 · 2014: 2 · 2013: 8 · 2012: 5
- FWCI
- 0.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- European Journal of Social Psychology (publishedVersion)
- HAL (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Social Sciences › Psychology › Social Psychology › Deception detection and forensic psychology
- Keywords
- emotional facial expressions, spontaneous facial expressions, dynamic facial expressions, emotional judgment, emotion induction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
