The DOI matches its Crossref record; 169 of the 169 references it cites were found in a registry or an index.
Affective Body Expression Perception and Recognition: A Survey
Open accessAbstract
Thanks to the decreasing cost of whole-body sensing technology and its increasing reliability, there is an increasing interest in, and understanding of, the role played by body expressions as a powerful affective communication channel. The aim of this survey is to review the literature on affective body expression perception and recognition. One issue is whether there are universal aspects to affect expression perception and recognition models or if they are affected by human factors such as culture. Next, we discuss the difference between form and movement information as studies have shown that they are governed by separate pathways in the brain. We also review psychological studies that have investigated bodily configurations to evaluate if specific features can be identified that contribute to the recognition of specific affective states. The survey then turns to automatic affect recognition systems using body expressions as at least one input modality. The survey ends by raising open questions on data collecting, labeling, modeling, and setting benchmarks for comparing automatic recognition systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002149 · Cited by 6,887
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 3×
“Russell [180] considers the prototypical expressions of emotions just a subset of the way we express emotions.”
InfluentialBarsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936 · cited 1×
“A typical example is offered by whole-body computer games (e.g., Nintendo Wii and Microsoft Kinect) where body movement is not only a means to control the interaction between us and the games, but also a way to capture and affect our own emotional and cognitive performances [16], [17], [18], [19].”
BackgroundHand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
Handbook of Affective Sciences
(2002) · doi:10.1093/oso/9780195126013.001.0001 · Cited by 5,073
Fear-avoidance and its consequences in chronic musculoskeletal pain: a state of the art.
Vlaeyen, J. W. S., & Linton, S. J. (2000) · Pain · doi:10.1016/s0304-3959(99)00242-0 · Cited by 4,931
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345
The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
EKMAN, P., & FRIESEN, W. V. (1969) · Semiotica · doi:10.1515/semi.1969.1.1.49 · Cited by 3,316
Comprehensive database for facial expression analysis
Kanade, T., Cohn, J. F., & Tian, Y. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840611 · Cited by 2,591
DePaulo, B. M., Lindsay, J. J., Malone, B. E., Muhlenbruck, L., Charlton, K., & Cooper, H. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.1.74 · Cited by 2,479
A measure of emotional empathy1
Mehrabian, A., & Epstein, N. (1972) · Journal of Personality · doi:10.1111/j.1467-6494.1972.tb00078.x · Cited by 2,360
On the universality and cultural specificity of emotion recognition: a meta-analysis
Elfenbein, H. A., & Ambady, N. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.2.203 · Cited by 2,049
Neural systems for recognizing emotion
Adolphs, R. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00301-x · Cited by 1,933
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893 · cited 1×
“There has been an increased pursuit of affective computing within the last few years in particular, as evidenced by recently published surveys in the field [104], [28], [35], [105].”
BackgroundNonverbal Leakage and Clues to Deception †
Ekman, P., & Friesen, W. V. (1969) · Psychiatry · doi:10.1080/00332747.1969.11023575 · Cited by 1,854
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778
(2008) · Cited by 1,657
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640
Embodiment in attitudes, social perception, and emotion
Niedenthal, P. M., Barsalou, L. W., Winkielman, P., Krauth-Gruber, S., & Ric, F. (2005) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0903_1 · Cited by 1,484
Communication of emotions in vocal expression and music performance: different channels, same code?
Juslin, P. N., & Laukka, P. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.5.770 · Cited by 1,273
A 3D Facial Expression Database For Facial Behavior Research
Yin, L., Wei, X., Sun, Y., Wang, J., & Rosato, M. J. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.6 · Cited by 1,171
Get another label? improving data quality and data mining using multiple, noisy labelers
Sheng, V. S., Provost, F., & Ipeirotis, P. G. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401965 · Cited by 1,165
Strong evidence for universals in facial expressions: A reply to Russell's mistaken critique.
Ekman, P. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.2.268 · Cited by 1,130
Web-Based Database for Facial Expression Analysis
Pantic, M., Valstar, M., Rademaker, R., & Maat, L. (2005) · 2005 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2005.1521424 · Cited by 1,039
Felt, false, and miserable smiles
Ekman, P., & Friesen, W. V. (1982) · Journal of Nonverbal Behavior · doi:10.1007/bf00987191 · Cited by 1,027
Neural mechanisms for the recognition of biological movements
Giese, M. A., & Poggio, T. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1057 · Cited by 955
Raykar, V. C., Yu, S., Zhao, L. H., Valadez, G. H., Florin, C., Bogoni, L., & Moy, L. P. (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859894 · Cited by 951
Handbook of Individual Differences, Learning, and Instruction
Jonassen, D. H., & Grabowski, B. L. (2012) · Routledge eBooks · doi:10.4324/9780203052860 · Cited by 934
Wallbott, H. G. (1998) · European Journal of Social Psychology · doi:10.1002/(sici)1099-0992(1998110)28:6<879::aid-ejsp901>3.0.co;2-w · Cited by 922
Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business
(2009) · Journal of Consumer Marketing · doi:10.1108/07363760910965918 · Cited by 882
Prototype-referenced shape encoding revealed by high-level aftereffects
Leopold, D. A., O'Toole, A. J., Vetter, T., & Blanz, V. (2001) · Nature Neuroscience · doi:10.1038/82947 · Cited by 875
Explaining Math: Gesturing Lightens the Load
Goldin-Meadow, S., Nusbaum, H., Kelly, S. D., & Wagner, S. (2001) · Psychological Science · doi:10.1111/1467-9280.00395 · Cited by 842
Towards the neurobiology of emotional body language
de Gelder, B. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1872 · Cited by 786
Detecting deception from the body or face.
Ekman, P., & Friesen, W. V. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0036006 · Cited by 730
Rapid perceptual integration of facial expression and emotional body language
Meeren, H. K. M., van Heijnsbergen, C. C. R. J., & de Gelder, B. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507650102 · Cited by 675
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., & Movellan, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.297 · Cited by 624
Perceiving affect from arm movement
Pollick, F. E., Paterson, H. M., Bruderlin, A., & Sanford, A. J. (2001) · Cognition · doi:10.1016/s0010-0277(01)00147-0 · Cited by 616
Coulson, M. (2004) · Journal of Nonverbal Behavior · doi:10.1023/b:jonb.0000023655.25550.be · Cited by 606
Automatic prediction of frustration
Kapoor, A., Burleson, W., & Picard, R. W. (2007) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2007.02.003 · Cited by 592
Keltner, D., Ekman, P., Gonzaga, & Beer, J. (2002) · Handbook of Affective Sciences · doi:10.1093/oso/9780195126013.003.0022 · Cited by 513
de Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0407042101 · Cited by 511
A principal component analysis of facial expressions
Calder, A. J., Burton, A. M., Miller, P., Young, A. W., & Akamatsu, S. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00002-5 · Cited by 471
Body expressions influence recognition of emotions in the face and voice.
Van den Stock, J., Righart, R., & de Gelder, B. (2007) · Emotion · doi:10.1037/1528-3542.7.3.487 · Cited by 457
The production and recognition of emotions in speech: features and algorithms
Pierre-Yves, O. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(02)00141-6 · Cited by 439
von Laban, R., & Ullmann, L. (1950) · Medical Entomology and Zoology · Cited by 431
Action Categories and the Perception of Biological Motion
Dittrich, W. H. (1993) · Perception · doi:10.1068/p220015 · Cited by 429
Automatic, Dimensional and Continuous Emotion Recognition
Gunes, H., & Pantic, M. (2010) · International Journal of Synthetic Emotions · doi:10.4018/jse.2010101605 · Cited by 426
Why bodies? Twelve reasons for including bodily expressions in affective neuroscience
de Gelder, B. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0190 · Cited by 420
Emotion recognition in human–computer interaction
Fragopanagos, N., & Taylor, J. G. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.03.006 · Cited by 414
Camurri, A., Lagerlöf, I., & Volpe, G. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00050-8 · Cited by 413
The contribution of general features of body movement to the attribution of emotions
de Meijer, M. (1989) · Journal of Nonverbal Behavior · doi:10.1007/bf00990296 · Cited by 408
Peelen, M. V., Wiggett, A. J., & Downing, P. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.02.004 · Cited by 402
A Conversational Agent as Museum Guide – Design and Evaluation of a Real-World Application
Kopp, S., Gesellensetter, L., Krämer, N. C., & Wachsmuth, I. (2005) · Lecture Notes in Computer Science · doi:10.1007/11550617_28 · Cited by 393
Bi-modal emotion recognition from expressive face and body gestures
Gunes, H., & Piccardi, M. (2007) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2006.09.007 · Cited by 382
Critical features for the perception of emotion from gait
Roether, C. L., Omlor, L., Christensen, A., & Giese, M. A. (2009) · Journal of Vision · doi:10.1167/9.6.15 · Cited by 372
The painful face – Pain expression recognition using active appearance models
Ashraf, A. B., Lucey, S., Cohn, J. F., Chen, T., Ambadar, Z., Prkachin, K. M., & Solomon, P. E. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.05.007 · Cited by 355
Emotion words shape emotion percepts.
Gendron, M., Lindquist, K. A., Barsalou, L., & Barrett, L. F. (2012) · Emotion · doi:10.1037/a0026007 · Cited by 331
Language and the perception of emotion.
Lindquist, K. A., Barrett, L. F., Bliss-Moreau, E., & Russell, J. A. (2006) · Emotion · doi:10.1037/1528-3542.6.1.125 · Cited by 325
Cues and channels in emotion recognition.
Wallbott, H. G., & Scherer, K. R. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.4.690 · Cited by 325
Visual Perception of Expressiveness in Musicians' Body Movements
Dahl, S., & Friberg, A. (2007) · Music Perception · doi:10.1525/mp.2007.24.5.433 · Cited by 311
Seeing fearful body expressions activates the fusiform cortex and amygdala
Hadjikhani, N., & de Gelder, B. (2003) · Current Biology · doi:10.1016/j.cub.2003.11.049 · Cited by 298
Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures
El Kaliouby, R., & Robinson, P. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.427 · Cited by 282
Head and Body Cues in the Judgment of Emotion: A Reformulation
Ekman, P., & Friesen, W. V. (1967) · Perceptual and Motor Skills · doi:10.1177/003151256702400305 · Cited by 279
Vaina, L. M., Lemay, M., Bienfang, D. C., Choi, A. Y., & Nakayama, K. (1990) · Visual Neuroscience · doi:10.1017/s0952523800000444 · Cited by 278
EMOTION IN SPEECH: RECOGNITION AND APPLICATION TO CALL CENTERS
Petrushin, V. A. (1999) · Cited by 276
Verbal and nonverbal cues in the perception of lying.
Kraut, R. E. (1978) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.36.4.380 · Cited by 269
Inference of attitudes from the posture, orientation, and distance of a communicator.
Mehrabian, A. (1968) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0025906 · Cited by 259
F�rnkranz, J., & Hllermeier, E. (2010) · Cited by 259
Automatic analysis of affective postures and body motion to detect engagement with a game companion,
Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P. W., & Paiva, A. (2011) · Proceedings of the 6th international conference on Human-robot interaction · doi:10.1145/1957656.1957781 · Cited by 250
Handbook of Individual Differences, Learning, and Instruction
Yeo, S. H. (2010) · Korean Journal of Medical Education · doi:10.3946/kjme.2010.22.2.151 · Cited by 244
Watson, P., Booker, C., Main, C., & Chen, A. (1997) · Clinical Biomechanics · doi:10.1016/s0268-0033(97)00065-x · Cited by 237
Geisser, M. E., Haig, A. J., Wallbom, A. S., & Wiggert, E. A. (2004) · The Clinical Journal of Pain · doi:10.1097/00002508-200403000-00001 · Cited by 235
von Laban, R. (1948) · Medical Entomology and Zoology · Cited by 233
Aronoff, J., Woike, B. A., & Hyman, L. M. (1992) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.62.6.1050 · Cited by 230
APML, a Markup Language for Believable Behavior Generation
De Carolis, B., Pelachaud, C., Poggi, I., & Steedman, M. (2004) · Cognitive Technologies · doi:10.1007/978-3-662-08373-4_4 · Cited by 229
Understanding the Role of Body Movement in Player Engagement
Bianchi-Berthouze, N. (2013) · Human–Computer Interaction · doi:10.1080/07370024.2012.688468 · Cited by 227
Self-citationCross-cultural differences in recognizing affect from body posture
Kleinsmith, A., De Silva, P. R., & Bianchi-Berthouze, N. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2006.04.003 · Cited by 226
Self-citationMemory for Everyday and Emotional Events
(2013) · Psychology Press eBooks · doi:10.4324/9781315799421 · Cited by 225
Toward computers that recognize and respond to user emotion
Picard, R. W. (2000) · IBM Systems Journal · doi:10.1147/sj.393.0705 · Cited by 222
Atkinson, A. P., Tunstall, M. L., & Dittrich, W. H. (2007) · Cognition · doi:10.1016/j.cognition.2006.05.005 · Cited by 219
Toward a Minimal Representation of Affective Gestures
Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M., & Scherer, K. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.7 · Cited by 215
Ma, Y., Paterson, H. M., & Pollick, F. E. (2006) · Behavior Research Methods · doi:10.3758/bf03192758 · Cited by 202
Gesture-Based Affective Computing on Motion Capture Data
Kapur, A., Kapur, A., Virji-Babul, N., Tzanetakis, G., & Driessen, P. F. (2005) · Lecture Notes in Computer Science · doi:10.1007/11573548_1 · Cited by 202
Gunes, H., & Piccardi, M. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.39 · Cited by 199
Automatic Temporal Segment Detection and Affect Recognition From Face and Body Display
Gunes, H., & Piccardi, M. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.927269 · Cited by 198
Antle, A. N., Corness, G., & Droumeva, M. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2008.10.005 · Cited by 191
Preston-Dunlop, V. M. (1990) · Medical Entomology and Zoology · Cited by 190
Individual differences and cues to deception.
Riggio, R. E., & Friedman, H. S. (1983) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.45.4.899 · Cited by 189
Culture and Nonverbal Behavior
Matsumoto, D. (2006) · The SAGE Handbook of Nonverbal Communication · doi:10.4135/9781412976152.n12 · Cited by 186
Recognition of emotions in interactive voice response systems
Yacoub, S., Simske, S., Lin, X., & Burns, J. (2003) · 8th European Conference on Speech Communication and Technology (Eurospeech 2003) · doi:10.21437/eurospeech.2003-307 · Cited by 176
Atkinson, A. P. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.05.019 · Cited by 175
Automatic Recognition of Non-Acted Affective Postures
Kleinsmith, A., Bianchi-Berthouze, N., & Steed, A. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2103557 · Cited by 174
Self-citationThe Body Action and Posture Coding System (BAP): Development and Reliability
Dael, N., Mortillaro, M., & Scherer, K. R. (2012) · Journal of Nonverbal Behavior · doi:10.1007/s10919-012-0130-0 · Cited by 173
A blueprint for affective computing: A sourcebook
Scherer, K. R., Bänziger, T., & Roesch, E. B. (2010) · Cited by 168
Ada and Grace: Toward Realistic and Engaging Virtual Museum Guides
Swartout, W., Traum, D., Artstein, R., Noren, D., Debevec, P., Bronnenkant, K., Williams, J., Leuski, A., Narayanan, S., Piepol, D., et al. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15892-6_30 · Cited by 165
Recognition of Affect Based on Gait Patterns
Karg, M. E., Kühnlenz, K., & BUSS, M. J. (2010) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2044040 · Cited by 165
Movement-based sports video games: Investigating motivation and gaming experience
Pasch, M., Bianchi-Berthouze, N., van Dijk, B., & Nijholt, A. (2009) · Entertainment Computing · doi:10.1016/j.entcom.2009.09.004 · Cited by 163
Self-citationGallagher, H. L., & Frith, C. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.05.006 · Cited by 163
Argyle, M. (2013) · Routledge eBooks · doi:10.4324/9780203753835 · Cited by 160
Self-Organization of Discrete Emotions, Emotion Patterns, and Emotion-Cognition Relations
Izard, C. E., Ackerman, B. P., Schoff, K. M., & Fine, S. E. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511527883.003 · Cited by 154
Recognizing Affective Dimensions from Body Posture
Kleinsmith, A., & Bianchi‐Berthouze, N. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_5 · Cited by 152
Self-citationEncoding of attitude by a seated communicator via posture and position cues.
Mehrabian, A., & Friar, J. T. (1969) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0027576 · Cited by 150
Studies on gesture expressivity for a virtual agent
Pélachaud, C. (2008) · Speech Communication · doi:10.1016/j.specom.2008.04.009 · Cited by 148
Bull, P. E. (1987) · Cited by 147
Detecting Affect from Non-stylised Body Motions
Bernhardt, D., & Robinson, P. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_6 · Cited by 144
Estimating the efficiency of recognizing gender and affect from biological motion
Pollick, F. E., Lestou, V., Ryu, J., & Cho, S.-B. (2002) · Vision Research · doi:10.1016/s0042-6989(02)00196-7 · Cited by 144
Matsumoto, D., Consolacion, T. B., Yamada, H., Suzuki, R., Franklin, B., Paul, S., Ray, R. D., & Uchida, H. (2002) · Cognition & Emotion · doi:10.1080/02699930143000608 · Cited by 144
Methodology for Assessing Bodily Expression of Emotion
Gross, M. M., Crane, E. A., & Fredrickson, B. L. (2010) · Journal of Nonverbal Behavior · doi:10.1007/s10919-010-0094-x · Cited by 143
Emotions as Dynamic Cultural Phenomena
Mesquita, B. (2002) · Oxford University Press eBooks · doi:10.1093/oso/9780195126013.003.0046 · Cited by 139
Using Actor Portrayals to Systematically Study Multimodal Emotion Expression: The GEMEP Corpus
Bänziger, T., & Scherer, K. R. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_42 · Cited by 135
Automated Analysis of Body Movement in Emotionally Expressive Piano Performances
Castellano, G., Mortillaro, M., Camurri, A., Volpe, G., & Scherer, K. R. (2008) · Music Perception An Interdisciplinary Journal · doi:10.1525/mp.2008.26.2.103 · Cited by 135
Fürnkranz, J., & Hüllermeier, E. (2010) · Springer eBooks · doi:10.1007/978-3-642-14125-6 · Cited by 132
Emotion, Development, and Self-Organization: Dynamic Systems Approaches to Emotional Development.
Abbass, A. A. (2004) · PubMed Central · Cited by 128
Preserved and Impaired Detection of Structure From Motion by a 'Motion-blind" Patient
McLeod, P. (1996) · Visual Cognition · doi:10.1080/135062896395634 · Cited by 128
Beyond Facial Expressions: Learning Human Emotion from Body Gestures
Shan, C., Gong, S., & McOwan, P. W. (2007) · British Machine Vision Conference (BMVC) · doi:10.5244/c.21.43 · Cited by 127
Cross-cultural patterns in emotion recognition: Highlighting design and analytical techniques.
Elfenbein, H. A., Mandal, M. K., Ambady, N., Harizuka, S., & Kumar, S. (2002) · Emotion · doi:10.1037/1528-3542.2.1.75 · Cited by 124
Muscle tension in generalized anxiety disorder: A critical review of the literature
Pluess, M., Conrad, A., & Wilhelm, F. H. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2008.03.016 · Cited by 119
Nonverbal indicators of deception: A new theoretical perspective
Hocking, J. E., & Leathers, D. G. (1980) · Communication Monographs · doi:10.1080/03637758009376025 · Cited by 119
Chandler, J., & Schwarz, N. (2008) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2008.06.012 · Cited by 112
Willis, M. L., Palermo, R., & Burke, D. (2011) · Emotion · doi:10.1037/a0022571 · Cited by 108
Towards a Learning Companion that Recognizes Affect
Kapoor, A., Mota, S., & Picard, R. W. (2001) · Cited by 107
Doyle, J. (2004) · Computational Intelligence · doi:10.1111/j.0824-7935.2004.00233.x · Cited by 107
Universality and Distinctiveness in Dimensions of Japanese Person Perception
Bond, M. H., Nakazato, H., & Shiraishi, D. (1975) · Journal of Cross-Cultural Psychology · doi:10.1177/002202217563007 · Cited by 105
Varni, G., Volpe, G., & Camurri, A. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2052592 · Cited by 105
A Study of the Expression of Bodily Posture
James, W. (1932) · The Journal of General Psychology · doi:10.1080/00221309.1932.9918475 · Cited by 103
Probabilistic combination of multiple modalities to detect interest
Kapoor, A., Picard, R. W., & Ivanov, Y. A. (2004) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2004.1334690 · Cited by 100
Modeling human affective postures: an information theoretic characterization of posture features
Silva, P. R. D., & Bianchi‐Berthouze, N. (2004) · Computer Animation and Virtual Worlds · doi:10.1002/cav.29 · Cited by 98
Self-citationFrom the Lab to the Real World: Affect Recognition Using Multiple Cues and Modalities
Güneş, H., Piccardi, M., & Pantić, M. (2008) · doi:10.5772/6180 · Cited by 97
Expression of emotional–motivational connotations with a one-word utterance
Leinonen, L. M., Hiltunen, T., Linnankoski, I., & Laakso, M. (1997) · The Journal of the Acoustical Society of America · doi:10.1121/1.420109 · Cited by 96
A categorical approach to affective gesture recognition
Bianchi‐Berthouze, N., & Kleinsmith, A. (2003) · Connection Science · doi:10.1080/09540090310001658793 · Cited by 94
Self-citationAffect recognition for interactive companions: challenges and design in real world scenarios
Castellano, G., Leite, I., Pereira, A., Martinho, C., Paiva, A., & McOwan, P. W. (2009) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-009-0033-5 · Cited by 93
Human emotion recognition from motion using a radial basis function network architecture
Rosenblum, M., Yacoob, Y., & Davis, L. S. (2002) · doi:10.1109/mnrao.1994.346256 · Cited by 88
Posture, movement patterns, and body awareness in women with chronic pelvic pain
Haugstad, G. K., Haugstad, T. S., Kirste, U. M., Leganger, S., Wojniusz, S., Klemmetsen, I., & Malt, U. F. (2006) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2006.05.003 · Cited by 87
Physicians' H]ead and Body Positions as Determinants of Perceived Rapport
Harrigan, J. A., & Rosenthal, R. (1983) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1983.tb02332.x · Cited by 83
Savva, N., Scarinzi, A., & Bianchi‐Berthouze, N. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2202663 · Cited by 82
Self-citationAcoustical analysis of spectral and temporal changes in emotional speech
Kienast, M., & Sendlmeier, W. F. (2000) · Cited by 81
Body Language for Competent Teachers
Caswell, C., & Neill, S. R. S. J. (2003) · Routledge eBooks · doi:10.4324/9780203392690 · Cited by 73
Ekman, P. (1981) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1981.tb34479.x · Cited by 72
(2002) · doi:10.1109/icme.2002.1035887 · Cited by 69
DETECTING DECEPTIVE COMMUNICATION FROM VERBAL, VISUAL, AND PARALINGUISTIC CUES1
Hocking, J. E., Kaminski, E. P., Bauchner, J. E., & Miller, G. R. (1979) · Human Communication Research · doi:10.1111/j.1468-2958.1979.tb00289.x · Cited by 66
Combining Facial and Postural Expressions of Emotions in a Virtual Character
Clavel, C., Plessier, J., Martin, J., Ach, L., & Morel, B. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04380-2_31 · Cited by 64
The role of spatial and temporal information in biological motion perception
Lange, J., & Lappe, M. (2007) · Advances in Cognitive Psychology · doi:10.2478/v10053-008-0006-3 · Cited by 57
Tuminello, E. R., & Davidson, D. Z. (2011) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2011.02.016 · Cited by 55
The Role of Velocity in Affect Discrimination
Paterson, H., Pollick, F. E., & Sanford, A. J. (2001) · eScholarship (California Digital Library) · Cited by 54
Emotion Recognition in Ethiopia
Ducci, L., Arcuri, L., Georgis, T. W., & Sineshaw, T. (1982) · Journal of Cross-Cultural Psychology · doi:10.1177/0022002182013003005 · Cited by 52
Developmental characteristics in judgments of emotion from nonverbal vocal cues
Matsumoto, D., & Kishimoto, H. (1983) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(83)90047-0 · Cited by 50
Cross-cultural examination of the semantic dimensions of body postures.
Kudoh, T., & Matsumoto, D. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.48.6.1440 · Cited by 50
Extraction of spatio-temporal primitives of emotional body expressions
Omlor, L., & Giese, M. A. (2006) · Neurocomputing · doi:10.1016/j.neucom.2006.10.100 · Cited by 49
Natural affect data — Collection & annotation in a learning context
Afzal, S., & Robinson, P. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349537 · Cited by 48
Preference learning for affective modeling
Yannakakis, G. N. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349491 · Cited by 46
Does Movement Recognition Precision Affect the Player Experience in Exertion Games?
Nijhar, J., Bianchi‐Berthouze, N., & Boguslawski, G. (2012) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-30214-5_9 · Cited by 46
Self-citationExamination of movement in patients with long‐lasting musculoskeletal pain: reliability and validity
Kvåle, A., Ljunggren, A. E., & Johnsen, T. B. (2003) · Physiotherapy Research International · doi:10.1002/pri.270 · Cited by 43
A comparison of PCA, KPCA and LDA for feature extraction to recognize affect in gait kinematics
Karg, M. E., Jenke, R., Seiberl, W., Kühnlenz, K., Schwirtz, A., & BUSS, M. J. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349438 · Cited by 42
Concepts of depression in emotion lexicons of eight cultures
Brandt, M. E., & Boucher, J. D. (1986) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(86)90016-7 · Cited by 41
Cultural similarities and differences in the semantic dimensions of body postures
Matsumoto, D., & Kudoh, T. (1987) · Journal of Nonverbal Behavior · doi:10.1007/bf00990235 · Cited by 38
Hirai, M., & Hiraki, K. (2005) · Cognition · doi:10.1016/j.cognition.2005.05.003 · Cited by 37
Using Crowdsourcing for Labelling Emotional Speech Assets
Tarasov, A. (2010) · Arrow - TU Dublin (Technological University Dublin) · doi:10.21427/d7rs4g · Cited by 35
Emotion in user interface, voice interaction system
Kostov, V., & Fukuda, S. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2000.885947 · Cited by 32
Detection of Deceptive Factual Statements from the Body and the Face
Littlepagel, G. E., & Pineault, M. A. (1979) · Personality and Social Psychology Bulletin · doi:10.1177/014616727900500311 · Cited by 32
Mueller, F., & Bianchi‐Berthouze, N. (2009) · Human-computer interaction series · doi:10.1007/978-1-84882-963-3_11 · Cited by 27
Self-citationGrounding Affective Dimensions into Posture Features
Kleinsmith, A., Silva, P. R. D., & Bianchi‐Berthouze, N. (2005) · Lecture notes in computer science · doi:10.1007/11573548_34 · Cited by 27
Self-citationTowards authentic emotion recognition
Sebe, N., Sun, Y., Bakker, E. M., Lew, M. S., Cohen, I., & Huang, T. S. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1398369 · Cited by 27
Multi-score Learning for Affect Recognition: The Case of Body Postures
Meng, H., Kleinsmith, A., & Bianchi‐Berthouze, N. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24600-5_26 · Cited by 20
Self-citationMartens, U., Leuthold, H., & Schweinberger, S. R. (2010) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.10.4.505 · Cited by 18
Recognizing affect from non-stylized body motion using shape of Gaussian descriptors
Gong, L., Wang, T., Wang, C., Liu, F., Zhang, F., & Yu, X. (2010) · ACM Symposium on Applied Computing · doi:10.1145/1774088.1774341 · Cited by 15
Emotion Recognition from Dance Image Sequences Using Contour Approximation
Park, H., Park, J., Kim, U.-M., & Woo, W. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-27868-9_59 · Cited by 14
Observer annotation of affective display and evaluation of expressivity: face vs. face-and-body
Güneş, H., & Piccardi, M. (2006) · UTS ePRESS (University of Technology Sydney) · Cited by 7
Cited by
Survey on Emotional Body Gesture Recognition
Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2874986 · Cited by 455
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360
An Efficient LSTM Network for Emotion Recognition From Multichannel EEG Signals
Du, X., Ma, C., Zhang, G., Li, J., Lai, Y.-K., Zhao, G., Deng, X., Liu, Y.-J., & Wang, H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3013711 · Cited by 357
Learning deep physiological models of affect
Martinez, H. P., Bengio, Y., & Yannakakis, G. N. (2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2247823 · Cited by 287
Automatic ECG-Based Emotion Recognition in Music Listening
Hsu, Y.-L., Wang, J.-S., Chiang, W.-C., & Hung, C.-H. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2781732 · Cited by 258
Metadata
- Authors
- Kleinsmith, A., & Bianchi-Berthouze, N.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2013-01
- Volume
- 4
- Issue
- 1
- Pages
- 15-33
- ISSN
- 1949-3045 (ISSN-L)
- OpenAlex
- W2024221294
- Cited by
- 607
- References
- 169
- FWCI
- 57.90
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.