The DOI matches its Crossref record; 159 of the 159 references it cites were found in a registry or an index.
Survey on Emotional Body Gesture Recognition
Open accessAbstract
Automatic emotion recognition has become a trending research topic in the past decade. While works based on facial expressions or speech abound, recognizing affect from body gestures remains a less explored topic. We present a new comprehensive survey hoping to boost research in the field. We first introduce emotional body gestures as a component of what is commonly known as ”body language” and comment general aspects as gender differences and culture dependence. We then define a complete framework for automatic emotional body gesture recognition. We introduce person detection and comment static and dynamic body pose estimation methods both in RGB and 3D. We then comment the recent literature related to representation learning and emotion recognition from images of emotionally expressive gestures. We also discuss multi-modal approaches that combine speech or face with body gestures for improved emotion recognition. While pre-processing methodologies (e.g., human detection and pose estimation) are nowadays mature technologies fully developed for robust large scale analysis, we show that for emotion recognition the quantity of labelled data is scarce. There is no agreement on clearly defined output spaces and the representations are shallow and largely based on naive geometrical representations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 2×
“The proposed system, based on neural network, is able to project the emotion transition of the actor’s body as a trajectory on the RCM diagram during theater performances with sufficient accuracy.”
MethodThe expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Pedestrian Detection: An Evaluation of the State of the Art
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.155 · Cited by 3,190
DeepPose: Human Pose Estimation via Deep Neural Networks
Toshev, A., & Szegedy, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.214 · Cited by 3,185
Wei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966
A discriminatively trained, multiscale, deformable part model
Felzenszwalb, P., McAllester, D., & Ramanan, D. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587597 · Cited by 2,867
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
A survey of advances in vision-based human motion capture and analysis
Moeslund, T. B., Hilton, A., & Krüger, V. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.002 · Cited by 2,541
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
Universals and cultural differences in facial expressions of emotion.
Ekman, P. (1972) · Medical Entomology and Zoology · Cited by 2,273
Detecting Pedestrians Using Patterns of Motion and Appearance
Viola, P., Jones, M. J., & Snow, D. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-6644-8 · Cited by 2,079
Real-time human pose recognition in parts from single depth images
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., & Moore, R. (2013) · Communications of the ACM · doi:10.1145/2398356.2398381 · Cited by 2,044
Evidence for a three-factor theory of emotions
Russell, J. A., & Mehrabian, A. (1977) · Journal of Research in Personality · doi:10.1016/0092-6566(77)90037-x · Cited by 1,940 · cited 2×
“Categorical (a) (here a universal set of emotions as define by Ekman [46]), (b) dimensional (Russell’s model depicted) [47], and (c) componential models (Plutchik’s model shown) [48].”
BackgroundAutomatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1×
“phony [137], video conferencing and stress-monitoring tool, violence detection [138], [139], [140], video surveillance [141], and animation or synthesis of life-like agents [139] and auto-”
BackgroundUniversals and cultural differences in the judgments of facial expressions of emotion.
Ekman, P., Friesen, W. V., O'Sullivan, M., Chan, A., Diacoyanni-Tarlatzis, I., Heider, K., Krause, R., LeCompte, W. A., Pitcairn, T., Ricci-Bitti, P. E., et al. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.4.712 · Cited by 1,763
Human Detection Using Oriented Histograms of Flow and Appearance
Dalal, N., Triggs, B., & Schmid, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744047_33 · Cited by 1,652
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Action recognition based on a bag of 3D points
Li, W., Zhang, Z., & Liu, Z. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543273 · Cited by 1,428
DensePose: Dense Human Pose Estimation in the Wild.
Güler, R. A., Neverova, N., & Kokkinos, I. (2018) · UCL Discovery (University College London) · Cited by 1,421
Plutchik, R. (2001) · American Scientist · doi:10.1511/2001.4.344 · Cited by 1,419
Efficient object localization using Convolutional Networks
Tompson, J., Goroshin, R., Jain, A., LeCun, Y., & Bregler, C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298664 · Cited by 1,365
The Representation and Matching of Pictorial Structures
Fischler, M. A., & Elschlager, R. A. (1973) · IEEE Transactions on Computers · doi:10.1109/t-c.1973.223602 · Cited by 1,322
Monocular 3D Human Pose Estimation in the Wild Using Improved CNN Supervision
Mehta, D., Rhodin, H., Casas, D., Fua, P., Sotnychenko, O., Xu, W., & Theobalt, C. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00064 · Cited by 1,142
Strong evidence for universals in facial expressions: A reply to Russell's mistaken critique.
Ekman, P. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.2.268 · Cited by 1,130
DeeperCut: A Deeper, Stronger, and Faster Multi-person Pose Estimation Model
Insafutdinov, E., Pishchulin, L., Andres, B., Andriluka, M., & Schiele, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_3 · Cited by 1,130
DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation
Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.533 · Cited by 1,051
Detecting pedestrians using patterns of motion and appearance
Viola, Jones, & Snow (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238422 · Cited by 1,002
Poselets: Body part detectors trained using 3D human pose annotations
Bourdev, L., & Malik, J. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459303 · Cited by 961
Articulated body motion capture by annealed particle filtering
Deutscher, J., Blake, A., & Reid, I. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854758 · Cited by 868
Towards Accurate Multi-person Pose Estimation in the Wild
Papandreou, G., Zhu, T., Kanazawa, N., Toshev, A., Tompson, J., Bregler, C., & Murphy, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.395 · Cited by 860
Is Faster R-CNN Doing Well for Pedestrian Detection?
Zhang, L., Lin, L., Liang, X., & He, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_28 · Cited by 852
Compound facial expressions of emotion
Du, S., Tao, Y., & Martinez, A. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1322355111 · Cited by 806
Human Pose Estimation with Iterative Error Feedback
Carreira, J., Agrawal, P., Fragkiadaki, K., & Malik, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.512 · Cited by 805
Toward an affect-sensitive multimodal human-computer interaction
Pantic, M., & Rothkrantz, L. J. M. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817122 · Cited by 791
The Expression Of The Emotions In Man And Animals
Darwin, C. (1998) · doi:10.1093/oso/9780195112719.001.0001 · Cited by 732
Tracking people with twists and exponential maps
Bregler, C., & Malik, J. (2002) · Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231) · doi:10.1109/cvpr.1998.698581 · Cited by 719
3-D model-based tracking of humans in action: a multi-view approach
Gavrila, D. M., & Davis, L. S. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517056 · Cited by 702
Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition
Sariyanidi, E., Gunes, H., & Cavallaro, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366127 · Cited by 685
Simon, R. W., & Nath, L. E. (2004) · American Journal of Sociology · doi:10.1086/382111 · Cited by 663
Affective Body Expression Perception and Recognition: A Survey
Kleinsmith, A., & Bianchi-Berthouze, N. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.16 · Cited by 607
Violence Detection in Video Using Computer Vision Techniques
Bermejo Nievas, E., Deniz Suarez, O., Bueno García, G., & Sukthankar, R. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23678-5_39 · Cited by 589
Parametric hidden Markov models for gesture recognition
Wilson, A. D., & Bobick, A. F. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.790429 · Cited by 574
3D Human Pose Estimation = 2D Pose Estimation + Matching
Chen, C.-H., & Ramanan, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.610 · Cited by 566
Hand gesture recognition with 3D convolutional neural networks
Molchanov, P., Gupta, S., Kim, K., & Kautz, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301342 · Cited by 543
Vision-Based Gesture Recognition: A Review
Wu, Y., & Huang, T. S. (1999) · Lecture Notes in Computer Science · doi:10.1007/3-540-46616-9_10 · Cited by 528
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527
Self-citationDetecting Pedestrians by Learning Shapelet Features
Sabzmeydani, P., & Mori, G. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383134 · Cited by 515
Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Image
Tome, D., Russell, C., & Agapito, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.603 · Cited by 504
Human Pose Estimation via Convolutional Part Heatmap Regression
Bulat, A., & Tzimiropoulos, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_44 · Cited by 501
(1989) · Journal of Psychophysiology · Cited by 489
PoseTrack: A Benchmark for Human Pose Estimation and Tracking
Andriluka, M., Iqbal, U., Insafutdinov, E., Pishchulin, L., Milan, A., Gall, J., & Schiele, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00542 · Cited by 486
Differential Facial Responses to Four Basic Tastes in Newborns
Rosenstein, D., & Oster, H. (1988) · Child Development · doi:10.2307/1130670 · Cited by 470
Learning 3D mesh segmentation and labeling
Kalogerakis, E., Hertzmann, A., & Singh, K. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778839 · Cited by 469
Video Based Reconstruction of 3D People Models
Alldieck, T., Magnor, M., Xu, W., Theobalt, C., & Pons-Moll, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00875 · Cited by 468
Associative Embedding: End-to-End Learning for Joint Detection and Grouping
Newell, A., Huang, Z., & Deng, J. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05424 · Cited by 461
Body expressions influence recognition of emotions in the face and voice.
Van den Stock, J., Righart, R., & de Gelder, B. (2007) · Emotion · doi:10.1037/1528-3542.7.3.487 · Cited by 457
3D Human Pose Estimation from Monocular Images with Deep Convolutional Neural Network
Li, S., & Chan, A. B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16808-1_23 · Cited by 443
Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011
Anagnostopoulos, C.-N., Iliou, T., & Giannoukos, I. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-012-9368-5 · Cited by 428
Why bodies? Twelve reasons for including bodily expressions in affective neuroscience
de Gelder, B. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0190 · Cited by 420
Looking at people: sensing for ubiquitous and wearable computing
Pentland, A. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824823 · Cited by 403
Bi-modal emotion recognition from expressive face and body gestures
Gunes, H., & Piccardi, M. (2007) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2006.09.007 · Cited by 382
A real time system for robust 3D voxel reconstruction of human motions
Cheung, G. K. M., Kanade, T., Bouguet, J.-Y., & Holler, M. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854944 · Cited by 376
Instructing people for training gestural interactive systems
Fothergill, S., Mentis, H., Kohli, P., & Nowozin, S. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208303 · Cited by 368
Recognition and Segmentation of 3-D Human Action Using HMM and Multi-class AdaBoost
Lv, F., & Nevatia, R. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_28 · Cited by 351
Motion capture using joint skeleton tracking and surface estimation
Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., & Seidel, H.-P. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206755 · Cited by 344
Nonverbal Behavior and Communication
(2014) · Psychology Press eBooks · doi:10.4324/9781315799759 · Cited by 335
Recognising Human Emotions from Body Movement and Gesture Dynamics
Castellano, G., Villalba, S. D., & Camurri, A. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_7 · Cited by 329
Learning Complexity-Aware Cascades for Deep Pedestrian Detection
Cai, Z., Saberian, M., & Vasconcelos, N. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.384 · Cited by 326
FeaStNet: Feature-Steered Graph Convolutions for 3D Shape Analysis
Verma, N., Boyer, E., & Verbeek, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00275 · Cited by 324
Layered representations for human activity recognition
Oliver, N., Horvitz, E., & Garg, A. (2003) · Proceedings. Fourth IEEE International Conference on Multimodal Interfaces · doi:10.1109/icmi.2002.1166960 · Cited by 312
LIRIS-ACCEDE: A Video Database for Affective Content Analysis
Baveye, Y., Dellandrea, E., Chamaret, C., & Chen, L. (2015) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2396531 · Cited by 306
Meta-Analysis of the First Facial Expression Recognition Challenge
Valstar, M. F., Mehu, M., Jiang, B., Pantic, M., & Scherer, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2200675 · Cited by 297
Human Body Model Acquisition and Tracking Using Voxel Data
Mikić, I., Trivedi, M., Hunter, E., & Cosman, P. (2003) · International Journal of Computer Vision · doi:10.1023/a:1023012723347 · Cited by 291
Covariance scaled sampling for monocular 3D body tracking
Sminchisescu, C., & Triggs, B. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990509 · Cited by 290
Foley, J. P., & Efron, D. (1942) · The American Journal of Psychology · doi:10.2307/1417100 · Cited by 279
Emotional expressivity in men and women: Stereotypes and self-perceptions
Hess, U., Senécal, S., Kirouac, G., Herrera, P., Philippot, P., & Kleck, R. E. (2000) · Cognition & Emotion · doi:10.1080/02699930050117648 · Cited by 275
Finding and tracking people from the bottom up
Ramanan, D., & Forsyth, D. A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211504 · Cited by 268
Human detection from images and videos: A survey
Nguyen, D. T., Li, W., & Ogunbona, P. O. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2015.08.027 · Cited by 267
Audio-Visual Emotion Recognition in Video Clips
Noroozi, F., Marjanovic, M., Njegus, A., Escalera, S., & Anbarjafari, G. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2713783 · Cited by 266
Self-citationAffective Computing: From Laughter to IEEE
Picard, R. W. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.10 · Cited by 265
Multi-source Deep Learning for Human Pose Estimation
Ouyang, W., Chu, X., & Wang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.299 · Cited by 262
Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech
Castellano, G., Kessous, L., & Caridakis, G. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85099-1_8 · Cited by 259
Kessous, L., Castellano, G., & Caridakis, G. (2010) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-009-0025-5 · Cited by 256
Yang, W., Ouyang, W., Li, H., & Wang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.335 · Cited by 255
Multimodal emotion recognition using deep learning architectures
Ranganathan, H., Chakraborty, S., & Panchanathan, S. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477679 · Cited by 249
Real-Time Pedestrian Detection with Deep Network Cascades
Angelova, A., Krizhevsky, A., Vanhoucke, V., Ogale, A., & Ferguson, D. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.32 · Cited by 239
Exploring the Trade-off Between Accuracy and Observational Latency in Action Recognition
Ellis, C., Masood, S. Z., Tappen, M. F., LaViola, J. J., & Sukthankar, R. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0550-7 · Cited by 238
ArtTrack: Articulated Multi-Person Tracking in the Wild
Insafutdinov, E., Andriluka, M., Pishchulin, L., Tang, S., Levinkov, E., Andres, B., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.142 · Cited by 237
Deformable Shape Completion with Graph Convolutional Autoencoders
Litany, O., Bronstein, A., Bronstein, M., & Makadia, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00202 · Cited by 226
PoseTrack: Joint Multi-person Pose Estimation and Tracking
Iqbal, U., Milan, A., & Gall, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.495 · Cited by 224
Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection
Kakadiaris, I. A., & Metaxas, D. (1996) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1996.517057 · Cited by 220
From individual to group-level emotion recognition: EmotiW 5.0
Dhall, A., Goecke, R., Ghosh, S., Joshi, J., Hoey, J., & Gedeon, T. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3143004 · Cited by 218
Body Movements for Affective Expression: A Survey of Automatic Recognition and Generation
Karg, M., Samadani, A.-A., Gorbet, R., Kuhnlenz, K., Hoey, J., & Kulic, D. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2013.29 · Cited by 217
Toward a Minimal Representation of Affective Gestures
Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M., & Scherer, K. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.7 · Cited by 215
ChaLearn LAP 2016: First Round Challenge on First Impressions - Dataset and Results
Ponce-López, V., Chen, B., Oliu, M., Corneanu, C., Clapés, A., Guyon, I., Baró, X., Escalante, H. J., & Escalera, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_32 · Cited by 215
Self-citationPicard, R. W. (1999) · International Conference on Human-Computer Interaction · Cited by 209
Emotion Recognition in Context
Kosti, R., Alvarez, J. M., Recasens, A., & Lapedriza, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.212 · Cited by 200
Gunes, H., & Piccardi, M. (2006) · 18th International Conference on Pattern Recognition (ICPR'06) · doi:10.1109/icpr.2006.39 · Cited by 199
Affect Recognition from Face and Body: Early Fusion vs. Late Fusion
Gunes, H., & Piccardi, M. (2006) · 2005 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2005.1571679 · Cited by 191
Fan, X., Zheng, K., Lin, Y., & Wang, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298740 · Cited by 191
Multimodal emotion recognition from expressive faces, body gestures and speech
Caridakis, G., Castellano, G., Kessous, L., Raouzaiou, A., Malatesta, L., Asteriadis, S., & Karpouzis, K. (2007) · IFIP The International Federation for Information Processing · doi:10.1007/978-0-387-74161-1_41 · Cited by 183 · cited 1×
“Historical works usually focused on simple fusion techniques of predefined body and face representations [127], [128].”
BackgroundAutomatic Recognition of Non-Acted Affective Postures
Kleinsmith, A., Bianchi-Berthouze, N., & Steed, A. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2103557 · Cited by 174
Randomized trees for human pose detection
Rogez, G., Rihan, J., Ramalingam, S., Orrite, C., & Torr, P. H. S. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587617 · Cited by 173
A Framework for Gesture Generation and Interpretation
Cassell, J. (1998) · Computer Vision for Human-Machine Interaction · doi:10.1017/cbo9780511569937.013 · Cited by 172
Learning and Matching of Dynamic Shape Manifolds for Human Action Recognition
Wang, L., & Suter, D. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.896661 · Cited by 162
Reconstruction of articulated objects from point correspondences in a single uncalibrated image
Taylor, C. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.855885 · Cited by 159
Gesture and emotion: Can basic gestural form features discriminate emotions?
Kipp, M., & Martin, J. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349544 · Cited by 130
3D Articulated Models and Multiview Tracking with Physical Forces
Delamarre, Q., & Faugeras, O. D. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0892 · Cited by 129
A Survey of Autonomous Human Affect Detection Methods for Social Robots Engaged in Natural HRI
McColl, D., Hong, A., Hatakeyama, N., Nejat, G., & Benhabib, B. (2015) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-015-0259-2 · Cited by 127
Japanese and American infants' responses to arm restraint.
Camras, L. A., Oster, H., Campos, J. J., Miyake, K., & Bradshaw, D. L. (1992) · Developmental Psychology · doi:10.1037/0012-1649.28.4.578 · Cited by 120
Metallinou, A., Katsamanis, A., & Narayanan, S. S. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.08.018 · Cited by 118
Adaptive Body Gesture Representation for Automatic Emotion Recognition
Piana, S., Staglianò, A., Odone, F., & Camurri, A. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2818740 · Cited by 118
Recognizing Emotions Conveyed by Human Gait
Venture, G., Kadone, H., Zhang, T., Grèzes, J., Berthoz, A., & Hicheur, H. (2014) · International Journal of Social Robotics · doi:10.1007/s12369-014-0243-1 · Cited by 116
Ten Years of Pedestrian Detection, What Have We Learned?Preprint
Benenson, R., Omran, M., Hosang, J., & Schiele, B. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4304 · Cited by 116
The Study of Gesture: Some Remarks on its History
Kendon, A. (1983) · Springer eBooks · doi:10.1007/978-1-4615-9328-7_15 · Cited by 110
Recurrent 3D Pose Sequence Machines
Lin, M., Lin, L., Liang, X., Wang, K., & Cheng, H. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.588 · Cited by 110
Human tracking with mixtures of trees
Ioffe, S., & Forsyth, D. A. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937589 · Cited by 106
Bottom-Up and Top-Down Reasoning with Hierarchical Rectified Gaussians
Hu, P., & Ramanan, D. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.604 · Cited by 103
Human pose estimation from a single view point, real-time range sensor
Siddiqui, M., & Medioni, G. (2010) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2010.5543618 · Cited by 102
Technique for automatic emotion recognition by body gesture analysis
Glowinski, D., Camurri, A., Volpe, G., Dael, N., & Scherer, K. R. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563173 · Cited by 95
Personalizing Human Video Pose Estimation
Charles, J., Pfister, T., Magee, D., Hogg, D., & Zisserman, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.334 · Cited by 93
Challenges in Multi-modal Gesture Recognition
Escalera, S., Athitsos, V., & Guyon, I. (2017) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-57021-1_1 · Cited by 91
Self-citationMultimodal emotional state recognition using sequence-dependent deep hierarchical features
Barros, P., Jirak, D., Weber, C., & Wermter, S. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.09.009 · Cited by 86
A study on emotion recognition from body gestures using Kinect sensor
Saha, S., Datta, S., Konar, A., & Janarthanan, R. (2014) · International Conference on Communications and Signal Processing (ICCSP) · doi:10.1109/iccsp.2014.6949798 · Cited by 85
Savva, N., Scarinzi, A., & Bianchi‐Berthouze, N. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2202663 · Cited by 82
Real-time inference of mental states from facial expressions and upper body gestures
Baltrušaitis, T., McDuff, D., Banda, N., Mahmoud, M., el Kaliouby, R., Robinson, P., & Picard, R. W. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771372 · Cited by 76
Chen, S., Tian, Y., Liu, Q., & Metaxas, D. N. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.014 · Cited by 72
Emotion recognition using Kinect motion capture data of human gaits
Li, S., Cui, L., Zhu, C., Li, B., Zhao, N., & Zhu, T. (2016) · PeerJ · doi:10.7717/peerj.2364 · Cited by 71
Bodily Expression for Automatic Affect Recognition
Güneş, H., Shan, C., Chen, S., & Tian, Y. (2015) · Wiley eBooks · doi:10.1002/9781118910566.ch14 · Cited by 60
Recognizing affect in human touch of a robot
Altun, K., & MacLean, K. E. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.10.016 · Cited by 60
Deep Learning for Action and Gesture Recognition in Image Sequences: A Survey
Asadi, M., Clapés, A., Bellantonio, M., Escalante, H. J., Ponce-López, V., Baró, X., Guyon, I., Kasaei, S., & Escalera, S. (2017) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-57021-1_19 · Cited by 59
Self-citationDouglas‐Cowie, E., Cox, C., Martin, J., Devillers, L. Y., Cowie, R., Sneddon, I., McRorie, M., Pélachaud, C., Peters, C., Lowry, O. M., et al. (2010) · Cognitive technologies · doi:10.1007/978-3-642-15184-2_14 · Cited by 53
A Multi-scale Approach to Gesture Detection and Recognition
Neverova, N., Wolf, C., Paci, G., Sommavilla, G., Taylor, G. W., & Nebout, F. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.69 · Cited by 52
Continuous body emotion recognition system during theater performances
Sénécal, S., Cuel, L., Aristidou, A., & Magnenat‐Thalmann, N. (2016) · Computer Animation and Virtual Worlds · doi:10.1002/cav.1714 · Cited by 51
Automatic Human Emotion Recognition in Surveillance Video
Arunnehru, J., & Geetha, M. K. (2016) · Studies in computational intelligence · doi:10.1007/978-3-319-44790-2_15 · Cited by 51
Felzenszwalb, P. F. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130311 · Cited by 50
Hierarchical recognition of daily human actions based on continuous Hidden Markov Models
Mori, T., Segawa, Y., Shimosaka, M., & Sato, T. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301629 · Cited by 48
Multimodal affective state recognition in serious games applications
Psaltis, A., Kaza, K., Stefanidis, K., Thermos, S., Apostolakis, K. C., Dimitropoulos, K., & Daras, P. (2016) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2016.7738265 · Cited by 47
Laughter Type Recognition from Whole Body Motion
Griffin, H. J., Aung, M. H., Romera‐Paredes, B., McLoughlin, C., McKeown, G. J., Curran, W. J., & Bianchi‐Berthouze, N. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.64 · Cited by 46
The MEI Robot: Towards Using Motherese to Develop Multimodal Emotional Intelligence
Lim, A., & Okuno, H. G. (2014) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2014.2317513 · Cited by 45
Fusing face and body gesture for machine recognition of emotions
Gunes, H., & Piccardi, M. (2006) · IEEE RO-MAN · doi:10.1109/roman.2005.1513796 · Cited by 31
Emotion recognition based on human gesture and speech information using RT middleware
Vu, H. A., Yamazaki, Y., Dong, F., & Hirota, K. (2011) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzzy.2011.6007557 · Cited by 31
Face and Body Gesture Recognition for a Vision-Based Multimodal Analyzer.
Güneş, H., Piccardi, M., & Jan, T. (2003) · Cited by 30
Body Motion Analysis for Emotion Recognition in Serious Games
Kaza, K., Psaltis, A., Stefanidis, K., et al. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40244-4_4 · Cited by 25
Affective Movement Recognition Based on Generative and Discriminative Stochastic Dynamic Models
Samadani, A.-A., Gorbet, R., & Kulić, D. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2014.2310953 · Cited by 19
Emotion inference from human body motion
Bernhardt, D. (2010) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.48456/tr-787 · Cited by 19
Multi-level classification of emotional body expression
Fourati, N., & Pélachaud, C. (2015) · IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163145 · Cited by 18
Augmenting Supervised Emotion Recognition with Rule-Based Decision ModelPreprint
Patwardhan, A., & Knapp, G. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02660 · Cited by 11
A Latent Clothing Attribute Approach for Human Pose Estimation
Zhang, W., Shen, J., Liu, G., & Yu, Y. H. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16865-4_10 · Cited by 8
How deep learning can help emotion recognition
Khorrami, P. (2017) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 8
Cited by
Outlook on human-centric manufacturing towards Industry 5.0
Lu, Y., Zheng, H., Chand, S., Xia, W., Liu, Z., Xu, X., Wang, L., Qin, Z., & Bao, J. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.02.001 · Cited by 671
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
Deep 3D human pose estimation: A review
Wang, J., Tan, S., Zhen, X., Xu, S., Zheng, F., He, Z., & Shao, L. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103225 · Cited by 399
Emotion Recognition for Human-Robot Interaction: Recent Advances and Future Perspectives
Spezialetti, M., Placidi, G., & Rossi, S. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.532279 · Cited by 293
Adaptive Multilayer Perceptual Attention Network for Facial Expression Recognition
Liu, H., Cai, H., Lin, Q., Li, X., & Xiao, H. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3165321 · Cited by 129
Metadata
- Authors
- Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2021-04-01
- Volume
- 12
- Issue
- 2
- Pages
- 505-523
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2784655662
- Cited by
- 455
- References
- 159
- FWCI
- 42.57
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.