The DOI matches its Crossref record; 169 of the 169 references it cites were found in a registry or an index.
Affective Body Expression Perception and Recognition: A Survey
Open accessAbstract
Thanks to the decreasing cost of whole-body sensing technology and its increasing reliability, there is an increasing interest in, and understanding of, the role played by body expressions as a powerful affective communication channel. The aim of this survey is to review the literature on affective body expression perception and recognition. One issue is whether there are universal aspects to affect expression perception and recognition models or if they are affected by human factors such as culture. Next, we discuss the difference between form and movement information as studies have shown that they are governed by separate pathways in the brain. We also review psychological studies that have investigated bodily configurations to evaluate if specific features can be identified that contribute to the recognition of specific affective states. The survey then turns to automatic affect recognition systems using body expressions as at least one input modality. The survey ends by raising open questions on data collecting, labeling, modeling, and setting benchmarks for comparing automatic recognition systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Barsalou, L. W. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002149 · Cited by 6,887
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Core affect and the psychological construction of emotion.
Russell, J. A. (2003) · Psychological Review · doi:10.1037/0033-295x.110.1.145 · Cited by 6,113 · cited 3×
“Russell [180] considers the prototypical expressions of emotions just a subset of the way we express emotions.”
InfluentialBarsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936 · cited 1×
“A typical example is offered by whole-body computer games (e.g., Nintendo Wii and Microsoft Kinect) where body movement is not only a means to control the interaction between us and the games, but also a way to capture and affect our own emotional and cognitive performances [16], [17], [18], [19].”
BackgroundHand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
Handbook of Affective Sciences
(2002) · doi:10.1093/oso/9780195126013.001.0001 · Cited by 5,073
Fear-avoidance and its consequences in chronic musculoskeletal pain: a state of the art.
Vlaeyen, J. W. S., & Linton, S. J. (2000) · Pain · doi:10.1016/s0304-3959(99)00242-0 · Cited by 4,931
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345
The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
EKMAN, P., & FRIESEN, W. V. (1969) · Semiotica · doi:10.1515/semi.1969.1.1.49 · Cited by 3,316
Cited by
Current State of Text Sentiment Analysis from Opinion to Emotion Mining
Yadollahi, A., Shahraki, A. G., & Zaiane, O. R. (2018) · ACM Computing Surveys · doi:10.1145/3057270 · Cited by 489
Survey on Emotional Body Gesture Recognition
Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2874986 · Cited by 455
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360
An Efficient LSTM Network for Emotion Recognition From Multichannel EEG Signals
Du, X., Ma, C., Zhang, G., Li, J., Lai, Y.-K., Zhao, G., Deng, X., Liu, Y.-J., & Wang, H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3013711 · Cited by 357
Learning deep physiological models of affect
Martinez, H. P., Bengio, Y., & Yannakakis, G. N. (2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2247823 · Cited by 287
Automatic ECG-Based Emotion Recognition in Music Listening
Hsu, Y.-L., Wang, J.-S., Chiang, W.-C., & Hung, C.-H. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2781732 · Cited by 258
Shoumy, N. J., Ang, L.-M., Seng, K. P., Rahaman, D. M. M., & Zia, T. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.102447 · Cited by 171
The more the merrier: Analysing the affect of a group of people in images
Dhall, A., Joshi, J., Sikka, K., Goecke, R., & Sebe, N. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163151 · Cited by 93
Automatic emotion recognition based on body movement analysis: a survey
Zacharatos, H., Gatzoulis, C., & Chrysanthou, Y. L. (2014) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2014.106 · Cited by 77
Emotion recognition using Kinect motion capture data of human gaits
Li, S., Cui, L., Zhu, C., Li, B., Zhao, N., & Zhu, T. (2016) · PeerJ · doi:10.7717/peerj.2364 · Cited by 71
A glove-based system for studying hand-object manipulation via joint pose and force sensing
Liu, H., Xie, X., Millar, M., Edmonds, M., Gao, F., Zhu, Y., Santos, V. J., Rothrock, B., & Zhu, S.-C. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206575 · Cited by 60
Schwarz, J., Marais, C. C., Leyvand, T., Hudson, S. E., & Mankoff, J. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2556989 · Cited by 45
Human Emotion Recognition With Relational Region-Level Analysis
Li, W., Dong, X., & Wang, Y. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3064918 · Cited by 43
Body expression recognition from animated 3D skeleton
Crenn, A., Khan, R. A., Meyer, A., & Bouakaz, S. (2016) · 2016 International Conference on 3D Imaging (IC3D) · doi:10.1109/ic3d.2016.7823448 · Cited by 34
Schrader, C., & Kalyuga, S. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.102374 · Cited by 31
Trajkova, M., Long, D., Deshpande, M., Knowlton, A., & Magerko, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642677 · Cited by 24
Qu, C., Brinkman, W.-P., Ling, Y., Wiggers, P., & Heynderickx, I. (2013) · Virtual Reality · doi:10.1007/s10055-013-0231-z · Cited by 16
Learning Gait Emotions Using Affective and Deep Features
Randhavane, T., Bhattacharya, U., Kabra, P., Kapsaskis, K., Gray, K., Manocha, D., & Bera, A. (2022) · Proceedings of the 15th ACM SIGGRAPH Conference on Motion, Interaction and Games · doi:10.1145/3561975.3562957 · Cited by 13
Towards Analyzing and Predicting the Experience of Live Performances with Wearable Sensing
Gedik, E., Cabrera-Quiros, L., Martella, C., Englebienne, G., & Hung, H. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2875987 · Cited by 10
Metadata
- Authors
- Kleinsmith, A., & Bianchi-Berthouze, N.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2013-01
- Volume
- 4
- Issue
- 1
- Pages
- 15-33
- ISSN
- 1949-3045 (ISSN-L)
- OpenAlex
- W2024221294
- Cited by
- 607
- References
- 169
- FWCI
- 57.90
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.