The Perception of Emotion in Artificial Agents
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Given recent technological developments in robotics, artificial intelligence, and virtual reality, it is perhaps unsurprising that the arrival of emotionally expressive and reactive artificial agents is imminent. However, if such agents are to become integrated into our social milieu, it is imperative to establish an understanding of whether and how humans perceive emotion in artificial agents. In this review, we incorporate recent findings from social robotics, virtual reality, psychology, and neuroscience to examine how people recognize and respond to emotions displayed by artificial agents. First, we review how people perceive emotions expressed by an artificial agent, such as facial and bodily expressions. Second, we evaluate the similarities and differences in the consequences of perceived emotions in artificial compared to human agents. Besides accurately recognizing the emotional state of an artificial agent, it is critical to understand how humans respond to those emotions. Does interacting with an angry robot induce the same responses in people as interacting with an angry person? Similarly, does watching a robot rejoice when it wins a game elicit similar feelings of elation in the human observer? Here, we provide an overview of the current state of emotion expression and perception during interactions with artificial agents, as well as a clear articulation of the challenges and guiding principles to be addressed as we move ever closer to truly emotional artificial agents.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 1×
“tive for faces [61], was greater for human agents compared to virtual agents [55], but the opposite pattern emerged for robotic agents [24], [25].”
BackgroundConstants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509 · cited 1×
“Ever since the early study of Ekman and Friesen [119], debate continues as to whether emotions are universal.”
BackgroundBehavioral Study of obedience.
Milgram, S. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040525 · Cited by 4,918 · cited 2×
“This question has been investigated by studies using a similar approach to a classical psychology study known as the Milgram Obedience experiment [116].”
MethodEmpathy: its ultimate and proximate bases
Preston, S. D., & de Waal, F. B. M. (2002) · Behavioral and Brain Sciences · doi:10.1017/s0140525x02000018 · Cited by 4,126 · cited 1×
“erally translating to “to feel into another”), is assumed to be driving force behind social behavior [98], [99].”
BackgroundSocial perception from visual cues: Role of the STS region
Allison, T., Puce, A., & McCarthy, G. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01501-1 · Cited by 2,461 · cited 1×
“a third region, the posterior superior temporal sulcus (pSTS) is involved in processing bodily motion [87], [88] and the nature of the interaction [89].”
BackgroundToward a second-person neuroscience
Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., & Vogeley, K. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000660 · Cited by 1,510
Socially intelligent robots: Dimensions of human-robot interaction
Dautenhahn, K. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.2004 · Cited by 1,210 · cited 1×
“Artificial agents are becoming progressively better at reading and appropriately responding to emotions expressed by humans [7], with many artificial agents programmed to display emotional reactions, such as sadness or joy.”
BackgroundAffective interactions using virtual reality: the link between presence and emotions
Riva, G., Mantovani, F., Capideville, C. S., Preziosa, A., Morganti, F., Villani, D., Gaggioli, A., Botella, C., & Alcañiz, M. (2007) · CyberPsychology & Behavior · doi:10.1089/cpb.2006.9993 · Cited by 1,111 · cited 1×
“The second category includes visually presented digital agents or avatars, such as those used in virtual reality environments [13], therapeutic interventions [14], and educational contexts [15].”
BackgroundMUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
Facial expressions of emotion are not culturally universal
Jack, R. E., Garrod, O. G. B., Yu, H., Caldara, R., & Schyns, P. G. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1200155109 · Cited by 940
Cited by
Liu-Thompkins, Y., Okazaki, S., & Li, H. (2022) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-022-00892-5 · Cited by 441
Laban, G., Kappas, A., Morrison, V., & Cross, E. S. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-023-01076-z · Cited by 119
Self-citationTaxonomy of Trust-Relevant Failures and Mitigation Strategies
Tolmeijer, S., Weiss, A., Hanheide, M., Lindner, F., Powers, T. M., Dixon, C., & Tielman, M. L. (2020) · Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3319502.3374793 · Cited by 103
“However, effects of robots showing negative emotions are in general understudied [42], and no systematic studies of the other strategies exist so far.”
BackgroundAn Overview of Emotion in Artificial Intelligence
Assunção, G., Patrão, B., Castelo-Branco, M., & Menezes, P. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3159614 · Cited by 103
A Systematic Review of Ten Years of Research on Human Interaction with Social Robots
Lambert, A., Norouzi, N., Bruder, G., & Welch, G. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1801172 · Cited by 89
Metadata
- Authors
- Hortensius, R., Hekele, F., & Cross, E. S.
- Venue
- IEEE Transactions on Cognitive and Developmental Systems
- Published
- 2018-12
- Volume
- 10
- Issue
- 4
- Pages
- 852-864
- ISSN
- 2379-8920 (ISSN-L)
- 2379-8939
- OpenAlex
- W2799638175
- Cited by
- 166
- References
- 27
- FWCI
- 16.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Perception of Emotion in Artificial Agents. https://app.cochat.ai/papers/10.1109/tcds.2018.2826921
- The paper
- Hortensius, R., Hekele, F., & Cross, E. S. (2018). The Perception of Emotion in Artificial Agents. IEEE Transactions on Cognitive and Developmental Systems. https://doi.org/10.1109/tcds.2018.2826921
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.