Brain Response to a Humanoid Robot in Areas Implicated in the Perception of Human Emotional Gestures
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The humanoid robot WE4-RII was designed to express human emotions in order to improve human-robot interaction. We can read the emotions depicted in its gestures, yet might utilize different neural processes than those used for reading the emotions in human agents. METHODOLOGY: Here, fMRI was used to assess how brain areas activated by the perception of human basic emotions (facial expression of Anger, Joy, Disgust) and silent speech respond to a humanoid robot impersonating the same emotions, while participants were instructed to attend either to the emotion or to the motion depicted. PRINCIPAL FINDINGS: Increased responses to robot compared to human stimuli in the occipital and posterior temporal cortices suggest additional visual processing when perceiving a mechanical anthropomorphic agent. In contrast, activity in cortical areas endowed with mirror properties, like left Broca's area for the perception of speech, and in the processing of emotions like the left anterior insula for the perception of disgust and the orbitofrontal cortex for the perception of anger, is reduced for robot stimuli, suggesting lesser resonance with the mechanical agent. Finally, instructions to explicitly attend to the emotion significantly increased response to robot, but not human facial expressions in the anterior part of the left inferior frontal gyrus, a neural marker of motor resonance. CONCLUSIONS: Motor resonance towards a humanoid robot, but not a human, display of facial emotion is increased when attention is directed towards judging emotions. SIGNIFICANCE: Artificial agents can be used to assess how factors like anthropomorphism affect neural response to the perception of human actions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rizzolatti, G., & Craighero, L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144230 · Cited by 7,433 · cited 12×
“Neuroimaging studies have identified brain regions, in premotor and parietal cortices [21,22,23], in which action execution and observation overlap in the human brain (for review see [24]).”
BackgroundResultInfluentialSelf-citationOn seeing human: A three-factor theory of anthropomorphism
Epley, N., Waytz, A., & Cacioppo, J. T. (2007) · Psychological Review · doi:10.1037/0033-295x.114.4.864 · Cited by 4,069 · cited 1×
“We suggest that because of its clearly artificial nature, the robot did not elicit a desire for social contact [75] sufficient to be reflected in orbitofrontal activity.”
BackgroundA new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 2×
“When available, functional localization is based on the anatomy toolbox (Eickhoff et al., 2005), with percentage indicating the probability of the maximum belonging to the designated area.”
BackgroundMethodPINKER, S. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb08538.x · Cited by 3,738
Functional neuroanatomy of emotion: A meta-analysis of emotion activation studies in PET and fMRI
Phan, K. L., Wager, T., Taylor, S. F., & Liberzon, I. (2002) · NeuroImage · doi:10.1006/nimg.2002.1087 · Cited by 3,502
Cattaneo, L., & Rizzolatti, G. (2009) · Archives of Neurology · doi:10.1001/archneurol.2009.41 · Cited by 3,137
Self-citationCortical mechanisms of human imitation
Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C., & Rizzolatti, G. (1999) · Science · doi:10.1126/science.286.5449.2526 · Cited by 2,683 · cited 2×
“This region of the cortex, which has been implicated in the perception of human actions [56] and imitation [22,81], is likely homologous to frontal regions responding to action observation in macaque monkeys [24,82].”
BackgroundSelf-citationAction observation activates premotor and parietal areas in a somatotopic manner: an fMRI study
Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., Seitz, R. J., Zilles, K., Rizzolatti, G., & Freund, H. ‐. (2001) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2001.01385.x · Cited by 2,488
Self-citationSocial perception from visual cues: Role of the STS region
Allison, T., Puce, A., & McCarthy, G. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01501-1 · Cited by 2,461 · cited 1×
“It is particularly respondent to visual depictions of actions across a variety of presentations (full body or body parts actions [65], pointlight displays [66], as well as animal actions [56] and scripted geometrical shapes movements [67]).”
BackgroundBoth of Us Disgusted in My Insula
Wicker, B., Keysers, C., Plailly, J., Royet, J.-P., Gallese, V., & Rizzolatti, G. (2003) · Neuron · doi:10.1016/s0896-6273(03)00679-2 · Cited by 2,185
Self-citationNeurobiology of emotion perception I: the neural basis of normal emotion perception
Phillips, M. L., Drevets, W. C., Rauch, S. L., & Lane, R. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(03)00168-9 · Cited by 2,173
Neural mechanisms of empathy in humans: a relay from neural systems for imitation to limbic areas
Carr, L., Iacoboni, M., Dubeau, M.-C., Mazziotta, J. C., & Lenzi, G. L. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0935845100 · Cited by 1,978 · cited 1×
“These examples support a generalization of resonance to multiple domains of cognition including emotions [29,30].”
BackgroundHearing Sounds, Understanding Actions: Action Representation in Mirror Neurons
Kohler, E., Keysers, C., Umiltà, M. A., Fogassi, L., Gallese, V., & Rizzolatti, G. (2002) · Science · doi:10.1126/science.1070311 · Cited by 1,801
Self-citationImpairment of social and moral behavior related to early damage in human prefrontal cortex
Anderson, S. W., Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1999) · Nature Neuroscience · doi:10.1038/14833 · Cited by 1,539 · cited 1×
“Orbitofrontal lesions have been associated with disinhibited social behaviours, putatively by lack of anticipation of their negative outcomes [74].”
BackgroundOn Broca, brain, and binding: A new framework
Hagoort, P. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.07.004 · Cited by 1,411 · cited 2×
“More generally, Broca’s region involvement in language production and comprehension [52] supports a role of motor resonance in the domain of speech perception that was hypothesized prior to the discovery of mirror neurons as the ‘‘motor theory of speech perception’’ [78].”
BackgroundDissociable neural responses to facial expressions of sadness and anger
Blair, R. J. R., Morris, J. S., Frith, C. D., Perrett, D. I., & Dolan, R. J. (1999) · Brain · doi:10.1093/brain/122.5.883 · Cited by 1,212
Self-citationPuce, A., Allison, T., Asgari, M., Gore, J. C., & McCarthy, G. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-16-05205.1996 · Cited by 987 · cited 6×
“This increase appears at odd with their proposed human face-specificity [55] of FFA bilaterally and right LFA.”
BackgroundInfluentialAn Interference Effect of Observed Biological Movement on Action
Kilner, J. M., Paulignan, Y., & Blakemore, S. J. (2003) · Current Biology · doi:10.1016/s0960-9822(03)00165-9 · Cited by 844
Self-citationKeysers, C. (2004) · doi:10.1016/s0896-6273(04)00156-4 · Cited by 806
Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study
Buccino, G., Lui, F., Canessa, N., Patteri, I., Lagravinese, G., Benuzzi, F., Porro, C. A., & Rizzolatti, G. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322755601 · Cited by 762 · cited 3×
“This region of the cortex, which has been implicated in the perception of human actions [56] and imitation [22,81], is likely homologous to frontal regions responding to action observation in macaque monkeys [24,82].”
BackgroundSelf-citationAmphetamine-induced dopamine release in human ventral striatum correlates with euphoria
Drevets, W. C., Gautier, C., Price, J. C., Kupfer, D. J., Kinahan, P. E., Grace, A. A., Price, J. L., & Mathis, C. A. (2001) · Biological Psychiatry · doi:10.1016/s0006-3223(00)01038-6 · Cited by 706 · cited 1×
“This can be attributed to its role in reward-processing [69] following the suggestion that dopaminergic signalling in these regions is important to elicit internal rewarding response [70].”
BackgroundSomatosensory activations during the observation of touch and a case of vision–touch synaesthesia
Blakemore, S.-J., Bristow, D., Bird, G., Frith, C., & Ward, J. (2005) · Brain · doi:10.1093/brain/awh500 · Cited by 614 · cited 1×
“Furthermore, the somatosensory cortex responds to the observation and feeling of touch [25,26,27], and the insula responds to the observation and feeling of disgust [28].”
BackgroundSelf-citationde Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0407042101 · Cited by 511
The human inferior parietal lobule in stereotaxic space
Caspers, S., Eickhoff, S. B., Geyer, S., Scheperjans, F., Mohlberg, H., Zilles, K., & Amunts, K. (2008) · Brain Structure and Function · doi:10.1007/s00429-008-0195-z · Cited by 395 · cited 3×
“In the left hemisphere, clusters were found in V3v (#2), V4 [44] and V5 [50] (#3), as well as in the left-hemisphere FFA (MNI coordinates 234, 262, 218 compared to 235, 264, 216 in [48]), but not in the lateral temporal cortex.”
BackgroundObserving others: multiple action representation in the frontal lobe.
Nelissen, K., Luppino, G., Vanduffel, W., Rizzolatti, G., & Orban, G. A. (2005) · Science · doi:10.1126/science.1115593 · Cited by 352
Self-citationReading normal and degraded words: Contribution of the dorsal and ventral visual pathways.
Cohen, L., Dehaene, S., Vinckier, F., Jobert, A., & Montavont, A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.036 · Cited by 303 · cited 1×
“. Alternatively, this comparison could require additional processing of the visual input in order to recognize the robot as a face. This interpretation is supported by the significant increase of response in extrastriate areas V3, V4 and V5, implied in the processing of low-level aspect of visual stimuli such as form,…”
BackgroundWada, K., Shibata, T., Saito, T., Sakamoto, K., & Tanie, K. (2006) · Proceedings of the 2005 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2005.1570535 · Cited by 288
Anthropomorphism influences perception of computer-animated characters' actions
Chaminade, T., Hodgins, J., & Kawato, M. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsm017 · Cited by 181
Self-citation
Cited by
Saygin, A. P., Chaminade, T., Ishiguro, H., Driver, J., & Frith, C. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr025 · Cited by 452
“…have not been sufficiently explored or separated in previous studies, even though this is a topic of increasing interest in robotics, neuroscience and vision science (MacDorman and Ishiguro, 2006; Chaminade et al., 2007, 2010; Kanda et al., 2008; Jastorff and Orban, 2009; Saygin et al., 2010).”
BackgroundSelf-citationEmpathy in Virtual Agents and Robots: A Survey
Paiva, A., Leite, I., Boukricha, H., & Wachsmuth, I. (2017) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2912150 · Cited by 361
Robots As Intentional Agents: Using Neuroscientific Methods to Make Robots Appear More Social
Wiese, E., Metta, G., & Wykowska, A. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01663 · Cited by 286
Investigations on empathy towards humans and robots using fMRI
Rosenthal-von der Pütten, A. M., Schulte, F. P., Eimler, S. C., Sobieraj, S., Hoffmann, L., Maderwald, S., Brand, M., & Krämer, N. C. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.01.004 · Cited by 148
Marangolo, P., Cipollari, S., Fiori, V., Razzano, C., & Caltagirone, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038610 · Cited by 49
Metadata
- Authors
- Chaminade, T., Zecca, M., Blakemore, S.-J., Takanishi, A., Frith, C. D., Micera, S., Dario, P., Rizzolatti, G., Gallese, V., & Umiltà, M. A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-07-21
- Volume
- 5
- Issue
- 7
- Pages
- e11577
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2104584247
- Cited by
- 140
- References
- 28
- FWCI
- 10.52
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.