Embodying Others in Immersive Virtual Reality: Electro-Cortical Signatures of Monitoring the Errors in the Actions of an Avatar Seen from a First-Person Perspective
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Brain monitoring of errors in one's own and other's actions is crucial for a variety of processes, ranging from the fine-tuning of motor skill learning to important social functions, such as reading out and anticipating the intentions of others. Here, we combined immersive virtual reality and EEG recording to explore whether embodying the errors of an avatar by seeing it from a first-person perspective may activate the error monitoring system in the brain of an onlooker. We asked healthy participants to observe, from a first- or third-person perspective, an avatar performing a correct or an incorrect reach-to-grasp movement toward one of two virtual mugs placed on a table. At the end of each trial, participants reported verbally how much they embodied the avatar's arm. Ratings were maximal in first-person perspective, indicating that immersive virtual reality can be a powerful tool to induce embodiment of an artificial agent, even through mere visual perception and in the absence of any cross-modal boosting. Observation of erroneous grasping from a first-person perspective enhanced error-related negativity and medial–frontal theta power in the trials where human onlookers embodied the virtual character, hinting at the tight link between early, automatic coding of error detection and sense of embodiment. Error positivity was similar in 1PP and 3PP, suggesting that conscious coding of errors is similar for self and other. Thus, embodiment plays an important role in activating specific components of the action monitoring system when others' errors are coded as if they are one's own errors. SIGNIFICANCE STATEMENT Detecting errors in other's actions is crucial for social functions, such as reading out and anticipating the intentions of others. Using immersive virtual reality and EEG recording, we explored how the brain of an onlooker reacted to the errors of an avatar seen from a first-person perspective. We found that mere observation of erroneous actions enhances electrocortical markers of error detection in the trials where human onlookers embodied the virtual character. Thus, the cerebral system for action monitoring is maximally activated when others' errors are coded as if they are one's own errors. The results have important implications for understanding how the brain can control the external world and thus creating new brain–computer interfaces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Oostenveld, R., Fries, P., Maris, E., & Schoffelen, J.-M. (2011) · Computational Intelligence and Neuroscience · doi:10.1155/2011/156869 · Cited by 10,323
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328 · cited 1×
“ERD and ERS represent a decrease or increase in synchrony of the recorded neuronal population (Pfurtscheller and Lopes da Silva, 1999).”
BackgroundAgresti, A. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471249688 · Cited by 6,746
Kutas, M., & Federmeier, K. D. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.131123 · Cited by 4,377 · cited 3×
“N400componentis traditionally linked to the occurrence of semantic violations when processing linguistic material (Kutas and Federmeier, 2011).”
BackgroundInfluentialHolroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538 · cited 1×
“To try and tease apart the effect of participant’s perspective from sense of embodiment, we used a median-split procedure to separate low and high reports of sense of embodiment in the different perspective and avatar accuracy conditions (MacCallum et al., 2002).”
MethodAnterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 2×
“Importantly, neural activity in the frontal node of the performance monitor system (Carter et al., 1998) may underpin error processing through a complex coding of error detection and perspective taking that ultimately induces changes in one’s sense of embodiment.”
BackgroundA neural system for error detection and compensation
Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00586.x · Cited by 2,862 · cited 3×
“The ERN is a negative deflection waveform with a frontocentral midline distribution that peaks 80 –100 ms after the occurrence of an erroneous response (Falkenstein et al., 1991; Gehring et al., 1993).”
BackgroundThe neural basis of error detection: Conflict monitoring and the error-related negativity
Yeung, N., Botvinick, M. M., & Cohen, J. D. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.931 · Cited by 1,924
Falkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1991) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(91)90062-9 · Cited by 1,706 · cited 3×
“The ERN is a negative deflection waveform with a frontocentral midline distribution that peaks 80 –100 ms after the occurrence of an erroneous response (Falkenstein et al., 1991; Gehring et al., 1993).”
BackgroundLisman, J. E., & Jensen, O. (2013) · Neuron · doi:10.1016/j.neuron.2013.03.007 · Cited by 1,609
ERP components on reaction errors and their functional significance: A tutorial
Falkenstein, M., Hoormann, J., Christ, S., & Hohnsbein, J. (2000) · Biological Psychology · doi:10.1016/s0301-0511(99)00031-9 · Cited by 1,442
First person experience of body transfer in virtual reality
Slater, M., Spanlang, B., Sanchez-Vives, M. V., & Blanke, O. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010564 · Cited by 1,090
Use of the Extreme Groups Approach: A Critical Reexamination and New Recommendations.
Preacher, K. J., Rucker, D. D., MacCallum, R. C., & Nicewander, W. A. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.2.178 · Cited by 732 · cited 1×
“Although the median-split procedure provides a straightforward way to categorize specific trials, studies suggest that dychotomizing continuous variables may imply a gain in power (Preacher et al., 2005).”
MethodCavanagh, J. F., Cohen, M. X., & Allen, J. J. B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4137-08.2009 · Cited by 669
Anterior cingulate cortex, conflict monitoring, and levels of processing
van Veen, V., Cohen, J. D., Botvinick, M. M., Stenger, V. A., & Carter, C. S. (2001) · NeuroImage · doi:10.1006/nimg.2001.0923 · Cited by 656
Luu, P., Tucker, D. M., & Makeig, S. (2004) · Clinical Neurophysiology · doi:10.1016/j.clinph.2004.03.031 · Cited by 545 · cited 1×
“It is worth noting that oscillations in the theta band recorded from medial–frontal regions during error detection or other types of conflict monitoring (Cohen, 2014; Cavanagh and Shackman, 2015) seem to be inherently linked to ERN in the domain of time (Luu et al., 2004).”
BackgroundOn the other hand: Dummy hands and peripersonal space
Makin, T. R., Holmes, N. P., & Ehrsson, H. H. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.02.041 · Cited by 530
Is the “error negativity” specific to errors?
Vidal, F., Hasbroucq, T., Grapperon, J., & Bonnet, M. (2000) · Biological Psychology · doi:10.1016/s0301-0511(99)00032-0 · Cited by 517
The mechanism of self-recognition in humans.
Jeannerod, M. (2003) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00384-4 · Cited by 515 · cited 1×
“movement) are essential for self-recognition and for distinguishing self-generated from other-produced actions (Jeannerod, 2003; Kalckert and Ehrsson, 2012).”
BackgroundThe Electrophysiological Dynamics of Interference during the Stroop Task
Hanslmayr, S., Pastötter, B., Bäuml, K.-H., Gruber, S., Wimber, M., & Klimesch, W. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20020 · Cited by 510
Neural Systems for Error Monitoring: Recent Findings and Theoretical Perspectives
Taylor, S. F., Stern, E. R., & Gehring, W. J. (2007) · The Neuroscientist · doi:10.1177/1073858406298184 · Cited by 368
Theta EEG dynamics of the error-related negativity
Trujillo, L. T., & Allen, J. J. B. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2006.11.009 · Cited by 314 · cited 5×
“While the results concerning enhancement of theta power is in keeping with most of the previous literature (Trujillo and Allen, 2007; Cavanagh et al., 2009; van Driel et al., 2012), the enhancement of alpha band in the very same conditions found for theta is less expected and deserves some…”
BackgroundResultInfluentialPetkova, V. I., Khoshnevis, M., & Ehrsson, H. H. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00035 · Cited by 311 · cited 1×
“…studies show that mere visual perception of an avatar seen from a first-person perspective (1PP) may suffice to induce a strong feeling of being embodied in a virtual avatar (Slater et al., 2010; Petkova et al., 2011; Maselli and Slater, 2013) and controlling its actions (Tieri et al., 2015a).”
Backgroundvan Driel, J., Ridderinkhof, K. R., & Cohen, M. X. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0802-12.2012 · Cited by 225 · cited 5×
“In particular, parieto-occipital alpha synchronization seems to be more related to attention-related errors and mid-frontal theta to motor-control related errors ( van Driel et al., 2012).”
BackgroundResultInfluentialError awareness and the error-related negativity: evaluating the first decade of evidence
Wessel, J. R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00088 · Cited by 215 · cited 5×
“Cortical signatures of observed action error as inferred from ERPs ERN and Pe are thought of as electrocortical signatures of the neural system that monitors one’s own action and detects performance errors in humans (van Veen and Carter, 2006; Wessel, 2012) and nonhuman primates (Phillips and Everling, 2014).”
BackgroundInfluentialN400 ERPs for actions: building meaning in context
Amoruso, L., Gelormini, C., Aboitiz, F., Alvarez González, M., Manes, F., Cardona, J. F., & Ibanez, A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00057 · Cited by 125 · cited 1×
“That N400 was larger for erroneous grasps is in keeping with studies suggesting its role in the process of integrating experience-related knowledge with actual information in specific contexts (Amoruso et al., 2013).”
ResultBrozzoli, C., Ehrsson, H. H., & Farnè, A. (2014) · The Neuroscientist · doi:10.1177/1073858413511153 · Cited by 125
An electrophysiological signal that precisely tracks the emergence of error awareness
Murphy, P. R., Robertson, I. H., Allen, D., Hester, R., & O'Connell, R. G. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00065 · Cited by 94 · cited 1×
“Another novel result concerns Pe, the ERP component that predicts whether an error would be consciously perceived up to 400 ms before the average awareness response (Murphy et al., 2012; Wessel, 2012).”
Background
Cited by
Virtual reality in cognitive and motor rehabilitation: facts, fiction and fallacies
Tieri, G., Morone, G., Paolucci, S., & Iosa, M. (2018) · Expert Review of Medical Devices · doi:10.1080/17434440.2018.1425613 · Cited by 456
Self-citationAvatar Embodiment. A Standardized Questionnaire
Peck, T. C., & Gonzalez-Franco, M. (2021) · Frontiers in Virtual Reality · doi:10.3389/frvir.2020.575943 · Cited by 258
Midline frontal and occipito-temporal activity during error monitoring in dyadic motor interactions
Moreau, Q., Candidi, M., Era, V., Tieri, G., & Aglioti, S. M. (2020) · Cortex · doi:10.1016/j.cortex.2020.01.020 · Cited by 53
Self-citationBoukarras, S., Özkan, D. G., Era, V., Moreau, Q., Tieri, G., & Candidi, M. (2022) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01834 · Cited by 24
“Here, we decided to include also a first-person virtual avatar, a procedure able to induce the illusory feeling that the virtual body (body ownership) and its actions (agency) belong to the participant (Tieri, Morone, Paolucci, & Iosa, 2018; Pavone et al., 2016).”
BackgroundMethodSelf-citationInterpersonal Motor Interactions Shape Multisensory Representations of the Peripersonal Space
Fanghella, M., Era, V., & Candidi, M. (2021) · Brain Sciences · doi:10.3390/brainsci11020255 · Cited by 22
Metadata
- Authors
- Pavone, E. F., Tieri, G., Rizza, G., Tidoni, E., Grisoni, L., & Aglioti, S. M.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2016-01-12
- Volume
- 36
- Issue
- 2
- Pages
- 268-279
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2289937106
- Cited by
- 148
- References
- 29
- FWCI
- 24.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.