It’s in your eyes—using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
The field of social neuroscience has made remarkable progress in elucidating the neural mechanisms of social cognition. More recently, the need for new experimental approaches has been highlighted that allow studying social encounters in a truly interactive manner by establishing 'online' reciprocity in social interaction. In this article, we present a newly developed adaptation of a method which uses eyetracking data obtained from participants in real time to control visual stimulation during functional magnetic resonance imaging, thus, providing an innovative tool to generate gaze-contingent stimuli in spite of the constraints of this experimental setting. We review results of two paradigms employing this technique and demonstrate how gaze data can be used to animate a virtual character whose behavior becomes 'responsive' to being looked at allowing the participant to engage in 'online' interaction with this virtual other in real-time. Possible applications of this setup are discussed highlighting the potential of this development as a new 'tool of the trade' in social cognitive and affective neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Does Rejection Hurt? An fMRI Study of Social Exclusion
Eisenberger, N. I., Lieberman, M. D., & Williams, K. D. (2003) · Science · doi:10.1126/science.1089134 · Cited by 3,849 · cited 4×
“, 2006), while mentalizing during ‘online’ social interaction has only been studied by a minority of studies (e.g. Montague et al., 2002; Eisenberger et al., 2003), often making use of game theory paradigms from economics (e.”
BackgroundInfluentialMeeting of minds: the medial frontal cortex and social cognition
Amodio, D. M., & Frith, C. D. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1884 · Cited by 3,782 · cited 2×
“…al., 2001; Schilbach et al., 2008), activations in ventral and dorsal MPFCat voxel-level correction for multiple comparisonshave been related to outcome monitoring and the understanding of communicative intent (Amodio and Frith, 2006) as well as representations of triadic relations (Saxe, 2006).”
BackgroundDevelopment and neurophysiology of mentalizing
Frith, U., & Frith, C. D. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1218 · Cited by 2,306 · cited 1×
“Social neuroscience has helped to shed light upon the neural mechanisms underlying our ability to understand other minds under the headings of 'theory of mind' or 'mentalizing', commonly understood as the ability to represent other people's mental states (Frith and Frith, 2003, 2008).”
BackgroundThe eyes have it: the neuroethology, function and evolution of social gaze
Emery, N. J. (2000) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(00)00025-7 · Cited by 2,037
Social Cognitive Neuroscience: A Review of Core Processes
Lieberman, M. D. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085654 · Cited by 2,010
From presence to consciousness through virtual reality.
Sanchez-Vives, M. V., & Slater, M. (2005) · Nature reviews. Neuroscience · doi:10.1038/nrn1651 · Cited by 1,831 · cited 1×
“Such computer-generated characters have been suggested as a valuable tool for social neuroscience (e.g. Sanchez-Vives and Slater, 2005) as they convey social information to human observers (e.g. Bente et al., 2001; Bente et al., 2002, 2008a; Bailenson et al., 2003) and cause reactions strikingly…”
MethodSinger, T. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.06.011 · Cited by 1,079 · cited 2×
“Consequently, the need to develop 'interactive mind' paradigms that could provide a platform to systematically study the neural mechanisms of social interaction in an ecologically valid manner has been pointed out recently (Singer, 2006).”
BackgroundTwo-year-olds with autism orient to non-social contingencies rather than biological motion
Klin, A., Lin, D. J., Gorrindo, P., Ramsay, G., & Jones, W. (2009) · Nature · doi:10.1038/nature07868 · Cited by 921 · cited 1×
“Also, it has been suggested that autistic individuals might be more sensitive to perfect, non-social as compared to imperfect, social contingencies in the environment (Gergely, 2001; Klin et al., 2009).”
BackgroundUniquely human social cognition
Saxe, R. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.001 · Cited by 919 · cited 2×
“This'; Saxe, 2006).”
BackgroundThe enactive mind, or from actions to cognition: lessons from autism
Klin, A., Jones, W., Schultz, R., & Volkmar, F. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1202 · Cited by 890
Cited by
Toward a second-person neuroscience
Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., & Vogeley, K. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000660 · Cited by 1,510
Self-citationCan social interaction constitute social cognition?
De Jaegher, H., Di Paolo, E., & Gallagher, S. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.009 · Cited by 911
Parsons, T. D. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00660 · Cited by 837
Risko, E. F., Laidlaw, K., Freeth, M., Foulsham, T., & Kingstone, A. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00143 · Cited by 295
The Role of Eye Gaze During Natural Social Interactions in Typical and Autistic People
Cañigueral, R., & Hamilton, A. F. D. C. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00560 · Cited by 164
Design of a virtual reality based adaptive response technology for children with autism
Lahiri, U., Bekele, E., Dohrmann, E., Warren, Z., & Sarkar, N. (2013) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2012.2218618 · Cited by 162
Pfeiffer, U. J., Schilbach, L., Timmermans, B., Kuzmanovic, B., Georgescu, A. L., Bente, G., & Vogeley, K. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.061 · Cited by 155
Self-citationGeorgescu, A. L., Kuzmanovic, B., Roth, D., Bente, G., & Vogeley, K. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00807 · Cited by 123
Self-citationFunctional changes of the reward system underlie blunted response to social gaze in cocaine users
Preller, K. H., Herdener, M., Schilbach, L., Stämpfli, P., Hulka, L. M., Vonmoos, M., Ingold, N., Vogeley, K., Tobler, P. N., Seifritz, E., et al. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1317090111 · Cited by 104
Self-citationOberwelland, E., Schilbach, L., Barisic, I., Krall, S. C., Vogeley, K., Fink, G. R., Herpertz-Dahlmann, B., Konrad, K., & Schulte-Rüther, M. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.026 · Cited by 93
Self-citationBekele, E., Crittendon, J., Zheng, Z., Swanson, A., Weitlauf, A., Warren, Z., & Sarkar, N. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2035-8 · Cited by 78
Oxytocin under opioid antagonism leads to supralinear enhancement of social attention
Dal Monte, O., Piva, M., Anderson, K. M., Tringides, M., Holmes, A. J., & Chang, S. W. C. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1702725114 · Cited by 55
Metadata
- Authors
- Wilms, M., Schilbach, L., Pfeiffer, U., Bente, G., Fink, G. R., & Vogeley, K.
- Venue
- Social Cognitive and Affective Neuroscience
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-03-01
- Volume
- 5
- Issue
- 1
- Pages
- 98-107
- ISSN
- 1749-5016 (ISSN-L)
- 1749-5024
- OpenAlex
- W2109531568
- Cited by
- 155
- References
- 15
- FWCI
- 18.51
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.