A Common Neural Code for Perceived and Inferred Emotion
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Although the emotions of other people can often be perceived from overt reactions (e.g., facial or vocal expressions), they can also be inferred from situational information in the absence of observable expressions. How does the human brain make use of these diverse forms of evidence to generate a common representation of a target's emotional state? In the present research, we identify neural patterns that correspond to emotions inferred from contextual information and find that these patterns generalize across different cues from which an emotion can be attributed. Specifically, we use functional neuroimaging to measure neural responses to dynamic facial expressions with positive and negative valence and to short animations in which the valence of a character's emotion could be identified only from the situation. Using multivoxel pattern analysis, we test for regions that contain information about the target's emotional state, identifying representations specific to a single stimulus type and representations that generalize across stimulus types. In regions of medial prefrontal cortex (MPFC), a classifier trained to discriminate emotional valence for one stimulus (e.g., animated situations) could successfully discriminate valence for the remaining stimulus (e.g., facial expressions), indicating a representation of valence that abstracts away from perceptual features and generalizes across different forms of evidence. Moreover, in a subregion of MPFC, this neural representation generalized to trials involving subjectively experienced emotional events, suggesting partial overlap in neural responses to attributed and experienced emotions. These data provide a step toward understanding how the brain transforms stimulus-bound inputs into abstract representations of emotion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring individual differences in empathy: Evidence for a multidimensional approach.
Davis, M. H. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.1.113 · Cited by 10,272
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005653411471 · Cited by 6,450 · cited 1×
“The Autism-Spectrum Quotient (Baron-Cohen et al., 2001) and the Interpersonal Reactivity Index (Davis, 1983) were completed via on-line Qualtrics surveys.”
MethodLoss aversion in riskless choice: A reference-dependent model.
Tversky, A., & Kahneman, D. (1991) · The Quarterly Journal of Economics · doi:10.2307/2937956 · Cited by 6,432 · cited 1×
“Negative values ranged from $0.20 to $1.00, and positive values ranged from $0.20 to $2.00; this asymmetry allowed subjects to have net gain for their bonus and accounted for the fact that losses are experienced more strongly than comparable gains (Tversky and Kahneman, 1991).”
BackgroundInfluentialFriston, K. J., Harrison, L., & Penny, W. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00202-7 · Cited by 4,583
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940 · cited 1×
“…the present research uses multivariate analyses that exploit reliable signal across distributed patterns of voxels to uncover neural representations at a spatial scale smaller than that of entire regions (Haxby et al., 2001; Kamitani and Tong, 2005; Kriegeskorte et al., 2006; Norman et al., 2006).”
Meeting of minds: the medial frontal cortex and social cognition
Amodio, D. M., & Frith, C. D. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1884 · Cited by 3,782 · cited 2×
“In addition to the MMPFC region identified by Peelen et al. (2010), adjacent regions of dorsal and ventral MPFC have been strongly implicated in studies of emotion and affective value (Amodio and Frith, 2006; Hynes et al., 2006; Völlm et al., 2006; Etkin et al. 2011).”
BackgroundEmotional processing in anterior cingulate and medial prefrontal cortex
Etkin, A., Egner, T., & Kalisch, R. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.11.004 · Cited by 3,059
The brain basis of emotion: a meta-analytic review
Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012) · Behavioral and Brain Sciences · doi:10.1017/s0140525x11000446 · Cited by 2,320 · cited 2×
“While emotion-specific representations could, in principle, take the form of a uniform response across voxels in a region (detectable with univariate analyses), prior research has yielded little evidence for consistent and selective associations between discrete brain regions and specific emotions (Fusar-Poli et al.,…”
BackgroundPeople thinking about thinking peopleThe role of the temporo-parietal junction in “theory of mind”
Saxe, R., & Kanwisher, N. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00230-1 · Cited by 2,316 · cited 3×
“We localized in individual subjects a middle MPFC ROI comparable with that of Peelen et al. (2010), using a standard social versus nonsocial contrast (Saxe and Kanwisher, 2003; Dodell-Feder et al., 2011; see below).”
BackgroundMethodSelf-citationBeyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271 · cited 2×
“…the present research uses multivariate analyses that exploit reliable signal across distributed patterns of voxels to uncover neural representations at a spatial scale smaller than that of entire regions (Haxby et al., 2001; Kamitani and Tong, 2005; Kriegeskorte et al., 2006; Norman et al., 2006).”
MethodInformation-based functional brain mapping
Kriegeskorte, N., Goebel, R., & Bandettini, P. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0600244103 · Cited by 2,113
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927 · cited 7×
“Results from anatomical OFC/VMPFC reward ROI (Bartra et al., 2013; Clithero and Rangel, 2013).”
BackgroundMethodInfluentialThe neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916
Decoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829 · cited 2×
“…the present research uses multivariate analyses that exploit reliable signal across distributed patterns of voxels to uncover neural representations at a spatial scale smaller than that of entire regions (Haxby et al., 2001; Kamitani and Tong, 2005; Kriegeskorte et al., 2006; Norman et al., 2006).”
MethodPessoa, L., & Adolphs, R. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2920 · Cited by 1,794 · cited 1×
“This study also leaves open the role of other regions (e.g., amygdala, insula, inferior frontal gyrus) that have previously been associated with emotion perception and experience (Shamay-Tsoory et al., 2009; Singer et al., 2009; Pessoa and Adolphs, 2010).”
BackgroundHow does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
The fusiform face area: a cortical region specialized for the perception of faces
Kanwisher, N., & Yovel, G. (2006) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.1934 · Cited by 1,718
Machine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624
Shamay-Tsoory, S. G., Aharon-Peretz, J., & Perry, D. (2009) · Brain · doi:10.1093/brain/awn279 · Cited by 1,544 · cited 1×
“This study also leaves open the role of other regions (e.g., amygdala, insula, inferior frontal gyrus) that have previously been associated with emotion perception and experience (Shamay-Tsoory et al., 2009; Singer et al., 2009; Pessoa and Adolphs, 2010).”
BackgroundNiedenthal, P. M. (2007) · Science · doi:10.1126/science.1136930 · Cited by 1,406
A common role of insula in feelings, empathy and uncertainty
Singer, T., Critchley, H. D., & Preuschoff, K. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.05.001 · Cited by 1,270
Why the child’s theory of mind really is a theory
GOPNIK, A., & WELLMAN, H. M. (1992) · Mind & Language · doi:10.1111/j.1468-0017.1992.tb00202.x · Cited by 1,158
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855
Fast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
The neurobiology of rewards and values in social decision making
Ruff, C. C., & Fehr, E. (2014) · Nature reviews. Neuroscience · doi:10.1038/nrn3776 · Cited by 716 · cited 1×
“One interpretation of this result is that attributing positive or rewarding experiences to others depends on general purpose reward representations that code value in social and nonsocial contexts (Chib et al., 2009; Lin et al., 2012, Ruff and Fehr, 2014).”
BackgroundSimulationist models of face-based emotion recognition
Goldman, A. I., & Sripada, C. S. (2005) · Cognition · doi:10.1016/j.cognition.2004.01.005 · Cited by 647 · cited 1×
“If so, the participant’s empathic reaction might be causally involved in the process of attributing emotions to others (consistent with “simulation theory”; Goldman and Sripada, 2005; Niedenthal, 2007) or might be a downstream consequence of attribution.”
BackgroundChib, V. S., Rangel, A., Shimojo, S., & O'Doherty, J. P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2575-09.2009 · Cited by 643
Zaki (2008) · doi:10.1111/j.1467-9280.2008.02099.x · Cited by 470
The neural bases of empathic accuracy
Zaki, J., Weber, J., Bolger, N., & Ochsner, K. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0902666106 · Cited by 422 · cited 1×
“Moreover, the degree to which MPFC is recruited during an emotion attribution task predicts individual differences in the accuracy of emotion judgments (Zaki et al., 2009a,b).”
BackgroundInferences about mental states
Mitchell, J. P. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0318 · Cited by 387
Stelzer, J., Chen, Y., & Turner, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.063 · Cited by 372 · cited 2×
“Whereas parametric tests are not always appropriate for assessing the significance of classification accuracies (Stelzer et al., 2013), the assumptions of these tests are met in the present case: the accuracy values are independent samples from separate subjects (rather than individual folds…”
BackgroundPelphrey, K. A., Morris, J. P., Michelich, C. R., Allison, T., & McCarthy, G. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi064 · Cited by 369 · cited 2×
“…specific to overt facial expressions: the right middle superior temporal sulcus (rmSTS), hypothesized to code for facial motion parameters (Pelphrey et al., 2005; Calder et al., 2007; Carlin et al., 2011), and face-selective patches in right occipitotemporal cortex thought to code for…”
BackgroundSocial and monetary reward learning engage overlapping neural substrates
Lin, A., Adolphs, R., & Rangel, A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr006 · Cited by 351
Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses?
Op de Beeck, H. P. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.02.047 · Cited by 275
Dufour, N., Redcay, E., Young, L., Mavros, P. L., Moran, J. M., Triantafyllou, C., Gabrieli, J. D. E., & Saxe, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075468 · Cited by 228 · cited 2×
“To define individual ROIs, we used hypothesis spaces derived from random-effects analyses of previous studies [theory of mind (Dufour et al., 2013): bilateral TPJ, rATL, PC, subregions of MPFC (DMPFC, MMPFC, VMPFC); face perception (Julian et al., 2012): rmSTS, rFFA, rOFA], combined with individual…”
BackgroundMethodSelf-citation
Cited by
Discrete Neural Signatures of Basic Emotions
Saarimäki, H., Gotsopoulos, A., Jääskeläinen, I. P., Lampinen, J., Vuilleumier, P., Hari, R., Sams, M., & Nummenmaa, L. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv086 · Cited by 458
Lieberman, M. D., Straccia, M. A., Meyer, M. L., Du, M., & Tan, K. M. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.12.021 · Cited by 268
Representation, Pattern Information, and Brain Signatures: From Neurons to Neuroimaging
Kragel, P. A., Koban, L., Barrett, L. F., & Wager, T. D. (2018) · Neuron · doi:10.1016/j.neuron.2018.06.009 · Cited by 215
Dricu, M., & Frühholz, S. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.10.020 · Cited by 102
Horikawa, T., Cowen, A. S., Keltner, D., & Kamitani, Y. (2020) · iScience · doi:10.1016/j.isci.2020.101060 · Cited by 101
“A critical question in neuroscience is where emotions evoked by different modalities of sensory input are encoded in the brain (Chikazoe et al., 2014; Kragel et al., 2016; Skerry and Saxe, 2014).”
Background
Metadata
- Authors
- Skerry, A. E., & Saxe, R.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2014-11-26
- Volume
- 34
- Issue
- 48
- Pages
- 15997-16008
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2008498286
- Cited by
- 143
- References
- 36
- FWCI
- 6.13
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.