Computations Underlying Social Hierarchy Learning: Distinct Neural Mechanisms for Updating and Representing Self-Relevant Information
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Knowledge about social hierarchies organizes human behavior, yet we understand little about the underlying computations. Here we show that a Bayesian inference scheme, which tracks the power of individuals, better captures behavioral and neural data compared with a reinforcement learning model inspired by rating systems used in games such as chess. We provide evidence that the medial prefrontal cortex (MPFC) selectively mediates the updating of knowledge about one's own hierarchy, as opposed to that of another individual, a process that underpinned successful performance and involved functional interactions with the amygdala and hippocampus. In contrast, we observed domain-general coding of rank in the amygdala and hippocampus, even when the task did not require it. Our findings reveal the computations underlying a core aspect of social cognition and provide new evidence that self-relevant information may indeed be afforded a unique representational status in the brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Self-citationBayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823
Meeting of minds: the medial frontal cortex and social cognition
Amodio, D. M., & Frith, C. D. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1884 · Cited by 3,782 · cited 2×
“Indeed, this has broader relevance for the fundamental question of whether self-related information is represented by distinct neural mechanisms (Amodio and Frith, 2006; Denny et al., 2012; Mitchell et al., 2006), an issue that has been difficult to answer definitively because of the natural intertwining of the self/o…”
BackgroundAre the Dorsal and Ventral Hippocampus Functionally Distinct Structures?
Fanselow, M. S., & Dong, H.-W. (2010) · Neuron · doi:10.1016/j.neuron.2009.11.031 · Cited by 3,358 · cited 1×
“…work that used a related paradigm to show that the anterior hippocampus and amygdala as identified here—regions that are coupled by massive bidirectional connectivity (Fanselow and Dong, 2010)—play a specific role in the acquisition of knowledge about social hierarchies (Kumaran et al., 2012).”
MethodPsychophysiological and Modulatory Interactions in Neuroimaging
Friston, K. J., Buechel, C., Fink, G. R., Morris, J., Rolls, E., & Dolan, R. J. (1997) · NeuroImage · doi:10.1006/nimg.1997.0291 · Cited by 3,097 · cited 2×
“To do this, we performed a psychophysiological (PPI) analysis (Friston et al., 1997; O’Reilly et al., 2012) (see Supplemental Experimental Procedures for details): this was specifically set up to ask in which brain regions the magnitude of functional coupling of neural activity with the MPFC shows…”
MethodThe cognitive neuroscience of constructive memory: remembering the past and imagining the future
Schacter, D. L., & Addis, D. R. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2087 · Cited by 1,836 · cited 2×
“…that items subjected to self-related processing are afforded privileged status in memory (Macrae et al., 2004), and research on constructing imagined scenarios involving either oneself or others (De Brigard et al., 2015; FeldmanHall et al., 2012; Hassabis et al., 2014; Schacter and Addis, 2007).”
BackgroundThe Social Brain: Neural Basis of Social Knowledge
Adolphs, R. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163514 · Cited by 1,827
Finding the self? An event-related fMRI study
Kelley, W. M., Macrae, C. N., Wyland, C. L., Caglar, S., Inati, S., & Heatherton, T. F. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/08989290260138672 · Cited by 1,606 · cited 5×
“This evidence has come from a range of studies: experiments in which participants are asked to judge the applicability of traits to themselves compared with others (Denny et al., 2012; Kelley et al., 2002; Mitchell et al., 2006), work suggesting that items subjected to self-related processing are afforded privileged s…”
BackgroundResultInfluentialEichenbaum (2004) · doi:10.1016/j.neuron.2004.08.028 · Cited by 1,464
Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange
King-Casas, B., Tomlin, D., Anen, C., Camerer, C. F., Quartz, S. R., & Montague, P. R. (2005) · Science · doi:10.1126/science.1108062 · Cited by 1,345 · cited 4×
“…are able to capture behavior and neural data in a wide range of settings, including experiments involving trust games (Hackel et al., 2015; King-Casas, 2005), theory ofmind (Hampton et al., 2008), and inferring the preferences and actions of others (Burke et al., 2010; Suzuki et al.,…”
BackgroundInfluentialLimbic connections of the orbital and medial prefrontal cortex in macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630408 · Cited by 1,197 · cited 4×
“…activity in this part of theMPFC and the amygdala and hippocampus, regions that are thought to be anatomically connected (Beckmann et al., 2009; Carmichael and Price, 1995), exhibit greater functional coupling during updating of hierarchy knowledge in the Self compared with the Other condition.”
BackgroundResultInfluentialDissociable Medial Prefrontal Contributions to Judgments of Similar and Dissimilar Others
Mitchell, J. P., Macrae, C. N., & Banaji, M. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.040 · Cited by 1,023
Automatic and intentional brain responses during evaluation of trustworthiness of faces
Winston, J. S., Strange, B. A., O'Doherty, J., & Dolan, R. J. (2002) · Nature Neuroscience · doi:10.1038/nn816 · Cited by 993 · cited 4×
“This provides novel evidence that these neural structures automatically generate rank signals even when the task does not require it and complements studies showing obligatory processing of perceptual cues of trustworthiness (though not dominance), whereby less trustworthy faces elicit higher levels of amygdala activi…”
BackgroundInfluentialOchsner, K. N., Knierim, K., Ludlow, D. H., Hanelin, J., Ramachandran, T., Glover, G., & Mackey, S. C. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929042947829 · Cited by 850
Denny, B. T., Kober, H., Wager, T. D., & Ochsner, K. N. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00233 · Cited by 830 · cited 8×
“…relevance for the fundamental question of whether self-related information is represented by distinct neural mechanisms (Amodio and Frith, 2006; Denny et al., 2012; Mitchell et al., 2006), an issue that has been difficult to answer definitively because of the natural intertwining of the…”
BackgroundResultInfluentialThe Link between Social Cognition and Self-referential Thought in the Medial Prefrontal Cortex
Mitchell, J. P., Banaji, M. R., & Macrae, C. N. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929055002418 · Cited by 806
Beckmann, M., Johansen-Berg, H., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3328-08.2009 · Cited by 789 · cited 2×
“…next asked whether neural activity in this part of theMPFC and the amygdala and hippocampus, regions that are thought to be anatomically connected (Beckmann et al., 2009; Carmichael and Price, 1995), exhibit greater functional coupling during updating of hierarchy knowledge in the Self compared…”
BackgroundTools of the trade: psychophysiological interactions and functional connectivity
O’Reilly, J. X., Woolrich, M. W., Behrens, T. E. J., Smith, S. M., & Johansen-Berg, H. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss055 · Cited by 765 · cited 2×
“To do this, we performed a psychophysiological (PPI) analysis (Friston et al., 1997; O’Reilly et al., 2012) (see Supplemental Experimental Procedures for details): this was specifically set up to ask in which brain regions the magnitude of functional coupling of neural activity with the MPFC shows…”
MethodUnderstanding evaluation of faces on social dimensions
Todorov, A., Said, C. P., Engell, A. D., & Oosterhof, N. N. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.10.001 · Cited by 706
Know Your Place: Neural Processing of Social Hierarchy in Humans
Zink, C. F., Tong, Y., Chen, Q., Bassett, D. S., Stein, J. L., & Meyer-Lindenberg, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.01.025 · Cited by 622 · cited 3×
“, facial features and body posture) (Marsh et al., 2004; Todorov et al., 2008; Zink et al., 2008).”
BackgroundMedial prefrontal activity predicts memory for self
Macrae, C. N. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh025 · Cited by 581 · cited 5×
“…information, decoupled as far as possible from many forms of preexisting and prior knowledge about the self that are inherent in other studies (Denny et al., 2012; Jenkins et al., 2008; Kelley et al., 2002; Macrae et al., 2004; Mitchell et al., 2005, 2006; Tamir and Mitchell, 2011, 2012).”
BackgroundResultInfluentialThe Anterior Cingulate Gyrus and Social Cognition: Tracking the Motivation of Others
Apps, M. A. J., Rushworth, M. F. S., & Chang, S. W. C. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.018 · Cited by 559 · cited 5×
“…to relate our work to evidence suggesting that the anterior cingulate cortex gyrus (ACCg), a region that contains Brodmann areas 24 a/b and 32 (Apps et al., 2016) and whose anterior portion overlaps with the MPFC region identified in our study, makes an important contribution to social…”
BackgroundInfluentialAn automatic valuation system in the human brain: Evidence from functional neuroimaging
Lebreton, M., Jorge, S., Michel, V., Thirion, B., & Pessiglione, M. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.040 · Cited by 455 · cited 2×
“036; Figure 7) in the Self condition, providing a parallel to the automatic valuation of items observed in the vmPFC (Lebreton et al., 2009).”
MethodInfluentialThe Computation of Social Behavior
Behrens, T. E. J., Hunt, L. T., & Rushworth, M. F. S. (2009) · Science · doi:10.1126/science.1169694 · Cited by 407 · cited 1×
“…of social learning (e.g., about traits, trust games, and theory of mind [ToM]) can be accounted for by reinforcement learning (RL) mechanisms (Behrens et al., 2009; Burke et al., 2010; Hackel et al., 2015; Hampton et al., 2008; King-Casas, 2005; Suzuki et al., 2012), a rich theoretical…”
BackgroundNeuronal reference frames for social decisions in primate frontal cortex
Chang, S. W. C., Gariépy, J.-F., & Platt, M. L. (2013) · Nature Neuroscience · doi:10.1038/nn.3287 · Cited by 336 · cited 3×
“, for reward receipt by self) of neurons in other regions such as the orbitofrontal cortex (Chang et al., 2013).”
BackgroundA Role for the Macaque Anterior Cingulate Gyrus in Social Valuation
Rudebeck, P. H., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2006) · Science · doi:10.1126/science.1128197 · Cited by 312 · cited 2×
“…that the anterior cingulate cortex gyrus (ACCg), a region that contains Brodmann areas 24 a/b and 32 (Apps et al., 2016) and whose anterior portion overlaps with the MPFC region identified in our study, makes an important contribution to social cognition (Apps et al., 2016; Rudebeck, 2006).”
BackgroundA Key Role for Similarity in Vicarious Reward
Mobbs, D., Yu, R., Meyer, M., Passamonti, L., Seymour, B., Calder, A. J., Schweizer, S., Frith, C. D., & Dalgleish, T. (2009) · Science · doi:10.1126/science.1170539 · Cited by 270
Repetition suppression of ventromedial prefrontal activity during judgments of self and others
Jenkins, A. C., Macrae, C. N., & Mitchell, J. P. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0708785105 · Cited by 266 · cited 5×
“One hypothesis, therefore, is that the learning and representation of recently experienced self-related information is subserved by a distinct ventral part of theMPFC, which if appropriate can be leveraged to simulate the preferences and behavior of others, a notion that aligns with the proposal that the simulation of…”
BackgroundResultInfluentialThe hippocampus and inferential reasoning: building memories to navigate future decisions
Zeithamova, D., Schlichting, M. L., & Preston, A. R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00070 · Cited by 266 · cited 2×
“, hierarchies) accrued across multiple experiences is compatible with a key role for the hippocampus in supporting memory for individual episodes constitutes an important area for future research (Eichenbaum, 2004; Kumaran and McClelland, 2012; Zeithamova et al., 2012).”
BackgroundA normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251
Self-citationImagine all the people: how the brain creates and uses personality models to predict behavior
Hassabis, D., Spreng, R. N., Rusu, A. A., Robbins, C. A., Mar, R. A., & Schacter, D. L. (2014) · Cerebral Cortex · doi:10.1093/cercor/bht042 · Cited by 247
Self-citationThe Human Hippocampus: Cognitive Maps or Relational Memory?
Kumaran, D., & Maguire, E. A. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1103-05.2005 · Cited by 218
Self-citationA neural circuit covarying with social hierarchy in macaques
Noonan, M. P., Sallet, J., Mars, R. B., Neubert, F. X., O'Reilly, J. X., Andersson, J. L., Mitchell, A. S., Bell, A. H., Miller, K. L., & Rushworth, M. F. S. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001940 · Cited by 183 · cited 2×
“, 2012), complemented by research in animals (Noonan et al., 2014; Rushworth et al., 2013), has provided evidence that the amygdala and anterior hippocampus are selectively involved in the acquisition and use of knowledge about a social (i.”
BackgroundResultSelf-Other Mergence in the Frontal Cortex during Cooperation and Competition
Wittmann, M. K., Kolling, N., Faber, N. S., Scholl, J., Nelissen, N., & Rushworth, M. F. S. (2016) · Neuron · doi:10.1016/j.neuron.2016.06.022 · Cited by 168
Vicarious reinforcement in rhesus macaques (Macaca Mulatta)
Chang, S. W. C., Winecoff, A. A., & Platt, M. L. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00027 · Cited by 124 · cited 4×
“…(Apps et al., 2016), but also incorporates rank information, particularly within one’s own social group, dovetailing with behavioral evidence concerning the influence of social dominance and familiarity on cooperative behavior (Chang et al., 2011; Molenberghs, 2013; Seyfarth and Cheney, 2012).”
BackgroundInfluentialAre there specialized circuits for social cognition and are they unique to humans?
Rushworth, M. F., Mars, R. B., & Sallet, J. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.013 · Cited by 117
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111 · cited 2×
“1138 Neuron 92, 1135–1147, December 7, 2016 participant (see Daw, 2011; Wimmer et al., 2012), we found strong evidence (see Table 1) in favor of the SMCmodel according to the log likelihood of each model and the corresponding Bayesian information criterion (BIC) measure (Raftery, 1995).”
MethodToward the neural implementation of structure learning
Tervo, D. G. R., Tenenbaum, J. B., & Gershman, S. J. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2016.01.014 · Cited by 106 · cited 2×
“…Burke et al., 2010; Hackel et al., 2015; Hampton et al., 2008; King-Casas, 2005; Suzuki et al., 2012), a rich theoretical framework formalizes the acquisition of structured knowledge (e.g., about social hierarchies and networks) in Bayesian terms (Kemp and Tenenbaum, 2008; Tervo et al., 2016).”
Background
Cited by
Navigating cognition: Spatial codes for human thinking
Bellmund, J. L. S., Gärdenfors, P., Moser, E. I., & Doeller, C. F. (2018) · Science · doi:10.1126/science.aat6766 · Cited by 643
“Hippocampal encoding of the power dimension has also been demonstrated after learning of social hierarchies (85).”
BackgroundIf deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397
“Indeed, fMRI studies of statistical learning have revealed that neural similarities (such as multivoxel pattern overlap) in the MTL recapitulate association strengths for pairs, lines, maps or hierarchies of stimuli 94,98–104 .”
BackgroundMap Making: Constructing, Combining, and Inferring on Abstract Cognitive Maps
Park, S. A., Miller, D. S., Nili, H., Ranganath, C., & Boorman, E. D. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.030 · Cited by 270
Gershman, S. J., & Uchida, N. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0220-7 · Cited by 236
Kettner, H., Rosas, F. E., Timmermann, C., Kärtner, L., Carhart-Harris, R. L., & Roseman, L. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.623985 · Cited by 221
Metadata
- Authors
- Kumaran, D., Banino, A., Blundell, C., Hassabis, D., & Dayan, P.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2016-12
- Volume
- 92
- Issue
- 5
- Pages
- 1135-1147
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2560612641
- Cited by
- 156
- References
- 38
- FWCI
- 7.05
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.