The computational challenge of social learning
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
The complex reward structure of the social world and the uncertainty endemic to social contexts poses a challenge for modeling. For example, during social interactions, the actions of one person influence the internal states of another. These social dependencies make it difficult to formalize social learning problems in a mathematically tractable way. While it is tempting to dispense with these complexities, they are a defining feature of social life. Because the structure of social interactions challenges the simplifying assumptions often made in models, they make an ideal testbed for computational models of cognition. By adopting a framework that embeds existing social knowledge into the model, we can go beyond explaining behaviors in laboratory tasks to explaining those observed in the wild.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Collective action and the evolution of social norms.
Ostrom, E. (2000) · Journal of Economic Perspectives · doi:10.1257/jep.14.3.137 · Cited by 4,195
Understanding Social Preferences with Simple Tests
Charness, G., & Rabin, M. (2002) · The Quarterly Journal of Economics · doi:10.1162/003355302760193904 · Cited by 3,970
Attitudes and cognitive organization
Heider, F. (1946) · The Journal of Psychology · doi:10.1080/00223980.1946.9917275 · Cited by 3,672
What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?
Levitt, S. D., & List, J. A. (2007) · Journal of Economic Perspectives · doi:10.1257/jep.21.2.153 · Cited by 2,668
Attribution theory and research
Kelley, H. H., & Michela, J. L. (1980) · Annual Review of Psychology · doi:10.1146/annurev.ps.31.020180.002325 · Cited by 2,651
(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621 · cited 1×
“One particular model class, called inverse RL, provides a framework through which reward functions can be inferred, rather than hard coded, thus bridging the disconnect between traditional RL algorithms and actual social learning [56,57].”
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · cited 1×
“For starters, learning occurs incrementally through iterative trial-and-error to estimate the expected value of a choice [8,10,12,16,17].”
Action understanding as inverse planning
Baker, C. L., Saxe, R., & Tenenbaum, J. B. (2009) · Cognition · doi:10.1016/j.cognition.2009.07.005 · Cited by 920
The hidden structure of overimitation
Lyons, D. E., Young, A. G., & Keil, F. C. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0704452104 · Cited by 734
Perceptions of moral character modulate the neural systems of reward during the trust game
Delgado, M. R., Frank, R. H., & Phelps, E. A. (2005) · Nature Neuroscience · doi:10.1038/nn1575 · Cited by 729 · cited 1×
“For instance, a negative fi rst impression can be so powerful that people may ignore subsequent positive social information, effectively abolishing a learning effect [89].”
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · cited 1×
“However, the fact that the number of factors known to bias social cognition is matched by the sheer number of verbal theories that abound [36] only highlights the pressing need to more precisely characterize the mechanics of the social mind.”
Cialdini, R. B. (2001) · Scientific American · doi:10.1038/scientificamerican0201-76 · Cited by 582
Humans use directed and random exploration to solve the explore–exploit dilemma.
Wilson, R. C., Geana, A., White, J. M., Ludvig, E. A., & Cohen, J. D. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0038199 · Cited by 580
Probabilistic models of cognition: exploring representations and inductive biases
Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., & Tenenbaum, J. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.004 · Cited by 568
A computational and neural model of momentary subjective well-being
Rutledge, R. B., Skandali, N., Dayan, P., & Dolan, R. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1407535111 · Cited by 444
The Computation of Social Behavior
Behrens, T. E. J., Hunt, L. T., & Rushworth, M. F. S. (2009) · Science · doi:10.1126/science.1169694 · Cited by 407 · cited 1×
“In addition, reward functions are commonly parameterized by a simple monetary gain or loss [7,11,13], which do not contend with the multifaceted and subjective reward functions that guide most everyday social behavior [18].”
Mood as representation of momentum
Eldar, E., Rutledge, R. B., Dolan, R. J., & Niv, Y. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.010 · Cited by 383
Emotional learning selectively and retroactively strengthens memories for related events
Dunsmoor, J. E., Murty, V. P., Davachi, L., & Phelps, E. A. (2015) · Nature · doi:10.1038/nature14106 · Cited by 332 · cited 1×
“Since emotions are known to provide relevant feedback to foster useful action tendencies [65,66], they are well situated to translate external rewards into an internal value signal [67 – 70].”
Ten-month-old infants infer the value of goals from the costs of actions
Liu, S., Ullman, T. D., Tenenbaum, J. B., & Spelke, E. S. (2017) · Science · doi:10.1126/science.aag2132 · Cited by 230
Inferring on the intentions of others by hierarchical Bayesian learning
Diaconescu, A. O., Mathys, C., Weber, L. A. E., Daunizeau, J., Kasper, L., Lomakina, E. I., Fehr, E., & Stephan, K. E. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003810 · Cited by 219
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191
Zhu, L., Mathewson, K. E., & Hsu, M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116783109 · Cited by 125 · cited 2×
“the fl ip side, informing the model of an individual ’ s social priors or beliefs about the world [16,90] can speed the learning rate [77,91] and these models fair far better in describing how people actually learn in strategic situations [61].”
The Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards
Apps, M. A. J., & Ramnani, N. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2701-13.2014 · Cited by 109
Neural Correlates of Reinforcement Learning and Social Preferences in Competitive Bidding
van den Bos, W., Talwar, A., & McClure, S. M. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3095-12.2013 · Cited by 80 · cited 1×
“These nascent models revealed that, much like classic reward learning, social learning in the laboratory can be explained in terms of prediction errors [7 – 9].”
Learning moral values: Another’s desire to punish enhances one’s own punitive behavior.
FeldmanHall, O., Otto, A. R., & Phelps, E. A. (2018) · Journal of Experimental Psychology: General · doi:10.1037/xge0000405 · Cited by 51 · cited 3×
“It turns out that the difference between what a person expects and what they ultimately encounter (the prediction error, δ ) can capture how humans learn social value, such as how generous another person is [10], or whether another ’ s desire for punishment in fl uences our own [11].”
Self-citation
Cited by
Reconsidering autistic ‘camouflaging’ as transactional impression management
Ai, W., Cunningham, W. A., & Lai, M.-C. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.05.002 · Cited by 140
Computational processes of simultaneous learning of stochasticity and volatility in humans
Piray, P., & Daw, N. D. (2024) · Nature Communications · doi:10.1038/s41467-024-53459-z · Cited by 45
“These additional issues include attention 2 , decision noise and the explore-exploit tradeoff 47,59 , social cause inference 27,60,61 , the organization of experiences into latent causes or contexts 5,62,63 , and planning 64 – 67 .”
Mahmoodi, A., Luo, S., Harbison, C., Piray, P., & Rushworth, M. F. S. (2024) · Neuron · doi:10.1016/j.neuron.2024.09.001 · Cited by 17
Metadata
- Authors
- FeldmanHall, O., & Nassar, M. R.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2021-12
- Volume
- 25
- Issue
- 12
- Pages
- 1045-1057
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W3202996932
- Cited by
- 78
- References
- 26
- FWCI
- 2.49
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.