The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Neural mechanisms of observational learning
Open accessAbstract
Individuals can learn by interacting with the environment and experiencing a difference between predicted and obtained outcomes (prediction error). However, many species also learn by observing the actions and outcomes of others. In contrast to individual learning, observational learning cannot be based on directly experienced outcome prediction errors. Accordingly, the behavioral and neural mechanisms of learning through observation remain elusive. Here we propose that human observational learning can be explained by two previously uncharacterized forms of prediction error, observational action prediction errors (the actual minus the predicted choice of others) and observational outcome prediction errors (the actual minus predicted outcome received by others). In a functional MRI experiment, we found that brain activity in the dorsolateral prefrontal cortex and the ventromedial prefrontal cortex respectively corresponded to these two distinct observational learning signals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Behavior of Organisms: An Experimental Analysis
Jones, F. N., & Skinner, B. F. (1939) · The American Journal of Psychology · doi:10.2307/1416495 · Cited by 4,398
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 1×
“Attentional learning models differ from standard reinforcement learning models in that they use an unsigned rather than a signed prediction error (12).”
BackgroundDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · cited 2×
“Imitative responses can bemodeled using an “action prediction error” which corresponds to the difference between the expected probability of observing a choice and the actual choice made, analogous to the error terms in the delta learning rule (9, 10) and some forms of motor learning (11).”
BackgroundNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Self-citationReward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426 · cited 2×
“The probability of the model subsequently selecting a stimulus was determined using the softmax function (6).”
BackgroundMethodA free energy principle for the brain
Friston, K., Kilner, J., & Harrison, L. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.10.001 · Cited by 1,369
Conditioning and Associative Learning
Hill, W. F., & Mackintosh, N. J. (1984) · The American Journal of Psychology · doi:10.2307/1422540 · Cited by 1,302
The proactive brain: using analogies and associations to generate predictions
Bar, M. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.05.005 · Cited by 1,144
Animal intelligence; experimental studies
Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100
Error-related brain activation during a Go/NoGo response inhibition task
Menon, V., Adleman, N. E., White, C. D., Glover, G. H., & Reiss, A. L. (2001) · Human Brain Mapping · doi:10.1002/1097-0193(200103)12:3<131::aid-hbm1010>3.0.co;2-c · Cited by 1,045
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · cited 1×
“This predictive coding framework has been shown to be present during learning unrelated to reward (32, 33) and for highly cognitive concepts such as learning whether or not to trust someone (34).”
BackgroundBeauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness
O’Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D. M., & Dolan, R. J. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00145-8 · Cited by 898
The Prefrontal Cortex: Response Selection or Maintenance Within Working Memory?
Rowe, J. B., Toni, I., Josephs, O., Frackowiak, R. S. J., & Passingham, R. E. (2000) · Science · doi:10.1126/science.288.5471.1656 · Cited by 856
Perceptions of moral character modulate the neural systems of reward during the trust game
Delgado, M. R., Frank, R. H., & Phelps, E. A. (2005) · Nature Neuroscience · doi:10.1038/nn1575 · Cited by 729
Social Comparison Affects Reward-Related Brain Activity in the Human Ventral Striatum
Fliessbach, K., Weber, B., Trautner, P., Dohmen, T., Sunde, U., Elger, C. E., & Falk, A. (2007) · Science · doi:10.1126/science.1145876 · Cited by 646
Sensorimotor learning configures the human mirror system
Catmur, C., Walsh, V., & Heyes, C. (2007) · Current Biology · doi:10.1016/j.cub.2007.08.006 · Cited by 564
Rational Herds: Economic Models of Social Learning
CHAMLEY, C. P. (2003) · Cited by 524
Neural correlates of mentalizing-related computations during strategic interactions in humans
Hampton, A. N., Bossaerts, P., & O'Doherty, J. P. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0711099105 · Cited by 515
Model‐Based fMRI and Its Application to Reward Learning and Decision Making
O'DOHERTY, J. P., HAMPTON, A., & KIM, H. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.022 · Cited by 508
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451
The Computation of Social Behavior
Behrens, T. E. J., Hunt, L. T., & Rushworth, M. F. S. (2009) · Science · doi:10.1126/science.1169694 · Cited by 407
Casey, B. J., Thomas, K. M., Welsh, T. F., Badgaiyan, R. D., Eccard, C. H., Jennings, J. R., & Crone, E. A. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.15.8728 · Cited by 389 · cited 1×
“The region of DLPFC where activity correlates most strongly with the expected action prediction error signal has previously been shown to respond to other types of prediction error (15), to conflict (16), and to trials that violate an expectancy that was learned from previous trials (17).”
BackgroundA Dual Role for Prediction Error in Associative Learning
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn161 · Cited by 306 · cited 1×
“This predictive coding framework has been shown to be present during learning unrelated to reward (32, 33) and for highly cognitive concepts such as learning whether or not to trust someone (34).”
BackgroundA Neural Representation of Prior Information during Perceptual Inference
Summerfield, C., & Koechlin, E. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.021 · Cited by 305
A Key Role for Similarity in Vicarious Reward
Mobbs, D., Yu, R., Meyer, M., Passamonti, L., Seymour, B., Calder, A. J., Schweizer, S., Frith, C. D., & Dalgleish, T. (2009) · Science · doi:10.1126/science.1170539 · Cited by 270 · cited 1×
“For example, do positive reward prediction errors when viewing another person lose drive observational learning, or is it simply rewarding to view the misfortunes of others? Recent research suggests that the perceived similarity in the personalities of the participant and confederate modulates ventral striatum activit…”
BackgroundNeural signature of fictive learning signals in a sequential investment task
Lohrenz, T., McCabe, K., Camerer, C. F., & Montague, P. R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0608842104 · Cited by 265
Fletcher, P. C., Anderson, J. M., Shanks, D. R., Honey, R., Carpenter, T. A., Donovan, T., Papadakis, N., & Bullmore, E. T. (2001) · Nature Neuroscience · doi:10.1038/nn733 · Cited by 238 · cited 1×
“The region of DLPFC where activity correlates most strongly with the expected action prediction error signal has previously been shown to respond to other types of prediction error (15), to conflict (16), and to trials that violate an expectancy that was learned from previous trials (17).”
BackgroundFictive Reward Signals in the Anterior Cingulate Cortex
Hayden, B. Y., Pearson, J. M., & Platt, M. L. (2009) · Science · doi:10.1126/science.1168488 · Cited by 234
Cognitive Imitation in Rhesus Macaques
Subiaul, F., Cantlon, J. F., Holloway, R. L., & Terrace, H. S. (2004) · Science · doi:10.1126/science.1099136 · Cited by 173
Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces
Bray, S., & O'Doherty, J. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01211.2006 · Cited by 172
Reinforcement-based vs. Belief-based Learning Models in Experimental Asymmetric-information Games
Feltovich, N. (2000) · Econometrica · doi:10.1111/1468-0262.00125 · Cited by 168
Kettner, R. E., Mahamud, S., Leung, H., Sitkoff, N., Houk, J. C., Peterson, B. W., & Barto, A. G. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.4.2115 · Cited by 136
General mechanisms for making decisions?
Rushworth, M. F. S., Mars, R. B., & Summerfield, C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.02.005 · Cited by 133
Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning
Rodriguez, P. F., Aron, A. R., & Poldrack, R. A. (2006) · Human Brain Mapping · doi:10.1002/hbm.20186 · Cited by 122
Rational Herds: Economic Models of Social Learning
CHAMLEY, C. P. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511616372 · Cited by 114
Frith, C. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/1481.003.0035 · Cited by 82
Cited by
Principles of sensorimotor learning
Wolpert, D. M., Diedrichsen, J., & Flanagan, J. R. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3112 · Cited by 1,391
The neurobiology of rewards and values in social decision making
Ruff, C. C., & Fehr, E. (2014) · Nature reviews. Neuroscience · doi:10.1038/nrn3776 · Cited by 716
The Anterior Cingulate Gyrus and Social Cognition: Tracking the Motivation of Others
Apps, M. A. J., Rushworth, M. F. S., & Chang, S. W. C. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.018 · Cited by 559
“On first glance it may therefore seem surprising to suggest that this region is also particularly important for processing information about others.”
The ecology of human fear: survival optimization and the nervous system
Mobbs, D., Hagan, C. C., Dalgleish, T., Silston, B., & Prévost, C. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00055 · Cited by 498
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475
Metadata
- Authors
- Burke, C. J., Tobler, P. N., Baddeley, M., & Schultz, W.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2010-07-26
- Volume
- 107
- Issue
- 32
- Pages
- 14431-14436
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2050730932
- Cited by
- 367
- References
- 39
- FWCI
- 22.72
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.