Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Abstract
Learning to predict rewarding and aversive outcomes is based on the comparison between predicted and actual outcomes (prediction error: PE). Recent electrophysiological studies reported that during a Pavlovian procedure some dopamine neurons code a classical PE signal while a larger population of dopaminergic neurons reflect a "salient" prediction error (SPE) signal, being excited both by unpredictable aversive events and by rewards. Yet, it is still unclear whether specific human brain structures receiving afferents from dopaminergic neurons code a SPE and whether this signal depends upon reinforcer type. Here, we used a model-based functional magnetic resonance imaging approach implementing a reinforcement learning model to compute the PE while subjects underwent a Pavlovian conditioning procedure with 2 types of rewards (pleasant juice and monetary gain) and 2 types of punishments (aversive juice and aversive picture). The results revealed that activity of a brain network composed of the striatum, anterior insula, and anterior cingulate cortex covaried with a SPE for appetitive and aversive juice. Moreover, amygdala activity correlated with a SPE for these 2 reinforcers and for aversive pictures. These results provide insights into the neurobiological mechanisms underlying the ability to learn stimuli-rewards and stimuli-punishments contingencies, by demonstrating that the network reflecting the SPE depends upon reinforcement's type.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,661
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 2×
“A current theory proposes that dopaminergic neurons encode a form of valence for learning and motivating rewardseeking behavior (Schultz et al. 1997; Berridge and Robinson 1998; Wise 2004) while another theory states that these neurons encode a form of salience (or ‘‘alerting’’) for shifting…”
LeDoux, J. E. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.155 · Cited by 8,444 · cited 2×
“Many of these processes, which include learning when to exhibit defensive as opposed to approach behavior, are thus likely to involve the amygdala (LeDoux 2000).”
(2005) · CTIT technical reports series · Cited by 5,307
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
The Behavior of Organisms: An Experimental Analysis
Jones, F. N., & Skinner, B. F. (1939) · The American Journal of Psychology · doi:10.2307/1416495 · Cited by 4,398
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 2×
“Activations Localization and Reported Statistics Anatomic labeling of activated regions was done using the SPM Anatomy toolbox (Eickhoff et al. 2005) and the probabilistic atlas of Hammers et al.”
Cited by
Items 101–134 of 134
Advancing Stroke Recovery Through Operant Conditioning of Corticomuscular Coherence
Mark, J. I., Cunningham, D. A., & Cassidy, J. M. (2025) · Restorative Neurology and Neuroscience · doi:10.1177/09226028251379344 · Cited by 1
“…such as monetary or social, token-, and sensory-based, activate reward-related neural substrates (i.e., striatum, insula, and anterior cingulate cortex) to varying extents likely driven by context and salience factors (Bieniek & B ą bel, 2023; Delgado et al., 2000; Metereau & Dreher, 2013).”
Dynamic changes in feedback processing as learning progresses
김수현, Kang, E., & 김진희 (2015) · 한국심리학회지: 인지 및 생물 · doi:10.22172/cogbio.2015.27.3.005 · Cited by 1
Effects of motivation on error processing: Controversy and integration
Yaqin, L. I., Ruolan, Z. H. A. O., & Yang, Q. K. (2023) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00085 · Cited by 1
The Structure and Function of Interoceptive Brain Regions in Adolescent Substance Users
Migliorini, R. (2017) · eScholarship (California Digital Library) · Cited by 1
Placebo analgesia : the role of expectation and aversive prediction error
Hird, E. (2018) · Research Explorer (The University of Manchester) · Cited by 1
Zhou, X., Xu, T., Zeng, Y., Zhang, R., Qi, Z., Zhao, W., Kendrick, K. M., & Becker, B. (2021) · Authorea · doi:10.22541/au.163251473.31756493/v1 · Cited by 1
On the computational and neural characterisation of reward learning behaviour
Ban, K. (2024) · Enlighten: Theses (The University of Glasgow) · doi:10.5525/gla.thesis.84313 · Cited by 2
Bauer, E. (2023) · OakTrust (Texas A&M University Libraries) · Cited by 1
Meditation and the DMN: an intentional approach to attention
Alcorta, C. S. (2013) · Religion Brain & Behavior · doi:10.1080/2153599x.2013.826729
Bernardes, E. D. F. (2016) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.59.2016.tde-18112015-115200
AN ELECTROPHYSIOLOGICAL INVESTIGATION OF REWARD PREDICTION ERRORS IN THE HUMAN BRAIN
Sambrook, T. D. (2015) · PEARL (University of Plymouth) · doi:10.24382/1340
Human Behavior in the Execution of Tasks: Influencing Factors of Decision-Making
Rose, D.-M. (2015) · Springer eBooks · doi:10.1007/978-3-662-47407-5_3
Neural Substrates of Learning and Attentive Processes
George, D. N. (2016) · Wiley eBooks · doi:10.1002/9781118650813.ch5
The Basal Ganglia and Decision-Making in Neuropsychiatric Disorders
Tinaz, S., & Stern, C. E. (2016) · Innovations in cognitive neuroscience · doi:10.1007/978-3-319-42743-0_15
Murty, V. P. (2012) · DukeSpace (Duke University)
Exploring the Brain Mechanisms Involved in Reward Prediction Errors Using Conditioned Inhibition
Mollick, J. (2013) · CU Scholar (University of Colorado Boulder)
Dynamique intracérébrale de l'apprentissage par renforcement chez l'humain
Gueguen, M. C. M. (2017) · theses.fr (ABES) · doi:10.70675/172d1379zaca2z4cf8zb448z18e25ea7823e
Neural and Computational Mechanisms of Reward and Aversion
Mollick, J. (2017) · CU Scholar (University of Colorado Boulder)
Rawls, E. (2019) · Journal of the Arkansas Academy of Science
Encoding Motivation Prediction Errors in the Human Dopaminergic Reward SystemPreprint
Ni, Y., Wang, S., Su, J., Li, J., & Wan, X. (2020) · Research Square · doi:10.21203/rs.3.rs-51287/v1
Predictive coding deficits in autism: Abnormalities in feedback or feedforward connectivities?
Wei, J. I. N. G., Qi, C. H. E. N., Yun Qing, X. U. E., Miao, Y. A. N. G., & ZHANG, J. (2024) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00813
Neurocognitive mechanisms underlying transmission of uncertain information in humans
Guigon, V. (2022) · theses.fr (ABES) · doi:10.70675/326b1bfdz0ef2z41f0z8580z2ace202ce0cb
Disgust acquisition in Pavlovian conditioning: A systematic review and meta-analysis
Schippers, A. M., Klucken, T., Sperl, M. F. J., Lipp, O. V., & Finke, J. B. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106499
Extending the concept of emotion regulation with model-based fMRI
Bratec, S. M. (2016) · Electronic Theses of LMU Munich (Ludwig-Maximilians-Universität München) · doi:10.5282/edoc.20094
Daniel-Weiner, R. (2012) · Digitalen Hochschulbibliothek Sachsen-Anhalt (Universitäts- und Landesbibliothek Sachsen-Anhalt) · doi:10.25673/3811
Neural characteristics of reward and punishment learning for optimising decision-making
Westwood, S. (2025) · Enlighten: Theses (The University of Glasgow) · doi:10.5525/gla.thesis.84992
Bulganin, L., & Justus Liebig University Giessen (2014) · University writing server of the Justus Liebig University Giessen (Justus-Liebig-Universität Gießen) · doi:10.22029/jlupub-15083
Vega, D., & Legal, U. A. D. B. D. D. P. I. D. M. (2014) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Renault, H. (2025) · eScholarship@McGill (McGill) · doi:10.82308/31873
Temporal Processing In The Amygdalo-Prefronto-Dorsostriatal Network In Rats
Tallot, L. (2015) · theses.fr (ABES) · doi:10.70675/21dbbecbze3bcz4e26z92adz6c438f2bee10
Towards an integrative view on sensory and outcome predictions
Vincent, R. (2016) · theses.fr (ABES) · doi:10.70675/5a8a5625zab88z40ffzb250ze2da20c48b52
Etude du traitement cérébral d'un contexte visuel prédictif dans l'autisme
Thillay, A. (2015) · theses.fr (ABES) · doi:10.70675/10817044z1f27z404ezb4b2z23afe6735f25
Neural substrates of value-based choice : electrophysiology and neuropsychology
Landron, T. (2024) · theses.fr (ABES) · doi:10.70675/4655f770z924ez4600zbe4dz128e203d1bd5
Interactions between appetitive and aversive processing in the human brain
Choi, J. M. (2014) · University Libraries (University of Maryland) · doi:10.13016/m27g79
Metadata
- Authors
- Metereau, E., & Dreher, J.-C.
- Affiliations
- Lyon 1 Université (FR)
- ORCID
- Dreher, Jean-Claude
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-02-23
- Volume
- 23
- Issue
- 2
- Pages
- 477-487
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2140531843
- Cited by
- 114
- References
- 98
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 3 · 2023: 5 · 2022: 7 · 2021: 11 · 2020: 9 · 2019: 9 · 2018: 5 · 2017: 7 · 2016: 7 · 2015: 12 · 2014: 14 · 2013: 17 · 2012: 3
- FWCI
- 7.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- prediction error, classical conditioning, reward, punishment, aversive stimuli, dopaminergic neurons, striatum, anterior insula, anterior cingulate cortex, amygdala, reinforcement learning models, model-based fMRI, monetary gain
- MeSH terms
- Brain, Brain Mapping, Conditioning, Classical, Female, Humans, Learning, Magnetic Resonance Imaging, Male, Punishment, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.