The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Abstract
Learning to predict rewarding and aversive outcomes is based on the comparison between predicted and actual outcomes (prediction error: PE). Recent electrophysiological studies reported that during a Pavlovian procedure some dopamine neurons code a classical PE signal while a larger population of dopaminergic neurons reflect a "salient" prediction error (SPE) signal, being excited both by unpredictable aversive events and by rewards. Yet, it is still unclear whether specific human brain structures receiving afferents from dopaminergic neurons code a SPE and whether this signal depends upon reinforcer type. Here, we used a model-based functional magnetic resonance imaging approach implementing a reinforcement learning model to compute the PE while subjects underwent a Pavlovian conditioning procedure with 2 types of rewards (pleasant juice and monetary gain) and 2 types of punishments (aversive juice and aversive picture). The results revealed that activity of a brain network composed of the striatum, anterior insula, and anterior cingulate cortex covaried with a SPE for appetitive and aversive juice. Moreover, amygdala activity correlated with a SPE for these 2 reinforcers and for aversive pictures. These results provide insights into the neurobiological mechanisms underlying the ability to learn stimuli-rewards and stimuli-punishments contingencies, by demonstrating that the network reflecting the SPE depends upon reinforcement's type.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,461
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 2×
“A current theory proposes that dopaminergic neurons encode a form of valence for learning and motivating rewardseeking behavior (Schultz et al. 1997; Berridge and Robinson 1998; Wise 2004) while another theory states that these neurons encode a form of salience (or ‘‘alerting’’) for shifting…”
LeDoux, J. E. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.155 · Cited by 8,444 · cited 2×
“Many of these processes, which include learning when to exhibit defensive as opposed to approach behavior, are thus likely to involve the amygdala (LeDoux 2000).”
(2005) · CTIT technical reports series · Cited by 5,307
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
The Behavior of Organisms: An Experimental Analysis
Jones, F. N., & Skinner, B. F. (1939) · The American Journal of Psychology · doi:10.2307/1416495 · Cited by 4,398
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 2×
“Activations Localization and Reported Statistics Anatomic labeling of activated regions was done using the SPM Anatomy toolbox (Eickhoff et al. 2005) and the probabilistic atlas of Hammers et al.”
Cited by
Precise minds in uncertain worlds: Predictive coding in autism.
Van de Cruys, S., Evers, K., Van der Hallen, R., Van Eylen, L., Boets, B., de-Wit, L., & Wagemans, J. (2014) · Psychological Review · doi:10.1037/a0037665 · Cited by 885
“In healthy subjects ACC activity is found for behaviorally relevant prediction errors (Ide, Shenoy, Yu, & Li, 2013; Metereau & Dreher, 2013).”
BackgroundSescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782
“coding, regardless of reinforcer type or valence (Météreau and Dreher, 2012).”
Self-citationEvent-related potential studies of outcome processing and feedback-guided learning
San Martín, R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00304 · Cited by 354
“Similar conclusions have been reached using fMRI in humans (Walton et al., 2004; Aarts et al., 2008; Metereau and Dreher, 2012) and single-unit recordings inmonkeys (Niki andWatanabe, 1979; Akkal et al.”
ResultInteroception and drug addiction
Paulus, M. P., & Stewart, J. L. (2014) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.07.002 · Cited by 281
“Some have argued that the insula provides a salience signal during reward related processing (Metereau and Dreher, 2013).”
BackgroundChase, H. W., Kumar, P., Eickhoff, S. B., & Dombrovski, A. Y. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0338-7 · Cited by 231
“…(13.15) Schonberg et al., 2010 (11.75) Gradin et al., 2011 (9.43) Madlon-Kay et al., 2013 (8.96) Howard-Jones et al., 2010 (7.83) O’Sullivan et al., 2011 (6.48) Metereau & Dreher, 2013 (5.80) Gershman et al., 2009 (2.57) Murray et al., 2008 (0.98) The studies contributing to each cluster and the…”
InfluentialImpaired reward prediction error encoding and striatal-midbrain connectivity in depression
Kumar, P., Goer, F., Murray, L., Dillon, D. G., Beltzer, M. L., Cohen, A. L., Brooks, N. H., & Pizzagalli, D. A. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0032-x · Cited by 219
“, shock, monetary loss, social rejection), it also emerges during encoding of RPE [49, 50], suggesting that the insula might encode a salience PE [51, 52].”
BackgroundThe Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors
Talmi, D., Atkinson, R., & El-Deredy, W. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.5695-12.2013 · Cited by 212
“Our data agrees with previous fMRI data (Metereau and Dreher, 2012) that showed that both the ACC and 300 the striatum (both targets of dopaminergic projections, which according to RL-ERN cause the FRN) code salience rather than reward prediction errors, and supports the suggestion that the medial prefrontal cortex co…”
ResultA universal role of the ventral striatum in reward-based learning: Evidence from human studies
Daniel, R., & Pollmann, S. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.002 · Cited by 208
“…to non-rewarding events such as negative outcomes or saliency (Jensen et al., 2007; Litt, Plassmann, Shiv, & Rangel, 2011; Menon et al., 2007; Metereau & Dreher, 2013; Robinson, Overstreet, Charney, Vytal, & Grillon, 2013; Seymour et al., 2004; Zink, Pagnoni, Chappelow, Martin-Skurski, &…”
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Detection of a Temporal Error Triggers Reconsolidation of Amygdala-Dependent Memories
Díaz-Mataix, L., Ruiz Martinez, R. C., Schafe, G. E., LeDoux, J. E., & Doyère, V. (2013) · Current Biology · doi:10.1016/j.cub.2013.01.053 · Cited by 168
“In effect, the amygdala shows anticipatory neurophysiological activity [22, 23, 24], as well as reactivity to surprising temporal irregularities or unexpected events [25, 26].”
Altered neural reward and loss processing and prediction error signalling in depression
Ubl, B., Kuehner, C., Kirsch, P., Ruttorf, M., Diener, C., & Flor, H. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu158 · Cited by 165
“These parameters were included in the statistical model in order to modulate the data of combined gains and losses at the time of their reception (cf. Metereau and Dreher, 2013).”
BackgroundMethodInfluentialWu, M., Brockmeyer, T., Hartmann, M., Skunde, M., Herzog, W., & Friederich, H. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.11.017 · Cited by 147
“Food is considered a naturally rewarding stimulus (Metereau and Dreher, 2013; Sescousse et al., 2010; Simon et al., 2014), and there is evidence that poor abilities to tolerate the delay of rewards and to inhibit approach behavior towards rewarding stimuli in general contribute to an inability to refrain from this pri…”
Haarsma, J., Fletcher, P. C., Griffin, J. D., Taverne, H. J., Ziauddeen, H., Spencer, T. J., Miller, C., Katthagen, T., Goodyer, I., Diederen, K. M. J., et al. (2021) · Molecular Psychiatry · doi:10.1038/s41380-020-0803-8 · Cited by 108
Boll, S., Gamer, M., Gluth, S., Finsterbusch, J., & Büchel, C. (2012) · European Journal of Neuroscience · doi:10.1111/ejn.12094 · Cited by 108
“Likewise, the amygdala has been shown to be sensitive to unexpected events irrespective of their valence (Belova et al., 2007; Metereau & Dreher, 2012) and to unpredictability itself (Herry et al., 2007).”
BackgroundDeserno, L., Boehme, R., Heinz, A., & Schlagenhauf, F. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00172 · Cited by 103
Hu, J., Qi, S., Becker, B., Luo, L., Gao, S., Gong, Q., Hurlemann, R., & Kendrick, K. M. (2015) · Human Brain Mapping · doi:10.1002/hbm.22760 · Cited by 104
Gueguen, M. C. M., Lopez‐Persem, A., Billeke, P. B., Lachaux, J.-P., Rheims, S., Kahane, P., Minotti, L., David, O., Pessiglione, M., & Bastin, J. (2021) · Nature Communications · doi:10.1038/s41467-021-23704-w · Cited by 84
Auditory hedonic phenotypes in dementia: A behavioural and neuroanatomical analysis
Fletcher, P. D., Downey, L. E., Golden, H. L., Clark, C. N., Slattery, C. F., Paterson, R. W., Schott, J. M., Rohrer, J. D., Rossor, M. N., & Warren, J. D. (2015) · Cortex · doi:10.1016/j.cortex.2015.03.021 · Cited by 79
“The amygdala is heavily affected in FTLD and likely to process intensity, arousal potential and novelty of affective signals (Metereau & Dreher, 2013; Sescousse et al., 2013; Small et al., 2003).”
BackgroundSimon, J. J., Skunde, M., Wu, M., Schnell, K., Herpertz, S. C., Bendszus, M., Herzog, W., & Friederich, H. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu162 · Cited by 75
“…to different kinds of reward such as food, money, erotic stimuli or even pleasant music (Menon and Levitin, 2005; Sescousse et al., 2010; Simon et al., 2010, 2014) confirm the role of the VS as a site of modality-independent computation of reward-related salience (Metereau and Dreher, 2013).”
BackgroundPrincipal components analysis of reward prediction errors in a reinforcement learning task
Sambrook, T. D., & Goslin, J. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.07.032 · Cited by 73
“This value was arbitrary, but in keeping with similar studies of reinforcement learning (Metereau and Dreher, 2013; Seymour et al., 2005), and comparable with a value extracted in a recent study of non-reversal probabilistic learning and the FRN (Mas-Herrero and Marco-Pallarés, 2014).”
Treatment approaches for interoceptive dysfunctions in drug addiction
Paulus, M. P., Stewart, J. L., & Haase, L. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00137 · Cited by 69
“Others have argued that the ACC encodes salient prediction errors for appetitive and aversive stimuli (29).”
BackgroundAversive Prediction Error Signals in the Amygdala
McHugh, S. B., Barkus, C., Huber, A., Capitao, L., Lima, J., Lowry, J. P., & Bannerman, D. M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4465-13.2014 · Cited by 68
“Some studies report higher amygdala blood– oxygen level-dependent (BOLD) responses to an unexpected versus an expected or blocked US, consistent with a role in predicting aversive events (Dunsmoor et al., 2008; Eippert et al., 2012; Wood et al., 2012; Metereau and Dreher, 2013).”
BackgroundAn imaging genetics approach to understanding social influence
Falk, E. B., Way, B. M., & Jasinska, A. J. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00168 · Cited by 68
“In support of this model, the ACC and insula have been found to record a prediction error for both rewards and punishments (Metereau and Dreher, 2012).”
MethodSambrook, T. D., & Goslin, J. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.06.004 · Cited by 67
“The UPE size effect at 200 – 270 ms is consistent with other demonstrations of strong UPE size effects in this interval (Hauser et al., 2014; Talmi et al., 2013) and fMRI work showing such a signal (Metereau & Dreher, 2013; Rutledge, Dean, Caplin, & Glimcher, 2010).”
Pervasive competition between threat and reward in the brain
Choi, J. M., Padmala, S., Spechler, P. A., & Pessoa, L. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst053 · Cited by 67
“For each region, we list the number of participants exhibiting the two simple effects (final column in Table 2), indicating that the conjunction did not originate from the group analysis process.”
BackgroundBiggs, E. E., Timmers, I., Meulders, A., Vlaeyen, J. W. S., Goebel, R., & Kaas, A. L. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.09.016 · Cited by 65
Météreau, É., & Dreher, J. (2014) · Cortex · doi:10.1016/j.cortex.2014.08.012 · Cited by 63
“…searched for brain response correlating with a salient prediction error for appetitive and aversive reinforcers, that is, for the set of brain regions showing high BOLD signal when both rewards and punishments are delivered and low BOLD signal for their omission (Metereau & Dreher, 2013).”
InfluentialSelf-citationFouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61
“Similarly, others have endorsed the notion of a ventral-dorsal gradient in the striatum encoding valence-surprise RPE information 27, 50 .”
InfluentialBissonette, G. B., Gentry, R. N., Padmala, S., Pessoa, L., & Roesch, M. R. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00024 · Cited by 53
“Similarly, Dreher and colleagues reported salience type PE signals in the striatum (bilateral putamen) and amygdala (as well as anterior insula and ACC) (Metereau and Dreher, 2013).”
BackgroundFunctional lateralization of the anterior insula during feedback processing
Späti, J., Chumbley, J. R., Brakowski, J., Doerig, N., Holtforth, M. G., Seifritz, E., & Spinelli, S. (2014) · Human Brain Mapping · doi:10.1002/hbm.22484 · Cited by 51
“, 2009), a region widely implicated in both post-error adjustments and salience processing (Hickey et al., 2010; Metereau and Dreher, 2013; Wessel et al., 2012).”
BackgroundD’Astolfo, L., & Rief, W. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01253 · Cited by 50
Waltz, J. A., Xu, Z., Brown, E. C., Ruiz, R., Frank, M. J., & Gold, J. M. (2017) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2017.07.008 · Cited by 50
“Finally, the AI has been linked not only to the signaling of aversive outcomes (47), but also the anticipation of aversive outcomes (11), as well as the signaling of salient outcomes, without respect to valence (48).”
Pupil dilation as an implicit measure of appetitive Pavlovian learning
Pietrock, C., Ebrahimi, C., Katthagen, T., Koch, S., Heinz, A., Rothkirch, M., & Schlagenhauf, F. (2019) · Psychophysiology · doi:10.1111/psyp.13463 · Cited by 50
Ferdinand, N. K., & Opitz, B. (2014) · Scientific Reports · doi:10.1038/srep05986 · Cited by 49
Basal ganglia lateralization in different types of reward
Arsalidou, M., Vijayarajah, S., & Sharaev, M. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00215-3 · Cited by 46
Sensorimotor‐independent prefrontal activity during response inhibition
Cai, W., Cannistraci, C. J., Gore, J. C., & Leung, H. (2013) · Human Brain Mapping · doi:10.1002/hbm.22315 · Cited by 46
Qu, C., Météreau, É., Butera, L., Villeval, M. C., & Dreher, J. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000283 · Cited by 45
“Consistent with this effect, the anterior insula has been associated with both positive and negative correlations with subjective value in a conjunction meta-analysis [40], reflecting a quantity such as salience [63, 64].”
BackgroundSelf-citationShahnazian, D., & Holroyd, C. B. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1280-1 · Cited by 45
Jarcho, J. M., Tanofsky-Kraff, M., Nelson, E. E., Engel, S. G., Vannucci, A., Field, S. E., Romer, A. L., Hannallah, L., Brady, S. M., Demidowich, A. P., et al. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.054 · Cited by 43
“, 2011; Schultz, 2000), recent work suggests that the striatummay play a more general role in tracking the affective salience of stimuli (Metereau and Dreher, 2013; Shohamy, 2011).”
The amygdala: A potential player in timing CS–US intervals
Díaz-Mataix, L., Tallot, L., & Doyère, V. (2013) · Behavioural Processes · doi:10.1016/j.beproc.2013.08.007 · Cited by 43
Learned Value Shapes Responses to Objects in Frontal and Ventral Stream Networks in Macaque Monkeys
Kaskan, P. M., Costa, V. D., Eaton, H. P., Zemskova, J. A., Mitz, A. R., Leopold, D. A., Ungerleider, L. G., & Murray, E. A. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw113 · Cited by 41
Decreased reward circuit connectivity during reward anticipation in major depression
Geugies, H., Groenewold, N. A., Meurs, M., Doornbos, B., de Klerk‐Sluis, J. M., van Eijndhoven, P., Roest, A. M., & Ruhé, H. G. (2022) · NeuroImage Clinical · doi:10.1016/j.nicl.2022.103226 · Cited by 37
“, 2011), suggesting encoding of a salience PE (Gu et al., 2016; Metereau and Dreher, 2013).”
Prediction errors to emotional expressions: the roles of the amygdala in social referencing
Meffert, H., Brislin, S. J., White, S. F., & Blair, J. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu085 · Cited by 33
“None declared.”
Neural processing of food and monetary rewards is modulated by metabolic state
Yousuf, M., Heldmann, M., Göttlich, M., Münte, T. F., & Doñamayor, N. (2017) · Brain Imaging and Behavior · doi:10.1007/s11682-017-9811-y · Cited by 33
Temporal dissociation of salience and prediction error responses to appetitive and aversive taste
Hird, E., El‐Deredy, W., Jones, A. K. P., & Talmi, D. (2017) · Psychophysiology · doi:10.1111/psyp.12976 · Cited by 33
Bratec, S. M., Xie, X., Schmid, G., Doll, A., Schilbach, L., Zimmer, C., Wohlschläger, A. M., Riedl, V., & Sorg, C. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.08.038 · Cited by 32
“…and insula is consistent with previous studies, where they have repeatedly been implicated as the neural correlates of aversive prediction errors (Delgado et al., 2008a; Metereau and Dreher, 2013; Robinson et al., 2010; Schiller et al., 2008; Seymour et al., 2004, 2007; Spoormaker et al., 2011).”
Richter, A., Richter, S., Barman, A., Soch, J., Klein, M., Assmann, A., Libeau, C., Behnisch, G., Wüstenberg, T., Seidenbecher, C. I., et al. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00250 · Cited by 32
“…anticipation (for a review, see Diekhof et al., 2012), although some studies argue that insuladependent processing of cues and prediction errors is particularly critical for the prediction of losses (Palminteri et al., 2012; Metereau and Dreher, 2013) and negative choices (Knutson et al., 2007).”
BackgroundNeural mechanisms mediating association of sympathetic activity and exploration in decision-making
Ohira, H., Matsunaga, M., Murakami, H., Osumi, T., Fukuyama, S., Shinoda, J., & Yamada, J. (2013) · Neuroscience · doi:10.1016/j.neuroscience.2013.04.050 · Cited by 31
“, 2012), detection of salient events (Metereau and Dreher, 2013), and switching functions of neural networks to allocate attention and working memory (Menon and Uddin, 2010).”
BackgroundGreening, S. G., Norton, L. E., Virani, K., Ty, A., Mitchell, D. G. V., & Finger, E. C. (2013) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-013-0213-3 · Cited by 31
López, M. A., Santos, M. J., Cortasa, S. A., Fernández, R. S., Tano, M. C., & Pedreira, M. E. (2016) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2016.10.016 · Cited by 31
Kim, H., Nanavaty, N., Ahmed, H., Mathur, V. A., & Anderson, B. A. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01769 · Cited by 30
“This makes the amygdala an ideal candidate for encoding motivational salience (Metereau & Dreher, 2013; Ousdal et al., 2008).”
BackgroundKlein, S., Krikova, K., Antons, S., Brand, M., Klucken, T., & Stark, R. M. (2022) · Current Addiction Reports · doi:10.1007/s40429-022-00423-w · Cited by 29
Neural coding of computational factors affecting decision making
Dreher, J. (2013) · Progress in brain research · doi:10.1016/b978-0-444-62604-2.00016-2 · Cited by 29
Self-citationConnecting Childhood Wariness to Adolescent Social Anxiety through the Brain and Peer Experiences
Jarcho, J. M., Grossman, H., Guyer, A. E., Quarmley, M., Smith, A. R., Fox, N. A., Leibenluft, E., Pine, D. S., & Nelson, E. E. (2019) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-019-00543-4 · Cited by 29
“…is often implicated in reward learning, the amygdala is also implicated in coding for salience of positive and negative prediction error outcomes (Belova et al. 2007; Metereau and Dreher 2013), and is necessary for successful reinforcement learning in unpredictable contexts (Janak and Tye 2015).”
BackgroundDesigning Brains for Pain: Human to Mollusc
Key, B., & Brown, D. J. (2018) · Frontiers in Physiology · doi:10.3389/fphys.2018.01027 · Cited by 28
Striatal and septo-hypothalamic responses to anticipation and outcome of affiliative rewards
Bortolini, T., Melo, B. R. P., Basílio, R., Fischer, R. D., Zahn, R., de Oliveira‐Souza, R., Knutson, B. D., & Moll, J. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118474 · Cited by 27
Neural dynamics of reward probability coding: a Magnetoencephalographic study in humans
Thomas, J., Vanni-Mercier, G., & Dreher, J. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00214 · Cited by 27
Self-citationMethylphenidate modifies reward cue responses in adults with ADHD: An fMRI study.
Furukawa, E., da Costa, R. Q. M., Bado, P., Hoefle, S., Vigne, P., Monteiro, M., Wickens, J., Moll, J., Tripp, G., & Mattos, P. (2020) · Neuropharmacology · doi:10.1016/j.neuropharm.2019.107833 · Cited by 19
Instrumental and Pavlovian Mechanisms in Alcohol Use Disorder
Doñamayor, N., Ebrahimi, C., Garbusow, M., Wedemeyer, F., Schlagenhauf, F., & Heinz, A. (2020) · Current Addiction Reports · doi:10.1007/s40429-020-00333-9 · Cited by 26
Moughrabi, N., Botsford, C., Gruichich, T. S., Azar, A., Heilicher, M. O., Hiser, J., Crombie, K. M., Dunsmoor, J. E., Stowe, Z. N., & Cisler, J. M. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119709 · Cited by 23
“Similarly, the striatum and DMN encoded positive expectations for both reward and threat, suggesting a sign-specific, rather than valence-specific, function for expectation of outcomes in these networks (Delgado et al., 2008; Metereau and Dreher, 2013).”
Lake, J. I., Spielberg, J. M., Infantolino, Z. P., Crocker, L. D., Yee, C. M., Heller, W., & Miller, G. A. (2019) · Psychophysiology · doi:10.1111/psyp.13381 · Cited by 21
The Neural Correlates of Cued Reward Omission
Mollick, J., Chang, L. J., Krishnan, A., Hazy, T. E., Krueger, K. A., Frank, G., Wager, T. D., & O’Reilly, R. C. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.615313 · Cited by 20
Wittmann, B. C., & D’Esposito, M. (2014) · Psychopharmacology · doi:10.1007/s00213-014-3646-7 · Cited by 19
“2003) and that the striatum is part of a network responding to salience prediction errors (Delgado et al. 2008; Jensen et al. 2007; Metereau and Dreher 2013; Seymour et al. 2004), possibly with an anteroposterior gradient dissociating reward and punishment-based activations (Seymour et al.”
InfluentialPain and Reorganization after Amputation: Is Interoceptive Prediction a Key?
Weiß, T., Koehler, H., & Croy, I. (2022) · The Neuroscientist · doi:10.1177/10738584221112591 · Cited by 19
“…network consists of cortical hubs (anterior cingulate cortex, anterior insula) that show common activation patterns whenever internal stimuli of the body or external stimuli become salient (i.e., immediately significant for the organism) (Ham and others 2013; Metereau and Dreher 2013; Seeley 2019).”
BackgroundReward and punisher experience alter rodent decision-making in a judgement bias task
Neville, V., Bonney-King, J. G., Gilchrist, I. D., Dayan, P., Paul, E. S., & Mendl, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-68737-1 · Cited by 19
Migraine Mistakes: Error Awareness
Borsook, D., Aasted, C. M., Burstein, R., & Becerra, L. R. (2013) · The Neuroscientist · doi:10.1177/1073858413503711 · Cited by 17
Chasing probabilities — Signaling negative and positive prediction errors across domains
Meder, D., Madsen, K. H., Hulme, O. J., & Siebner, H. R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.019 · Cited by 16
Kolada, E., Bielski, K., Wilk, M., Rymarczyk, K., Bogorodzki, P., Kazulo, P., Kossowski, B., Wypych, M., Marchewka, A., Kaczmarek, L., et al. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0926-22.2023 · Cited by 15
Goal-relevant situations facilitate memory of neutral faces
Montagrin, A., Virginie Sterpenich, A., Brosch, T., Grandjean, D., Armony, J. L., Ceravolo, L., & Sander, D. (2018) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-018-0637-x · Cited by 15
“…the learning of rewarding and aversive situations were found to be more activated in the goal-relevant than in the goal-irrelevant situations (ventral striatum, ventral tegmental area, substantia nigra, cingulate cortex; Haber & Knutson, 2010; Matsumoto & Hikosaka, 2009; Metereau & Dreher, 2012).”
Gu, Y., Liu, T., Zhang, X., Long, Q., Hu, N., Zhang, Y., & Chen, A. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa274 · Cited by 15
van der Heiden, L., Liberati, G., Sitaram, R., Kim, S., Ja'kowski, P., Raffone, A., Belardinelli, M. O., Birbaumer, N., & Veit, R. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00247 · Cited by 15
“The repeated association of words or sentences with a significant US, such as a painful stimulus, produces a CR, i.e., measured at the level of cortical evoked responses (Montoya et al., 1996).”
BackgroundPsychoticism and salience network morphology
Krishnadas, R., Palaniyappan, L. K., Lang, J., McLean, J., & Cavanagh, J. (2013) · Personality and Individual Differences · doi:10.1016/j.paid.2013.09.016 · Cited by 13
“A swift switching function carried out by the SN may be crucial for associative learning that accompanies processing of salience stimuli (den Ouden, Friston, Daw, McIntosh, & Stephan, 2008; Metereau & Dreher, 2013).”
BackgroundHaarsma, J., Fletcher, P. C., Ziauddeen, H., Spencer, T. J., Diederen, K. M. J., & Murray, G. K. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/288936 · Cited by 13
The Anterior Insula Processes a Time-Resolved Subjective Risk Prediction Error
Kim, J.-C., Hellrung, L., Nebe, S., & Tobler, P. N. (2025) · The Journal of Neuroscience · doi:10.1523/jneurosci.2302-24.2025 · Cited by 12
“…insula dominance for aversive salience (Simmons et al., 2006; Linnman et al., 2013; Liljeholm et al., 2014), whereas studies of learning-related risk prediction errors in anterior insula often found bilateral or left-lateralized activation (Preuscho ff et al., 2008; Metereau and Dreher, 2013).”
Kalbe, F., & Schwabe, L. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab402 · Cited by 13
Aberrant reward prediction errors in young adult at‐risk alcohol users
Cao, Z., Bennett, M., O’Halloran, L., Pragulbickaitė, G., Flanagan, L., McHugh, L., & Whelan, R. (2020) · Addiction Biology · doi:10.1111/adb.12873 · Cited by 12
Domain-specific neural substrates underlie the framing effect
Sun, S., Hu, J., & Yu, R. (2022) · Neuroimage Reports · doi:10.1016/j.ynirp.2022.100119 · Cited by 11
Krikova, K., Klein, S., Kampa, M., Walter, B., Stark, R. M., & Klucken, T. (2024) · Human Brain Mapping · doi:10.1002/hbm.26711 · Cited by 11
“In this context, the amygdala seems to modulate the motivational salience of a CS (Metereau & Dreher, 2013; Sescousse et al., 2013; Warlow & Berridge, 2021), retrieve the outcome memories of a CS (Everitt et al., 2003; Sias et al., 2021; Wassum, 2022) and is crucial for the acquisition and…”
BackgroundGu, Y., Hu, X., Pan, W., Yang, C., Wang, L., Li, Y., & Chen, A. (2016) · Scientific Reports · doi:10.1038/srep34032 · Cited by 11
Lender, A., Miedl, S. F., Wilhelm, F. H., Miller, J., & Blechert, J. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.113014 · Cited by 10
“After the cue-reward association has been consolidated, the dorsal striatum can be activated during prediction errors, that is, when the anticipated reward was not delivered as expected [25, 26].”
Functional organization of the human amygdala in appetitive learning
Kolada, E., Bielski, K., Falkiewicz, M., & Szatkowska, I. (2017) · Acta Neurobiologiae Experimentalis · doi:10.21307/ane-2017-044 · Cited by 10
“Metereau and Dreher (2013) carried out an experiment based on Pavlovian conditioning procedure in which they compared the activity related to error prediction in four conditions: two aversive using primary reinforcers of different modalities (salty water, picture of injured person) and two…”
MethodHaarsma, J., Fletcher, P. C., Griffin, J. D., Taverne, H., Ziauddeen, H., Spencer, T. J., Goodyer, I. M., Diederen, K. M. J., & Murray, G. K. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/558478 · Cited by 10
Furukawa, E., Bado, P., da Costa, R. Q. M., Melo, B. R. P., Erthal, P., de Oliveira, I. P., Wickens, J. R., Moll, J., Tripp, G., & Mattos, P. (2022) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2022.111561 · Cited by 9
“The time between a cue and outcome was kept constant to establish the predictive properties of the cue (Furukawa et al., 2014; Metereau and Dreher, 2013).”
Reward, Salience, and Agency in Event-Related Potentials for Appetitive and Aversive Contexts
Stewardson, H. J., & Sambrook, T. D. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab137 · Cited by 9
Neville, V., Dayan, P., Gilchrist, I. D., Paul, E. S., & Mendl, M. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01776 · Cited by 9
Balconi, M., & Canavesio, Y. (2015) · Journal of Psychophysiology · doi:10.1027/0269-8803/a000128 · Cited by 7
Hsu, Y., Hämäläinen, J. A., Moutsopoulou, K., & Waszak, F. (2015) · Biological Psychology · doi:10.1016/j.biopsycho.2015.02.001 · Cited by 7
Neural Correlates of Causal Confounding
Liljeholm, M. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01479 · Cited by 6
Learning under social versus nonsocial uncertainty: A meta‐analytic approach
Martinez‐Saito, M., & Gorina, E. (2022) · Human Brain Mapping · doi:10.1002/hbm.25948 · Cited by 6
de Cruys, S. V. (2014) · Lirias · Cited by 6
Subjective and neural reactivity during savoring and rumination
Brandeis, B. O., Siegle, G. J., Franzen, P. L., Soehner, A. M., Hasler, B. P., McMakin, D. L., Young, K., & Buysse, D. J. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01123-2 · Cited by 5
“Indeed, while savoring and ruminating differ in their valence and consequent theoretical behavioral functions, the literature shows that the same brain networks, particularly those involving the striatum, are associated with both reward and punishment (Delgado et al., 2000; Metereau & Dreher, 2013).”
BackgroundSharp, P. E. (2013) · Religion Brain & Behavior · doi:10.1080/2153599x.2013.826717 · Cited by 5
Cognitive and neural bases of visual-context-guided decision-making
Sun, S., Yu, H., Wang, S., & Yu, R. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120170 · Cited by 4
“…by both value and visual salience (Litt et al., 2011), and it encodes attention-guided relative-value signals (Lim et al., 2011), anticipated aversive stimuli (Jensen et al., 2003), salient non-rewarding stimuli (Zink et al., 2003), and salient prediction errors (Metereau and Dreher, 2013).”
Park, I. H., Lee, C. E., & Jhung, K. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1581802 · Cited by 3
Altered category learning and reduced generalization in autistic adults
Overwalle, J. V., der Donck, S. V., Geusens, B., Boets, B., & Wagemans, J. P. (2024) · Autism Research · doi:10.1002/aur.3286 · Cited by 3
“Moreover, other studies have identified the anterior cingulate cortex as a main player in the computation and saliency of prediction errors (Bach et al., 2011; Behrens et al., 2007; Ide et al., 2013; Metereau & Dreher, 2013).”
Dysfonctionnements du système de récompense et biais cognitifs chez les joueurs pathologiques
Dreher, J. (2021) · Bulletin de l Académie Nationale de Médecine · doi:10.1016/j.banm.2021.05.010 · Cited by 3
Self-citationJun, F., Jin, J., Zhao, S., Derrington, E. A., Qin, X., Fu, S., Shen, Q., & Dreher, J. (2026) · Games and Economic Behavior · doi:10.1016/j.geb.2026.02.011 · Cited by 2
Self-citationShearrer, G. E., Nansel, T. R., Lipsky, L. M., Sadler, J. R., & Burger, K. S. (2019) · Physiology & Behavior · doi:10.1016/j.physbeh.2019.04.009 · Cited by 2
“More specifically for the present study, BOLD response in the somatosensory region has been shown to be sensitive to prediction errors [50,51], is affected by stimulus probability [52], and is associated with salience prediction errors [53].”
BackgroundZhou, X., Xu, T., Zeng, Y., Zhang, R., Qi, Z., Zhao, W., Kendrick, K. M., & Becker, B. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.19.452920 · Cited by 2
Menschliches Verhalten bei der Ausführung von Prozessen
Rose, D.-M. (2014) · Springer eBooks · doi:10.1007/978-3-642-38045-7_3 · Cited by 1
Metadata
- Authors
- Metereau, E., & Dreher, J.-C.
- Affiliations
- Lyon 1 Université (FR)
- ORCID
- Dreher, Jean-Claude
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-02-23
- Volume
- 23
- Issue
- 2
- Pages
- 477-487
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2140531843
- Cited by
- 114
- References
- 98
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 3 · 2023: 5 · 2022: 7 · 2021: 11 · 2020: 9 · 2019: 9 · 2018: 5 · 2017: 7 · 2016: 7 · 2015: 12 · 2014: 14 · 2013: 17 · 2012: 3
- FWCI
- 7.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- prediction error, classical conditioning, reward, punishment, aversive stimuli, dopaminergic neurons, striatum, anterior insula, anterior cingulate cortex, amygdala, reinforcement learning models, model-based fMRI, monetary gain
- MeSH terms
- Brain, Brain Mapping, Conditioning, Classical, Female, Humans, Learning, Magnetic Resonance Imaging, Male, Punishment, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.