Activity in human ventral striatum locked to errors of reward prediction
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The mesolimbic dopaminergic system has long been known to be involved in the processing of rewarding stimuli, although recent evidence from animal research has suggested a more specific role of signaling errors in the prediction of rewards. We tested this hypothesis in humans, using functional magnetic resonance imaging (fMRI) and an operant conditioning paradigm for the discrete delivery of small quantities of fruit juice, along with a control experiment in which juice was substituted with a neutral visual stimulus. A local estimation of the activity in the ventral striatum showed a significant differentiation when the juice was withheld at the expected time of delivery; this finding was not replicated in the case of visual stimulation, providing evidence for time-locked processing of reward prediction errors in human ventral striatum.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The nucleus accumbens has notably been associated with coding prediction error in healthy controls (Abler et al. 2006; O’doherty et al. 2004; Pagnoni et al. 2002; Rodriguez et al. 2006).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pagnoni et al. 2002
Citations
Cites
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationIkemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
The dopamine hypothesis of reward: past and current status
Spanagel, R., & Weiss, F. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(99)01447-2 · Cited by 973
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Duvernoy, H. M. (1999) · Springer eBooks · doi:10.1007/978-3-7091-6792-2 · Cited by 756
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740
Parametric Analysis of fMRI Data Using Linear Systems Methods
Cohen, M. S. (1997) · NeuroImage · doi:10.1006/nimg.1997.0278 · Cited by 714
Research works printed but not linked: 1
- Ward, B. D. in AFNI 3dDeconvolve Documentation (Medical College of Wisconsin, 2001).
Cited by
Items 101–200 of 446
Different neural systems adjust motor behavior in response to reward and punishment
Wrase, J., Kahnt, T., Schlagenhauf, F., Beck, A., Cohen, M. X., Knutson, B., & Heinz, A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.001 · Cited by 172
“This phenomena is hypothesized to reflect the workings of a reinforcement learning system that uses error signals to correct and dynamically adjust performance (Holroyd and Coles, 2002; Pagnoni et al., 2002).”
BackgroundGABAergic output of the basal ganglia
Hikosaka, O. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)60012-5 · Cited by 171
“On the other hand, the ventral striatum is now known to carry rewardrelated motivational signals in rodents (Nicola et al., 2004), monkeys (Schultz et al., 1992), and humans (Knutson et al., 2001; Pagnoni et al., 2002).”
BackgroundFrom recurrent choice to skill learning: A reinforcement-learning model.
Fu, W.-T., & Anderson, J. R. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.2.184 · Cited by 167
“Inversely, when a fully predicted reward fails to occur, DA neurons are depressed in their activity at exactly the time when the reward would have occurred ( Pagnoni, Zink, Montague, & Berns, 2002; Schultz, Apicella, & Ljungberg, 1993).”
BackgroundZhang, L., Lengersdorff, L., Mikus, N., Gläscher, J., & Lamm, C. (2020) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsaa089 · Cited by 173
“…of other brain regions that are associated with PE, see O’Doherty et al., 2017), and this finding has been replicated across several studies (e.g. Pagnoni et al., 2002; Pes-siglione et al., 2006; Behrens et al., 2008; Jocham et al., 2014; Chien et al., 2016; Klein et al., 2017; Zhang and…”
ResultSelective activation of the nucleus accumbens during risk-taking decision making
Matthews, S. C., Simmons, A. N., Lane, S. D., & Paulus, M. P. (2004) · NeuroReport · doi:10.1097/00001756-200409150-00025 · Cited by 157
“Additionally, the nucleus accumbens has been implicated in the calculation of an error signal due to the difference between expected and received reward [11].”
BackgroundNeural signatures of trust in reciprocity: A coordinate‐based meta‐analysis
Bellucci, G., Chernyak, S. V., Goodyear, K., Eickhoff, S. B., & Krueger, F. (2017) · Human Brain Mapping · doi:10.1002/hbm.23451 · Cited by 160
“The striatum has previously been observed to response to both primary (e.g., sex and food) and secondary rewards (e.g., monetary gains) [Elliott et al., 2004; Moll et al., 2006; O’Doherty et al., 2002; Pagnoni et al., 2002; Pfaus et al., 1995].”
BackgroundStimulant and Sedative Effects of Alcohol
Hendler, R. A., Ramchandani, V. A., Gilman, J. M., & Hommer, D. W. (2011) · Current topics in behavioral neurosciences · doi:10.1007/978-3-642-28720-6_135 · Cited by 182
Distorted expectancy coding in problem gambling: is the addictive in the anticipation?
van Holst, R. J., Veltman, D. J., Büchel, C., van den Brink, W., & Goudriaan, A. E. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.030 · Cited by 155
Pruning of memories by context-based prediction error
Kim, G., Lewis-Peacock, J. A., Norman, K. A., & Turk-Browne, N. B. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319438111 · Cited by 159
Satterthwaite, T. D., Green, L., Myerson, J., Parker, J. B., Ramaratnam, M., & Buckner, R. L. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.066 · Cited by 171
“In previous studies, the nucleus accumbens in the ventral striatum has been found to respond to reward (Knutson et al., 2001a; O'Doherty et al., 2004; Pagnoni et al., 2002), and one recent study demonstrated uncertainty-modulated reward responses in the midbrain (Dreher et al.”
Feeling in control: neural correlates of experience of agency
Kühn, S., Brass, M., & Haggard, P. (2013) · Cortex · doi:10.1016/j.cortex.2012.09.002 · Cited by 138
“This area is involved in computations of reward and prediction error thought to underlie reinforcement learning (O’Doherty et al., 2003; Pagnoni et al., 2002; Pessiglione et al., 2006).”
Decision-related loss: Regret and disappointment
Chua, H. F., Gonzalez, R., Taylor, S. F., Welsh, R. C., & Liberzon, I. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.006 · Cited by 172
“This is consistent with previous work that associated the lateral orbitofrontal cortex (O'Doherty et al., 2003) and SLEA/ventral striatum (Pagnoni et al., 2002) with processing the difference between expected and observed outcomes.”
BackgroundResultReward-related processing in the human brain: developmental considerations
Fareri, D. S., Martin, L. N., & Delgado, M. R. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000576 · Cited by 141
“Such studies have tested whether activity in the striatum was related to positive (unexpectedly receiving a reward) and negative (omission of an expected reward) temporal predictionerrors(McClure,Berns,MO’Dohertyetal.,2003; Pagnoni,Zink,Montague, & Berns, 2002 ).”
BackgroundMarchand, W. R. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0280-y · Cited by 150
Chib, V. S., De Martino, B., Shimojo, S., & O'Doherty, J. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.02.038 · Cited by 130
“Given that the striatum is also known to encode signals resembling a rewarded prediction error (McClure et al., 2003; O’Doherty et al., 2003; Pagnoni et al., 2002), we performed a simulation to determine if the deactivations observed during the motor task could be elicited as a byproduct of…”
Prediction error for free monetary reward in the human prefrontal cortex
Ramnani, N., Elliott, R., Athwal, B. S., & Passingham, R. E. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.028 · Cited by 151
“, juice), the basal ganglia are activated by prediction error (McClure et al., 2003; O’Doherty et al., 2003; Pagnoni et al., 2002).”
BackgroundMethodResultInfluentialde Bruijn, E. R. A., de Lange, F. P., von Cramon, D. Y., & Ullsperger, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1751-09.2009 · Cited by 132
“Also in line with previous research (Pagnoni et al., 2002; Ullsperger and von Cramon, 2003; Knutson and Cooper, 2005; Klein et al., 2007; O’Doherty et al., 2007), the reward-specific contrast revealed increased activations in the striatum with a maximum in the ventral striatum including the nucleus…”
Reward-based decision-making and aging
Marschner, A., Mell, T., Wartenburger, I., Villringer, A., Reischies, F. M., & Heekeren, H. R. (2005) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2005.06.010 · Cited by 154
Neuroanatomy of Reward: A View from the Ventral Striatum
Haber, S. N. (2011) · Europe PMC (PubMed Central) · Cited by 172
Researching the pathophysiology of pediatric bipolar disorder
Leibenluft, E., Charney, D. S., & Pine, D. S. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(03)00069-6 · Cited by 133
“In addition to the medial and ventral PFC, basal ganglia structures are activated by the expectation and detection of reward in both animals and humans (Pagnoni et al 2002; Schulze et al 2000).”
BackgroundLemche, E., Giampietro, V. P., Surguladze, S. A., Amaro, E. J., Andrew, C. M., Williams, S. C. R., Brammer, M. J., Lawrence, N., Maier, M. A., Russell, T. A., et al. (2006) · Human Brain Mapping · doi:10.1002/hbm.20206 · Cited by 123
“These findings may therefore reflect the role of the putamen in the response to emotive or salient material, reported previously in other neuroimaging studies in humans [e.g., Pagnoni et al., 2002; Surguladze et al., 2003], but not in attachment in humans.”
ResultThe neural circuitry of reward and its relevance to psychiatric disorders
Chau, D. T., Roth, R. M., & Green, A. I. (2004) · Current Psychiatry Reports · doi:10.1007/s11920-004-0026-8 · Cited by 123
Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning
Rodriguez, P. F., Aron, A. R., & Poldrack, R. A. (2006) · Human Brain Mapping · doi:10.1002/hbm.20186 · Cited by 122
“In conclusion, we have confirmed prior reports of Nacc response for a contrast of unpredictable vs. predictable events [Berns et al., 2001; Pagnoni et al., 2002; Volz et al., 2003], demonstrated that it varies parametrically with level of prediction error, and shown that it also applies in the case…”
BackgroundResultInfluentialGershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118
“We thus sought evidence of such a decomposition in the oft-reported (Pagnoni et al., 2002; McClure et al., 2003; O’Doherty et al., 2003; Daw et al., 2006a; Scho¨nberg et al., 2007; Hare et al., 2008) prediction error correlates of ventral striatal BOLD, and our results demonstrate a contralateral…”
BackgroundMethodResultMusic and Memory in Alzheimer’s Disease and The Potential Underlying Mechanisms
Peck, K. J., Girard, T. A., Russo, F., & Fiocco, A. J. (2016) · Journal of Alzheimer s Disease · doi:10.3233/jad-150998 · Cited by 144
“The ventral striatum, which is important for motivation and processing of reward [18, 19], is also found to be compromised in patients with AD, evidenced by significant decreases in cholinergic neurons [20].”
BackgroundPredicting danger: The nature, consequences, and neural mechanisms of predictive fear learning
McNally, G. P., & Westbrook, R. F. (2006) · Learning & Memory · doi:10.1101/lm.196606 · Cited by 117
“Regarding the circumstances that produce unblocking , theories of indirect predictive learning state that unblocking occurs with increases or decreases in the US from stage 1 to stage 2 (Pearce and Hall 1980).”
BackgroundThe role of dopamine in cognitive sequence learning: evidence from Parkinson’s disease
Shohamy, D., Myers, C. E., Grossman, S., Sage, J., & Gluck, M. A. (2004) · Behavioural Brain Research · doi:10.1016/j.bbr.2004.05.023 · Cited by 128
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111
Emotional processing in bipolar disorder: Behavioural and neuroimaging findings
Wessa, M., & Linke, J. (2009) · International Review of Psychiatry · doi:10.1080/09540260902962156 · Cited by 108
Right frontal cortex generates reward-related theta-band oscillatory activity
Christie, G. J., & Tata, M. S. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.076 · Cited by 457
“Studies using functional Magnetic Resonance Imaging (fMRI) have implicated a distributed network of subcortical and frontal cortical structures mediating reward processing (Delgado et al., 2000; McClure et al., 2003; McClure et al., 2004; O'Doherty et al., 2004; O'Doherty et al., 2002; Pagnoni et al., 2002; Schonberg…”
Adult age differences in frontostriatal representation of prediction error but not reward outcome
Samanez-Larkin, G. R., Worthy, D. A., Mata, R., McClure, S. M., & Knutson, B. D. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0297-4 · Cited by 120
Carhart-Harris, R. L., Mayberg, H. S., Malizia, A. L., & Nutt, D. (2008) · Annals of General Psychiatry · doi:10.1186/1744-859x-7-9 · Cited by 99
Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
Gläscher, J. P., & O'Doherty, J. P. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.57 · Cited by 104
Altered function of ventral striatum during reward-based decision making in old age
Mell, T. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.034.2009 · Cited by 107
Cerebral interactions of pain and reward and their relevance for chronic pain
Becker, S., Gandhi, W., & Schweinhardt, P. (2012) · Neuroscience Letters · doi:10.1016/j.neulet.2012.03.013 · Cited by 122
Sensitivity to punishment and reward omission: Evidence from error-related ERP components
Boksem, M. A. S., Tops, M., Kostermans, E., & De Cremer, D. (2008) · Biological Psychology · doi:10.1016/j.biopsycho.2008.04.010 · Cited by 103
“…striatum indeed shows a strong outcomerelated response when a reward occurs unexpectedly or an activity decrease when an expected reward is omitted (Pagnoni et al., 2002; McClure et al., 2003; O'Doherty et al., 2003, 2004; Ramnani et al., 2004), resembling a prediction error signal similar to…”
Signatures of Value Comparison in Ventral Striatum Neurons
Strait, C. E., Sleezer, B. J., & Hayden, B. Y. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002173 · Cited by 104
“On the other hand, most theories emphasize the contribution of VS to learning and other processes distal to the evaluation and comparison processes that directly implement reward-based choices [25–32].”
BackgroundDifferential effects of clozapine and haloperidol on interval timing in the supraseconds range
MacDonald, C. J., & Meck, W. H. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0074-8 · Cited by 114
“…and reward prediction—umbrella terms that describe the process by which a biologically prepotent stimulus supports and organizes behavior that directs an organism to, or away from, the same stimulus in the future (e.g., Hernandez et al. 2002; Nicola et al. 2000; Pagnoni et al. 2002; Robbins 2003).”
Koch, K., Schachtzabel, C., Wagner, G., Schikora, J., Schultz, C., Reichenbach, J. R., Sauer, H., & Schlösser, R. G. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.031 · Cited by 101
Kahnt, T., Park, S. Q., Cohen, M. X., Beck, A., Heinz, A., & Wrase, J. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21092 · Cited by 115
“Kahnt et al. 1337 Downloaded from http://www.mitpressjournals.org/doi/pdfplus/10.1162/jocn.2009.21092 by guest on 05 June 2021”
BackgroundInfluentialHuman Medial Orbitofrontal Cortex Is Recruited During Experience of Imagined and Real Rewards
Bray, S., Shimojo, S., & O'Doherty, J. P. (2010) · Journal of Neurophysiology · doi:10.1152/jn.01030.2009 · Cited by 104
Neurobiological regret and rejoice functions for aversive outcomes
Chandrasekhar, P. V. S., Capra, C. M., Moore, S. E., NOUSSAIR, C. N., & Berns, G. S. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.027 · Cited by 105
“The striatum, in particular, is generally accepted as playing a key role in reward-prediction errors (Berns et al., 2001; McClure et al., 2003; Montague et al., 2006; O’Doherty et al., 2004; O’Doherty et al., 2003; Pagnoni et al., 2002; Schultz et al., 1997; Yacubian et al., 2006).”
BackgroundSelf-citationGilman, J. M., Ramchandani, V. A., Crouss, T., & Hommer, D. W. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.206 · Cited by 97
Experiential reward learning outweighs instruction prior to adulthood
Decker, J. H., Lourenco, F. S., Doll, B. B., & Hartley, C. A. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0332-5 · Cited by 96
“Experiential learning is thought to depend critically on dopaminergic prediction errors, through which the striatum can learn the value of an action (McClure et al., 2003; O’Doherty et al., 2003; Pagnoni et al., 2002; Schultz, Dayan, & Montague, 1997).”
BackgroundTurner, D. C. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh046 · Cited by 94
“Prediction error is increasingly becoming a focus for functional neuroimaging studies (Ploghaus et al., 2000; Pagnoni et al., 2002; Braver and Brown, 2003; McClure et al., 2003; O'Doherty et al., 2003), although this has largely focused upon emotionally salient learning, or conditioning.”
The Protective Action Encoding of Serotonin Transients in the Human Brain
Moran, R., Kishida, K. T., Lohrenz, T. M., Sáez, I., Laxton, A. W., Witcher, M. R., Tatter, S. B., Ellis, T. L., Phillips, P. E. M., Dayan, P., et al. (2018) · Neuropsychopharmacology · doi:10.1038/npp.2017.304 · Cited by 104
Self-citationLutz, K., & Widmer, M. (2014) · Neuroscience and Neuroeconomics · doi:10.2147/nan.s38864 · Cited by 112
“Prediction of rewards in response to cues seems to take place in the nucleus accumbens, 22 whereas the medial prefrontal cortex seems to (re)calculate expectations of gains in response to outcomes.”
BackgroundParallel contributions of distinct human memory systems during probabilistic learning
Dickerson, K. C., Li, J., & Delgado, M. R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.080 · Cited by 92
Brain Hemispheres Selectively Track the Expected Value of Contralateral Options
Palminteri, S., Boraud, T., Lafargue, G., Dubois, B., & Pessiglione, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1500-09.2009 · Cited by 100
“Also consistent with previous reports (Pagnoni et al., 2002; O’Doherty et al., 2004; Pessiglione et al., 2006; Lohrenz et al., 2007), regions expressing prediction errors at the time of outcome largely overlapped with the above regions related to both expected reward and hand movement at the time…”
ResultStriatal activations signal prediction errors on confidence in the absence of external feedback
Daniel, R., & Pollmann, S. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.11.058 · Cited by 112
“fMRI activity in the ventral striatum has been shown to follow the reward prediction error in humans (Abler et al., 2006; Berns et al., 2001; Daw et al., 2006; Hare et al., 2008; McClure et al., 2003; O'Doherty et al., 2003, 2004; Pagnoni et al., 2002).”
BackgroundAbnormal striatal BOLD responses to reward anticipation and reward delivery in ADHD
Furukawa, E., Bado, P., Tripp, G., Mattos, P., Wickens, J. R., Bramati, I. E., Alsop, B., Ferreira, F. M., Lima, D., Tovar-Moll, F., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089129 · Cited by 90
“Similarly, in humans, striatal activity has been seen in response to reward-predicting cues [45], [57], [81], [82].”
BackgroundFilbey, F. M., Myers, U. S., & DeWitt, S. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.073 · Cited by 101
“…greater activation in reward areas of the brain compared to water (Bassareo and Di Chiara, 1999; Berns et al., 2001; Frank et al., 2003; Grabenhorst et al., 2010; James et al., 2001; Pagnoni et al., 2002) and that these areas form a functionally connected circuit as determined by PPI analysis.”
Expectations and outcomes: decision-making in the primate brain
McCoy, A. N., & Platt, M. L. (2004) · Journal of Comparative Physiology A · doi:10.1007/s00359-004-0565-9 · Cited by 99
“2004), ventral striatum (Pagnoni et al. 2002; Seymour et al. 2004), CGp (Smith et al.”
BackgroundFocal basal ganglia lesions are associated with impairments in reward-based reversal learning
Bellebaum, C., Koch, B., Schwarz, M., & Daum, I. (2008) · Brain · doi:10.1093/brain/awn011 · Cited by 89
Aversive stimuli and loss in the mesocorticolimbic dopamine system
Brooks, A. M., & Berns, G. S. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.04.001 · Cited by 85
Self-citationFailing where others have succeeded: Medial Frontal Negativity tracks failure in a social context
Boksem, M. A. S., Kostermans, E., & Cremer, D. D. (2010) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01163.x · Cited by 93
How Psychosocial Alcohol Interventions Work: A Preliminary Look at What fMRI Can Tell Us
Ewing, S. W. F., Filbey, F. M., Sabbineni, A., Chandler, L. D., & Hutchison, K. E. (2011) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2010.01382.x · Cited by 89
“It should be noted that several studies have used similar administration procedures to examine the brain regions associated with the rewarding value of juice (e.g., Pagnoni et al., 2002).”
BackgroundDopamine and reward: a view from the prefrontal cortex
Chau, B. K. H., Jarvis, H., Law, C.-K., & Chong, T. T. ‐. (2018) · Behavioural Pharmacology · doi:10.1097/fbp.0000000000000424 · Cited by 97
“Human fMRI studies provide convergent evidence, showing that the ventral striatum encodes reward prediction error (Pagnoni et al., 2002; McClure et al., 2003; Abler et al., 2006).”
BackgroundVentral striatum: a critical look at models of learning and evaluation
van der Meer, M. A., & Redish, A. D. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.02.011 · Cited by 84
“fMRI studies reliably report reward prediction error signaling in the ventral striatum [21–23], thought in part, although not entirely, to arise from VTA input [24,25].”
Backgroundvan den Bos, W., McClure, S. M., Harris, L. T., Fiske, S. T., & Cohen, J. D. (2007) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.7.4.337 · Cited by 94
“The pattern of increased activity associated with positive relative to negative feedback in the striatum is in accord with previous evidence that the ventral striatum is involved in reward expectation and delivery in humans (Breiter et al., 2001; Delgado, Nystrom, Fissell, Noll, & Fiez, 2000; Knutson et al., 2003; McC…”
ResultSchönberg, T., O’Doherty, J. P., Joel, D., Inzelberg, R., Segev, Y., & Daw, N. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.011 · Cited by 93
“…them) during learning tasks patterned after those used to elicit dopaminergic responses in animals (Delgado et al., 2000; Knutson et al., 2000; Pagnoni et al., 2002; McClure et al., 2003; O'Doherty et al., 2003, 2004; Rodriguez et al., 2006; Schonberg et al., 2007; D'Ardenne et al., 2008; for…”
Dopamine and the interdependency of time perception and reward
Fung, B. J., Sutlief, E., & Shuler, M. G. H. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.02.030 · Cited by 91
Millard, S. J., Bearden, C. E., Karlsgodt, K. H., & Sharpe, M. J. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01188-y · Cited by 85
Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement
Acheson, A., Farrar, A. M., Patak, M., Hausknecht, K. A., Kieres, A. K., CHOI, S., de Wit, H., & RICHARDS, J. (2006) · Behavioural Brain Research · doi:10.1016/j.bbr.2006.06.024 · Cited by 92
Okamoto, M., & Dan, I. (2012) · Seminars in Cell and Developmental Biology · doi:10.1016/j.semcdb.2012.11.001 · Cited by 95
Xiang, T., Ray, D., Lohrenz, T., Dayan, P., & Montague, P. R. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002841 · Cited by 78
“In games against nature, prediction errors associated with rewarding outcomes have frequently been observed in the BOLD signal measured in striatal regions [17–19].”
BackgroundSelf-citationThe Anterior Insular Cortex Represents Breaches of Taste Identity Expectation
Veldhuizen, M. G., Douglas, D., Aschenbrenner, K., Gitelman, D. R., & Small, D. M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1502-11.2011 · Cited by 76
“Both regions have been implicated by functional neuroimaging studies in coding error signals in the context of reward learning (Pagnoni et al., 2002; McClure et al., 2003; O’Doherty et al., 2003), with the magnitude of responses modulated according to the strength of an error signal thought to be…”
BackgroundInfluentialBrain mechanism of reward prediction under predictable and unpredictable environmental dynamics
Tanaka, S., Samejima, K., Okada, G., Ueda, K., Okamoto, Y., Yamawaki, S., & Doya, K. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.05.039 · Cited by 89
“Also a number of previous functional brain imaging studies have shown striatal activities correlated with reward prediction error (Berns et al., 2001; McClure et al., 2003; O’Doherty, J. P. et al., 2003; Pagnoni et al., 2002; Seymour et al., 2004; Tanaka et al., 2004).”
BackgroundHelfinstein, S. M., Benson, B., Perez-Edgar, K., Bar-Haim, Y., Detloff, A., Pine, D. S., Fox, N. A., & Ernst, M. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.12.015 · Cited by 75
“…in childhood and adolescence (Chronis-Tuscano et al., 2009). hese children also differ physiologically from non-inhibited peers, isplaying higher baseline cortisol levels, greater right frontal elecroencephalogram (EEG) asymmetry, and higher heart rates (Fox, enderson, Perez-Edgar, & White,…”
BackgroundAdjusting behavior to changing environmental demands with development
Lourenco, F. S., & Casey, B. J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.003 · Cited by 95
“Subcortical systems have been shown to support essential, evolutionarily-conserved learning processes involving reward (Galvan et al., 2005; Pagnoni et al., 2002; Schultz et al., 1997) and threat (Delgado et al.”
BackgroundAge-Based Differences in Strategy Use in Choice Tasks
Worthy, D. A., & Maddox, W. T. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00145 · Cited by 81
“Reward prediction errors from RL models similar to the one presented above have been correlated with striatal activity in a number of studies (Pagnoni et al., 2002; Pessiglione et al., 2006; Hare et al., 2008).”
BackgroundKenett, Y. N., Humphries, S. A., & Chatterjee, A. K. (2023) · Creativity Research Journal · doi:10.1080/10400419.2023.2165748 · Cited by 91
Replicability and Heterogeneity of Awake Unrestrained Canine fMRI Responses
Berns, G. S., Brooks, A. M., & Spivak, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0081698 · Cited by 73
“The caudate response is to a visual cue indicating the imminent receipt of fruit juice, to which participants had to press a button to receive the juice [17].”
BackgroundResultSelf-citationLai, M.-C., Lombardo, M. V., Chakrabarti, B., Ecker, C., Sadek, S. A., Wheelwright, S. J., Murphy, D. G. M., Suckling, J., Bullmore, E. T., & Baron-Cohen, S. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.018 · Cited by 74
“food and sexual stimuli) (Arnow et al., 2002; Berns et al., 2001; McClure et al., 2003; Pagnoni et al., 2002), secondary rewards (e.”
Glimcher, P. W. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00032-4 · Cited by 76
Understanding the Placebo Effect: Contributions from Neuroimaging
Lidstone, S. C., & Stoessl, A. J. (2007) · Molecular Imaging and Biology · doi:10.1007/s11307-007-0086-3 · Cited by 81
Apicella, P., Ravel, S., Deffains, M., & Legallet, E. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4880-10.2011 · Cited by 86
“Functional brain imaging studies have identified prediction error-related activity in target structures of dopamine neurons, especially the striatum (Knutson et al., 2000; Pagnoni et al., 2002; McClure et al., 2003; O’Doherty et al., 2003, 2004; Schönberg et al., 2007).”
BackgroundLearning relative values in the striatum induces violations of normative decision making
Klein, T. A., Ullsperger, M., & Jocham, G. (2017) · Nature Communications · doi:10.1038/ncomms16033 · Cited by 83
Neuroanatomical Prediction of Anhedonia in Adolescents
Auerbach, R. P., Pisoni, A., Bondy, E., Kumar, P., Stewart, J. G., Yendiki, A., & Pizzagalli, D. A. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.28 · Cited by 74
“…have described robust activation in the ventral striatum in response to rewards (O'Doherty, 2004), with some research showing differential sensitivity to reward receipt (ie, increased activation; Forbes and Dahl, 2005) vs omission (ie, deactivation; O'Doherty et al, 2003; Pagnoni et al, 2002).”
BackgroundWilson, S. J., Creswell, K. G., Sayette, M. A., & Fiez, J. A. (2012) · Addictive Behaviors · doi:10.1016/j.addbeh.2012.03.020 · Cited by 73
The Case for Adaptive Neuromodulation to Treat Severe Intractable Mental Disorders
Provenza, N. R., Matteson, E., Allawala, A. B., Barrios-Anderson, A., Sheth, S. A., Viswanathan, A., McIngvale, E., Storch, E. A., Frank, M. J., McLaughlin, N. C. R., et al. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00152 · Cited by 71
Rose, E. J., Ross, T. J., Salmeron, B. J., Lee, M., Shakleya, D. M., Huestis, M. A., & Stein, E. A. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.09.013 · Cited by 70
Theoretical and Empirical Studies of Learning
Niv, Y., & Montague, P. R. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00022-1 · Cited by 73
Self-citationOpioid Receptors in the Nucleus Accumbens Regulate Attentional Learning in the Blocking Paradigm
Iordanova, M. D., McNally, G. P., & Westbrook, R. F. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4679-05.2006 · Cited by 62
“Neuroimaging studies in human participants reveal similar changes in target regions of midbrain DA cells, the ventral striatum and ventral putamen (Pagnoni et al., 2002; O’Doherty et al., 2003).”
ResultWilson, S. J., Sayette, M. A., & Fiez, J. A. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0025112 · Cited by 69
Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The Role of Reward System
Lee, J. S., Jung, S., Park, I. H., & Kim, J. (2015) · Current Neuropharmacology · doi:10.2174/1570159x13666150612230333 · Cited by 69
“modulation of stimulus-response association according to rewarding outcomes of actions in instrumental conditioning [81,82].”
BackgroundDepersonalization Disorder: A Functional Neuroanatomical Perspective
Phillips, M. L., & Sierra, M. (2003) · Stress · doi:10.1080/1025389031000138538 · Cited by 62
“, 1997), in the anticipation and time-locked processing of reward (Knutson et al., 2001; Pagnoni et al., 2002), and in romantic love (Bartels and Zeki, 2000), whilst a positive correlation has been reported between the euphoric response to dextroamphetamine and the magnitude of dopamine release in anteroventral striat…”
BackgroundAnatomy and Connectivity of the Reward Circuit
Haber, S. N. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00001-4 · Cited by 72
Understanding the Placebo Effect: Contributions from Neuroimaging
Lidstone, S. C., & Stoessl, A. J. (2007) · Molecular Imaging and Biology · doi:10.1007/s11307-007-0098-z · Cited by 60
Bebko, G. M., Bertocci, M. A., Fournier, J. C. J., Hinze, A. K., Bonar, L. K., Almeida, J., Perlman, S. B., Versace, A., Schirda, C., Travis, M. J., et al. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.2870 · Cited by 65
Mühlberger, A., Wieser, M. J., Gerdes, A. B. M., Frey, M. C. M., Weyers, P., & Pauli, P. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq039 · Cited by 60
“…accumbens) has been found to be a key structure activated by the conditioned stimulus associated with either a primary (e.g. O’Doherty et al., 2001; Pagnoni et al., 2002; Gottfried et al., 2003) or a secondary reinforcer (e.g. Delgado et al., 2000; Kirsch et al., 2003; Delgado et al., 2008, for…”
BackgroundEarly-life adversity and adolescent depression: mechanisms involving the ventral striatum
Goff, B., & Tottenham, N. (2014) · CNS Spectrums · doi:10.1017/s1092852914000674 · Cited by 66
Retest reliability of reward-related BOLD signals
Fließbach, K., Rohe, T., Linder, N. S., Trautner, P., Elger, C. E., & Weber, B. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.036 · Cited by 64
“, 2008) and in its projection sites (Pagnoni et al., 2002; Rolls et al., 2008) increases with reward predictions and scales positively with the RPE.”
BackgroundKosson, D. S., Budhani, S., Nakic, M., Chen, G., Saad, Z. S., Vythilingam, M., Pine, D. S., & Blair, J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.07.060 · Cited by 66
Skottnik, L., Sorger, B., Kamp, T., Linden, D. E. J., & Goebel, R. (2019) · Brain and Behavior · doi:10.1002/brb3.1240 · Cited by 61
Non-Conscious Prediction and a Role for Consciousness in Correcting Prediction Errors
Pally, R. (2005) · Cortex · doi:10.1016/s0010-9452(08)70282-x · Cited by 57
Beylergil, S. B., Beck, A., Deserno, L., Lorenz, R. C., Rapp, M. A., Schlagenhauf, F., Heinz, A., & Obermayer, K. (2017) · NeuroImage: Clinical · doi:10.1016/j.nicl.2017.04.010 · Cited by 55
Murray, G. K., Knolle, F., Ersche, K. D., Craig, K. J., Abbott, S., Shabbir, S. S., Fineberg, N. A., Suckling, J., Sahakian, B. J., Bullmore, E. T., et al. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05292-2 · Cited by 53
Stolz, D. S., Müller‐Pinzler, L., Krach, S., & Paulus, F. M. (2020) · Nature Communications · doi:10.1038/s41467-020-14800-4 · Cited by 58
Mattfeld, A. T., & Stark, C. E. L. (2015) · Hippocampus · doi:10.1002/hipo.22411 · Cited by 63
“…Eskandar, 2006) and reward prediction error mechanisms, wherein the difference between expected and received reward (i.e., error term) is greatest during learning and subsequently declines once associations are well learned (Pagnoni et al., 2002; McClure et al. 2003; O’Doherty et al., 2003, 2004).”
Background
Metadata
- Authors
- Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S.
- Affiliations
- Emory University (US)
- Baylor College of Medicine (US)
- Corresponding author
- Pagnoni, Giuseppe
- Venue
- Nature Neuroscience
- Published
- 2002-01-22
- Volume
- 5
- Issue
- 2
- Pages
- 97-98
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2002352860
- Cited by
- 451
- References
- 12
- Citations by year
- 2026: 9 · 2025: 10 · 2024: 13 · 2023: 9 · 2022: 7 · 2021: 17 · 2020: 16 · 2019: 15 · 2018: 17 · 2017: 11 · 2016: 17 · 2015: 22 · 2014: 23 · 2013: 24 · 2012: 29
- FWCI
- 10.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh061010-02)
- National Institute of Mental Health (MH61010)
- National Institute on Drug Abuse (K08DA000367, DA-00367, DA 11723, R01DA011723)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- ventral striatum, reward prediction error, mesolimbic dopamine system, operant conditioning, reward processing, human brain imaging
- MeSH terms
- Adult, Algorithms, Conditioning, Operant, Corpus Striatum, Forecasting, Humans, Magnetic Resonance Imaging, Random Allocation, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.