Activity in human ventral striatum locked to errors of reward prediction
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The mesolimbic dopaminergic system has long been known to be involved in the processing of rewarding stimuli, although recent evidence from animal research has suggested a more specific role of signaling errors in the prediction of rewards. We tested this hypothesis in humans, using functional magnetic resonance imaging (fMRI) and an operant conditioning paradigm for the discrete delivery of small quantities of fruit juice, along with a control experiment in which juice was substituted with a neutral visual stimulus. A local estimation of the activity in the ventral striatum showed a significant differentiation when the juice was withheld at the expected time of delivery; this finding was not replicated in the case of visual stimulation, providing evidence for time-locked processing of reward prediction errors in human ventral striatum.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The nucleus accumbens has notably been associated with coding prediction error in healthy controls (Abler et al. 2006; O’doherty et al. 2004; Pagnoni et al. 2002; Rodriguez et al. 2006).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pagnoni et al. 2002
Citations
Cites
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationIkemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
The dopamine hypothesis of reward: past and current status
Spanagel, R., & Weiss, F. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(99)01447-2 · Cited by 973
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Duvernoy, H. M. (1999) · Springer eBooks · doi:10.1007/978-3-7091-6792-2 · Cited by 756
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740
Parametric Analysis of fMRI Data Using Linear Systems Methods
Cohen, M. S. (1997) · NeuroImage · doi:10.1006/nimg.1997.0278 · Cited by 714
Research works printed but not linked: 1
- Ward, B. D. in AFNI 3dDeconvolve Documentation (Medical College of Wisconsin, 2001).
Cited by
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Self-citationNeurobiology of emotion perception I: the neural basis of normal emotion perception
Phillips, M. L., Drevets, W. C., Rauch, S. L., & Lane, R. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(03)00168-9 · Cited by 2,173
“These have highlighted the role of the ventral striatum in craving (Breiter et al 1997), in the time-locked processing of reward prediction (Pagnoni et al 2002), in anticipation of reward (Knutson et al 2001), and in romantic love (Bartels and Zeki 2000).”
BackgroundDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
The somatic marker hypothesis: A neural theory of economic decision
Bechara, A., & Damasio, A. R. (2005) · Games and Economic Behavior · doi:10.1016/j.geb.2004.06.010 · Cited by 1,986
“(3) Berns, Montague, and their colleagues (Berns et al., 2001; Pagnoni et al., 2002) developed a task where subjects had to choose which of two buttons to press in order to get the maximum gain of $40, by driving a slider all the way up to the top of a bar.”
BackgroundAn integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
“A further study of trial-based learning showed a positive BOLD response in ventral striatum when a reward wasIntroduction delivered later than expected (Pagnoni et al., 2002).”
BackgroundResultInfluentialA neural basis for social cooperation
Rilling, J. K., Gutman, D. A., Zeh, T. R., Pagnoni, G., Berns, G. S., & Kilts, C. D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00755-9 · Cited by 1,451
“Schulz et al. the orbitofrontal cortex (Francis et al., 1999; O’Doherty (1997) have demonstrated that the omission of expected et al., 2001; Rolls, 1999; Schultz et al., 2000; Thut et al., rewards deactivates midbrain dopamine neurons (de- 1997) and ventral striatum (Berns et al., 2001; Breiter et creases spike produc…”
BackgroundSelf-citationReward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426
“However, the omission of an unexpected reward produces deactivations in at least some parts of ventral striatum [25,36,37 ,45].”
BackgroundGetting to Know You: Reputation and Trust in a Two-Person Economic Exchange
King-Casas, B., Tomlin, D., Anen, C., Camerer, C. F., Quartz, S. R., & Montague, P. R. (2005) · Science · doi:10.1126/science.1108062 · Cited by 1,345
Self-citationNeural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994
“Honeybees possess octopaminergicfrom Pagnoni et al., 2002 [copyright 2002 by Nature Neuroscience, neurons in their subesophogeal ganglion that are re-www.nature.com/neurosci).”
Self-citationComputational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
“Using passive tasks with a juice reward, reward-prediction errors have been shown to activate structures in the ventral striatu”
MethodSelf-citationTemporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Self-citationLiu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916
“Many studies also implied that the NAcc was responsible for detecting prediction error, a crucial signal in incentive learning and reward association (McClure et al., 2003; O’Doherty et al., 2003b; Pagnoni et al., 2002).”
Cools, R. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.024 · Cited by 903
“The dissociable functions of the dorsal and ventral striatum are upheld by neuroimaging studies in humans (Knutson et al., 2001; McClure et al., 2003; O’Doherty et al., 2003b, 2004; Pagnoni et al., 2002).”
Processing of Social and Monetary Rewards in the Human Striatum
Izuma, K., Saito, D. N., & Sadato, N. (2008) · Neuron · doi:10.1016/j.neuron.2008.03.020 · Cited by 855
“Using functional magnetic resonance imaging (fMRI) and positron emission tomography (PET), similar findings have been reported in humans: the striatum showed increased activation in response not only to primary rewards such as liquid or food (Berns et al., 2001; McClure et al., 2003; Pagnoni et al., 2002) and sexual s…”
BackgroundRelation Between Obesity and Blunted Striatal Response to Food Is Moderated by Taq IA A1 Allele
Stice, E., Spoor, S., Bohon, C., & Small, D. M. (2008) · Science · doi:10.1126/science.1161550 · Cited by 786
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779
Paulus, M. P., Rogalsky, C., Simmons, A., Feinstein, J. S., & Stein, M. B. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00251-9 · Cited by 745
“…anterior cingulate activation during decision making is related to the degree to which the outcome is uncertain (Elliott and Dolan, 1998), whereas the activation in the nucleus accumbens is due to the calculation of an error signal between an expected and received reward (Pagnoni et al., 2002).”
BackgroundReward‐Related Responses in the Human Striatum
DELGADO, M. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.002 · Cited by 736
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 717
“The first fMRI studies to search for prediction errors in humans implicated the nucleus accumbens and the orbitofrontal cortex (Berns et al., 2001; Knutson et al., 2001; Pagnoni et al., 2002), both major dopaminergic targets.”
BackgroundHaber, S. N., Kim, K.-S., Mailly, P., & Calzavara, R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0271-06.2006 · Cited by 686
“Different prefrontal cortical areas and corresponding striatal regions are involved in various aspects of reward evaluation and incentive-based learning (Elliott et al., 2000b, 2003; Schultz et al., 2000; Knutson et al., 2001; Pagnoni et al., 2002) and are associated with pathological risk taking and addictive behavio…”
BackgroundBOLD responses reflecting dopaminergic signals in the human ventral tegmental area
D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008) · Science · doi:10.1126/science.1150605 · Cited by 661
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
“In the case of nucleus accumbens, activity may be related to reward prediction rather than being related to feedback itself (Knutson et al., 2001; Pagnoni et al., 2002).”
BackgroundIntertemporal choice – toward an integrative framework
Berns, G. S., Laibson, D., & Loewenstein, G. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.08.011 · Cited by 580
Self-citationModulation of Caudate Activity by Action Contingency
Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00848-1 · Cited by 574
Neurobiology of Decision Making: A Selective Review from a Neurocognitive and Clinical Perspective
Ernst, M., & Paulus, M. P. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.06.004 · Cited by 469
“Functional neuroimaging experiments have shown that ventral striatum (Pagnoni et al 2002) and orbitofrontal cortex (O'Doherty et al M. Ernst and M.P. Paulus BIOL PSYCHIATRY 2005;xx:xxx 3 www.sobp.org/journal”
BackgroundHyperdopaminergic mutant mice have higher "wanting" but not "liking" for sweet rewards
Peciña, S., Cagniard, B., Berridge, K. C., Aldridge, J. W., & Zhuang, X. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-28-09395.2003 · Cited by 551
“…of dopamine function known so far to be elevated by DAT knockdown mutation (Zhuang et al., 2001), to enhance relevant phasic neuronal computations of prediction (Montague and Berns, 2002; Pagnoni et al., 2002; Schultz, 2002; Suri, 2002; Fiorillo et al., 2003; Shizgal and Arvanitogiannis, 2003).”
Yacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., & Büchel, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2915-06.2006 · Cited by 537
“In humans, these response properties have been observed in the ventral striatum (Pagnoni et al., 2002; McClure et al., 2003; O’Doherty et al., 2003; Ramnani et al., 2004), a region known to receive afferent input from midbrain dopaminergic neurons (Haber et al., 1995).”
BackgroundInfluentialHow prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512
“Note that this message-passing scheme is not necessarily restricted to early sensory cortex (where it has been studied in most detail), but is thought to represent a general coding scheme of cortico-cortical interactions.”
BackgroundMidbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503
Ullsperger, M., & von Cramon, D. Y. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-10-04308.2003 · Cited by 490
“…is consistent with the view that the VTA and SN react with phasic changes of dopamine release to errors in reward prediction (i.e., with dopamine release on unexpected rewards and a decrease in activity on nonoccurring predicted rewards) (Schultz and Dickinson, 2000; Pagnoni et al., 2002).”
BackgroundResultInfluentialThe neural substrates of reward processing in humans: the modern role of FMRI
McClure, S. M., York, M. K., & Montague, P. R. (2004) · The Neuroscientist · doi:10.1177/1073858404263526 · Cited by 480
“…primary rewards such as fruit juice and water (Berns and others 2001; O'Doherty, Rolls, and others 2001; O'Doherty and others 2002; Pagnoni and others 2002; McClure, Berns, and others 2003; O'Doherty, Dayan, and others 2003), appetitive smells (Gottfried and others 2002;…”
BackgroundSelf-citationGottfried, J. A., O'Doherty, J., & Dolan, R. J. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10829.2002 · Cited by 477
“Recent human neuroimaging studies of tastereward anticipation are broadly consistent with this proposal (O’Doherty et al., 2002; Pagnoni et al., 2002).”
ResultInfluentialDifferential Encoding of Losses and Gains in the Human Striatum
Seymour, B., Daw, N., Dayan, P., Singer, T., & Dolan, R. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0400-07.2007 · Cited by 462
“However, in experiments that involve cues that predict rewards exclusively (which can be presented or omitted), or primary punishments exclusively (which can also be presented or omitted), the BOLD signals are apparently oppositely oriented, with positive BOLD excursions accompanying both positive reward and positive…”
BackgroundThe neurobiology of interoception in health and disease
Quadt, L., Critchley, H. D., & Garfinkel, S. N. (2018) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13915 · Cited by 434
Haruno, M., & Kawato, M. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00382.2005 · Cited by 433
“Another functional MRI (fMRI) study reported that activity in the anterior striatum (mainly the caudate nucleus) is correlated with the reward-prediction (TD) error during behavioral learning (O’Doherty et al. 2004).”
BackgroundResultInfluentialHuman Striatal Responses to Monetary Reward Depend On Saliency
Zink, C. F., Pagnoni, G., Martin-Skurski, M. E., Chappelow, J. C., & Berns, G. S. (2004) · Neuron · doi:10.1016/s0896-6273(04)00183-7 · Cited by 434
Self-citationDorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations
DELGADO, M. R., LOCKE, H. M., STENGER, V. A., & FIEZ, J. A. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.1.27 · Cited by 431
“The striatum has also been implicated in reward processing in different types of imaging paradigms (Berns et al., 2001; Breiter et al., 2001; Breiter & Rosen, 1999; Delgado, Nystrom, et al., 2000; Elliott, Friston, & Dolan, 2000; Knutson, Adams et al., 2001; Knutson, Westdorp, Kaiser, & Hommer, 2000; Koepp et al., 199…”
BackgroundMethodInfluentialGenetically Determined Differences in Learning from Errors
Klein, T. A., Neumann, J., Reuter, M., Hennig, J., von Cramon, D. Y., & Ullsperger, M. (2007) · Science · doi:10.1126/science.1145044 · Cited by 426
Beyond stereotypes of adolescent risk taking: Placing the adolescent brain in developmental context
Romer, D., Reyna, V. F., & Satterthwaite, T. D. (2017) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2017.07.007 · Cited by 407
“These regions are heavily involved in recognition and anticipation of reward (Pagnoni et al., 2002; Schultz et al., 1997) and thus suggest a biological basis for increased attraction to novel and exciting experience during”
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Read Montague, P. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 422
Self-citationHaving a word with yourself: neural correlates of self-criticism and self-reassurance.
Longe, O., Maratos, F. A., Gilbert, P., Evans, G., Volker, F., Rockliff, H., & Rippon, G. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.019 · Cited by 403
“Dorsal striatal (caudate and putamen) activity is regularly reported in human imaging studies of both rewards and punishments (Delgado et al., 2000, 2003; Elliott et al., 2004; Knutson et al., 2000, 2001; O'Doherty et al., 2002, 2004; Pagnoni et al., 2002), thus striatal activity in the current task may relate to feel…”
BackgroundSchönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
IMAGING VALUATION MODELS IN HUMAN CHOICE
Montague, P. R., King-Casas, B., & Cohen, J. D. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112903 · Cited by 368
Self-citationPlassmann, H., O'Doherty, J. P., & Rangel, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0788-10.2010 · Cited by 356
“There is much evidence to implicate the phasic activity of dopamine neurons in encoding a prediction error signal during learning with reward stimuli (Schultz, 1998), and moreover human imaging studies report reward-prediction error-related activity in prominent target areas of these neurons in the striatum (Delgado e…”
Neural mechanisms of observational learning
Burke, C. J., Tobler, P. N., Baddeley, M., & Schultz, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1003111107 · Cited by 367
Social and monetary reward learning engage overlapping neural substrates
Lin, A., Adolphs, R., & Rangel, A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr006 · Cited by 351
“The key involvement of the ventral striatum in this third component is borne out by a sizable and rapidly growing body of human fMRI studies of reinforcement learning that have used almost exclusively non-social rewards such as monetary payments (Delgado et al., 2000; Berns et al., 2001; Pagnoni et al., 2002; O’Dohert…”
BackgroundSmall, D. M. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2012.04.011 · Cited by 348
Rao, H., Korczykowski, M., Pluta, J., Hoang, A., & Detre, J. A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.05.046 · Cited by 352
“An unexpected balloon explosion, that is, a loss event following this action might produce a strong prediction error, which has been associated with significant striatal activation (Schultz et al., 1997; Pagnoni et al., 2002; Jensen et al., 2007; Schultz, 2007).”
BackgroundAn fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 346
“In accordance with animal studies, brain imaging studies of the human striatum have observed activity during the processing of both primary and secondary rewards (Aharon et al., 2001; Berns et al., 2001; Breiter et al., 2001; Delgado et al., 2000, 2003; Elliott et al., 2004; Kirsch et al., 2003; Knutson et al., 2000,…”
BackgroundResultMeasuring macroscopic brain connections in vivo
Jbabdi, S., Sotiropoulos, S. N., Haber, S. N., Van Essen, D. C., & Behrens, T. E. (2015) · Nature Neuroscience · doi:10.1038/nn.4134 · Cited by 334
Diekhof, E. K., Kaps, L., Falkai, P., & Gruber, O. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.02.007 · Cited by 331
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328
“Consistent with the findings from these animals models, brain imaging studies in humans have widely reported activation of the striatum during appetitive conditioning tasks with both primary (e.g. O’Doherty et al. 2001; Pagnoni et al. 2002; Gottfried et al. 2003) and secondary (e.”
BackgroundResultScheres, A., Dijkstra, M., Ainslie, E., Balkan, J., Reynolds, B., Sonuga-Barke, E., & Castellanos, F. X. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.10.012 · Cited by 327
Human striatal response to salient nonrewarding stimuli
Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., & Berns, G. S. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-22-08092.2003 · Cited by 312
“Recent neuroimaging studies in humans support these claims (Delgado et al., 2000; Knutson et al., 2000, 2001a,b; Berns et al., 2001, Breiter et al., 2001; Pagnoni et al., 2002; Elliott et al., 2003).”
ResultSelf-citationSubliminal Instrumental Conditioning Demonstrated in the Human Brain
Pessiglione, M., Petrovic, P., Daunizeau, J., Palminteri, S., Dolan, R. J., & Frith, C. D. (2008) · Neuron · doi:10.1016/j.neuron.2008.07.005 · Cited by 308
“The ventral striatum responded to subliminal cues and to visible outcomes in a manner that closely approximates Q-learning algorithm, expressing reward expected values and prediction errors, just as was reported in supraliminal instrumental conditioning studies (O’Doherty et al., 2004; Pagnoni et al., 2002; Pessiglion…”
ResultKonarski, J. Z., McIntyre, R. S., Kennedy, S. H., Rafi‐Tari, S., Soczynska, J. K., & Ketter, T. A. (2008) · Bipolar Disorders · doi:10.1111/j.1399-5618.2008.00435.x · Cited by 299
“In concert with the insula and thalamus, the ventral striatum has been implicated in the identification of displays of disgust (216, 217); taste perception (218); craving (219); timelocked processing of reward prediction (220); anticipation of reward (221); and in romantic love (222).”
BackgroundA unique adolescent response to reward prediction errors
Cohen, J. R., Asarnow, R. F., Sabb, F. W., Bilder, R. M., Bookheimer, S. Y., Knowlton, B. J., & Poldrack, R. A. (2010) · Nature Neuroscience · doi:10.1038/nn.2558 · Cited by 285
Lecourtier, L., & Kelly, P. H. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.01.004 · Cited by 283
Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways
Rilling, J. K., Sanfey, A. G., Aronson, J. A., Nystrom, L. E., & Cohen, J. D. (2004) · NeuroReport · doi:10.1097/00001756-200411150-00022 · Cited by 281
“This prediction is supported by two sources of evidence: (1) positive and negative BOLD responses following positive and negative errors in reward predictions have also been observed for the delivery of juice and monetary rewards [5,9,21,22] (but see [10] for an exception), and (2) dopamine agonists have been shown to…”
ResultStriatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277
“Anticipation of reward has been shown to be associated with striatal activity in both active and passive tasks (Aron et al., 2004; Berns et al., 2001; Delgado, 2007; Knutson et al., 2000; Pagnoni et al., 2002; Samejima et al., 2005; Tanaka et al., 2004; Yacubian et al., 2007), a response that is correlated with predic…”
Backgroundvan den Bos, W., Cohen, M. X., Kahnt, T., & Crone, E. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr198 · Cited by 276
“Neurocognitive Development of Feedback Processing prediction errors (Knutson et al., 2000; Pagnoni et al., 2002; e.g. McClure et al., 2003; O'Doherty et al., 2003; McClure et al., 2004).”
BackgroundResultGilman, J. M., Ramchandani, V. A., Davis, M. B., Bjork, J. M., & Hommer, D. W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.0086-08.2008 · Cited by 267
“A variety of primary rewards activate this circuit, including fruit juice and water (Berns et al., 2001; O’Doherty et al., 2002; Pagnoni et al., 2002; McClure et al., 2003), as well as secondary rewards such as praise and money (for review, see Knutson and Cooper, 2005).”
BackgroundThe Cognitive Neuroscience of Human Decision Making: A Review and Conceptual Framework
Fellows, L. K. (2004) · Behavioral and Cognitive Neuroscience Reviews · doi:10.1177/1534582304273251 · Cited by 265
Human Midbrain Sensitivity to Cognitive Feedback and Uncertainty During Classification Learning
Aron, A. R., Shohamy, D., Clark, J., Myers, C., Gluck, M. A., & Poldrack, R. A. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01209.2003 · Cited by 269
“…reward processing (Berns et al. 2001; Delgado et al. 2000; Hollerman et al. 2000; Knutson et al. 2001a,b; McClure et al. 2003; O'Doherty et al. 2003; Pagnoni et al. 2002)—should be conceptualized more generally in terms of informationally salient events rather than specifically in terms of "…”
BackgroundResultInfluentialClarke, H. F., Robbins, T. W., & Roberts, A. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1521-08.2008 · Cited by 263
“, reward loss, is consistent with a role for this region in reward prediction error signaling (Pagnoni et al., 2002; Seymour et al., 2007).”
ResultNeural signature of fictive learning signals in a sequential investment task
Lohrenz, T., McCabe, K., Camerer, C. F., & Montague, P. R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0608842104 · Cited by 265
Self-citationValence and salience contribute to nucleus accumbens activation
Cooper, J. C., & Knutson, B. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.009 · Cited by 256
“Existing studies have yielded conflicting evidence as to whether all salient outcomes increase NAcc activation (e.g., O'Doherty et al., 2003; Pagnoni et al., 2002).”
ResultLow-Serotonin Levels Increase Delayed Reward Discounting in Humans
Schweighofer, N., Bertin, M., Shishida, K., Okamoto, Y., Tanaka, S. C., Yamawaki, S., & Doya, K. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4982-07.2008 · Cited by 260
“Reinforcement learning models offer a biologically plausible framework to model human delayed reward choices (Pagnoni et al., 2002; O’Doherty et al., 2004; Tanaka et al., 2004, 2007).”
BackgroundWittmann, M., Leland, D. S., & Paulus, M. P. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0822-y · Cited by 255
“In a control task the juice was substituted by a neutral visual stimulus and the anticipation of this event did not activate the ventral striatum (Pagnoni et al. 2002).”
MethodMotivation-dependent responses in the human caudate nucleus.
Delgado, M. R. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh062 · Cited by 246
“…of rewards (Delgado et al., 2000; Breiter et al., 2001; Delgado et al., 2003), conditioned stimuli that predict a reward (Berns et al., 2001; Pagnoni et al., 2002; McClure et al., 2003; O’Doherty et al., 2003) and even during the anticipation of primary (O’Doherty et al., 2002) and…”
BackgroundZald, D. H., Cowan, R. L., Riccardi, P., Baldwin, R. M., Ansari, M. S., Li, R., Shelby, E. S., Smith, C. E., McHugo, M., & Kessler, R. M. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2423-08.2008 · Cited by 234
“This resolution allows visualization of [ 18F]fallypride BPND in the substantia nigra (SN)/ ventral tegmental area (VTA) [see Kessler et al. (1984), for a discussion of the spatial resolution requirements for detecting activity in the SN].”
BackgroundMethodTakakusaki, K., Chiba, R., Nozu, T., & Okumura, T. (2016) · Journal of Neural Transmission · doi:10.1007/s00702-015-1475-4 · Cited by 236
“The nucleus accumbens receives dopaminergic inputs from the ventral tegmental area and conveys reward-related motivational signals in rodents (Nicola et al. 2004), monkeys (Schultz 2013), and humans (Knutson et al. 2003; Pagnoni et al. 2002).”
BackgroundLiu, X., Powell, D. K., Wang, H., Gold, B. T., Corbly, C. R., & Joseph, J. E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5227-06.2007 · Cited by 241
“The striatum (Pagnoni et al., 2002; McClure et al., 2003) and OFC (O’Doherty et al.”
Rømer Thomsen, K., Whybrow, P. C., & Kringelbach, M. L. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00049 · Cited by 229
Jarbo, K., & Verstynen, T. D. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2636-14.2015 · Cited by 222
Mitchell, D. G. V. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.10.030 · Cited by 213
Levkovitz, Y., Harel, E. V., Roth, Y., Braw, Y., Most, D., Katz, L. N., Sheer, A., Gersner, R., & Zangen, A. (2009) · Brain Stimulation · doi:10.1016/j.brs.2009.08.002 · Cited by 217
“, NAc) are indeed related to reward, the connections of DLPFC to the dorsal caudate are mainly related to cognitive functions.(22) On the basis of the phantom brain measurements, the distribution of the electric field induced by the high intensity may very well reach the VLPFC, thus affecting reward pathways directly.”
BackgroundA universal role of the ventral striatum in reward-based learning: Evidence from human studies
Daniel, R., & Pollmann, S. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.002 · Cited by 208
Predictability modulates the affective and sensory-discriminative neural processing of pain
Carlsson, K., Andersson, J., Petrovic, P., Petersson, K. M., Öhman, A., & Ingvar, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.05.027 · Cited by 208
“A change in sequencing, that is, a violation of expectation, has previously been related to activity in the ventral striatum (Berns et al., 1997; Pagnoni et al., 2002; Schultz, 2002; Seymour et al., 2004; Forkstam and Petersson, 2005).”
BackgroundThe role of the basal ganglia in learning and memory: Insight from Parkinson’s disease
Foerde, K., & Shohamy, D. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.08.006 · Cited by 208
Functional Dissociations of Risk and Reward Processing in the Medial Prefrontal Cortex
Xue, G., Lu, Z., Levin, I. P., Weller, J. A., Li, X., & Bechara, A. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn147 · Cited by 207
Wörgötter, F., & Porr, B. (2005) · Neural Computation · doi:10.1162/0899766053011555 · Cited by 203
McClernon, F. J., Kozink, R. V., & Rose, J. E. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301618 · Cited by 202
Multidisciplinary perspectives on attention and the development of self-regulation
Berger, A., Kofman, O., Livneh, U., & Henik, A. (2007) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2007.06.004 · Cited by 199
“Reward discounting was also affected by neurotoxin lesions in the nucleus accumbens, a structure critical for evaluation of reward in human and other species (Pagnoni et al., 2002; Schultz, 2004).”
BackgroundComputational substrates of norms and their violations during social exchange
Xiang, T., Lohrenz, T., & Montague, P. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1642-12.2013 · Cited by 197
Self-citationA preferential increase in the extrastriate response to signals of danger
Surguladze, S. A., Brammer, M. J., Young, A. W., Andrew, C., Travis, M. J., Williams, S. C. R., & Phillips, M. L. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00085-5 · Cited by 198
“ventral putamen during time-locked processing of reward prediction (Pagnoni et al., 2002), or amphetamine-induced euphoria (Drevets et al.”
BackgroundPerformance Feedback Drives Caudate Activation in a Phonological Learning Task
Tricomi, E., Delgado, M. R., McCandliss, B. D., McClelland, J. L., & Fiez, J. A. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.6.1029 · Cited by 199
“For example, much research has implicated the ventral striatum in processing reward-related information (e.g., Pagnoni, Zink, Montague, & Berns, 2002; Berns et al., 2001; Knutson, Adams, Fong, & Hommer, 2001).”
BackgroundSaccade Reward Signals in Posterior Cingulate Cortex
McCoy, A. N., Crowley, J. C., Haghighian, G., Dean, H. L., & Platt, M. L. (2003) · Neuron · doi:10.1016/s0896-6273(03)00719-0 · Cited by 195
May, J. C., Delgado, M. R., Dahl, R. E., Stenger, V. A., Ryan, N. D., Fiez, J. A., & Carter, C. S. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2003.11.008 · Cited by 192
“Neuromodulatory mechanisms, such as enhanced dopamine release in the ventral striatum, have been found with respect to rewarding events (Koepp et al 1998) and might serve to alter associative learning signals within the basal ganglia (Robbins et al 1989).”
BackgroundReinforcement learning, conditioning, and the brain: Successes and challenges
Maia, T. V. (2009) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.9.4.343 · Cited by 187
Andrews, M. M., Meda, S. A., Thomas, A. D., Potenza, M. N., Krystal, J. H., Worhunsky, P., Stevens, M. C., O'Malley, S., Book, G. A., Reynolds, B., et al. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.09.049 · Cited by 181
Neural Correlates of Forward Planning in a Spatial Decision Task in Humans
Simon, D. A., & Daw, N. D. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4647-10.2011 · Cited by 177
“Much evidence links such learning to spiking and blood oxygen level-dependent (BOLD) signals in the nigrostriatal dopamine system (Houk et al., 1994; Schultz et al., 1997; Berns et al., 2001; O’Doherty et al., 2002; Pagnoni et al., 2002).”
BackgroundNeural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180
Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180
“The results revealed activation overlap in temporoparietal areas but little”
The biology of depression in cancer and the relationship between depression and cancer progression
Sotelo, J. L., Musselman, D., & Nemeroff, C. (2014) · International Review of Psychiatry · doi:10.3109/09540261.2013.875891 · Cited by 179
“Functional MRI and PET neuroimaging studies in patients treated with IFN- α have revealed reduced basal ganglia activity compared with control subjects (Juengling et al., 2000; Pagnoni et al., 2002).”
BackgroundMetabolic hormones, dopamine circuits, and feeding
Narayanan, N. S., Guarnieri, D. J., & DiLeone, R. J. (2010) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2009.10.004 · Cited by 174
Skvortsova, V., Palminteri, S., & Pessiglione, M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.1350-14.2014 · Cited by 177
“Neural signals of expected reward values and prediction errors were repeatedly found in the ventral corticostriatal circuit (O’Doherty et al., 2001; Pagnoni et al., 2002; Galvan et al., 2005; Hare et al., 2008; Rutledge et al., 2010), primarily in the ventromedial prefrontal cortex (vmPFC) and…”
BackgroundNeuroanatomic Correlates of Psychopathologic Components of Major Depressive Disorder
Milak, M. S., Parsey, R. V., Keilp, J., Oquendo, M. A., Malone, K. M., & Mann, J. J. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.4.397 · Cited by 178
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Metadata
- Authors
- Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S.
- Affiliations
- Emory University (US)
- Baylor College of Medicine (US)
- Corresponding author
- Pagnoni, Giuseppe
- Venue
- Nature Neuroscience
- Published
- 2002-01-22
- Volume
- 5
- Issue
- 2
- Pages
- 97-98
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2002352860
- Cited by
- 451
- References
- 12
- Citations by year
- 2026: 9 · 2025: 10 · 2024: 13 · 2023: 9 · 2022: 7 · 2021: 17 · 2020: 16 · 2019: 15 · 2018: 17 · 2017: 11 · 2016: 17 · 2015: 22 · 2014: 23 · 2013: 24 · 2012: 29
- FWCI
- 10.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh061010-02)
- National Institute of Mental Health (MH61010)
- National Institute on Drug Abuse (K08DA000367, DA-00367, DA 11723, R01DA011723)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- ventral striatum, reward prediction error, mesolimbic dopamine system, operant conditioning, reward processing, human brain imaging
- MeSH terms
- Adult, Algorithms, Conditioning, Operant, Corpus Striatum, Forecasting, Humans, Magnetic Resonance Imaging, Random Allocation, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.