Activity in human ventral striatum locked to errors of reward prediction
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The mesolimbic dopaminergic system has long been known to be involved in the processing of rewarding stimuli, although recent evidence from animal research has suggested a more specific role of signaling errors in the prediction of rewards. We tested this hypothesis in humans, using functional magnetic resonance imaging (fMRI) and an operant conditioning paradigm for the discrete delivery of small quantities of fruit juice, along with a control experiment in which juice was substituted with a neutral visual stimulus. A local estimation of the activity in the ventral striatum showed a significant differentiation when the juice was withheld at the expected time of delivery; this finding was not replicated in the case of visual stimulation, providing evidence for time-locked processing of reward prediction errors in human ventral striatum.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The nucleus accumbens has notably been associated with coding prediction error in healthy controls (Abler et al. 2006; O’doherty et al. 2004; Pagnoni et al. 2002; Rodriguez et al. 2006).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pagnoni et al. 2002
Citations
Cites
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationIkemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
The dopamine hypothesis of reward: past and current status
Spanagel, R., & Weiss, F. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(99)01447-2 · Cited by 973
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Duvernoy, H. M. (1999) · Springer eBooks · doi:10.1007/978-3-7091-6792-2 · Cited by 756
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740
Parametric Analysis of fMRI Data Using Linear Systems Methods
Cohen, M. S. (1997) · NeuroImage · doi:10.1006/nimg.1997.0278 · Cited by 714
Research works printed but not linked: 1
- Ward, B. D. in AFNI 3dDeconvolve Documentation (Medical College of Wisconsin, 2001).
Cited by
Items 201–300 of 446
Reward-Predictive Neural Activities in Striatal Striosome Compartments
Yoshizawa, T., Ito, M., & Doya, K. (2018) · eNeuro · doi:10.1523/eneuro.0367-17.2018 · Cited by 56
“From these observations, the striatum has been hypothesized as the brain region that predicts future rewards as state or action values (Kawagoe et al., 1998; Shidara et al., 1998; Pagnoni et al., 2002; O’Doherty et al., 2004).”
BackgroundImpairment of probabilistic reward-based learning in schizophrenia.
Weiler, J. A., Bellebaum, C., Brüne, M., Juckel, G., & Daum, I. (2009) · Neuropsychology · doi:10.1037/a0016166 · Cited by 52
Integrating Incremental Learning and Episodic Memory Models of the Hippocampal Region.
Meeter, M., Myers, C. E., & Gluck, M. A. (2005) · Psychological Review · doi:10.1037/0033-295x.112.3.560 · Cited by 53
“Operant conditioning, thought to rely at least partly on the basal ganglia (Lauwereyns et al., 2002; Pagnoni et al., 2002; Peoples et al., 1997), may thus be governed by the same rules as classical conditioning.”
BackgroundA reward prediction error for charitable donations reveals outcome orientation of donators
Kuss, K., Falk, A., Trautner, P., Elger, C. E., Weber, B., & Fliessbach, K. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr088 · Cited by 51
Distinct Medial Temporal Lobe Network States as Neural Contexts for Motivated Memory Formation
Murty, V. P., & Adcock, R. A. (2017) · Springer eBooks · doi:10.1007/978-3-319-50406-3_15 · Cited by 62
“In addition to reward-motivated behaviors, both the VTA and its targets in the striatum have been associated with motivated learning in Pavlovian and instrumental conditioning paradigms (D’Ardenne et al. 2008; Murray et al. 2008; McClure et al. 2003; Pagnoni et al. 2002).”
Dopaminergic Modulation of Appetitive and Aversive Predictive Learning
Iordanova, M. D. (2009) · Reviews in the Neurosciences · doi:10.1515/revneuro.2009.20.5-6.383 · Cited by 55
Prediction of Immediate and Future Rewards Differentially Recruits Cortico-Basal Ganglia Loops
Tanaka, S., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2016) · Springer eBooks · doi:10.1007/978-4-431-55402-8_22 · Cited by 59
Striatal and Medial Temporal Lobe Functional Interactions during Visuomotor Associative Learning
Mattfeld, A. T., & Stark, C. E. L. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq144 · Cited by 54
“This interpretation is in line with previous fMRI studies that have identified correlations between reward prediction error and fMRI activity in the dorsal and ventral striatum (Pagnoni et al. 2002; McClure Figure 5.”
ResultPaulus, M. P., Feinstein, J. S., Tapert, S. F., & Liu, T. T. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.060 · Cited by 52
“Keywords: Temporal difference model; Inferior prefrontal cortex; Functional magnetic resonance imaging”
BackgroundWorking-memory load and temporal myopia in dynamic decision making.
Worthy, D. A., Otto, A. R., & Maddox, W. T. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0028146 · Cited by 62
Differential cingulate and caudate activation following unexpected nonrewarding stimuli
Davidson, M. C., Horvitz, J. C., Tottenham, N., Fossella, J., Watts, R., Uluğ, A. M., & Casey, B. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.049 · Cited by 57
“The influence of prediction and expectation of reward has been explored in imaging studies with humans as well (Berns et al., 2001; Knutson et al., 2001a; McClure et al., 2003; Pagnoni et al., 2002; Pappata et al., 2002).”
Adaptive coding of reward prediction errors is gated by striatal coupling
Park, S. Q., Kahnt, T., Talmi, D., Rieskamp, J., Dolan, R. J., & Heekeren, H. R. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119969109 · Cited by 50
Ludwig, V. U., Nüsser, C., Goschke, T., Wittfoth, D., Wiers, C. E., Erk, S., Schott, B. H., & Walter, H. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00280 · Cited by 52
“…the EV of the rewards was reduced during the anticipation phase, while reward delivery during the outcome phase was likely to elicit a positive prediction error Frontiers in Behavioral Neuroscience | www.frontiersin.org 10 October 2015 | Volume 9 | Article 280 (e.g., Pagnoni et al., 2002).”
BackgroundAssociability-modulated loss learning is increased in posttraumatic stress disorder
Brown, V. M., Zhu, L., Wang, J. M., Frueh, B. C., King‐Casas, B., & Chiu, P. H. (2018) · eLife · doi:10.7554/elife.30150 · Cited by 51
“…humans and rodents has identified roles for the ventral striatum, anterior cingulate, and amygdala in encoding prediction error (Rangel et al., 2008; Pagnoni et al., 2002; Garrison et al., 2013) and for the amygdala and insula in encoding associability values (Li et al., 2011; Roesch et al., 2012).”
Reinforcing value and hypothetical behavioral economic demand for food and their relation to BMI
Epstein, L. H., Paluch, R. A., Carr, K. A., Temple, J. L., Bickel, W. K., & MacKillop, J. M. (2018) · Eating Behaviors · doi:10.1016/j.eatbeh.2018.03.008 · Cited by 50
Reward processing as a common diathesis for chronic pain and depression
Rizvi, S. J., Gandhi, W., & Salomons, T. V. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.04.033 · Cited by 55
Predictive processing models and affective neuroscience
Lee, K. M., Ferreira‐Santos, F., & Satpute, A. B. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.09.009 · Cited by 58
Bellebaum, C., Jokisch, D., Gizewski, E. R., Forsting, M., & Daum, I. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.10.042 · Cited by 49
Reward feedback processing in children and adolescents: medial frontal theta oscillations
Crowley, M. J., van Noordt, S. J. R., Wu, J., Hommer, R. E., South, M., Fearon, R. M. P., & Mayes, L. C. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2013.11.011 · Cited by 45
The Neural Basis of Frustration State
Yu, R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-800935-2.00011-7 · Cited by 47
Löffler, M., Levine, S. M., Usai, K., Desch, S., Mišić, M., Nees, F., & Flor, H. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100677 · Cited by 58
Age differences in default and reward networks during processing of personally relevant information
Grady, C. L., Grigg, O., & Ng, C. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.03.024 · Cited by 51
BOLD responses in reward regions to hypothetical and imaginary monetary rewards
Miyapuram, K. P., Tobler, P. N., Gregorios-Pippas, L., & Schultz, W. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.029 · Cited by 42
“, 2001; Peters and Büchel, 2009, 2010) and in reward prediction error (Hare et al., 2008; McClure et al., 2003; Pagnoni et al., 2002; Tobler et al., 2006).”
Oettl, L., Scheller, M. F., Filosa, C., Wieland, S., Haag, F., Loeb, C., Durstewitz, D., Shusterman, R., Russo, E., & Kelsch, W. (2020) · Nature Communications · doi:10.1038/s41467-020-17257-7 · Cited by 50
Ferdinand, N. K., & Opitz, B. (2014) · Scientific Reports · doi:10.1038/srep05986 · Cited by 43
Approach–withdrawal and the role of the striatum in the temperament of behavioral inhibition.
Helfinstein, S. M., Fox, N. A., & Pine, D. S. (2011) · Developmental Psychology · doi:10.1037/a0026402 · Cited by 51
Chakravarthy, V. S., Balasubramani, P. P., Mandali, A., Jahanshahi, M., & Moustafa, A. A. (2018) · Physiology & Behavior · doi:10.1016/j.physbeh.2018.06.032 · Cited by 47
The Neuroscience Behind the Stock Market's Reaction to Corporate Earnings News
Barton, J., Berns, G. S., & Brooks, A. M. (2014) · The Accounting Review · doi:10.2308/accr-50841 · Cited by 56
“6 fMRI studies have found the reward system to react to a variety of stimuli: fruit juice and water (Berns et al. 2001; Pagnoni et al. 2002; McClure et al. 2003; O’Doherty et al. 2003), appetitive smells (Anderson et al. 2003), sex (Arnow et al. 2002; Komisaruk and Whipple 2005), money (Delgado,…”
Self-citationvan Holst, R. J., Chase, H. W., & Clark, L. (2014) · NeuroImage Clinical · doi:10.1016/j.nicl.2014.06.008 · Cited by 52
“Contents lists available at ScienceDirect NeuroImage: Clinical j ourna l homepage: www.e lsev ie r .com/ locate /yn ic l Striatal connectivity changes following gambling wins and near-misses: Associations with gambling severity Ruth J. van Holst a,b,*, Henry W. Chase c, Luke Clark a,d a Department of Psychology, Unive…”
Neural predictive error signal correlates with depressive illness severity in a game paradigm
Steele, J. D., Meyer, M. E., & Ebmeier, K. P. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.04.023 · Cited by 47
The Accumbofrontal Fasciculus in the Human Brain: A Microsurgical Anatomical Study
Rigoard, P., Buffenoir, K., Jaafari, N., Giot, J., Houeto, J. L., Mertens, P., Velut, S., & Bataille, B. (2011) · Neurosurgery · doi:10.1227/neu.0b013e3182098e48 · Cited by 45
“Animal and human studies emphasize the essential role of the striatum in processing reward-related information.(25,46,47) The ventral striatal loop, or limbic loop, involves different structures.”
BackgroundKoch, K., Schachtzabel, C., Wagner, G., Reichenbach, J. R., Sauer, H., & Schlösser, R. (2008) · Learning & Memory · doi:10.1101/lm.1106408 · Cited by 42
“Activation in orbital/medial frontal and MDS regions has been found to be inversely related to the likelihood to receive positive feedback or reward (Pagnoni et al. 2002; McClure et al. 2003).”
BackgroundAltered functioning of reward circuitry in youth offspring of parents with bipolar disorder
Manelis, A., Ladouceur, C. D., Graur, S., Monk, K., Bonar, L. K., Hickey, M. B., Dwojak, A., Axelson, D., Goldstein, B., Goldstein, T. R., et al. (2015) · Psychological Medicine · doi:10.1017/s003329171500166x · Cited by 43
“…of regions in reward circuitry was determined from previous neuroimaging findings (Schultz et al. 2000; Knutson et al. 2001; Baxter & Murray, 2002; Pagnoni et al. 2002; O’Doherty, 2004; Tanaka et al. 2004; Yoshida & Ishii, 2006; Walton et al. 2006, 2011; Burgess et al. 2007; Koechlin & Hyafil,…”
BackgroundMethodInfluentialSingle-Neuron Responses in the Human Nucleus Accumbens during a Financial Decision-Making Task
Patel, S. R., Sheth, S. A., Mian, M. K., Gale, J. T., Greenberg, B. D., Dougherty, D. D., & Eskandar, E. N. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0027-12.2012 · Cited by 47
Imaging Models of Valuation During Social Interaction in Humans
Kishida, K. T., & Montague, P. R. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.037 · Cited by 40
Self-citationNavigating complex decision spaces: Problems and paradigms in sequential choice.
Walsh, M. M., & Anderson, J. R. (2014) · Psychological Bulletin · doi:10.1037/a0033455 · Cited by 38
“…show that prediction errors modulate activity throughout the striatum, a region densely innervated by dopamine neurons (Berns et al., 2001; Delgado et al., 2003; McClure, Berns, & Montague, 2003; O’Doherty et al., 2004; O’Doherty, Hampton, & Kim, 2007; Pagnoni et al., 2002; Rutledge et al., 2010).”
BackgroundAbnormal prediction error is associated with negative and depressive symptoms in schizophrenia
Moran, P. M., Owen, L. H., Crookes, A. E., Al-Uzri, M. M., & Reveley, M. A. (2007) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2007.07.021 · Cited by 43
Quick and Smart? Modularity and the Pro-Emotion Consensus
Jones, K. (2006) · Canadian Journal of Philosophy Supplementary Volume · doi:10.1353/cjp.2007.0031 · Cited by 60
Personality disorders as disorganisation of attachment and affect regulation
Sarkar, J., & Adshead, G. M. J. (2006) · Advances in Psychiatric Treatment · doi:10.1192/apt.12.4.297 · Cited by 49
“The ventral striatum appears to be involved in craving (Breiter et al , 1997), anticipation of reward (Pagnoni et al , 2002) and romantic love (Bartels & Zeki, 2000).”
BackgroundParazzini, M., Fiocchi, S., Chiaramello, E., Roth, Y., Zangen, A., & Ravazzani, P. (2017) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2017.02.003 · Cited by 42
Pérez-Rodríguez, M. M., Hazlett, E. A., Rich, E. L., Ripoll, L. H., Weiner, D. M., Spence, N. Z., Goodman, M. S., Koenigsberg, H. W., Siever, L. J., & New, A. S. (2012) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2012.02.014 · Cited by 42
“The striatum is activated in affective learning based on primary (Gottfried et al., 2003; O’Doherty et al., 2001; Pagnoni et al., 2002) and secondary (Delgado et al.”
BackgroundPREFRONTAL BRAIN ACTIVITY PREDICTS TEMPORALLY EXTENDED DECISION-MAKING BEHAVIOR
Yarkoni, T., Braver, T. S., Gray, J. R., & Green, L. (2005) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2005.121-04 · Cited by 43
“Recent research indicates, for example, that dissociable neural mechanisms are involved in the experience versus the anticipation of reward ( Pagnoni, Zink, Montague, & Berns, 2002 ); that the scale of a neural response tends to corresond to the magnitude of a gain or loss (Elliott, Newman, Longe, & Deakin, 2003); tha…”
Network neuroscience of apathy in cerebrovascular disease
Tay, J., Lisiecka, D. M., Hollocks, M. J., Tuladhar, A. M., Barrick, T. R., Förster, A., O'Sullivan, M. J., Husain, M., de Leeuw, F., Morris, R. G., et al. (2020) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101785 · Cited by 43
“Dopaminergic neurons within VS provide a key substrate for reward prediction error signals (Pagnoni et al., 2002), which in turn are used by ACC to update internal models of the environment and task (Kolling et al.”
BackgroundA translational perspective on the anti-anhedonic effect of ketamine and its neural underpinnings
Pulcu, E., Guinea, C., Cowen, P. J., Murphy, S. E., & Harmer, C. J. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01183-1 · Cited by 35
Sankar, A., Yttredahl, A. A., Fourcade, E. W., Mickey, B. J., Love, T., Langenecker, S. A., & Hsu, D. T. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00149 · Cited by 38
Altered cingulo-striatal function underlies reward drive deficits in schizophrenia
Park, I. H., Chun, J. W., Park, H.-J., Koo, M.-S., Park, S., Kim, S.-H., & Kim, J.-J. (2015) · Schizophrenia Research · doi:10.1016/j.schres.2014.11.005 · Cited by 34
“…to the ventral striatum and dorsal striatum that are involved in reward prediction and in modulation of stimulus–response association, respectively (Pagnoni et al., 2002; O'Doherty et al., 2004; Tricomi et al., 2004).Midbrain dopaminergicfiring occurswhen risky decisions are made with highly…”
BackgroundNeurobiology of decision-making in adolescents
Shad, M. U., Bidesi, A. S., Chen, L.-A., Thomas, B. P., Ernst, M., & Rao, U. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.09.033 · Cited by 37
Orquestic regulation of neurotransmitters on reward-seeking behavior
Arias-Carrión, Ó., Caraza-Santiago, X., Salgado-Licona, S., Salama, M., Machado, S. E. D. C., Nardi, A. E., Menéndez‐González, M., & Murillo‐Rodríguez, E. (2014) · International Archives of Medicine · doi:10.1186/1755-7682-7-29 · Cited by 40
“Different possibilities must be valued and chosen through direct comparison [2].”
BackgroundKobza, S., Ferrea, S., Schnitzler, A., Pollok, B., Südmeyer, M., & Bellebaum, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0050250 · Cited by 35
Chronic stress modulates neural and cardiovascular responses during reversal learning
Ohira, H., Matsunaga, M., Kimura, K., Murakami, H., Osumi, T., Isowa, T., Fukuyama, S., Shinoda, J., & Yamada, J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.07.014 · Cited by 33
“Striatal regions, such as the nucleus accumbens, caudate, and putamen, are major targets of midbrain dopamine neurons, and strongly correlate with prediction errors (Pagnoni et al., 2002; Pessiglione et al., 2006, 2008; Pennartz et al., 2009).”
BackgroundArachidonic acid as a retrograde signal controlling growth and dynamics of retinotectal arbors
Leu, B., & Schmidt, J. T. (2007) · Developmental Neurobiology · doi:10.1002/dneu.20561 · Cited by 32
Pessiglione, M., Guehl, D., Jan, C., François, C., Hirsch, É. C., Féger, J., & Tremblay, L. (2004) · European Journal of Neuroscience · doi:10.1111/j.0953-816x.2003.03089.x · Cited by 40
Humans Integrate Monetary and Liquid Incentives to Motivate Cognitive Task Performance
Yee, D. M., Krug, M. K., Allen, A. Z., & Braver, T. S. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.02037 · Cited by 37
“actions (Delgado et al., 2000; Delgado et al., 2008; Hare et al., 2008; Lak et al., 2014; Pagnoni et al., 2002).”
Sleezer, B. J., & Hayden, B. Y. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01011 · Cited by 32
Cognitive and limbic circuits that are affected by deep brain stimulation
Suzanne, N. H. (2009) · Frontiers in bioscience · doi:10.2741/3344 · Cited by 33
“are involved in various aspects of reward evaluation and incentive-based learning (59-63), and are associated with sadness and depression, pathological risk-taking, addictive”
BackgroundStudents' expectations and social media sharing in adopting augmented reality
Alamäki, A. V., Dirin, A., & Suomala, J. (2021) · International Journal of Information and Learning Technology · doi:10.1108/ijilt-05-2020-0072 · Cited by 39
The acute effects of nicotine on corticostriatal responses to distinct phases of reward processing
Wang, K. S., Zegel, M., Molokotos, E. K., Moran, L. V., Olson, D. P., Pizzagalli, D. A., & Janes, A. C. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0611-5 · Cited by 30
Nielsen, A. N., Wakschlag, L. S., & Norton, E. S. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.07.022 · Cited by 30
Multiple brain networks contribute to the acquisition of bias in perceptual decision-making
Chen, M.-Y., Jimura, K., White, C. N., Maddox, W. T., & Poldrack, R. A. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00063 · Cited by 32
“…use reward feedback to adjust the subjective value of each possible action, the signal pertaining to the difference between the expected and actual reward (reward prediction error, RPE) is represented in ventral striatum, a major target of midbrain dopaminergic neurons (Pagnoni et al., 2002).”
BackgroundKahn, L. E., Peake, S. J., Dishion, T. J., Stormshak, E. A., & Pfeifer, J. H. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00694 · Cited by 29
Dir, A. L., Hummer, T. A., Aalsma, M. C., & Hulvershorn, L. A. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2019.100634 · Cited by 35
“The ventral striatum has been associated with the outcome phase of decision-making and is important in reward processing and forming preferences (Galvan et al., 2006; Ernst et al., 2005; Pagnoni et al., 2002).”
Anatomy and connectivity of the reward circuit
Haber, S. N. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00001-7 · Cited by 33
Brain–computer interfaces increase whole-brain signal to noise
Papageorgiou, T. D., Lisinski, J. M., McHenry, M. A., White, J. P., & LaConte, S. M. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1210738110 · Cited by 30
“Examples include multitasking for dual task performance (2 – 5), con fl ict and outcome monitoring (6, 7), attention (8), reward monitoring (9, 10), and learning and conditioning (11, 12).”
BackgroundDunne, S., D’Souza, A., & O’Doherty, J. P. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00046.2016 · Cited by 28
“A substantial number of studies have reported reward prediction error encoding in ventral striatum (O'Doherty et al. 2004; Pagnoni et al. 2002; Pessiglione et al. 2006).”
Three studies on the neuroeconomics of decision-making when payoffs are real and negative
Berns, G. S., Capra, C. M., Moore, S. E., & NOUSSAIR, C. N. (2008) · Advances in health economics and health services research · doi:10.1016/s0731-2199(08)20001-4 · Cited by 25
Self-citationReversal learning strategy in adolescence is associated with prefrontal cortex activation
Boehme, R., Lorenz, R. C., Gleich, T., Romund, L., Pelz, P., Golde, S., Flemming, E., Wold, A., Deserno, L., Behr, J., et al. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13401 · Cited by 30
“…adults, PE signals are associated with dopaminergic transmission (Pessiglione et al., 2006) and encoded in areas innervated by dopaminergic neurons (Pagnoni et al., 2002; O’Doherty et al., 2004; D’Ardenne et al., 2008), like the striatum – but also in a widespread network including prefrontal and…”
BackgroundNeuroimaging in the Kleine-Levin Syndrome
Engström, M., Latini, F., & Landtblom, A. (2018) · Current Neurology and Neuroscience Reports · doi:10.1007/s11910-018-0866-y · Cited by 30
Striatal activation to monetary reward is associated with alcohol reward sensitivity
Radoman, M., Crane, N. A., Gorka, S. M., Weafer, J. J., Langenecker, S. A., de Wit, H., & Phan, K. L. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0728-6 · Cited by 29
From the Brain to the Field: The Applications of Social Neuroscience to Economics, Health and Law
Kedia, G., Harris, L. T., Lelieveld, G., & van Dillen, L. F. (2017) · Brain Sciences · doi:10.3390/brainsci7080094 · Cited by 26
Many hats: intratrial and reward level-dependent BOLD activity in the striatum and premotor cortex
Peterson, E. J., & Seger, C. A. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00164.2012 · Cited by 28
Minati, L., Grisoli, M., Franceschetti, S., Epifani, F., Granvillano, A., Medford, N., Harrison, N. A., Piacentini, S. H. M. J., & Critchley, H. (2011) · Brain Topography · doi:10.1007/s10548-011-0210-1 · Cited by 31
“…and reward prediction error signals, which are essential for behavioural reinforcement but not for the comparison among available choice options (Hollerman et al. 1998; Pagnoni et al. 2002; Schultz 2004; Cohen and Ranganath 2005; Rorie and Newsome 2005; Wrase et al. 2007; Tobler et al. 2009).”
BackgroundLa prise de décision : aspects théoriques, neuro-anatomie et évaluation
Allain, P. (2013) · Revue de neuropsychologie · doi:10.3917/rne.052.0069 · Cited by 63
“Au plan cérébral, cette étape impliquerait : – le striatum ventral [37] et le cortex orbitofrontal [38] impliqués dans la détection de la différence entre un fait attendu et un fait observé.”
Short-term mindfulness practice attenuates reward prediction errors signals in the brain
Kirk, U., Pagnoni, G., Hétu, S., & Montague, R. (2019) · Scientific Reports · doi:10.1038/s41598-019-43474-2 · Cited by 23
Self-citationKobza, S., & Bellebaum, C. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.10.036 · Cited by 24
“…also in brain regions receiving projections from midbrain DA neurons (Haber and Fudge, 1997), most prominently the basal ganglia (BG; Delgado, 2007; Pagnoni et al., 2002) and the medial prefrontal cortex (mPFC) (O'Doherty et al., 2001; Rolls et al., 2008), particularly the anterior cingulate…”
Endocannabinoid modulation of dopamine release during reward seeking, interval timing, and avoidance
Everett, T. J., Gomez, D. M., Hamilton, L. R., & Oleson, E. B. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.110031 · Cited by 27
fMRI of the brain’s response to stimuli experimentally paired with alcohol intoxication
Kareken, D. A., Grahame, N. J., Džemidžić, M., Walker, M. J., Lehigh, C. A., & O’Connor, S. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2526-7 · Cited by 23
“Some studies, however, also find increased BOLD responses to omitted reward or negative feedback (e.g., Pagnoni et al. 2002; Rodriguez et al. 2006).”
Dissociation of BOLD responses to reward prediction errors and reward receipt by a model comparison
Rohe, T., Weber, B., & Fliessbach, K. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08125.x · Cited by 22
“RPE is reported to be represented in the same regions (MB: D’Ardenne et al., 2008; VS: Abler et al., 2006; McClure et al., 2003; O’Doherty et al., 2003; Pagnoni et al., 2002; Pessiglione et al., 2006; Yacubian et al., 2006; OFC: O’Doherty et al., 2003).”
Franken, I. H. A., Van den Berg, I., & Van Strien, J. W. (2010) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2009.01139.x · Cited by 22
Goal or Gold: Overlapping Reward Processes in Soccer Players upon Scoring and Winning Money
Häusler, A. N., Becker, B., Bartling, M., & Weber, B. (2015) · PLoS ONE · doi:10.1371/journal.pone.0122798 · Cited by 23
“It is well known for its role in reward prediction error processing [19, 20, 37, 47–49], but this is the first time a sport-related context has been shown to elicit this type of activity.”
BackgroundFrom the Reward Circuit to the Valuation System: How the Brain Motivates Behavior
Pessiglione, M., & Lebreton, M. P. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1236-0_11 · Cited by 26
“digms further demonstrated that the VMPFC and VS were reflecting expected reward at the time of cue and reward prediction error at the time of outcome (Gottfried et al. 2003; Pagnoni et al. 2002).”
BackgroundDommett, E. J., & Rostron, C. L. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.10.025 · Cited by 23
Dopamine, Salience, and Response Set Shifting in Prefrontal Cortex
Shiner, T., Symmonds, M., Guitart‐Masip, M., Fleming, S. M., Friston, K. J., & Dolan, R. J. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu210 · Cited by 28
“(Pagnoni et al. 2002), or negatively valenced events such as loss or punishment on the one hand (Cools et al.”
BackgroundInfluentialRegional brain activations in awake unrestrained dogs
Cook, P. F., Brooks, A. M., Spivak, M., & Berns, G. S. (2015) · Journal of Veterinary Behavior · doi:10.1016/j.jveb.2015.12.003 · Cited by 21
Self-citationIntegration of conflict resolution and positive emotions: Electrophysiological evidence
Pan, F., Ou, Y., Sun, H., & Qian, Y. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107661 · Cited by 21
Schroll, H., Horn, A., Gröschel, C., Brücke, C., Lütjens, G., Schneider, G., Krauss, J. K., Kühn, A. A., & Hamker, F. H. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.07.061 · Cited by 21
“Third, for the striatum, coding of reward expectations and prediction errors has often been shown via fMRI (e.g., Delgado et al., 2005; Pagnoni et al., 2002; Brovelli et al., 2011), a method that primarily reflects inputs to target nuclei just as well (Logothetis et al.”
MethodNeuroeconomics: in search of the neural representation of brands
Schaefer, M. (2009) · Progress in brain research · doi:10.1016/s0079-6123(09)17817-2 · Cited by 24
Multiple model-based reinforcement learning explains dopamine neuronal activity
Bertin, M., Schweighofer, N., & Doya, K. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.028 · Cited by 21
Normal functional imaging of the basal ganglia
Lehéricy, S., & Gérardin, E. (2002) · Epileptic Disorders · doi:10.1684/j.1950-6945.2002.tb00543.x · Cited by 22
Koch, K., Wagner, G., Dahnke, R., Schachtzabel, C., Güllmar, D., Reichenbach, J. R., & Schlösser, R. G. M. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2010.03.026 · Cited by 21
van Noordt, S. J. R., Wu, J., Venkataraman, A., Larson, M. J., South, M., & Crowley, M. J. (2017) · Research in Autism · doi:10.1016/j.rasd.2017.01.011 · Cited by 25
“Activity in the striatum and medial frontal cortex is sensitive to deviations from expected outcomes (Pagnoni et al., 2002; Pasupathy & Miller, 2005) and is linked to the rapid updating of expectations following prediction errors (Silvetti, Nunez Castellar, Roger, & Verguts, 2014).”
Neurocognitive decision-making processes of casual methamphetamine users
Droutman, V., Xue, F., Barkley‐Levenson, E. E., Lam, H. Y., Bechara, A., Smith, B. J., Lu, Z., Xue, G., Miller, L. C., & Read, S. J. (2018) · NeuroImage Clinical · doi:10.1016/j.nicl.2018.101643 · Cited by 19
“, 2003; Baxter and Murray, 2002), reward prediction and error computation (Hare et al., 2008; Knutson et al., 2001; Pagnoni et al., 2002), the current findings may suggest that casual MA users' behavior during the task arises from Fig.”
Error-rate-related caudate and parietal cortex activation during decision making
Verney, S. P., Brown, G. G., Frank, L. R., & Paulus, M. P. (2003) · Neuroreport · doi:10.1097/01.wnr.0000072842.93264.b6 · Cited by 25
Kaplan, J. R., & Manuck, S. B. (1997) · PubMed · Cited by 21
Plaßmann, H., O’Doherty, J. P., & Rangel, A. (2009) · NeuroImage · doi:10.1016/s1053-8119(09)70763-3 · Cited by 19
Individual differences in dopamine D2 receptor availability correlate with reward valuation
Dang, L. C., Samanez-Larkin, G. R., Castrellon, J. J., Perkins, S. F., Cowan, R. L., & Zald, D. H. (2018) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-018-0601-9 · Cited by 18
Berthet, P., Lindahl, M., Tully, P. J., Kotaleski, J. H., & Lansner, A. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2016.00053 · Cited by 20
“…various phases of learning, and the underlying mechanisms were congruent with theoretical and biological data on reinforcement learning, dopaminergic neuron activity and RPE (Schultz et al., 1997; Sutton and Barto, 1998; Pagnoni et al., 2002; Suri, 2002; Samejima et al., 2005; Groman et al., 2011).”
BackgroundNeural insensitivity to upticks in value is associated with the disposition effect
Brooks, A. M., Capra, C. M., & Berns, G. S. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.081 · Cited by 22
“Any uptick in value should therefore result in a positive RPE, and consequently a ventral striatum response, regardless of the total present value of the asset.”
InfluentialSelf-citationIno, T., Nakai, R., Azuma, T., Kimura, T., & Fukuyama, H. (2009) · Cortex · doi:10.1016/j.cortex.2009.02.022 · Cited by 18
“Human neuroimaging studies in recent years also support this proposal (Breiter et al., 2001; Delgado et al., 2000; Elliott et al., 2003; Knutson et al., 2000, 2001; Pagnoni et al., 2002).”
ResultDisentangling motivational and experiential aspects of “utility” – A neuroeconomics perspective
Witt, U., & Binder, M. (2013) · Journal of Economic Psychology · doi:10.1016/j.joep.2013.02.001 · Cited by 16
“…al., 2004), conditioned rewards such as money and positive feedbacks (e.g. Delgado et al., 2000, O’Doherty et al., 2001), but also abstract conditioned rewards such as light flashes (e.g. Pagnoni et al., 2002) and social rewards (e.g. Aharon et al., 2001, Rilling et al., 2002, Rolls et al., 2003).”
BackgroundGu, X., Kirk, U., Lohrenz, T. M., & Montague, P. R. (2013) · Human Brain Mapping · doi:10.1002/hbm.22433 · Cited by 17
“Recent computational models and experimental probes support the notion of multiple learning mechanisms in healthy individuals [Chiu et al., 2008; Daw et al., 2011; Glascher et al., 2010; Lohrenz et al., 2007; Montague et al., 2004, 2006; Pagnoni et al., 2002; Simon and Daw, 2011].”
BackgroundSelf-citation
Metadata
- Authors
- Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S.
- Affiliations
- Emory University (US)
- Baylor College of Medicine (US)
- Corresponding author
- Pagnoni, Giuseppe
- Venue
- Nature Neuroscience
- Published
- 2002-01-22
- Volume
- 5
- Issue
- 2
- Pages
- 97-98
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2002352860
- Cited by
- 451
- References
- 12
- Citations by year
- 2026: 9 · 2025: 10 · 2024: 13 · 2023: 9 · 2022: 7 · 2021: 17 · 2020: 16 · 2019: 15 · 2018: 17 · 2017: 11 · 2016: 17 · 2015: 22 · 2014: 23 · 2013: 24 · 2012: 29
- FWCI
- 10.92
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh061010-02)
- National Institute of Mental Health (MH61010)
- National Institute on Drug Abuse (K08DA000367, DA-00367, DA 11723, R01DA011723)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- ventral striatum, reward prediction error, mesolimbic dopamine system, operant conditioning, reward processing, human brain imaging
- MeSH terms
- Adult, Algorithms, Conditioning, Operant, Corpus Striatum, Forecasting, Humans, Magnetic Resonance Imaging, Random Allocation, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.