Predictive Neural Coding of Reward Preference Involves Dissociable Responses in Human Ventral Midbrain and Ventral Striatum

O'Doherty, John P.; Buchanan, Tony W.; Seymour, Ben; Dolan, Raymond J.

doi:10.1016/j.neuron.2005.11.014

Cited by 322Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesMemory and Neural Mechanisms

Predictive Neural Coding of Reward Preference Involves Dissociable Responses in Human Ventral Midbrain and Ventral Striatum

Open access

O'Doherty, John P., Buchanan, Tony W., Seymour, Ben, Dolan, Raymond J.·2006·Neuron

DOI 10.1016/j.neuron.2005.11.014

Open this paper in CoChat — free account Open PDF

Abstract

Food preferences are acquired through experience and can exert strong influence on choice behavior. In order to choose which food to consume, it is necessary to maintain a predictive representation of the subjective value of the associated food stimulus. Here, we explore the neural mechanisms by which such predictive representations are learned through classical conditioning. Human subjects were scanned using fMRI while learning associations between arbitrary visual stimuli and subsequent delivery of one of five different food flavors. Using a temporal difference algorithm to model learning, we found predictive responses in the ventral midbrain and a part of ventral striatum (ventral putamen) that were related directly to subjects' actual behavioral preferences. These brain structures demonstrated divergent response profiles, with the ventral midbrain showing a linear response profile with preference, and the ventral striatum a bivalent response. These results provide insight into the neural mechanisms underlying human preference behavior.

Integrity signals

Registry

Crossref · 10.1016/j.neuron.2005.11.014

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

To make a choice, the brain uses representations of reward-expectancy and effort/risk requirement from prior experiences to optimize cost/benefit.
“Research suggests that to make this choice, the brain uses representations of reward-expectancy and effort/risk requirement from prior experiences to optimize cost/benefit”
From Food reward, hyperphagia, and obesity (2011) · cites this paper as [118]

A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,542 · see citing works
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Self-citation
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Self-citation
Reward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426 · see citing works
Self-citation
Neural Correlates of Behavioral Preference for Culturally Familiar Drinks
McClure, S. M., Li, J., Tomlin, D., Cypert, K. S., Montague, L. M., & Montague, P. R. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.019 · Cited by 1,347 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · see citing works
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works
Optimized EPI for fMRI studies of the orbitofrontal cortex
Deichmann, R., Gottfried, J. A., Hutton, C., & Turner, R. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00073-9 · Cited by 821 · see citing works
The Effects of Music in Advertising on Choice Behavior: A Classical Conditioning Approach
Gorn, G. J. (1982) · Journal of Marketing · doi:10.2307/1251163 · Cited by 803 · see citing works
The Human Brain
Duvernoy, H. M. (1999) · Springer eBooks · doi:10.1007/978-3-7091-6792-2 · Cited by 759 · see citing works
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works
Self-citation
Learning and Computational Neuroscience: Foundations of Adaptive Networks
Gabriel, M., & Moore, J. (1990) · Cited by 519 · see citing works
Time-Derivative Models of Pavlovian Reinforcement
Sutton, R. S., & Barto, A. G. (1990) · Cited by 496 · see citing works
Reward Circuitry Activation by Noxious Thermal Stimuli
Becerra, L. R., Breiter, H. C., Wise, R. A., González, R., & Borsook, D. (2001) · Neuron · doi:10.1016/s0896-6273(01)00533-5 · Cited by 489 · see citing works
Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · see citing works
Projections of the sexually dimorphic anteroventral periventricular nucleus in the female rat
Gu, G. B., & Simerly, R. B. (1997) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19970721)384:1 · Cited by 251 · see citing works
The relevance of behavioural measures for functional-imaging studies of cognition
Wilkinson, D. T., & Halligan, P. W. (2004) · Nature reviews. Neuroscience · doi:10.1038/nrn1302 · Cited by 222 · see citing works
Learning to Like: A Role for Human Orbitofrontal Cortex in Conditioned Reward
Cox, S. M. L., Andrade, A., & Johnsrude, I. S. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3360-04.2005 · Cited by 99 · see citing works
Three‐dimensional cartography of functional territories in the human striatopallidal complex by using calbindin immunoreactivity
Karachi, C., François, C., Parain, K., Bardinet, É., Tandé, D., Hirsch, É. C., & Yelnik, J. (2002) · The Journal of Comparative Neurology · doi:10.1002/cne.10312 · Cited by 94 · see citing works

Flagged first, then by citations

Sorted by citations

The neural correlates of subjective value during intertemporal choice
Kable, J. W., & Glimcher, P. W. (2007) · Nature Neuroscience · doi:10.1038/nn2007 · Cited by 1,916 · see citing works
Social cognition and the brain: A meta-analysis
Van Overwalle, F. (2009) · Human Brain Mapping · doi:10.1002/hbm.20547 · Cited by 1,792 · see citing works
Affective neuroscience of pleasure: reward in humans and animals
Berridge, K. C., & Kringelbach, M. L. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1099-6 · Cited by 1,254 · see citing works
The cognitive functions of the caudate nucleus
Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2008) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2008.09.004 · Cited by 942 · see citing works
Human fronto–mesolimbic networks guide decisions about charitable donation
Moll, J., Krueger, F., Zahn, R., Pardini, M., de Oliveira-Souza, R., & Grafman, J. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0604475103 · Cited by 900 · see citing works
Widespread reward-system activation in obese women in response to pictures of high-calorie foods
Stoeckel, L. E., Weller, R. E., Cook, E. W., Twieg, D. B., Knowlton, R. C., & Cox, J. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.031 · Cited by 857 · see citing works
Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · see citing works
Self-citation
Informatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706 · see citing works
Reinforcement learning: The Good, The Bad and The Ugly
Dayan, P., & Niv, Y. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.08.003 · Cited by 690 · see citing works
Behavioral and neural correlates of delay of gratification 40 years later
Casey, B. J., Somerville, L. H., Gotlib, I. H., Ayduk, O., Franklin, N. T., Askren, M. K., Jonides, J., Berman, M. G., Wilson, N. L., Teslovich, T., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1108561108 · Cited by 683 · see citing works
Differential activation of the dorsal striatum by high-calorie visual food stimuli in obese individuals
Rothemund, Y., Preuschhof, C., Bohner, G., Bauknecht, H.-C., Klingebiel, R., Flor, H., & Klapp, B. F. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.05.008 · Cited by 679 · see citing works
BOLD responses reflecting dopaminergic signals in the human ventral tegmental area
D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008) · Science · doi:10.1126/science.1150605 · Cited by 661 · see citing works
Empathy for positive and negative emotions in the gustatory cortex
Jabbi, M., Swart, M., & Keysers, C. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.10.032 · Cited by 590 · see citing works
Neural Representation of Subjective Value Under Risk and Ambiguity
Levy, I., Snell, J., Nelson, A. J., Rustichini, A., & Glimcher, P. W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00853.2009 · Cited by 491 · see citing works
Mesolimbic Functional Magnetic Resonance Imaging Activations during Reward Anticipation Correlate with Reward-Related Ventral Striatal Dopamine Release
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., Seidenbecher, C. I., Coenen, H. H., Heinze, H.-J., Zilles, K., et al. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-08.2008 · Cited by 496 · see citing works
Predictive coding
Huang, Y., & Rao, R. P. N. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.142 · Cited by 470 · see citing works
Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain
Kim, H., Shimojo, S., & O’Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 447 · see citing works
Self-citation
A computational and neural model of momentary subjective well-being
Rutledge, R. B., Skandali, N., Dayan, P., & Dolan, R. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1407535111 · Cited by 444 · see citing works
Self-citation
From Fear to Safety and Back: Reversal of Fear in the Human Brain
Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., & Phelps, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2265-08.2008 · Cited by 429 · see citing works
Oxytocin Attenuates Affective Evaluations of Conditioned Faces and Amygdala Activity
Petrovic, P., Kalisch, R., Singer, T., & Dolan, R. J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4572-07.2008 · Cited by 424 · see citing works
Self-citation
Neural representations of subjective reward value
Peters, J., & Büchel, C. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.04.031 · Cited by 405 · see citing works
Mechanisms of motivation–cognition interaction: challenges and opportunities
Braver, T. S., Krug, M. K., Chiew, K. S., Kool, W., Westbrook, J. A., Clement, N. J., Adcock, R. A., Barch, D. M., Botvinick, M., Carver, C. S., et al. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0300-0 · Cited by 400 · see citing works
Abnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374 · see citing works
IMAGING VALUATION MODELS IN HUMAN CHOICE
Montague, P. R., King‐Casas, B., & Cohen, J. D. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112903 · Cited by 371 · see citing works
Comparing Apples and Oranges: Using Reward-Specific and Reward-General Subjective Value Representation in the Brain
Levy, D. J., & Glimcher, P. W. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2218-11.2011 · Cited by 350 · see citing works
Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling
Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346 · see citing works
How cognition modulates affective responses to taste and flavor: top-down influences on the orbitofrontal and pregenual cingulate cortices
Grabenhorst, F., Rolls, E. T., & Bilderbeck, A. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm185 · Cited by 337 · see citing works
Rewards evoke learning of unconsciously processed visual stimuli in adult humans
Seitz, A. R., Kim, D., & Watanabe, T. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.016 · Cited by 337 · see citing works
The Role of Ventromedial Prefrontal Cortex in Decision Making: Judgment under Uncertainty or Judgment Per Se?
Fellows, L. K., & Farah, M. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl176 · Cited by 337 · see citing works
Audience preferences are predicted by temporal reliability of neural processing
Dmochowski, J., Bezdek, M. A., Abelson, B. P., Johnson, J. S., Schumacher, E. H., & Parra, L. C. (2014) · Nature Communications · doi:10.1038/ncomms5567 · Cited by 301 · see citing works
The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects
FitzGerald, T. H. B., Seymour, B., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0717-09.2009 · Cited by 279 · see citing works
Self-citation
Elevated striatal and decreased dorsolateral prefrontal cortical activity in response to emotional stimuli in euthymic bipolar disorder: no associations with psychotropic medication load
Hassel, S., Almeida, J. R., Kerr, N., Nau, S., Ladouceur, C. D., Fissell, K., Kupfer, D. J., & Phillips, M. L. (2008) · Bipolar Disorders · doi:10.1111/j.1399-5618.2008.00641.x · Cited by 277 · see citing works
Food reward, hyperphagia, and obesity
Berthoud, H.-R., Lenard, N. R., & Shin, A. C. (2011) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00028.2011 · Cited by 275 · see citing works
A neural network model of the structure and dynamics of human personality.
Read, S. J., Monroe, B. M., Brownstein, A. L., Yang, Y., Chopra, G., & Miller, L. C. (2010) · Psychological Review · doi:10.1037/a0018131 · Cited by 257 · see citing works
Disrupted Reinforcement Signaling in the Orbitofrontal Cortex and Caudate in Youths With Conduct Disorder or Oppositional Defiant Disorder and a High Level of Psychopathic Traits
Finger, E. C., Marsh, A. A., Blair, K. S., Reid, M. E., Sims, C., Ng, P., Pine, D. S., & Blair, J. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10010129 · Cited by 253 · see citing works
An fMRI study measuring analgesia enhanced by religion as a belief system.
Wiech, K., Farias, M., Kahane, G., Shackel, N., Tiede, W., & Tracey, I. (2008) · Pain · doi:10.1016/j.pain.2008.07.030 · Cited by 251 · see citing works
Functional Dissociation in Frontal and Striatal Areas for Processing of Positive and Negative Reward Information
Liu, X., Powell, D. K., Wang, H., Gold, B. T., Corbly, C. R., & Joseph, J. E. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.5227-06.2007 · Cited by 236 · see citing works
Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task
Rolls, E. T., McCabe, C., & Redouté, J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm097 · Cited by 234 · see citing works
The neural correlates of subjective pleasantness
Kühn, S., & Gallinat, J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.065 · Cited by 232 · see citing works
Brain correlates of aesthetic expertise: A parametric fMRI study
Kirk, U., Skov, M., Christensen, M. S., & Nygaard, N. (2009) · Brain and Cognition · doi:10.1016/j.bandc.2008.08.004 · Cited by 224 · see citing works
How the Brain Represents the Reward Value of Fat in the Mouth
Fabian Grabenhorst, B., Rolls, E. T., Parris, B. A., & D’Souza, A. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp169 · Cited by 210 · see citing works
A universal role of the ventral striatum in reward-based learning: Evidence from human studies
Daniel, R., & Pollmann, S. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.002 · Cited by 209 · see citing works
Choice from Non-Choice: Predicting Consumer Preferences from Blood Oxygenation Level-Dependent Signals Obtained during Passive Viewing
Levy, I., Lazzaro, S. C., Rutledge, R. B., & Glimcher, P. W. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3214-10.2011 · Cited by 205 · see citing works
Ageing and early-stage Parkinson's disease affect separable neural mechanisms of mesolimbic reward processing
Schott, B. H., Niehaus, L., Wittmann, B. C., Schütze, H., Seidenbecher, C. I., Heinze, H. –., & Düzel, E. (2007) · Brain · doi:10.1093/brain/awm147 · Cited by 193 · see citing works
A Neural Signature of Hierarchical Reinforcement Learning
Fernandes, J. J. F. R., Solway, A., Diuk, C., McGuire, J. T., Barto, A. G., Niv, Y., & Botvinick, M. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.042 · Cited by 193 · see citing works
Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing
Anderson, B. A., & Yantis, S. (2012) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-012-0348-2 · Cited by 192 · see citing works
New scanner data for brand marketers: How neuroscience can help better understand differences in brand preferences
Venkatraman, V., Clithero, J. A., Fitzsimons, G. J., & Huettel, S. A. (2011) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2011.11.008 · Cited by 192 · see citing works
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191 · see citing works
Separable Substrates for Anticipatory and Consummatory Food Chemosensation
Small, D. M., Veldhuizen, M. G., Felsted, J. A., Mak, Y. E., & McGlone, F. P. (2008) · Neuron · doi:10.1016/j.neuron.2008.01.021 · Cited by 190 · see citing works
Appetitive conditioning: Neural bases and implications for psychopathology
Martin-Söelch, C., Linthicum, J., & Ernst, M. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.11.002 · Cited by 185 · see citing works
The neural basis of academic achievement motivation
Mizuno, K., Tanaka, M., Ishii, A., Tanabe, H. C., Onoe, H., Sadato, N., & Watanabe, Y. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.04.253 · Cited by 182 · see citing works
Top-Down Dysregulation—From ADHD to Emotional Instability
Petrovic, P., & Castellanos, F. X. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00070 · Cited by 179 · see citing works
“Functional imaging studies on humans support this model (O’Doherty et al., 2003, 2006; Pessiglione et al., 2006).”
Method
Neural Correlates of Forward Planning in a Spatial Decision Task in Humans
Simon, D. A., & Daw, N. D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4647-10.2011 · Cited by 181 · see citing works
The Neural Mechanisms Underlying the Influence of Pavlovian Cues on Human Decision Making
Bray, S., Rangel, A., Shimojo, S., Balleine, B., & O'Doherty, J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.0897-08.2008 · Cited by 193 · see citing works
Self-citation
Overlapping Responses for the Expectation of Juice and Money Rewards in Human Ventromedial Prefrontal Cortex
Kim, H., Shimojo, S., & O'Doherty, J. P. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq145 · Cited by 176 · see citing works
Self-citation
Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces
Bray, S., & O’Doherty, J. P. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01211.2006 · Cited by 169 · see citing works
Self-citation
Preferential Reactivation of Motivationally Relevant Information in the Ventral Striatum
Lansink, C. S., Goltstein, P. M., Lankelma, J. V., Joosten, R. N. J. M. A., McNaughton, B. L., & Pennartz, C. M. A. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1054-08.2008 · Cited by 168 · see citing works
Learning the Exception to the Rule: Model-Based fMRI Reveals Specialized Representations for Surprising Category Members
Davis, T. H., Love, B. C., & Preston, A. R. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr036 · Cited by 150 · see citing works
Disrupted Expected Value and Prediction Error Signaling in Youths With Disruptive Behavior Disorders During a Passive Avoidance Task
White, S. F., Pope, K., Sinclair, S., Fowler, K. A., Brislin, S. J., Williams, W. C., Pine, D. S., & Blair, J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12060840 · Cited by 150 · see citing works
CEREBRE: A Novel Method for Very High Accuracy Event-Related Potential Biometric Identification
Ruiz-Blondet, M. V., Jin, Z., & Laszlo, S. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2543524 · Cited by 152 · see citing works
Functional MRI of pain application in youth who engaged in repetitive non-suicidal self-injury vs. psychiatric controls
Osuch, E., Ford, K., Wrath, A., Bartha, R., & Neufeld, R. (2014) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2014.05.003 · Cited by 144 · see citing works
When Desire Collides with Reason: Functional Interactions between Anteroventral Prefrontal Cortex and Nucleus Accumbens Underlie the Human Ability to Resist Impulsive Desires
Diekhof, E. K., & Gruber, O. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.4690-09.2010 · Cited by 150 · see citing works
Effective connectivity of a reward network in obese women
Stoeckel, L. E., Kim, J., Weller, R. E., Cox, J. E., Cook, E. W., & Horwitz, B. (2009) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2009.05.016 · Cited by 147 · see citing works
Temporal Difference Modeling of the Blood-Oxygen Level Dependent Response During Aversive Conditioning in Humans: Effects of Dopaminergic Modulation
Menon, M., Jensen, J., Vitcu, I., Graff‐Guerrero, A., Crawley, A. P., Smith, M. A., & Kapur, S. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.10.020 · Cited by 145 · see citing works
Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task
Chiu, P. H., Lohrenz, T. M., & Montague, P. R. (2008) · Nature Neuroscience · doi:10.1038/nn2067 · Cited by 144 · see citing works
Social Norms Shift Behavioral and Neural Responses to Foods
Nook, E. C., & Zaki, J. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00795 · Cited by 145 · see citing works
Self-projection and the default network in frontotemporal dementia
Irish, M., Piguet, O., & Hodges, J. R. (2012) · Nature Reviews Neurology · doi:10.1038/nrneurol.2012.11 · Cited by 140 · see citing works
Measuring consumer expectations to improve food product development
Cardello, A. V. (2007) · Elsevier eBooks · doi:10.1533/9781845693381.2.223 · Cited by 138 · see citing works
Personality Predicts the Brain's Response to Viewing Appetizing Foods: The Neural Basis of a Risk Factor for Overeating
Passamonti, L., Rowe, J. B., Schwarzbauer, C., Ewbank, M., Hagen, E. V. D., & Calder, A. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4966-08.2009 · Cited by 134 · see citing works
Beyond Self-Report: A Review of Physiological and Neuroscientific Methods to Investigate Consumer Behavior
Bell, L., Vogt, J., Willemse, C., Routledge, T., Butler, L. T., & Sakaki, M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01655 · Cited by 143 · see citing works
Adolescent-specific patterns of behavior and neural activity during social reinforcement learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Powers, A., Mehta, N., Dyke, J., & Casey, B. J. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0257-z · Cited by 127 · see citing works
Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans
Elliott, R., Agnew, Z. K., & Deakin, J. F. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06202.x · Cited by 128 · see citing works
Noninvasive remote activation of the ventral midbrain by transcranial direct current stimulation of prefrontal cortex
Chib, V. S., Yun, K., Takahashi, H., & Shimojo, S. (2013) · Translational Psychiatry · doi:10.1038/tp.2013.44 · Cited by 128 · see citing works
Abnormal social reward processing in autism as indexed by pupillary responses to happy faces
Sepeta, L. N., Tsuchiya, N., Davies, M. S., Sigman, M., Bookheimer, S. Y., & Dapretto, M. (2012) · Journal of Neurodevelopmental Disorders · doi:10.1186/1866-1955-4-17 · Cited by 130 · see citing works
Social rewards and social networks in the human brain
Fareri, D. S., & Delgado, M. R. (2014) · The Neuroscientist · doi:10.1177/1073858414521869 · Cited by 124 · see citing works
From affective value to decision‐making in the prefrontal cortex
Fabian Grabenhorst, B., Rolls, E. T., & Parris, B. A. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06489.x · Cited by 124 · see citing works
Distinct Midbrain and Habenula Pathways Are Involved in Processing Aversive Events in Humans
Hennigan, K., D’Ardenne, K., & McClure, S. M. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0927-14.2015 · Cited by 119 · see citing works
The neural correlates of intertemporal decision‐making: Contributions of subjective value, stimulus type, and trait impulsivity
Sripada, C., Gonzalez, R., Phan, K. L., & Liberzon, I. (2010) · Human Brain Mapping · doi:10.1002/hbm.21136 · Cited by 123 · see citing works
Differential patterns of nucleus accumbens activation during anticipation of monetary and social reward in young and older adults
Rademacher, L., Salama, A., Gründer, G., & Spreckelmeyer, K. N. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst047 · Cited by 114 · see citing works
Is our self based on reward? Self-relatedness recruits neural activity in the reward system
de Greck, M., Rotte, M., Paus, R., Moritz, D., Thiemann, R., Prösch, U., Bruer, U., Moerth, S., Tempelmann, C., Bogerts, B., et al. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.006 · Cited by 119 · see citing works
Human reward system activation is modulated by a single dose of olanzapine in healthy subjects in an event-related, double-blind, placebo-controlled fMRI study
Abler, B., Erk, S., & Walter, H. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0690-y · Cited by 118 · see citing works
Overlapping Prediction Errors in Dorsal Striatum During Instrumental Learning With Juice and Money Reward in the Human Brain
Valentin, V. V., & O’Doherty, J. P. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91195.2008 · Cited by 117 · see citing works
Self-citation
Distinct brain systems underlie the processing of valence and arousal of affective pictures
Nielen, M. M. A., Heslenfeld, D. J., Heinen, K., Van Strien, J. W., Witter, M. P., Jonker, C., & Veltman, D. J. (2009) · Brain and Cognition · doi:10.1016/j.bandc.2009.05.007 · Cited by 114 · see citing works
Impaired Neurocognitive Functions Affect Social Learning Processes in Oppositional Defiant Disorder and Conduct Disorder: Implications for Interventions
Matthys, W., Vanderschuren, L. J. M. J., Schutter, D. J. L. G., & Lochman, J. E. (2012) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-012-0118-7 · Cited by 116 · see citing works
Midbrain activation during pavlovian conditioning and delusional symptoms in schizophrenia
Romaniuk, L., Honey, G. D., King, J. R. L., Whalley, H. C., McIntosh, A. M., Levita, L., Hughes, M., Johnstone, E. C., Day, M., Lawrie, S. M., et al. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.169 · Cited by 113 · see citing works
Favorite brands as cultural objects modulate reward circuit
Schaefer, M., & Rotte, M. (2007) · Neuroreport · doi:10.1097/wnr.0b013e328010ac84 · Cited by 112 · see citing works
Abnormal activity in reward brain circuits in human narcolepsy with cataplexy
Ponz, A., Khatami, R., Poryazova, R., Werth, E., Boesiger, P., Bassetti, C. L., & Schwartz, S. (2009) · Annals of Neurology · doi:10.1002/ana.21825 · Cited by 109 · see citing works
Metabolic Regulation of Brain Response to Food Cues
de Araújo, I. E., Lin, T., Veldhuizen, M. G., & Small, D. M. (2013) · Current Biology · doi:10.1016/j.cub.2013.04.001 · Cited by 111 · see citing works
Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum
Diederen, K. M. J., Ziauddeen, H., Vestergaard, M. D., Spencer, T., Schultz, W., & Fletcher, P. C. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1979-16.2016 · Cited by 110 · see citing works
Greater striatopallidal adaptive coding during cue–reward learning and food reward habituation predict future weight gain
Burger, K. S., & Stice, E. M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.066 · Cited by 109 · see citing works
Prefrontal Cortex, Emotion, and Approach/Withdrawal Motivation
Spielberg, J. M., Stewart, J. L., Levin, R. L., Miller, G. A., & Heller, W. (2008) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00064.x · Cited by 107 · see citing works
Dopamine, Reward Prediction Error, and Economics*
Caplin, A., & Dean, M. R. W. (2008) · The Quarterly Journal of Economics · doi:10.1162/qjec.2008.123.2.663 · Cited by 106 · see citing works
Why Clowns Taste Funny: The Relationship between Humor and Semantic Ambiguity
Bekinschtein, T. A., Davis, M. H., Rodd, J. M., & Owen, A. M. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.5058-10.2011 · Cited by 104 · see citing works
Adaptive prediction error coding in the human midbrain and striatum facilitates behavioral adaptation and learning efficiency
Diederen, K. M. J., Spencer, T., Vestergaard, M. D., Fletcher, P. C., & Schultz, W. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.019 · Cited by 102 · see citing works
Neural activation in the “reward circuit” shows a nonlinear response to facial attractiveness
Liang, X., Zebrowitz, L. A., & Zhang, Y. (2010) · Social Neuroscience · doi:10.1080/17470911003619916 · Cited by 95 · see citing works
Stress increases aversive prediction error signal in the ventral striatum
Robinson, O. J., Overstreet, C. M., Charney, D. R., Vytal, K. E., & Grillon, C. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213923110 · Cited by 91 · see citing works
Learning to Become an Expert: Reinforcement Learning and the Acquisition of Perceptual Expertise
Krigolson, O. E., Pierce, L. J., Holroyd, C. B., & Tanaka, J. W. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21128 · Cited by 92 · see citing works
Decision Making: a Theoretical Review
Morelli, M., Casagrande, M., & Forte, G. (2021) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-021-09669-x · Cited by 102 · see citing works
Axiomatic methods, dopamine and reward prediction error
Caplin, A., & Dean, M. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.07.007 · Cited by 88 · see citing works
Distinct Contributions of Ventromedial and Dorsolateral Subregions of the Human Substantia Nigra to Appetitive and Aversive Learning
Pauli, W. M., Larsen, T., Collette, S., Tyszka, J. M., Seymour, B., & O’Doherty, J. P. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2277-15.2015 · Cited by 81 · see citing works
Self-citation

Decoding the Formation of Reward Predictions across Learning
Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3412-11.2011 · Cited by 52 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Self-citation
Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces
Bray, S., & O’Doherty, J. P. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01211.2006 · Cited by 169 · see citing works
Self-citation
� Human Brain Mapping 28:294–302(2007) � Separate Brain Regions Code for Salience vs. Valence During Reward Prediction in Humans
Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., & Kapur, S. (2013)
Encoding of predictive associations in human prefrontal and medial temporal neurons during Pavlovian appetitive conditioning
Aquino, T. G., Courellis, H. S., Mamelak, A. N., Rutishauser, U., & O’Doherty, J. P. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1628-23.2024 · Cited by 6 · see citing works
Self-citation

Authors: O'Doherty, J. P., Buchanan, T. W., Seymour, B., & Dolan, R. J.
Affiliations: University of Iowa (US)
UCL Queen Square Institute of Neurology (GB)
ORCID: Buchanan, Tony W.
Seymour, Ben
Dolan, Raymond J.
Venue: Neuron
Publisher: Elsevier BV
Published: 2006-01
Volume: 49
Issue: 1
Pages: 157-166
ISSN: 0896-6273 (ISSN-L)
DOI: 10.1016/j.neuron.2005.11.014
OpenAlex: W2170349865
Cited by: 322
References: 26
Citations by year: 2026: 2 · 2025: 4 · 2024: 9 · 2023: 8 · 2022: 15 · 2021: 11 · 2020: 9 · 2019: 19 · 2018: 12 · 2017: 10 · 2016: 16 · 2015: 13 · 2014: 25 · 2013: 22 · 2012: 17
FWCI: 10.25
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/open-access/userlicense/1.0/ (vor, 2754 d)
Locations: Neuron (publishedVersion)
PubMed (publishedVersion)
UCL Discovery (University College London) (submittedVersion)
Max Planck Digital Library (submittedVersion, other-oa)
Cambridge University Engineering Department Publications Database (submittedVersion)
MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
Funders: Wellcome Trust
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords: food preferences, reward prediction, predictive coding, ventral midbrain, ventral striatum, ventral putamen, classical conditioning, temporal difference learning, subjective value, choice behavior
MeSH terms: Adult, Algorithms, Cerebral Cortex, Corpus Striatum, Cues, Female, Food Preferences, Humans, Magnetic Resonance Imaging, Male, Mesencephalon, Models, Neurological, Pupil, Reaction Time, Reward, Taste, Linear Models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Predictive Neural Coding of Reward Preference Involves Dissociable Responses in Human Ventral Midbrain and Ventral Striatum

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks