The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Temporal Difference Models and Reward-Related Learning in the Human Brain
Open accessAbstract
Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, the signed prediction error indicates whether an outcome is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions [14–21].”
From Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis (2021) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Many early fMRI studies into prediction errors used model-free accounts in Pavlovian paradigms and located prediction errors in striatal BOLD (Berns et al., 2001; O’Doherty, 2004; O’Doherty et al., 2003; Haruno et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as O’Doherty et al., 2003
In the citing paper
“These changes in striatum BOLD activity coincide with the process of learning how to predict rewards 15, 16 – an observation supported by electrophysiological properties of its dopaminergic afferents.”
From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [15]
In the citing paper
“human fMRI studies have found that VS activity correlates with RPEs during tasks that feature exclusively Pavlovian reward associations [27,28]”
From Contributions of the striatum to learning, motivation, and performance: an associative account (2012) · cites this paper as [28]
In the citing paper
“Pupillary response dynamics are thought to reflect multiple different features, including sensory cues36,37, arousal/task engagement38,39, motor activity40,41, and motivation42,43.”
From Revealing abrupt transitions from goal-directed to habitual behavior (2026) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationRescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Spatial registration and normalization of images
Friston, K. J., Ashburner, J., Frith, C., Poline, J.-B., Heather, J. D., & Frackowiak, R. S. J. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030303 · Cited by 3,744
Self-citationPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Cited by
Sorted by citations
Items 201–300 of 1,002
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G. F., McClure, S. M., Wang, J. T., & Camerer, C. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1308286 · Cited by 214
Erdeniz, B., Rohe, T., Done, J., & Seidler, R. D. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00116 · Cited by 216
Krebs, R. M., Boehler, C. N., Roberts, K. C., Song, A. W., & Woldorff, M. G. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr134 · Cited by 231
Disrupted habenula function in major depression
Lawson, R. P., Nord, C. L., Seymour, B., Thomas, D. L., Dayan, P., Pilling, S., & Roiser, J. P. (2016) · Molecular Psychiatry · doi:10.1038/mp.2016.81 · Cited by 210
Self-citationKennerley, S. W., & Wallis, J. D. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06743.x · Cited by 211
Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI
Badre, D., & Frank, M. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr117 · Cited by 203
How the Brain Represents the Reward Value of Fat in the Mouth
Fabian Grabenhorst, B., Rolls, E. T., Parris, B. A., & D’Souza, A. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp169 · Cited by 210
Human neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
Self-citationCerebellar and Prefrontal Cortex Contributions to Adaptation, Strategies, and Reinforcement Learning
Taylor, J. A., & Ivry, R. B. (2014) · Progress in brain research · doi:10.1016/b978-0-444-63356-9.00009-1 · Cited by 225
The role of ventral frontostriatal circuitry in reward-based learning in humans.
Galvan, A., Hare, T. A., Davidson, M., Spicer, J., Glover, G., & Casey, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2431-05.2005 · Cited by 207
The role of the basal ganglia in learning and memory: Insight from Parkinson’s disease
Foerde, K., & Shohamy, D. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.08.006 · Cited by 231
Differential Effect of Reward and Punishment on Procedural Learning
Wächter, T., Lungu, O., Liu, T., Willingham, D. T., & Ashe, J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4132-08.2009 · Cited by 204
Neuroscientific Model of Motivational Process
Kim, S. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00098 · Cited by 235
Wörgötter, F., & Porr, B. (2005) · Neural Computation · doi:10.1162/0899766053011555 · Cited by 203
A Bayesian framework for simultaneously modeling neural and behavioral data
Turner, B. M., Forstmann, B. U., Wagenmakers, E., Brown, S. D., Sederberg, P. B., & Mark Steyvers, B. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.01.048 · Cited by 209
O’Doherty, J. P. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.036 · Cited by 206
Self-citationRegional specialization within the human striatum for diverse psychological functions
Pauli, W. M., O’Reilly, R. C., Yarkoni, T., & Wager, T. D. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1507610113 · Cited by 204
Computational substrates of norms and their violations during social exchange
Xiang, T., Lohrenz, T., & Montague, P. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1642-12.2013 · Cited by 197
Schott, B. H., Niehaus, L., Wittmann, B. C., Schütze, H., Seidenbecher, C. I., Heinze, H. –., & Düzel, E. (2007) · Brain · doi:10.1093/brain/awm147 · Cited by 197
A Neural Signature of Hierarchical Reinforcement Learning
Fernandes, J. J. F. R., Solway, A., Diuk, C., McGuire, J. T., Barto, A. G., Niv, Y., & Botvinick, M. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.042 · Cited by 207
Interaction between emotional state and learning underlies mood instability
Eldar, E., & Niv, Y. (2015) · Nature Communications · doi:10.1038/ncomms7149 · Cited by 205
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191
Surprise! Neural correlates of Pearce–Hall and Rescorla–Wagner coexist within the brain
Roesch, M. R., Esber, G. R., Li, J., Daw, N. D., & Schoenbaum, G. M. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07986.x · Cited by 208
Reinforcement learning, conditioning, and the brain: Successes and challenges
Maia, T. V. (2009) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.9.4.343 · Cited by 191
Mechanisms for widespread hippocampal involvement in cognition.
Shohamy, D., & Turk-Browne, N. B. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034461 · Cited by 187
Increased ventral striatal BOLD activity during non-drug reward anticipation in cannabis users
Nestor, L., Hester, R., & Garavan, H. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.022 · Cited by 186
Bayesian Prediction and Evaluation in the Anterior Cingulate Cortex
Ide, J. S., Shenoy, P., Yu, A. J., & Li, C.-S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2201-12.2013 · Cited by 185
Appetitive conditioning: Neural bases and implications for psychopathology
Martin-Söelch, C., Linthicum, J., & Ernst, M. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.11.002 · Cited by 199
Adaptive decision making and value in the anterior cingulate cortex
Walton, M. E., Croxson, P. L., Behrens, T. E. J., Kennerley, S. W., & Rushworth, M. F. S. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.03.029 · Cited by 191
Corlett, P. R., Honey, G. D., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Absalom, A. R., Lee, M., Pomarol-Clotet, E., Murray, G. K., McKenna, P. J., et al. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.6.611 · Cited by 182
The neural basis of academic achievement motivation
Mizuno, K., Tanaka, M., Ishii, A., Tanabe, H. C., Onoe, H., Sadato, N., & Watanabe, Y. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.04.253 · Cited by 182
Neural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180
Perceptual Learning and Decision-Making in Human Medial Frontal Cortex
Kahnt, T., Grueschow, M., Speck, O., & Haynes, J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.054 · Cited by 189
Neural Correlates of Forward Planning in a Spatial Decision Task in Humans
Simon, D. A., & Daw, N. D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4647-10.2011 · Cited by 186
Considering anger from a cognitive neuroscience perspective
Blair, J. (2011) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.154 · Cited by 192
Top-Down Dysregulation—From ADHD to Emotional Instability
Petrovic, P., & Castellanos, F. X. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00070 · Cited by 179
“Functional imaging studies on humans support this model (O’Doherty et al., 2003, 2006; Pessiglione et al., 2006).”
MethodEffort and Valuation in the Brain: The Effects of Anticipation and Execution
Kurniawan, I. T., Guitart‐Masip, M., Dayan, P., & Dolan, R. J. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4777-12.2013 · Cited by 188
Self-citationSeparate brain regions code for salience vs. valence during reward prediction in humans
Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., & Kapur, S. (2006) · Human Brain Mapping · doi:10.1002/hbm.20274 · Cited by 184
The Neural Mechanisms Underlying the Influence of Pavlovian Cues on Human Decision Making
Bray, S., Rangel, A., Shimojo, S., Balleine, B., & O'Doherty, J. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.0897-08.2008 · Cited by 193
Self-citationSchultz, W. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.064 · Cited by 177
Does Traumatic Brain Injury Increase Risk for Substance Abuse?
Bjork, J. M., & Grant, S. J. (2009) · Journal of Neurotrauma · doi:10.1089/neu.2008.0849 · Cited by 183
Kim, H., Shimojo, S., & O'Doherty, J. P. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq145 · Cited by 176
Self-citationCheetham, M. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00126 · Cited by 176
Decoding the Brain’s Algorithm for Categorization from Its Neural Implementation
Mack, M. L., Preston, A. R., & Love, B. C. (2013) · Current Biology · doi:10.1016/j.cub.2013.08.035 · Cited by 170
The fate of memory: Reconsolidation and the case of Prediction Error
Fernández, R. S., Boccia, M. M., & Pedreira, M. E. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.004 · Cited by 189
Social Network Modulation of Reward-Related Signals
Fareri, D. S., Niznikiewicz, M. A., Lee, V. K., & Delgado, M. R. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0610-12.2012 · Cited by 175
Zhang, L., Lengersdorff, L., Mikuš, N., Gläscher, J. P., & Lamm, C. (2020) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsaa089 · Cited by 168
Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces
Bray, S., & O’Doherty, J. P. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01211.2006 · Cited by 185
Self-citationChang, L. J., Jolly, E., Cheong, J. H., Rapuano, K. M., Greenstein, N., Chen, P.-H. A., & Manning, J. R. (2021) · Science Advances · doi:10.1126/sciadv.abf7129 · Cited by 177
Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement
Noonan, M. P., Kolling, N., Walton, M. E., & Rushworth, M. F. S. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08023.x · Cited by 169
Translational perspectives for computational neuroimaging
Stephan, K. E., Iglesias, S., Heinzle, J., & Diaconescu, A. O. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.008 · Cited by 169
Dopamine and effort-based decision making
Kurniawan, I. T. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00081 · Cited by 188
Habitual control of goal selection in humans
Cushman, F. A., & Morris, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1506367112 · Cited by 172
Summerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167
Computational neuroimaging strategies for single patient predictions
Stephan, K. E., Schlagenhauf, F., Huys, Q. J. M., Raman, S., Aponte, E. A., Brodersen, K. H., Rigoux, L., Moran, R., Jean Daunizeau, A., Dolan, R. J., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.038 · Cited by 174
Self-citationSonuga-Barke, E. J. S., Cortese, S., Fairchild, G. F., & Stringaris, A. K. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12496 · Cited by 177
Diekhof, E. K., Falkai, P., & Gruber, O. (2008) · Brain Research Reviews · doi:10.1016/j.brainresrev.2008.07.004 · Cited by 176
Brain Mechanisms for Extracting Spatial Information from Smell
Porter, J., Anand, T., Johnson, B., Khan, R. M., & Sobel, N. (2005) · Neuron · doi:10.1016/j.neuron.2005.06.028 · Cited by 171
A model-based fMRI analysis with hierarchical Bayesian parameter estimation.
Ahn, W., Krawitz, A., Kim, W., Busemeyer, J. R., & Brown, J. W. (2011) · Journal of Neuroscience Psychology and Economics · doi:10.1037/a0020684 · Cited by 172
Decoding different roles for vmPFC and dlPFC in multi-attribute decision making
Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.058 · Cited by 168
van Eimeren, T., Ballanger, B., Pellecchia, G., Miyasaki, J. M., Lang, A. E., & Strafella, A. P. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2009.124 · Cited by 171
Model-based predictions for dopamine
Langdon, A. J., Sharpe, M. J., Schoenbaum, G., & Niv, Y. (2018) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.10.006 · Cited by 161
Vijayakumar, N., Cheng, T. W., & Pfeifer, J. H. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.02.050 · Cited by 161
“Our results may therefore suggest that adolescent hyper-reactivity of VS is not limited to reward processing, and that this region may not be selective for the learning and prediction of rewarding outcomes (McClure et al., 2003; O'Doherty et al., 2004; 2003).”
BackgroundDing, W., Sun, J., Sun, Y., Zhou, Y., Li, L., Xu, J., & Du, Y. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059902 · Cited by 165
A brain network supporting social influences in human decision-making
Zhang, L., & Gläscher, J. P. (2020) · Science Advances · doi:10.1126/sciadv.abb4159 · Cited by 158
Behavioral and neurobiological mechanisms of punishment: implications for psychiatric disorders
Jean-Richard-Dit-Bressel, P., Killcross, S., & McNally, G. P. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0047-3 · Cited by 160
Chase, H. W., Nusslock, R., Almeida, J., Forbes, E. E., LaBarbara, E. J., & Phillips, M. L. (2013) · Bipolar Disorders · doi:10.1111/bdi.12132 · Cited by 168
How instructed knowledge modulates the neural systems of reward learning
Li, J., Delgado, M. R., & Phelps, E. A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014938108 · Cited by 152
Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction
Li, J., & Daw, N. D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6316-10.2011 · Cited by 159
The habenula encodes negative motivational value associated with primary punishment in humans
Lawson, R. P., Seymour, B., Loh, E., Lutti, A., Dolan, R. J., Dayan, P., Weiskopf, N., & Roiser, J. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323586111 · Cited by 153
Self-citationSatterthwaite, T. D., Green, L., Myerson, J., Parker, J. B., Ramaratnam, M., & Buckner, R. L. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.066 · Cited by 160
Striatal sensitivity to reward deliveries and omissions in substance dependent patients
Bjork, J. M., Smith, A. R., & Hommer, D. W. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.035 · Cited by 154
Jimura, K., Chushak, M. S., & Braver, T. S. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0919-12.2013 · Cited by 164
Dopamine, uncertainty and TD learning
Niv, Y., Duff, M. O., & Dayan, P. (2005) · Behavioral and Brain Functions · doi:10.1186/1744-9081-1-6 · Cited by 153
Self-citationSpoormaker, V. I., Schröter, M. S., Andrade, K. C., Dresler, M., Kiem, S. A., Goya‐Maldonado, R., Wetter, T. C., Holsboer, F., Sämann, P. G., & Czisch, M. (2012) · Human Brain Mapping · doi:10.1002/hbm.21369 · Cited by 153
Reputation for reciprocity engages the brain reward center
Phan, K. L., Sripada, C. S., Angstadt, M., & McCabe, K. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1008137107 · Cited by 152
On the role of general system theory for functional neuroimaging
Stephan, K. (2004) · Journal of Anatomy · doi:10.1111/j.0021-8782.2004.00359.x · Cited by 174
Anchors, scales and the relative coding of value in the brain
Seymour, B., & McClure, S. M. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.07.010 · Cited by 156
Error effects in anterior cingulate cortex reverse when error likelihood is high
Jessup, R. K., Busemeyer, J. R., & Brown, J. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4130-09.2010 · Cited by 151
Feeling in control: Neural correlates of experience of agency
Kühn, S., Braß, M., & Haggard, P. (2012) · Cortex · doi:10.1016/j.cortex.2012.09.002 · Cited by 157
Monteleone, A. M., Castellini, G., Volpe, U., Ricca, V., Lelli, L., Monteleone, P., & Maj, M. (2017) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.02.020 · Cited by 162
Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia
Morris, R. W., Vercammen, A., Lenroot, R., Moore, L., Langton, J. M., Short, B., Kulkarni, J., Curtis, J., O'Donnell, M., Weickert, C. S., et al. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.75 · Cited by 149
Dopamine and performance in a reinforcement learning task: evidence from Parkinson’s disease
Shiner, T., Seymour, B., Wunderlich, K., Hill, C. S., Bhatia, K. P., Dayan, P., & Dolan, R. J. (2012) · Brain · doi:10.1093/brain/aws083 · Cited by 157
Self-citationThe Neurobiology of Eating Disorders
Frank, G., Shott, M. E., & DeGuzman, M. C. (2019) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2019.05.007 · Cited by 155
Effects of Direct Social Experience on Trust Decisions and Neural Reward Circuitry
Fareri, D. S., Chang, L. J., & Delgado, M. R. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00148 · Cited by 147
Value normalization in decision making: theory and evidence
Rangel, A., & Clithero, J. A. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.07.011 · Cited by 165
Baliki, M. N., Mansour, A. R., Baria, A. T., Huang, L., Berger, S., Fields, H. L., & Apkarian, A. V. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1731-13.2013 · Cited by 161
Menon, M., Jensen, J., Vitcu, I., Graff‐Guerrero, A., Crawley, A. P., Smith, M. A., & Kapur, S. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.10.020 · Cited by 145
Separate mesocortical and mesolimbic pathways encode effort and reward learning signals
Hauser, T. U., Eldar, E., & Dolan, R. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705643114 · Cited by 142
Self-citationPrediction Error during Retrospective Revaluation of Causal Associations in Humans
Corlett, P. R., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Honey, G. D., Honey, R. A. E., Robbins, T. W., Bullmore, E. T., & Fletcher, P. C. (2004) · Neuron · doi:10.1016/j.neuron.2004.11.022 · Cited by 156
Barch, D. M. (2005) · Schizophrenia Bulletin · doi:10.1093/schbul/sbi040 · Cited by 147
Motivating forces of human actions
Walter, H., Abler, B., Ciaramidaro, A., & Erk, S. (2005) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2005.06.016 · Cited by 149
Altered Brain Reward Circuits in Eating Disorders: Chicken or Egg?
Frank, G. (2013) · Current Psychiatry Reports · doi:10.1007/s11920-013-0396-x · Cited by 153
Downregulation of the Posterior Medial Frontal Cortex Prevents Social Conformity
Klucharev, V. A., Munneke, M. A. M., Smidts, A., & Fernández, G. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1869-11.2011 · Cited by 147
Neural Evidence of Regret and Its Implications for Investor Behavior
Frydman, C., & Camerer, C. F. (2016) · Review of Financial Studies · doi:10.1093/rfs/hhw010 · Cited by 144
Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers
Delgado, M. R., Jou, R. L., & Phelps, E. A. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00071 · Cited by 141
Varnum, M. E. W., Shi, Z., Chen, A., Qiu, J., & Han, S. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.042 · Cited by 143
Individual Differences in Autobiographical Memory
Palombo, D. J., Sheldon, S., & Levine, B. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.04.007 · Cited by 163
Baram, A. B., Müller, T., Nili, H., Garvert, M. M., & Behrens, T. E. J. (2020) · Neuron · doi:10.1016/j.neuron.2020.11.024 · Cited by 134
Special Review: Decision Utility, The Brain, and Pursuit of Hedonic Goals
Berridge, K. C., & Aldridge, J. W. (2008) · Social Cognition · doi:10.1521/soco.2008.26.5.621 · Cited by 147
Metadata
- Authors
- O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J.
- Affiliations
- Gatsby Computational Neuroscience Unit (GB)
- UCL Queen Square Institute of Neurology (GB)
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2003-04
- Volume
- 38
- Issue
- 2
- Pages
- 329-337
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2007414406
- Cited by
- 1,522
- References
- 36
- Citations by year
- 2026: 51 · 2025: 50 · 2024: 51 · 2023: 46 · 2022: 53 · 2021: 55 · 2020: 54 · 2019: 64 · 2018: 87 · 2017: 65 · 2016: 97 · 2015: 71 · 2014: 70 · 2013: 93 · 2012: 97
- FWCI
- 17.96
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Wellcome Trust
- Gatsby Charitable Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- temporal difference learning, prediction error signal, classical conditioning, appetitive conditioning, reward prediction, ventral striatum, orbitofrontal cortex, conditioned stimulus, human brain
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Conditioning, Classical, Corpus Striatum, Female, Frontal Lobe, Humans, Learning, Magnetic Resonance Imaging, Male, Reference Values, Reflex, Pupillary, Reward, Taste, Time Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
