The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Temporal Difference Models and Reward-Related Learning in the Human Brain
Open accessAbstract
Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, the signed prediction error indicates whether an outcome is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions [14–21].”
From Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis (2021) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Many early fMRI studies into prediction errors used model-free accounts in Pavlovian paradigms and located prediction errors in striatal BOLD (Berns et al., 2001; O’Doherty, 2004; O’Doherty et al., 2003; Haruno et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as O’Doherty et al., 2003
In the citing paper
“These changes in striatum BOLD activity coincide with the process of learning how to predict rewards 15, 16 – an observation supported by electrophysiological properties of its dopaminergic afferents.”
From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [15]
In the citing paper
“human fMRI studies have found that VS activity correlates with RPEs during tasks that feature exclusively Pavlovian reward associations [27,28]”
From Contributions of the striatum to learning, motivation, and performance: an associative account (2012) · cites this paper as [28]
In the citing paper
“Pupillary response dynamics are thought to reflect multiple different features, including sensory cues36,37, arousal/task engagement38,39, motor activity40,41, and motivation42,43.”
From Revealing abrupt transitions from goal-directed to habitual behavior (2026) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationRescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Spatial registration and normalization of images
Friston, K. J., Ashburner, J., Frith, C., Poline, J.-B., Heather, J. D., & Frackowiak, R. S. J. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030303 · Cited by 3,744
Self-citationPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Cited by
Sorted by citations
Items 101–200 of 1,002
Brain mediators of predictive cue effects on perceived pain
Atlas, L. Y., Bolger, N., Lindquist, M. A., & Wager, T. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0057-10.2010 · Cited by 389
Applying a cognitive neuroscience perspective to the disorder of psychopathy
Blair, J. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050418 · Cited by 414
The anatomy of apathy: a neurocognitive framework for amotivated behaviour
Le Heron, C., Apps., M. A. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.07.003 · Cited by 380
Context dependence of the event‐related brain potential associated with reward and punishment
Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2004.00152.x · Cited by 388
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376
Abnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374
IMAGING VALUATION MODELS IN HUMAN CHOICE
Montague, P. R., King‐Casas, B., & Cohen, J. D. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112903 · Cited by 382
Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making
Sul, J. H., Kim, H., Huh, N., Lee, D., & Jung, M. W. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.033 · Cited by 378
Effort discounting in human nucleus accumbens
Botvinick, M., Huffstetler, S., & McGuire, J. T. (2009) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.9.1.16 · Cited by 364
Orbitofrontal cortex tracks positive mood in mothers viewing pictures of their newborn infants
Nitschke, J. B., Nelson, E. E., Rusch, B. D., Fox, A. S., Oakes, T. R., & Davidson, R. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.005 · Cited by 371
Finger, E. C., Marsh, A. A., Mitchell, D. G., Reid, M. E., Sims, C., Budhani, S., Kosson, D. S., Chen, G., Towbin, K. E., Leibenluft, E., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archpsyc.65.5.586 · Cited by 365
Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms
Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362
Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356
Self-citationDifferential roles of human striatum and amygdala in associative learning
Li, J., Schiller, D., Schoenbaum, G. M., Phelps, E. A., & Daw, N. D. (2011) · Nature Neuroscience · doi:10.1038/nn.2904 · Cited by 364
Event-related potential studies of outcome processing and feedback-guided learning
San Martín, R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00304 · Cited by 354
The Architecture of Reward Value Coding in the Human Orbitofrontal Cortex
Sescousse, G., Redouté, J., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-10.2010 · Cited by 353
Otto (2013) · doi:10.1177/0956797612463080 · Cited by 352
Social and monetary reward learning engage overlapping neural substrates
Lin, A., Adolphs, R., & Rangel, A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr006 · Cited by 351
Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Belova, M. A., Paton, J. J., Morrison, S. E., & Salzman, C. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.004 · Cited by 349
Dialogues on prediction errors
Niv, Y., & Schoenbaum, G. M. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.03.006 · Cited by 377
An fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 337
Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E. M., & Stephan, K. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.009 · Cited by 342
Diekhof, E. K., Kaps, L., Falkai, P., & Gruber, O. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.02.007 · Cited by 332
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328
O'Doherty, J. P., Buchanan, T. W., Seymour, B., & Dolan, R. J. (2006) · Neuron · doi:10.1016/j.neuron.2005.11.014 · Cited by 322
Self-citationLeotti, L. A., & Delgado, M. R. (2011) · Psychological Science · doi:10.1177/0956797611417005 · Cited by 318
Contributions of the striatum to learning, motivation, and performance: an associative account
Liljeholm, M., & O’Doherty, J. P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.007 · Cited by 317
Self-citationIndividual differences in trait rumination and the neural systems supporting cognitive reappraisal
RAY, R. D., OCHSNER, K. N., COOPER, J. C., ROBERTSON, E. R., GABRIELI, J. D. E., & GROSS, J. J. (2005) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.5.2.156 · Cited by 316
Anorexia nervosa and obesity are associated with opposite brain reward response
Frank, G. K. W., Reynolds, J. R., Shott, M. E., Jappe, L., Yang, T. T., Tregellas, J. R., & O'Reilly, R. C. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.51 · Cited by 311
Mapping value based planning and extensively trained choice in the human brain
Wunderlich, K., Dayan, P., & Dolan, R. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3068 · Cited by 310
Self-citationRostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven Exploration
Badre, D., Doll, B. B., Long, N. M., & Frank, M. J. (2012) · Neuron · doi:10.1016/j.neuron.2011.12.025 · Cited by 316
A Dual Role for Prediction Error in Associative Learning
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn161 · Cited by 306
Self-citationVisualization of Group Inference Data in Functional Neuroimaging
Gläscher, J. P. (2009) · Neuroinformatics · doi:10.1007/s12021-008-9042-x · Cited by 306
A Neural Representation of Prior Information during Perceptual Inference
Summerfield, C., & Koechlin, É. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.021 · Cited by 311
Striatal Prediction Error Modulates Cortical Coupling
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304
Self-citationHaruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300
“, 2001) and putamen (McClure et al., 2003; O’Doherty et al., 2003) is correlated with the reward prediction error.”
BackgroundGame theory and neural basis of social decision making
Lee, D. (2008) · Nature Neuroscience · doi:10.1038/nn2065 · Cited by 316
Pfeifer, J. H., Masten, C. L., Moore, W. E., Oswald, T. M., Mazziotta, J. C., Iacoboni, M., & Dapretto, M. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.019 · Cited by 294
Emotion and decision-making: affect-driven belief systems in anxiety and depression
Paulus, M. P., & Yu, A. J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.009 · Cited by 287
Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia
Ito, M., & Doya, K. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.6157-08.2009 · Cited by 284
Progress and challenges in probing the human brain
Poldrack, R. A., & Farah, M. J. (2015) · Nature · doi:10.1038/nature15692 · Cited by 285
Decoding the neural substrates of reward-related decision making with functional MRI
Hampton, A. N., & O’Doherty, J. P. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0606297104 · Cited by 285
Self-citationInteroception and drug addiction
Paulus, M. P., & Stewart, J. L. (2014) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.07.002 · Cited by 281
Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways
Rilling, J. K., Sanfey, A. G., Aronson, J. A., Nystrom, L. E., & Cohen, J. D. (2004) · NeuroReport · doi:10.1097/00001756-200411150-00022 · Cited by 281
Nucleus accumbens and impulsivity
Başar, K., Sesia, T., Groenewegen, H. J., Steinbusch, H. W. M., Visser-Vandewalle, V. E. R. M., & Temel, Y. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.08.007 · Cited by 289
Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors
Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., & Hallett, M. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.027 · Cited by 280
Self-citationStriatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277
Self-citationvan den Bos, W., Cohen, M. X., Kahnt, T., & Crone, E. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr198 · Cited by 276
Dopamine restores reward prediction errors in old age
Chowdhury, R., Guitart‐Masip, M., Lambert, C., Dayan, P., Huys, Q. J. M., Düzel, E., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3364 · Cited by 267
Self-citationLateral habenula neurons signal errors in the prediction of reward information
Bromberg-Martin, E. S., & Hikosaka, O. (2011) · Nature Neuroscience · doi:10.1038/nn.2902 · Cited by 275
Sucrose activates human taste pathways differently from artificial sweetener
Frank, G. K. W., Oberndorfer, T. A., Simmons, A. N., Paulus, M. P., Fudge, J. L., Yang, T. T., & Kaye, W. H. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.061 · Cited by 274
Davidow, J. Y., Foerde, K., Galván, A., & Shohamy, D. (2016) · Neuron · doi:10.1016/j.neuron.2016.08.031 · Cited by 286
Action versus valence in decision making
Guitart-Masip, M., Duzel, E., Dolan, R., & Dayan, P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.003 · Cited by 270
Self-citationHuman Midbrain Sensitivity to Cognitive Feedback and Uncertainty During Classification Learning
Aron, A. R., Shohamy, D., Clark, J. A., Myers, C. E., Gluck, M. A., & Poldrack, R. A. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01209.2003 · Cited by 276
Tindell, A. J., Berridge, K. C., Zhang, J., Peciña, S., & Aldridge, J. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04411.x · Cited by 268
Neural signature of fictive learning signals in a sequential investment task
Lohrenz, T. M., McCabe, K., Camerer, C. F., & Montague, P. R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0608842104 · Cited by 276
The Cognitive Neuroscience of Human Decision Making: A Review and Conceptual Framework
Fellows, L. K. (2004) · Behavioral and Cognitive Neuroscience Reviews · doi:10.1177/1534582304273251 · Cited by 285
de Araújo, I. E., Schatzker, M., & Small, D. M. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011643 · Cited by 276
Blunted response to feedback information in depressive illness
Steele, J. D., Kumar, P., & Ebmeier, K. P. (2007) · Brain · doi:10.1093/brain/awm150 · Cited by 261
What is reinforced by phasic dopamine signals?
Redgrave, P., GURNEY, K. N., & Reynolds, J. N. J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 261
Neural systems subserving valence and arousal during the experience of induced emotions.
Colibazzi, T., Posner, J. E., Wang, Z., Gorman, D. A., Gerber, A. J., Yu, S., Hongtu Zhu, B., Kangarlu, A., Duan, Y., Russell, J. A., et al. (2010) · Emotion · doi:10.1037/a0018484 · Cited by 281
Prefrontal Cortex Fails to Learn from Reward Prediction Errors in Alcohol Dependence
Park, S. Q., Kahnt, T., Beck, A., Cohen, M. X., Dolan, R. J., Wrase, J., & Heinz, A. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5587-09.2010 · Cited by 263
Self-citationA neural network model of the structure and dynamics of human personality.
Read, S. J., Monroe, B. M., Brownstein, A. L., Yang, Y., Chopra, G., & Miller, L. C. (2010) · Psychological Review · doi:10.1037/a0018131 · Cited by 257
The social brain and reward: Social information processing in the human striatum
Bhanji, J. P., & Delgado, M. R. (2014) · WIREs Cognitive Science · doi:10.1002/wcs.1266 · Cited by 256
Valence and salience contribute to nucleus accumbens activation
Cooper, J. C., & Knutson, B. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.009 · Cited by 256
Finger, E. C., Marsh, A. A., Blair, K. S., Reid, M. E., Sims, C., Ng, P., Pine, D. S., & Blair, J. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10010129 · Cited by 261
Using Neural Data to Test a Theory of Investor Behavior: An Application to Realization Utility
Frydman, C., Barberis, N., Camerer, C. F., Bossaerts, P. L., & Rangel, A. (2013) · The Journal of Finance · doi:10.1111/jofi.12126 · Cited by 249
Düzel, E., Bunzeck, N., Guitart-Masip, M., & Düzel, S. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.08.006 · Cited by 249
Rogers, R. D. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.165 · Cited by 262
Motivation-dependent responses in the human caudate nucleus.
Delgado, M. R. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh062 · Cited by 246
Emmert, K., Kopel, R., Sulzer, J., Brühl, A. B., Berman, B. D., Linden, D. E. J., Horovitz, S. G., Breimhorst, M., Caria, A., Frank, S., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.042 · Cited by 245
Testing the Reward Prediction Error Hypothesis with an Axiomatic Model
Rutledge, R. B., Dean, M., Caplin, A., & Glimcher, P. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1747-10.2010 · Cited by 244
Critical Roles for Anterior Insula and Dorsal Striatum in Punishment-Based Avoidance Learning
Palminteri, S., Justo, D., Jauffret, C., Pavlicek, B., Dauta, A., Delmaire, C., Czernecki, V., Karachi, C., Capelle, L., Dürr, A., et al. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.017 · Cited by 237
Separate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241
Liu, X., Powell, D. K., Wang, H., Gold, B. T., Corbly, C. R., & Joseph, J. E. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.5227-06.2007 · Cited by 242
The neurobiology of punishment
Seymour, B., Singer, T., & Dolan, R. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2119 · Cited by 240
Self-citationPsychopathy, frustration, and reactive aggression: The role of ventromedial prefrontal cortex
Blair, J. (2009) · British Journal of Psychology · doi:10.1348/000712609x418480 · Cited by 258
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 248
Distorted Cognitive Processes in Major Depression: A Predictive Processing Perspective
Κube, T., Schwarting, R. K. W., Rozenkrantz, L., Glombiewski, J. A., & Rief, W. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.07.017 · Cited by 257
Rolls, E. T., McCabe, C., & Redouté, J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm097 · Cited by 251
Food for thought: hedonic experience beyond homeostasis in the human brain
Kringelbach, M. L. (2004) · Neuroscience · doi:10.1016/j.neuroscience.2004.04.035 · Cited by 236
Expectancies as core features of mental disorders
Rief, W., Glombiewski, J. A., Gollwitzer, M., Schubö, A., Schwarting, R. K. W., & Thorwart, A. (2015) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000184 · Cited by 235
Does the orbitofrontal cortex signal value?
Schoenbaum, G., Takahashi, Y., Liu, T., & McDannald, M. A. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06210.x · Cited by 232
Delvecchio, G., Fossati, P., Boyer, P., Brambilla, P., Falkai, P., Gruber, O., Hietala, J. A., Lawrie, S. M., Martinot, J., McIntosh, A. M., et al. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.07.003 · Cited by 234
Chase, H. W., Kumar, P., Eickhoff, S. B., & Dombrovski, A. Y. (2015) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-015-0338-7 · Cited by 242
Computational Principles of Supervised Learning in the Cerebellum
Raymond, J. L., & Medina, J. F. (2018) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-080317-061948 · Cited by 245
Glutamatergic model psychoses: prediction error, learning, and inference
Corlett, P. R., Honey, G. D., Krystal, J. H., & Fletcher, P. C. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.163 · Cited by 229
Clatworthy, P. L., Lewis, S. J. G., Brichard, L., Hong, Y. T., Izquierdo, D., Clark, L., Cools, R., Aigbirhio, F. I., Baron, J.-C., Fryer, T. D., et al. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3266-08.2009 · Cited by 229
From prediction error to psychosis: Ketamine as a pharmacological model of delusions
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881107077716 · Cited by 227
Art for reward's sake: Visual art recruits the ventral striatum
Lacey, S., Hagtvedt, H., Patrick, V. M., Anderson, A., Stilla, R. F., Deshpande, G., Hu, X. P., Sato, J. R., Reddy, S. K., & Sathian, K. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.027 · Cited by 236
Repetition suppression: a means to index neural representations using BOLD?
Barron, H. C., Garvert, M. M., & Behrens, T. E. J. (2016) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2015.0355 · Cited by 229
The formation of abnormal associations in schizophrenia: Neural and behavioral evidence
Jensen, J., Willeit, M., Zipursky, R. B., Savina, I., Smith, A. J., Menon, M., Crawley, A. P., & Kapur, S. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301437 · Cited by 225
Jarbo, K., & Verstynen, T. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2636-14.2015 · Cited by 228
A functional neuroimaging study of motivation and executive function
Taylor, S. F., Welsh, R. C., Wager, T. D., Luan Phan, K., Fitzgerald, K. D., & Gehring, W. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.032 · Cited by 222
Behaviour Centred Design: towards an applied science of behaviour change
Aunger, R. V., & Curtis, V. A. (2016) · Health Psychology Review · doi:10.1080/17437199.2016.1219673 · Cited by 234
How Humans Integrate the Prospects of Pain and Reward during Choice
Talmi, D., Dayan, P., Kiebel, S. J., Frith, C., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2026-09.2009 · Cited by 239
Self-citationApproaches to analysis in model-based cognitive neuroscience
Turner, B. M., Forstmann, B. U., Love, B. C., Palmeri, T. J., & van Maanen, L. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.01.001 · Cited by 230
Mitchell, D. G. V. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.10.030 · Cited by 234
Guitart-Masip, M., Fuentemilla, L., Bach, D. R., Huys, Q. J. M., Dayan, P., Dolan, R. J., & Duzel, E. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6376-10.2011 · Cited by 216
Self-citationInstructional control of reinforcement learning: A behavioral and neurocomputational investigation
Doll, B. B., Jacobs, W. J., Sanfey, A. G., & Frank, M. J. (2009) · Brain Research · doi:10.1016/j.brainres.2009.07.007 · Cited by 218
Metadata
- Authors
- O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J.
- Affiliations
- Gatsby Computational Neuroscience Unit (GB)
- UCL Queen Square Institute of Neurology (GB)
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2003-04
- Volume
- 38
- Issue
- 2
- Pages
- 329-337
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2007414406
- Cited by
- 1,522
- References
- 36
- Citations by year
- 2026: 51 · 2025: 50 · 2024: 51 · 2023: 46 · 2022: 53 · 2021: 55 · 2020: 54 · 2019: 64 · 2018: 87 · 2017: 65 · 2016: 97 · 2015: 71 · 2014: 70 · 2013: 93 · 2012: 97
- FWCI
- 17.96
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Wellcome Trust
- Gatsby Charitable Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- temporal difference learning, prediction error signal, classical conditioning, appetitive conditioning, reward prediction, ventral striatum, orbitofrontal cortex, conditioned stimulus, human brain
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Conditioning, Classical, Corpus Striatum, Female, Frontal Lobe, Humans, Learning, Magnetic Resonance Imaging, Male, Reference Values, Reflex, Pupillary, Reward, Taste, Time Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
