The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Temporal Difference Models and Reward-Related Learning in the Human Brain
Open accessAbstract
Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, the signed prediction error indicates whether an outcome is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions [14–21].”
From Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis (2021) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Many early fMRI studies into prediction errors used model-free accounts in Pavlovian paradigms and located prediction errors in striatal BOLD (Berns et al., 2001; O’Doherty, 2004; O’Doherty et al., 2003; Haruno et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as O’Doherty et al., 2003
In the citing paper
“These changes in striatum BOLD activity coincide with the process of learning how to predict rewards 15, 16 – an observation supported by electrophysiological properties of its dopaminergic afferents.”
From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [15]
In the citing paper
“human fMRI studies have found that VS activity correlates with RPEs during tasks that feature exclusively Pavlovian reward associations [27,28]”
From Contributions of the striatum to learning, motivation, and performance: an associative account (2012) · cites this paper as [28]
In the citing paper
“Pupillary response dynamics are thought to reflect multiple different features, including sensory cues36,37, arousal/task engagement38,39, motor activity40,41, and motivation42,43.”
From Revealing abrupt transitions from goal-directed to habitual behavior (2026) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationRescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Spatial registration and normalization of images
Friston, K. J., Ashburner, J., Frith, C., Poline, J.-B., Heather, J. D., & Frackowiak, R. S. J. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030303 · Cited by 3,744
Self-citationPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Cited by
Sorted by citations
Items 601–700 of 1,002
Error detection in the stop signal task
Chevrier, A., & Schachar, R. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.056 · Cited by 51
Neurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cohen, M. X. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.2.113 · Cited by 51
Köhler, S., Bär, K., & Wagner, G. (2016) · Human Brain Mapping · doi:10.1002/hbm.23173 · Cited by 57
Towards a neuro-computational account of prism adaptation
Petitet, P., O’Reilly, J. X., & O’Shea, J. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.12.021 · Cited by 53
Schaefer, L. M., & STEINGLASS, J. E. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-020-01213-9 · Cited by 51
Prediction of Immediate and Future Rewards Differentially Recruits Cortico-Basal Ganglia Loops
Tanaka, S., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2016) · Springer eBooks · doi:10.1007/978-4-431-55402-8_22 · Cited by 52
Dopaminergic Modulation of Appetitive and Aversive Predictive Learning
Iordanova, M. D. (2009) · Reviews in the Neurosciences · doi:10.1515/revneuro.2009.20.5-6.383 · Cited by 50
Learning progress mediates the link between cognitive effort and task engagement
Sayalı, C., Heling, E., & Cools, R. (2023) · Cognition · doi:10.1016/j.cognition.2023.105418 · Cited by 57
Shao, R., Read, J., Behrens, T. E. J., & Rogers, R. D. (2013) · Translational Psychiatry · doi:10.1038/tp.2012.134 · Cited by 50
Adaptive coding of reward prediction errors is gated by striatal coupling
Park, S. Q., Kahnt, T., Talmi, D., Rieskamp, J., Dolan, R. J., & Heekeren, H. R. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119969109 · Cited by 51
Self-citationSensitivity of the nucleus accumbens to violations in expectation of reward
Spicer, J., Galván, A., Hare, T. A., Voss, H. U., Glover, G. H., & Casey, B. J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.012 · Cited by 52
Prediction error and somatosensory insula activation in women recovered from anorexia nervosa
Frank, G., Collier, S., Shott, M. E., & O’Reilly, R. C. (2016) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.150103 · Cited by 50
Tummeltshammer, K. S., Feldman, E. C. H., & Amso, D. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.12.006 · Cited by 52
Unconscious reinforcement learning of hidden brain states supported by confidence
Cortese, A., Lau, H. C., & Kawato, M. (2020) · Nature Communications · doi:10.1038/s41467-020-17828-8 · Cited by 54
Environmentally significant behavior in the home
Stern, P. C. (2008) · The Cambridge Handbook of Psychology and Economic Behaviour · doi:10.1017/cbo9780511490118.015 · Cited by 50
Luque, D., López, F. J., Marco‐Pallarés, J., Càmara, E., & Rodríguez‐Fornells, A. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00145 · Cited by 52
Striatal and Medial Temporal Lobe Functional Interactions during Visuomotor Associative Learning
Mattfeld, A. T., & Stark, C. E. L. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq144 · Cited by 49
Liu, X., & Scheidt, R. A. (2008) · Journal of Neurophysiology · doi:10.1152/jn.01044.2007 · Cited by 49
Factor analysis linking functions for simultaneously modeling neural and behavioral data
Turner, B. M., Wang, T., & Merkle, E. C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.03.044 · Cited by 49
Mathar, D., Neumann, J., Villringer, A., & Horstmann, A. (2017) · Cortex · doi:10.1016/j.cortex.2017.08.022 · Cited by 49
Orbitofrontal neurons signal reward predictions, not reward prediction errors
Stalnaker, T. A., Liu, T., Takahashi, Y. K., & Schoenbaum, G. M. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.01.013 · Cited by 55
Paulus, M. P., Feinstein, J. S., Tapert, S. F., & Liu, T. T. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.060 · Cited by 50
Predictive processing models and affective neuroscience
Lee, K. M., Ferreira‐Santos, F., & Satpute, A. B. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.09.009 · Cited by 53
Aging, uncertainty, and decision making—A review
Frank, C. C., & Seaman, K. L. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01064-w · Cited by 60
A Developmental Study of the Neural Circuitry Mediating Motor Inhibition in Bipolar Disorder
Weathers, J., Stringaris, A. K., Deveney, C. M., Brotman, M. A., Zarate, C. A., Connolly, M. E., Fromm, S. J., LeBourdais, S. B., Pine, D. S., & Leibenluft, E. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.11081244 · Cited by 49
Brain Systems for Probabilistic and Dynamic Prediction: Computational Specificity and Integration
O’Reilly, J. X., Jbabdi, S., Rushworth, M. F. S., & Behrens, T. E. J. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001662 · Cited by 49
Electrophysiology of appetitive taste and appetitive taste conditioning in humans
Franken, I. H. A., Huijding, J., Nijs, I. M. T., & Strien, J. W. V. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.12.008 · Cited by 48
Adolescents Adapt More Slowly than Adults to Varying Reward Contingencies
Javadi, A., Schmidt, D. H. K., & Smolka, M. N. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00677 · Cited by 48
“Chasing the first high”: memory sampling in drug choice
Bornstein, A. M., & Pickard, H. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-019-0594-2 · Cited by 51
Corlett, P. R. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.053.2009 · Cited by 50
l-DOPA changes ventral striatum recruitment during motor sequence learning in Parkinson's disease
Kwak, Y., Müller, M. L. T. M., Bohnen, N. I., Dayalu, P., & Seidler, R. D. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.02.006 · Cited by 46
Reinforcement learning signals in the anterior cingulate cortex code for others’ false beliefs
Apps, M. A. J., Green, R., & Ramnani, N. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.010 · Cited by 50
Gorrell, S., Shott, M. E., & Frank, G. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2022.108350 · Cited by 50
Reinforcement Learning and Tourette Syndrome
Palminteri, S., & Pessiglione, M. (2013) · International review of neurobiology · doi:10.1016/b978-0-12-411546-0.00005-6 · Cited by 47
Bellebaum, C., Jokisch, D., Gizewski, E. R., Forsting, M., & Daum, I. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.10.042 · Cited by 47
An MEG signature corresponding to an axiomatic model of reward prediction error
Talmi, D., Fuentemilla, L., Vladimir Litvak, A., Düzel, E., & Dolan, R. J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.051 · Cited by 53
Self-citationPerceptual learning alters post-sensory processing in human decision-making
Diaz, J. A., Queirazza, F., & Philiastides, M. G. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0035 · Cited by 46
Greenberg, T., Fournier, J. C. J., Stiffler, R. S., Chase, H. W., Almeida, J., Aslam, H. A., Deckersbach, T., Cooper, C. M., Toups, M. S. P., Carmody, T., et al. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0490-5 · Cited by 48
Value-free reinforcement learning: policy optimization as a minimal model of operant behavior
Bennett, D., Niv, Y., & Langdon, A. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.04.020 · Cited by 48
Pupillary Motility: Bringing Neuroscience to the Psychiatry Clinic of the Future
Graur, S., & Siegle, G. J. (2013) · Current Neurology and Neuroscience Reports · doi:10.1007/s11910-013-0365-0 · Cited by 47
Reward feedback processing in children and adolescents: medial frontal theta oscillations
Crowley, M. J., van Noordt, S. J. R., Wu, J., Hommer, R. E., South, M., Fearon, R. M. P., & Mayes, L. C. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2013.11.011 · Cited by 45
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2558-12.2012 · Cited by 45
Self-citationReward Sensitivity Is Associated with Brain Activity during Erotic Stimulus Processing
Costumero, V., Barrós-Loscertales, A., Bustamante, J. C., Ventura-Campos, N., Fuentes, P., Rosell-Negre, P., & Ávila, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066940 · Cited by 45
Network mechanisms of intentional learning
Hampshire, A., Hellyer, P. J., Parkin, B., Hiebert, N. M., MacDonald, P. A., Owen, A. M., Leech, R., & Rowe, J. B. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.11.060 · Cited by 44
A ventral striatal prediction error signal in human fear extinction learning
Thiele, M., Yuen, K. S. L., Gerlicher, A. M. V., & Kalisch, R. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117709 · Cited by 46
Neuroeconomics: a view from neuroscience.
Montague, P. R. (2007) · PubMed · Cited by 44
Hippocampus Guides Adaptive Learning during Dynamic Social Interactions
FeldmanHall, O., Montez, D. F., Phelps, E. A., Davachi, L., & Murty, V. P. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0873-20.2020 · Cited by 47
Approach–withdrawal and the role of the striatum in the temperament of behavioral inhibition.
Helfinstein, S. M., Fox, N. A., & Pine, D. S. (2011) · Developmental Psychology · doi:10.1037/a0026402 · Cited by 45
The Neuroscience Behind the Stock Market's Reaction to Corporate Earnings News
Barton, J., Berns, G. S., & Brooks, A. M. (2014) · The Accounting Review · doi:10.2308/accr-50841 · Cited by 45
Social impact and governance of AI and neurotechnologies
Doya, K., Ema, A., Kitano, H., Sakagami, M., & Russell, S. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.05.012 · Cited by 47
Conflict Monitoring in Cognition-Emotion Competition.
McClure, S. M., Botvinick, M., Yeung, N., Greene, J. D., & Cohen, J. D. (2007) · Cited by 44
Geddes, R. I., Han, L., Baldwin, A. E., Norgren, R., & Grigson, P. S. (2008) · Behavioral Neuroscience · doi:10.1037/a0012748 · Cited by 43
Piero, L. B. D., Saxbe, D., & Margolin, G. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2016.03.005 · Cited by 49
Besharati, S. N., Forkel, S. J., Kopelman, M. D., Solms, M., Jenkinson, P. M., & Fotopoulou, A. (2014) · Cortex · doi:10.1016/j.cortex.2014.08.016 · Cited by 46
Efficient statistics, common currencies and the problem of reward-harvesting
Montague, P. R., & King‐Casas, B. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.10.002 · Cited by 43
Insights from spatially mapped gene expression in the mouse brain
Sunkin, S. M., & Hohmann, J. G. (2007) · Human Molecular Genetics · doi:10.1093/hmg/ddm183 · Cited by 41
Remembering forward: Neural correlates of memory and prediction in human motor adaptation
Scheidt, R. A., Zimbelman, J. L., Salowitz, N. M. G., Suminski, A. J., Mosier, K. M., Houk, J., & Simo, L. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.072 · Cited by 42
Changes in corticostriatal connectivity during reinforcement learning in humans
Horga, G., Maia, T. V., Marsh, R., Hao, X., Xu, D., Duan, Y., Tau, G. Z., Graniello, B., Wang, Z., Kangarlu, A., et al. (2014) · Human Brain Mapping · doi:10.1002/hbm.22665 · Cited by 40
Deep and beautiful. The reward prediction error hypothesis of dopamine
Colombo, M. (2013) · Studies in History and Philosophy of Science Part C Studies in History and Philosophy of Biological and Biomedical Sciences · doi:10.1016/j.shpsc.2013.10.006 · Cited by 46
The Influence of Serotonin on Fear Learning
Attar, C. H., Finckh, B., & Büchel, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042397 · Cited by 43
Kline, R. L., Zhang, S., Farr, O. M., Hu, S., Záborszky, L., Samanez-Larkin, G. R., & Li, C. R. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00149 · Cited by 43
Real-world unexpected outcomes predict city-level mood states and risk-taking behavior
Otto, A. R., & Eichstaedt, J. C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0206923 · Cited by 43
Evidence for model-based encoding of Pavlovian contingencies in the human brain
Pauli, W. M., Gentile, G., Collette, S., Tyszka, J. M., & O’Doherty, J. P. (2019) · Nature Communications · doi:10.1038/s41467-019-08922-7 · Cited by 44
Self-citationToyokawa, W., Saito, Y., & Kameda, T. (2016) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2016.11.001 · Cited by 42
Neural predictive error signal correlates with depressive illness severity in a game paradigm
Steele, J. D., Meyer, M. E., & Ebmeier, K. P. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.04.023 · Cited by 42
Corticostriatothalamic reward prediction error signals and executive control in late-life depression
Dombrovski, A. Y., Szanto, K., Clark, L., Aizenstein, H. J., Chase, H. W., Reynolds, C. F., & Siegle, G. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714002517 · Cited by 41
Social feedback promotes positive social sharing, trust, and closeness.
Brudner, E. G., Fareri, D. S., Shehata, S., & Delgado, M. R. (2022) · Emotion · doi:10.1037/emo0001182 · Cited by 52
Peterburs, J., Hofmann, D., Becker, M. P. I., Nitsch, A. M., Miltner, W. H. R., & Straube, T. (2018) · Brain and Cognition · doi:10.1016/j.bandc.2018.07.001 · Cited by 39
Pupil dilation as an implicit measure of appetitive Pavlovian learning
Pietrock, C., Ebrahimi, C., Katthagen, T., Koch, S., Heinz, A., Rothkirch, M., & Schlagenhauf, F. (2019) · Psychophysiology · doi:10.1111/psyp.13463 · Cited by 44
A complementary learning systems approach to temporal difference learning
Blakeman, S., & Mareschal, D. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.10.011 · Cited by 41
Competitive and cooperative interactions between medial temporal and striatal learning systems
Freedberg, M., Toader, A. C., Wassermann, E. M., & Voss, J. L. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107257 · Cited by 40
Pupil dilation as an index of Pavlovian conditioning. A systematic review and meta-analysis
Finke, J. B., Roesmann, K., Stalder, T., & Klucken, T. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.09.005 · Cited by 48
Separate encoding of model-based and model-free valuations in the human brain
Beierholm, U., Anen, C., Quartz, S. R., & Bossaerts, P. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.071 · Cited by 45
Learning affective values for faces is expressed in amygdala and fusiform gyrus
Petrović, P., Kalisch, R., Pessiglione, M., Singer, T., & Dolan, R. J. (2008) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn002 · Cited by 45
Self-citationHuman orbitofrontal cortex signals decision outcomes to sensory cortex during behavioral adaptations
Wang, B., Veismann, M., Banerjee, A., & Pleger, B. (2023) · Nature Communications · doi:10.1038/s41467-023-38671-7 · Cited by 40
Neural Correlates of the Divergence of Instrumental Probability Distributions
Liljeholm, M., Wang, S., Zhang, J., & O’Doherty, J. P. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1353-13.2013 · Cited by 38
Self-citationNeural Evidence for Adaptive Strategy Selection in Value-Based Decision-Making
Gluth, S., Rieskamp, J., & Büchel, C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht049 · Cited by 41
Pupillometry as a Glimpse into the Neurochemical Basis of Human Memory Encoding
Hoffing, R. C., & Seitz, A. R. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00749 · Cited by 40
Extremes of eating are associated with reduced neural taste discrimination
Frank, G., Shott, M. E., Keffler, C., & Cornier, M. (2016) · International Journal of Eating Disorders · doi:10.1002/eat.22538 · Cited by 43
Time of Day Differences in Neural Reward Functioning in Healthy Young Men
Byrne, J. E. M., Hughes, M. E., Rossell, S. L., Johnson, S. L., & Murray, G. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.0918-17.2017 · Cited by 42
Lopez‐Persem, A., Roumazeilles, L., Folloni, D., Marche, K., Fouragnan, E. F., Khalighinejad, N., Rushworth, M. F. S., & Sallet, J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2000759117 · Cited by 38
Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making
He, X., Modirshanechi, A., Lehmann, M. P., Wulfram Gerstner, B., & Herzog, M. H. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009070 · Cited by 49
Parker, N. F., Baidya, A., Cox, J., Haetzel, L. M., Zhukovskaya, A., Murugan, M., Engelhard, B., Goldman, M. S., & Witten, I. B. (2022) · Cell Reports · doi:10.1016/j.celrep.2022.110756 · Cited by 41
Imaging Models of Valuation During Social Interaction in Humans
Kishida, K. T., & Montague, P. R. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.037 · Cited by 41
Ullsperger, M. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.06.009 · Cited by 41
Implicit Value Updating Explains Transitive Inference Performance: The Betasort Model
Jensen, G., Muñoz, F., Alkan, Y., Ferrera, V. P., & Terrace, H. S. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004523 · Cited by 39
Navigating complex decision spaces: Problems and paradigms in sequential choice.
Walsh, M. M., & Anderson, J. R. (2013) · Psychological Bulletin · doi:10.1037/a0033455 · Cited by 41
Ting, C.-C., Yu, C.-C., Maloney, L. T., & Wu, S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3161-14.2015 · Cited by 37
Laricchiuta, D., Petrosini, L., Piras, F., Cutuli, D., Macci, E., Picerni, E., Chiapponi, C., Caltagirone, C., & Spalletta, G. (2013) · Brain Structure and Function · doi:10.1007/s00429-013-0535-5 · Cited by 40
The influence of contextual reward statistics on risk preference
Rigoli, F., Rutledge, R. B., Dayan, P., & Dolan, R. J. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.12.016 · Cited by 39
Self-citationStriatal opioid receptor availability is related to acute and chronic pain perception in arthritis
Brown, C. A., Matthews, J. C., Fairclough, M., McMahon, A. W., Barnett, E., Al-Kaysi, A., El‐Deredy, W., & Jones, A. K. P. (2015) · Pain · doi:10.1097/j.pain.0000000000000299 · Cited by 39
Livesey, E. J., Harris, I. M., & Harris, J. A. (2009) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0014525 · Cited by 40
Characterization of Face-Selective Patches in Orbitofrontal Cortex
Troiani, V., Dougherty, C. C., Michael, A. M., & Olson, I. R. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00279 · Cited by 41
Pérez-Rodríguez, M. M., Hazlett, E. A., Rich, E. L., Ripoll, L. H., Weiner, D. M., Spence, N. Z., Goodman, M. S., Koenigsberg, H. W., Siever, L. J., & New, A. S. (2012) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2012.02.014 · Cited by 41
Learning to like disgust: neuronal correlates of counterconditioning
Schweckendiek, J., Klucken, T., Merz, C. J., Kagerer, S., Walter, B., Vaitl, D., & Stark, R. M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00346 · Cited by 38
Horstmann, A. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2017.04.001 · Cited by 37
Ide, J. S., Nedic, S., Wong, K. F. K., Strey, S. L., Lawson, E. A., Dickerson, B. C., Wald, L. L., Camera, G. L., & Mujica-Parodi, L. R. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.02.035 · Cited by 39
Arienzo, D., Happer, J. P., Molnar, S. M., Alderson‐Myers, A., & Marinković, K. (2019) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00107-6 · Cited by 39
Advances in techniques for imposing reciprocity in brain-behavior relations
Turner, B. M., Palestro, J. J., Miletić, S., & Forstmann, B. U. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.04.018 · Cited by 36
Goals, usefulness and abstraction in value-based choice
Martino, B. D., & Cortese, A. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.11.001 · Cited by 46
Metadata
- Authors
- O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J.
- Affiliations
- Gatsby Computational Neuroscience Unit (GB)
- UCL Queen Square Institute of Neurology (GB)
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2003-04
- Volume
- 38
- Issue
- 2
- Pages
- 329-337
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2007414406
- Cited by
- 1,522
- References
- 36
- Citations by year
- 2026: 51 · 2025: 50 · 2024: 51 · 2023: 46 · 2022: 53 · 2021: 55 · 2020: 54 · 2019: 64 · 2018: 87 · 2017: 65 · 2016: 97 · 2015: 71 · 2014: 70 · 2013: 93 · 2012: 97
- FWCI
- 17.96
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Wellcome Trust
- Gatsby Charitable Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- temporal difference learning, prediction error signal, classical conditioning, appetitive conditioning, reward prediction, ventral striatum, orbitofrontal cortex, conditioned stimulus, human brain
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Conditioning, Classical, Corpus Striatum, Female, Frontal Lobe, Humans, Learning, Magnetic Resonance Imaging, Male, Reference Values, Reflex, Pupillary, Reward, Taste, Time Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
