The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Temporal Difference Models and Reward-Related Learning in the Human Brain
Open accessAbstract
Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, the signed prediction error indicates whether an outcome is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions [14–21].”
From Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis (2021) · cites this paper as [17]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Many early fMRI studies into prediction errors used model-free accounts in Pavlovian paradigms and located prediction errors in striatal BOLD (Berns et al., 2001; O’Doherty, 2004; O’Doherty et al., 2003; Haruno et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as O’Doherty et al., 2003
In the citing paper
“These changes in striatum BOLD activity coincide with the process of learning how to predict rewards 15, 16 – an observation supported by electrophysiological properties of its dopaminergic afferents.”
From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [15]
In the citing paper
“human fMRI studies have found that VS activity correlates with RPEs during tasks that feature exclusively Pavlovian reward associations [27,28]”
From Contributions of the striatum to learning, motivation, and performance: an associative account (2012) · cites this paper as [28]
In the citing paper
“Pupillary response dynamics are thought to reflect multiple different features, including sensory cues36,37, arousal/task engagement38,39, motor activity40,41, and motivation42,43.”
From Revealing abrupt transitions from goal-directed to habitual behavior (2026) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationRescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Spatial registration and normalization of images
Friston, K. J., Ashburner, J., Frith, C., Poline, J.-B., Heather, J. D., & Frackowiak, R. S. J. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030303 · Cited by 3,744
Self-citationPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Dissociation of reward anticipation and outcome with event-related fMRI
Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00016 · Cited by 1,300
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Cited by
Sorted by citations
Items 701–800 of 1,002
Smith, A. J., Becker, S., & Kapur, S. (2005) · Neural Computation · doi:10.1162/0899766053011546 · Cited by 38
Reward anticipation in the adolescent and aging brain
Lorenz, R. C., Gleich, T., Beck, A., Pöhland, L., Raufelder, D., Sommer, W., Rapp, M. A., Kühn, S., & Gallinat, J. (2014) · Human Brain Mapping · doi:10.1002/hbm.22540 · Cited by 37
Temporal prediction errors modulate cingulate–insular coupling
Limongi, R., Sutherland, S. C., Zhu, J. M., Young, M. E., & Habib, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.12.078 · Cited by 34
Jessup, R. K., & O’Doherty, J. P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6421-10.2011 · Cited by 39
Self-citationElfwing, S., & Seymour, B. (2017) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2017.8329799 · Cited by 37
Gain and Loss Learning Differentially Contribute to Life Financial Outcomes
Knutson, B. D., Samanez-Larkin, G. R., & Kuhnen, C. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024390 · Cited by 37
A selective emotional decision-making bias elicited by facial expressions
Furl, N., Gallagher, S., & Averbeck, B. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033461 · Cited by 36
Sethi, A., Voon, V., Critchley, H. D., Cercignani, M., & Harrison, N. A. (2018) · Brain · doi:10.1093/brain/awy048 · Cited by 36
Self-citationSands, L. P., Jiang, A., Liebenow, B., DiMarco, E. K., Laxton, A. W., Tatter, S. B., Montague, P. R., & Kishida, K. T. (2023) · Science Advances · doi:10.1126/sciadv.adi4927 · Cited by 39
Working Memory and Anticipatory Set Modulate Midbrain and Putamen Activity
Yu, Y., FitzGerald, T. H. B., & Friston, K. J. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1176-13.2013 · Cited by 38
Self-citationRecent Advances in Neuroimaging to Model Eating Disorder Neurobiology
Frank, G. (2015) · Current Psychiatry Reports · doi:10.1007/s11920-015-0559-z · Cited by 36
Value and probability coding in a feedback-based learning task utilizing food rewards
Tricomi, E. M., & Lempert, K. M. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00086.2014 · Cited by 38
Learning offline: memory replay in biological and artificial reinforcement learning
Roscow, E. L., Chua, R., Costa, R. P., Jones, M. W., & Lepora, N. (2021) · Trends in Neurosciences · doi:10.1016/j.tins.2021.07.007 · Cited by 36
Neural systems approaches to the neurogenetics of autism spectrum disorders
Piggot, J., Shirinyan, D., Shemmassian, S. K., Vazirian, S., & Alarcón, M. G. C. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.05.054 · Cited by 36
Different Ways of Linking Behavioral and Neural Data via Computational Cognitive Models
de Hollander, G., Forstmann, B. U., & Brown, S. D. (2015) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2015.11.004 · Cited by 35
Dynamic Functional Connectivity Strength Within Different Frequency-Band in Schizophrenia
Luo, Y., He, H., Duan, M., Huang, H., Hu, Z., Wang, H., Yao, G., Yao, D., Li, J., & Luo, C. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00995 · Cited by 34
Network architectures supporting learnability
Zurn, P., & Bassett, D. S. (2020) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2019.0323 · Cited by 31
Priming for self-esteem influences the monitoring of one’s own performance
Bengtsson, S., Dolan, R. J., & Passingham, R. E. (2010) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq048 · Cited by 37
Self-citationBOLD and its connection to dopamine release in human striatum: a cross-cohort comparison
Lohrenz, T. M., Kishida, K. T., & Montague, P. R. (2016) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2015.0352 · Cited by 33
Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning
Ballard, I. C., Miller, E. M., Piantadosi, S. T., Goodman, N. D., & McClure, S. M. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx259 · Cited by 34
Sankar, A., Yttredahl, A. A., Fourcade, E. W., Mickey, B. J., Love, T., Langenecker, S. A., & Hsu, D. T. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00149 · Cited by 36
The emergence of saliency and novelty responses from Reinforcement Learning principles
Laurent, P. A. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.09.004 · Cited by 35
Expectation mismatch: Differences between self-generated and cue-induced expectations
Gaschler, R., Schwager, S., Umbach, V. J., Frensch, P. A., & Schubert, T. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.06.009 · Cited by 36
A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders
Story, G. W., Moutoussis, M., & Dolan, R. J. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01948 · Cited by 35
Self-citationWealth, consumption and happiness
Ahuvia, A. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.009 · Cited by 34
Economic theory and Psychological Data: Bridging the Divide
Caplin, A. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195328318.003.0015 · Cited by 34
Pool, E. R., Munoz Tord, D., Delplanque, S., Stussi, Y., Cereghetti, D., Vuilleumier, P., & Sander, D. (2022) · The Journal of Neuroscience · doi:10.1523/jneurosci.1124-21.2022 · Cited by 33
Reward Activates Stimulus-Specific and Task-Dependent Representations in Visual Association Cortices
Schiffer, A., Müller, T., Yeung, N., & Waszak, F. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.1640-14.2014 · Cited by 33
Risk Prediction Error Coding in Orbitofrontal Neurons
O’Neill, M. J., & Schultz, W. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4236-12.2013 · Cited by 35
Integrating explanations of tax evasion and avoidance
Braithwaite, V. A., & Wenzel, M. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.013 · Cited by 33
Baik, K., Cha, J., Ham, J. H., Baek, G.-M., Sunwoo, M. K., Hong, J. Y., Shin, N., Kim, J. S., Lee, J., Lee, S., et al. (2014) · Human Brain Mapping · doi:10.1002/hbm.22561 · Cited by 33
Reinforcement, Dopamine and Rodent Models in Drug Development for ADHD
Tripp, G., & Wickens, J. R. (2012) · Neurotherapeutics · doi:10.1007/s13311-012-0132-y · Cited by 36
Prediction errors to emotional expressions: the roles of the amygdala in social referencing
Meffert, H., Brislin, S. J., White, S. F., & Blair, J. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu085 · Cited by 33
Dynamics of Prefrontal and Cingulate Activity during a Reward-Based Logical Deduction Task
Landmann, C., Dehaene, S., Pappatà, S., Jobert, A., Bottlaender, M., Roumenov, D., & Bihan, D. L. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhk028 · Cited by 35
Motor Preparatory Activity in Posterior Parietal Cortex is Modulated by Subjective Absolute Value
Iyer, A., Lindner, A., Kagan, I., & Andersen, R. A. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000444 · Cited by 32
Principles of Neuronal Integration and Defense Mechanisms: Neuropsychoanalytic Hypothesis
Northoff, G., & Boeker, H. (2006) · Neuropsychoanalysis · doi:10.1080/15294145.2006.10773514 · Cited by 32
Thermal taster status: Evidence of cross-modal integration
Hort, J., Ford, R. A., Eldeghaidy, S., & Francis, S. (2016) · Human Brain Mapping · doi:10.1002/hbm.23171 · Cited by 32
Functional connectivity between prefrontal cortex and striatum estimated by phase locking value
Zhang, Y., Pan, X., Wang, R., & Sakagami, M. (2016) · Cognitive Neurodynamics · doi:10.1007/s11571-016-9376-2 · Cited by 33
Behind binge eating: A review of food-specific adaptations of neurocognitive and neuroimaging tasks
Berner, L. A., Winter, S. R., Matheson, B. E., Benson, L., & Lowe, M. R. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2017.03.037 · Cited by 36
Colas, J. T., Pauli, W. M., Larsen, T., Tyszka, J. M., & O’Doherty, J. P. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005810 · Cited by 30
Self-citationDissociable roles of left and right temporoparietal junction in strategic competitive interaction
Ogawa, A., & Kameda, T. (2019) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsz082 · Cited by 35
Lynn, S. K., Wormwood, J. B., Barrett, L. F., & Quigley, K. S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00952 · Cited by 39
Cognitive-Emotion Interactions
Armony, J. L., & Vuilleumier, P. O. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511843716.018 · Cited by 33
Dunsmoor, J. E., & LaBar, K. S. (2012) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2012.02.003 · Cited by 32
Striatal action-learning based on dopamine concentration
Morris, G., Schmidt, R., & Bergman, H. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2060-6 · Cited by 32
Insel, C., Reinen, J., Weber, J., Wager, T. D., Jarskog, L. F., Shohamy, D., & Smith, E. E. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0261-3 · Cited by 35
The Trouble with Choice: Studying Decision Variables in the Brain
Corrado, G. S., Sugrue, L. P., Brown, J., & Newsome, W. T. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00030-0 · Cited by 36
The Neurobiological Foundations of Valuation in Human Decision Making Under Uncertainty
Bossaerts, P. L., Preuschoff, K., & Hsu, M. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00023-3 · Cited by 32
Reward Inference by Primate Prefrontal and Striatal Neurons
Pan, X., Fan, H., Sawa, K., Tsuda, I., Tsukada, M., & Sakagami, M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.2263-13.2014 · Cited by 30
The neurophysiological basis of reward effects on backward inhibition processes
Zhang, R., Stock, A., & Beste, C. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.05.080 · Cited by 31
Byrne, J. E. M., Tremain, H., Leitan, N., Keating, C., Johnson, S. L., & Murray, G. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.01.025 · Cited by 32
One-shot learning and behavioral eligibility traces in sequential decision making
Lehmann, M. P., He, X., Liakoni, V., Herzog, M. H., Wulfram Gerstner, B., & Preuschoff, K. (2019) · eLife · doi:10.7554/elife.47463 · Cited by 29
Neural mechanisms underlying the hierarchical construction of perceived aesthetic value
Iigaya, K., Yi, S., Wahle, I. A., Tanwisuth, S., Cross, L., & O’Doherty, J. P. (2023) · Nature Communications · doi:10.1038/s41467-022-35654-y · Cited by 40
Self-citationBraunlich, K., & Seger, C. A. (2012) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1217 · Cited by 33
Decision Utility, Incentive Salience, and Cue-Triggered “Wanting”
Berridge, K. C., & Aldridge, J. W. (2008) · Oxford University Press eBooks · doi:10.1093/oso/9780195309980.003.0024 · Cited by 33
Neural mechanisms underlying context-dependent shifts in risk preferences
Vermeer, A. B. L., Boksem, M. A. S., & Sanfey, A. G. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.09.054 · Cited by 34
Neural evidence for description dependent reward processing in the framing effect
Yu, R., & Zhang, P. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00056 · Cited by 31
Neural correlates of appetitive extinction in humans
Kruse, O., León, I. T., Stark, R. M., & Klucken, T. (2016) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw157 · Cited by 30
Reduced reward-related probability learning in schizophrenia patients
Yılmaz, A., Şimşek, & Gönül, A. S. (2012) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s26243 · Cited by 31
The Dopaminergic Midbrain Mediates an Effect of Average Reward on Pavlovian Vigor
Rigoli, F., Chew, B., Dayan, P., & Dolan, R. J. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00972 · Cited by 30
Self-citationYeung, A. W. K. (2018) · Chemosensory Perception · doi:10.1007/s12078-018-9243-0 · Cited by 31
Fractionating adaptive learning: A meta-analysis of the reversal learning paradigm
Yaple, Z. A., & Yu, R. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.04.006 · Cited by 28
Jepma, M., Roy, M., Ramlakhan, K., van Velzen, M., & Dahan, A. (2022) · eLife · doi:10.7554/elife.74149 · Cited by 28
Neural coding of computational factors affecting decision making
Dreher, J. (2013) · Progress in brain research · doi:10.1016/b978-0-444-62604-2.00016-2 · Cited by 29
Reinforcement learning in young adults with developmental language impairment
Lee, J. C., & Tomblin, J. B. (2012) · Brain and Language · doi:10.1016/j.bandl.2012.07.009 · Cited by 30
Prefrontal-hippocampal dynamics involved in learning regularities across episodes
Doeller, C. F., Opitz, B., Krick, C. M., Mecklinger, A., & Reith, W. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh211 · Cited by 30
Model-based reinforcement learning under concurrent schedules of reinforcement in rodentsPreprint
Huh, N., Jo, S., Kim, H., Sul, J. H., & Jung, M. W. (2009) · Learning & Memory · doi:10.1101/lm.1295509 · Cited by 31
Computational Underpinnings of Neuromodulation in HumansPreprint
Montague, P. R., & Kishida, K. T. (2018) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2018.83.038166 · Cited by 27
Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality
Ognibene, D., Fiore, V. G., & Gu, X. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.022 · Cited by 29
Reward and Attentional Control in Visual Search
Yantis, S., Anderson, B. A., Wampler, E. K., & Laurent, P. A. (2012) · Nebraska Symposium on Motivation/The Nebraska symposium on motivation · doi:10.1007/978-1-4614-4794-8_5 · Cited by 34
Functional connectivity and grey matter volume of the striatum in schizophrenia
Koch, K., Rus, O. G., Reeß, T. J., Schachtzabel, C., Wagner, G., Schultz, C. C., Sorg, C., & Schlösser, R. G. M. (2014) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.113.138099 · Cited by 29
Reversal learning strategy in adolescence is associated with prefrontal cortex activation
Boehme, R., Lorenz, R. C., Gleich, T., Romund, L., Pelz, P., Golde, S., Flemming, E., Wold, A., Deserno, L., Behr, J., et al. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13401 · Cited by 28
Occipital and orbitofrontal hemodynamics during naturally paced reading: An fNIRS study
Hofmann, M., Dambacher, M., Jacobs, A. M., Kliegl, R. M., Radach, R. R., Kuchinke, L., Plichta, M. M., Fallgatter, A. J., & Herrmann, M. J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.014 · Cited by 28
Valence precedes value in neural encoding of prediction error
Stewardson, H. J., & Sambrook, T. D. (2023) · Psychophysiology · doi:10.1111/psyp.14266 · Cited by 28
Skatova, A., Chan, P. A., & Daw, N. D. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00525 · Cited by 33
Neurobiological processes during the Cambridge gambling task
Yazdi, K., Rumetshofer, T., Gnauer, M., Csillag, D., Rosenleitner, J., & Kleiser, R. (2018) · Behavioural Brain Research · doi:10.1016/j.bbr.2018.08.017 · Cited by 28
Kvamme, T. L., Pedersen, M. U., Overgaard, M. S., Thomsen, K. R., & Voon, V. (2019) · Psychopharmacology · doi:10.1007/s00213-018-5131-1 · Cited by 28
Tomasi, D. G., Wang, G., Studentsova, Y., & Volkow, N. D. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu269 · Cited by 29
A model of food reward learning with dynamic reward exposure
Hammond, R. A., Ornstein, J. T., Fellows, L. K., Dubé, L., Levitan, R. D., & Dagher, A. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00082 · Cited by 28
Jessup, R. K., & O’Doherty, J. P. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12625 · Cited by 29
Self-citationO’Doherty, J. P., & Dolan, R. J. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198565741.003.0010 · Cited by 28
Self-citationMean Diffusivity in the Dopaminergic System and Neural Differences Related to Dopaminergic System
Takeuchi, H., & Kawashima, R. (2018) · Current Neuropharmacology · doi:10.2174/1570159x15666171109124839 · Cited by 28
Age-related variability in decision-making: Insights from neurochemistry
Berry, A. S., Jagust, W. J., & Hsu, M. (2018) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-018-00678-9 · Cited by 28
Using Neural Data to Test a Theory of Investor Behavior: An Application to Realization Utility
Frydman, C., Barberis, N., Camerer, C. F., Bossaerts, P. L., & Rangel, A. (2012) · National Bureau of Economic Research · doi:10.3386/w18562 · Cited by 29
Shea, N. J. (2024) · doi:10.1093/9780191997167.001.0001 · Cited by 29
Electroencephalographic Topography Measures of Experienced Utility
Pedroni, A., Langer, N., Koenig, T. W., Allemand, M., & Jäncke, L. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.5488-10.2011 · Cited by 28
Models of neuromodulation for computational psychiatry
Iglesias, S., Tomiello, S., Schneebeli, M., & Stephan, K. E. (2016) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1420 · Cited by 28
Neural correlates of taste reward value across eating disorders
Olsavsky, A. K., Shott, M. E., DeGuzman, M. C., & Frank, G. (2018) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2018.08.010 · Cited by 28
Striatal BOLD and midfrontal theta power express motivation for action
Algermissen, J., Swart, J. C., Scheeringa, R., Cools, R., & den Ouden, H. E. M. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab391 · Cited by 30
Temporal Difference Error Prediction Signal Dysregulation in Cocaine Dependence
Rose, E. J., Salmeron, B. J., Ross, T. J., Waltz, J. A., Schweitzer, J. B., McClure, S. M., & Stein, E. A. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.21 · Cited by 28
Two sides of the same coin: Learning via positive and negative reinforcers in the human striatum
Niznikiewicz, M. A., & Delgado, M. R. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.07.006 · Cited by 26
Neural basis of decision making guided by emotional outcomes
Katahira, K., Matsuda, Y.-T., Fujimura, T., Ueno, K., Asamizuya, T., Suzuki, C., Cheng, K., Okanoya, K., & Okada, M. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00564.2014 · Cited by 29
Vitay, J., & Hamker, F. H. (2014) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2014.00004 · Cited by 28
Neural underpinnings of maladaptive decision-making in addictions
Guttman, Z., Moeller, S. J., & London, E. D. (2017) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2017.06.014 · Cited by 28
Perception of intentionality in investor attitudes towards financial risks
Bossaerts, P. L., Suzuki, S., & O’Doherty, J. P. (2018) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2017.12.011 · Cited by 27
Self-citationThe Neurobiology of Personal Control During Reward Learning and Its Relationship to Mood
Romaniuk, L., Sandu, A.-L., Waiter, G. D., McNeil, C. J., Xueyi, S., Harris, M. A., Macfarlane, J. A., Lawrie, S. M., Deary, I. J., Murray, A. D., et al. (2019) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2018.09.015 · Cited by 26
The Misnomer of Attention-Deficit Hyperactivity Disorder
Wasserman, T. H., & Wasserman, L. D. (2015) · Applied Neuropsychology Child · doi:10.1080/21622965.2015.1005487 · Cited by 27
Rationalizable Irrationalities of Choice
Dayan, P. (2014) · Topics in Cognitive Science · doi:10.1111/tops.12082 · Cited by 29
Self-citationWittkuhn, L., Eppinger, B., Bartsch, L. M., Thurm, F., Korb, F. M., & Li, S. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.057 · Cited by 30
Frank, G., Shott, M. E., Pryor, T. L., Swindle, S., Nguyen, T., & Stoddard, J. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-022-01440-z · Cited by 26
Metadata
- Authors
- O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J.
- Affiliations
- Gatsby Computational Neuroscience Unit (GB)
- UCL Queen Square Institute of Neurology (GB)
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2003-04
- Volume
- 38
- Issue
- 2
- Pages
- 329-337
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2007414406
- Cited by
- 1,522
- References
- 36
- Citations by year
- 2026: 51 · 2025: 50 · 2024: 51 · 2023: 46 · 2022: 53 · 2021: 55 · 2020: 54 · 2019: 64 · 2018: 87 · 2017: 65 · 2016: 97 · 2015: 71 · 2014: 70 · 2013: 93 · 2012: 97
- FWCI
- 17.96
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Wellcome Trust
- Gatsby Charitable Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- temporal difference learning, prediction error signal, classical conditioning, appetitive conditioning, reward prediction, ventral striatum, orbitofrontal cortex, conditioned stimulus, human brain
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Conditioning, Classical, Corpus Striatum, Female, Frontal Lobe, Humans, Learning, Magnetic Resonance Imaging, Male, Reference Values, Reflex, Pupillary, Reward, Taste, Time Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
