Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
Evaluation of both immediate and future outcomes of one's actions is a critical requirement for intelligent behavior. Using functional magnetic resonance imaging (fMRI), we investigated brain mechanisms for reward prediction at different time scales in a Markov decision task. When human subjects learned actions on the basis of immediate rewards, significant activity was seen in the lateral orbitofrontal cortex and the striatum. When subjects learned to act in order to obtain large future rewards while incurring small immediate losses, the dorsolateral prefrontal cortex, inferior parietal cortex, dorsal raphe nucleus and cerebellum were also activated. Computational model-based regression analysis using the predicted future rewards and prediction errors estimated from subjects' performance data revealed graded maps of time scale within the insula and the striatum: ventroanterior regions were involved in predicting immediate rewards and dorsoposterior regions were involved in predicting future rewards. These results suggest differential involvement of the cortico-basal ganglia loops in reward prediction at different time scales.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In neurotypical individuals, the key brain loci that have been implicated in prediction are basal ganglia (68, 69), striatum (70, 71), anterior cingulate (72), and cerebellum (73, 74).”
From Autism as a disorder of prediction (2014) · cites this paper as [69]
Citations
Cites
Statistical parametric maps in functional imaging: A general linear approach
Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. ‐., Frith, C. D., & Frackowiak, R. S. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020402 · Cited by 9,688
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“, which has been successfully used for explaining reward-predictive activations of the midbrain dopaminergic system as well as those of the cortex and the striatu”
MethodEmotion, Decision Making and the Orbitofrontal Cortex
Bechara, A. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.295 · Cited by 3,589 · cited 1×
“Damage to the prefrontal cortex often impairs daily decision making, which requires assessment of future outcome”
BackgroundBarto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Basal ganglia and cerebellar loops: motor and cognitive circuits
Middleton, F. (2000) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00040-5 · Cited by 1,940 · cited 1×
“The cortex and the basal ganglia both have parallel loop organization, with four major loops (limbic, cognitive, motor and oculomotor) and finer, topographic sub-loops within each major loo”
Background(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
The Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Cited by
Items 601–700 of 798
Sakuragi, S., & Sugiyama, Y. (2009) · Journal of PHYSIOLOGICAL ANTHROPOLOGY · doi:10.2114/jpa2.28.181 · Cited by 6
General Management of Cerebellar Disorders: An Overview
Ilg, W., & Timmann, D. (2012) · Springer eBooks · doi:10.1007/978-94-007-1333-8_105 · Cited by 6
Prediction of relative and absolute time of reward in monkey prefrontal neurons
Tsujimoto, S., & Sawaguchi, T. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3280d943a1 · Cited by 6
“For example, the dorsolateral prefrontal cortex has been implicated in decision-making processes based on the expectation of delays until the delivery of monetary reward, particularly in the choice of ‘larger, later reward’ compared with ‘sooner, smaller reward’ [18,19].”
BackgroundEvent-Related Potentials in a Decision-Making Task with Delayed and Immediate Reward Conditions
Heldmann, M., Rüsseler, J., & Münte, T. F. (2005) · Journal of Psychophysiology · doi:10.1027/0269-8803.19.4.270 · Cited by 6
Rossini, L., & Rossini, P. (2006) · Cited by 6
Ando, T., Matsui, K., Okamoto, Y., Atsuumi, K., Taniguchi, K., Hirai, H., & Nishikawa, A. (2024) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2024.1421765 · Cited by 8
Self-citationYoshizawa, T., & Funahashi, M. (2024) · Neuroscience Research · doi:10.1016/j.neures.2024.11.002 · Cited by 5
Dopaminergic Genetic Variation in Young Adolescents: Associations with Sensation-Seeking
Sapuram, V. R., Vrshek‐Schallhorn, S., Hilt, L. M., & Stroud, C. B. (2021) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-021-00823-y · Cited by 6
“, 2011 for review of polymorphisms), a key component of the brain reward system (Tanaka et al., 2016).”
BackgroundAssociation of abnormal explicit sense of agency with cerebellar impairment in myoclonus-dystonia
Tarrano, C., Galléa, C., Delorme, C., McGovern, E. M., Atkinson-Clément, C., Barnham, I. J., Brochard, V. B., Thobois, S., Tranchant, C., Grabli, D., et al. (2024) · Brain Communications · doi:10.1093/braincomms/fcae105 · Cited by 6
Lowe, C. J., & Bodell, L. P. (2024) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2024.101377 · Cited by 6
“Many human imaging studies have demonstrated the involvement of the VS in reward prediction (e.g., Knutson et al., 2001; Tanaka et al., 2004), and the current study suggests that such hyper-sensitivity to impending rewards may influence risk for future mal-adaptive eating behaviors.”
BackgroundReward, Reinforcement, and Impulsivity in Obesity
Verdejo‐García, A. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1203-2_2 · Cited by 5
Combining Modalities with Different Latencies for Optimal Motor Control
Bissmarck, F., Nakahara, H., Doya, K., & Hikosaka, O. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20133 · Cited by 6
“Brain mechanisms of reward discounting is an active research topic (McClure, Ericson, Laibson, Loewenstein, & Cohen, 2007; Schweighofer et al., 2006; Tanaka et al., 2004; Daw & Touretzky, 2002).”
Self-citationFu, W., Huang, Z., Li, J., Dong, Q., Li, Y., Li, G., Xu, Y., Xue, B., Li, Z., Chen, C., et al. (2021) · NeuroImage Clinical · doi:10.1016/j.nicl.2021.102895 · Cited by 5
“, 2020) and the insula participates in time and value processing (Tanaka et al., 2004; Von Siebenthal et al., 2020).”
BackgroundResultModel-based DDPG for motor control
Shi, H., Sun, Y., & Li, G. (2017) · IEEE International Conference on Progress in Informatics and Computing · doi:10.1109/pic.2017.8359558 · Cited by 6
“According to the categorization in the work of [13], the learning mechanisms exploited by the brain, when interpreted with the language of machine learning, cover all the three paradigms of the machine learning algorithms: supervised learning, unsupervised learning and the reinforcement learning.”
BackgroundExperiments in Psychology: Current Issues in Irrational Choice Behavior
Igaki, T., Romanowich, P., & Sakagami, T. (2019) · Springer eBooks · doi:10.1007/978-981-13-6065-7_5 · Cited by 5
Neural substrates of self‐ and external‐preoccupation: A voxel‐based morphometry study
Ikeda, S., Takeuchi, H., Taki, Y., Nouchi, R., Yokoyama, R., Nakagawa, S., Sekiguchi, A., Iizuka, K., Hanawa, S., Araki, T., et al. (2019) · Brain and Behavior · doi:10.1002/brb3.1267 · Cited by 5
“…as well as canonical reward‐related areas, has been known to be related to reward processing, and is involved in prediction of future rewards (Tanaka et al., 2004), evaluation of un‐ predicted rewards (Ramnani, Elliott, Athwal, & Passingham, 2004), and reward‐based learning (Thoma,…”
BackgroundThe role of serotonin in performance monitoring and cognitive control
Fischer, A. G., & Jocham, G. (2020) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-444-64125-0.00033-5 · Cited by 5
Moore, B., Khang, S., & Francis, J. T. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.541920 · Cited by 5
“…2018; Ramkumar et al. 2016; Ramakrishnan et al. 2017; Zhao et al. 2018), as do regions associated with motor output (Platt and Glimcher 1999; Zhao et al. 2018; Musallam et al. 2004; Tanaka et al. 2004; Campos et al. 2005; Shuler and Bear 2006; Louie, Grattan, and Glimcher 2011; Toda et al. 2012).”
BackgroundModel-Based Decision Making in the Human Brain
Hampton, A. N. (2007) · CaltechTHESIS (California Institute of Technology) · doi:10.7907/k9z8-e248 · Cited by 6
Hyperbolic Discounting Is Not Lack of Self-ControlPreprint
Jimenez‐Gomez, D. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3259378 · Cited by 5
Hallez, Q., Gil, S., & Droit‐Volet, S. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6jm2y · Cited by 6
Memory consolidation from a reinforcement learning perspective
Lee, J. W., & Jung, M. W. (2025) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1538741 · Cited by 10
“However, an early human imaging study detected value-related BOLD signals in the hippocampus alongside well-established value-related regions like the orbitofrontal cortex and striatum (Tanaka et al., 2004).”
Food Perception in Adults: Neuroimaging Findings
Key, A. P. F., Charboneau, E. J., & Cowan, R. L. (2011) · Springer eBooks · doi:10.1007/978-0-387-92271-3_34 · Cited by 4
A Computational Predictor of Human Episodic Memory Based on a Theta Phase Precession Network
Sato, N., & Yamaguchi, Y. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007536 · Cited by 6
“Tanaka et al. proposed an interesting data analysis where human behavioral data of a Markov decision task were analyzed according to the temporal difference (TD) learning rule and applied for BOLD data analysis in human subjects [ 33 ].”
MethodDevelopment of fMRI-Compatible Steering Reaction Force Generation Unit
Okamoto, Y., Sasaoka, T., Yoshida, T., Takemura, K., Soh, Z., Nouzawa, T., Yamawaki, S., & Tsuji, T. (2019) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2019.2895456 · Cited by 4
Self-citationActivity Recommendation: Optimizing Life in the Long Term
Rojas, J. A. R., Rosas, J. M., Shen, Y., Jin, H., & Dey, A. K. (2020) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom45495.2020.9127358 · Cited by 4
“Studies by Tanaca [4] and McClure [5] demonstrate that decisions over delayed rewards are processed by two different systems in the brain.”
BackgroundNeuroimaging of pleasantness and unpleasantness induced by thermal stimuli
Banožić, A. (2021) · Temperature · doi:10.1080/23328940.2021.1959288 · Cited by 4
“[44] Tanaka SC, Doya K, Okada G, et al.”
BackgroundАгрессия и аутоагрессия (суицид) – анализ с позиций нейробиологии
Розанов, В. А. (2022) · Суицидология · doi:10.32878/suiciderus.22-13-03(48)-3-38 · Cited by 6
Kruithof, E. S., Drop, E. M., Gerits, D., Klaus, J., & Schutter, D. J. L. G. (2025) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-025-01273-5 · Cited by 5
“Evidence has shown that the medial posterior cerebellum is particularly involved in predicting immediate rewards, while the left posterolateral cerebellum predicts rewards of future states (Tanaka et al., 2004).”
Martín, R. S., Isla, P., & Melis, C. (2012) · El Trimestre Económico · doi:10.20430/ete.v79i314.65 · Cited by 8
Neural correlates of episodic memory modulated by temporally delayed rewards
Yoo, J., Min, S., Lee, S., & Han, S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0249290 · Cited by 5
“short delay contrast, the ventrolateral PFC (vlPFC), insula, dorsolateral PFC (dlPFC), dorsal premotor cortex, and the inferior parietal cortex are activated [44].”
BackgroundMisonou, A., & Jimura, K. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.749252 · Cited by 5
“In all three phases, impulsivity in decision-making was associated with increased VS activation, consistent with previous reports (Tanaka et al., 2004; Hariri et al., 2006; Kable and Glimcher, 2007; Ballard and Knutson, 2009; Pine et al., 2009).”
BackgroundResultGeneral Management of Cerebellar Disorders: An Overview
Timmann, D. (2012) · Cited by 4
Event-related potentials reveal differential brain regions implicated in discounting in two tasksPreprint
Delaney, L. D., Rawdon, C., Denny, K., & Zhang, W. (2008) · RePEc: Research Papers in Economics · Cited by 4
Improvement of Depression after Treatment of Dural Arteriovenous Fistula: A Case Report and a Review
Nakagawa, M., Sugiu, K., Tokunaga, K., Sakamoto, C., & Fujiwara, K. (2012) · Case Reports in Psychiatry · doi:10.1155/2012/730151 · Cited by 3
“Impairment of the activity on future reward prediction is thought to make patients despondent, pessimistic, and apathic [8].”
BackgroundGamma-Nets: Generalizing Value Estimation over Timescale
Sherstan, C., Dohare, S., MacGlashan, J., Günther, J., & Pilarski, P. M. (2020) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v34i04.6027 · Cited by 8
Disordered Social Cognition: Alexithymia and Interoception
Brewer, R., & Bird, G. (2020) · The Cambridge Handbook of Evolutionary Perspectives on Human Behavior · doi:10.1017/9781108131797.036 · Cited by 3
Reinforcement learning with dopamine: A convergence of natural and artificial intelligence
Masset, P., & Gershman, S. J. (2025) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-443-29867-7.00019-0 · Cited by 6
The Basal Ganglia, Reinforcement Learning, and the Encoding of Value
Doya, K., & Kimura, M. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00017-6 · Cited by 3
Self-citationHippocampal conceptual representations and their reward value
Okatan, M. (2010) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.002.2010 · Cited by 3
Desseilles, M. (2013) · Santé mentale au Québec · doi:10.7202/1014947ar · Cited by 3
Learning and Representation: From Compressive Sampling to the ‘Symbol Learning Problem’
Lörincz, A. (2008) · Bolyai Society mathematical studies · doi:10.1007/978-3-540-69395-6_11 · Cited by 3
Contributions of Dorsal/Ventral Hippocampus and Dorsolateral/Dorsomedial Striatum to Interval Timing
Yin, B. (2016) · DukeSpace (Duke University) · Cited by 3
Nallapu, B. T., & Alexandre, F. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/867515 · Cited by 4
Plichta, M. M. (2009) · Online Publication Service of Würzburg University (Würzburg University) · Cited by 5
Hamroun, S., Lebreton, M. P., & Palminteri, S. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2uw85 · Cited by 3
Sidorina, V. V., Кулешова, Е. П., & Merzhanova, G. K. (2014) · Neuroscience and Behavioral Physiology · doi:10.1007/s11055-014-9965-7 · Cited by 2
“According to published data, “impulsive” subjects have been shown using fMRI in humans and at the cellular level in animal experiments [29, 30] to have increased activity in the frontal areas of the cortex in tests involving a small delay in the reinforcement.”
Hori, Y., Iwaoki, H., Mimura, K., Nagai, Y., Higuchi, M., & Minamimoto, T. (2024) · Scientific Reports · doi:10.1038/s41598-024-70414-6 · Cited by 2
The neural bases of meaningful intransitive gestures: A meta-analysis of lesion and fMRI studies
Baumard, J., Lanièpce, A., Guezouli, L., Osiurak, F., Lesourd, M., & Bartolo, A. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106316 · Cited by 3
The neurophysiological basis of an adaptation to stress
Okamoto, Y., Onoda, K., Miyake, Y., Yoshimura, S., Yoshino, A., Kurosaki, M., Sekida, M., Okada, G., Yamashita, H., & Yamawaki, S. (2008) · Folia Pharmacologica Japonica · doi:10.1254/fpj.131.5 · Cited by 4
Self-citationDiscounting of Delayed and Probabilistic Rewards by Women with and without Binge Eating Disorder
Manwaring, J. L. (2009) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7j964gh · Cited by 2
“…lateral prefrontal and parietal cortices) were activated (McClure, Laibson, Loewenstein, & Cohen, 2004; Tanaka et al., 2004; Wittmann, Leland, & Paulus, 2007), providing evidence of differential neural activation depending on whether short- or long-term rewards are predicted (Tanaka et al., 2004).”
BackgroundInfluentialYamaguchi, Y., & Sakai, Y. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.08.004 · Cited by 2
Stress, noradrenaline, and realistic prediction of mouse behaviour using reinforcement learning
Sandi, C., Gerstner, W., & Lukšys, G. (2008) · neural information processing systems · Cited by 2
Decision making and the medial prefrontal cortex function in social context
Nakao, T., Ohira, H., & Northoff, G. (2010) · Japanese Journal of Physiological Psychology and Psychophysiology · doi:10.5674/jjppp.28.45 · Cited by 2
Conservative Treatments for Tendinopathy
Tencone, F., Villa, S. D., & Giannini, A. (2017) · Springer eBooks · doi:10.1007/978-3-662-54184-5_15 · Cited by 2
Steele, J. D. (2010) · Elsevier eBooks · doi:10.1016/b978-0-7020-3137-3.00002-4 · Cited by 2
A role of serotonin and the insula in vigor: Tracking environmental and physiological resources
Tops, M., Boksem, M. A. S., Montero‐Marín, J., & van der Linden, D. (2021) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000261 · Cited by 2
Sato, N. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88853-6_2 · Cited by 2
“The combined analysis between computational theory and human experimental data analysis is known as an effective approach to evaluate the specific neural dynamics associated with brain function (e.g., a reinforcement leaning in a gambing task [ 44 ]).”
BackgroundBasal Ganglia Models for Autonomous Behavior Learning
Tsujino, H., Takeuchi, J., & Shouno, O. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00616-6_16 · Cited by 2
“Interactions between dopamine and acetylcholine regulate striatal dopamine release [27][28], and serotonin release from the dorsal raphe nucleus is thought to control the time scale of reward prediction in the striatum [29].”
BackgroundDelay discounting as a measure of impulsivity.
Gu, L. (2012) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 2
Imaging Imagination: Brain Scanning of the Imagined Future
Kringelbach, M. L., & Geake, J. G. (2007) · British Academy eBooks · doi:10.5871/bacad/9780197264195.003.0014 · Cited by 3
“A number of recent neuroimaging papers have investigated the role of cerebellum in predicting not only motor sequences but also in the prediction of other higher cognitive and emotional functions (Dreher and Grafman, 2002; Nitschke et al. 2003; Tanaka et al. 2004).”
BackgroundBASAL GANGLIA PATHWAYS: BEYOND THE CLOSED-LOOP CIRCUITS WITH THE CEREBRAL CORTEX
Bostan, A. C. (2013) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 4
Shintaki, R., Tanaka, D., Okayasu, M., Suzuki, S., Yoshimoto, T., Sadato, N., Chikazoe, J., & Jimura, K. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.03.16.484555 · Cited by 2
Working memory-based and -free reward prediction in a dual dopamine system in the basal gangliaPreprint
Yoshizawa, T., Miyamura, Y., Ochi, Y., Hira, R., Funahashi, M., Sakai, Y., Cui, Y., & Isomura, Y. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.03.06.531239 · Cited by 2
“Functional brain imaging (O’Doherty et al., 2004; Tanaka et al., 2004) and neuronal activity recording (Samejima et al., 2005; Ito and Doya, 2009; Kim et al., 2009; Ito and Doya, 2015; Yoshizawa et al., 2018) studies have shown that reinforcement learning is implemented in the cortico-basal ganglia…”
BackgroundBroekens, J., & Baarslag, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.2078 · Cited by 2
“These basic elements have been identified in the animal brain including the encoding of utility [20], changes in utility [21], and reward and motivational action value [20, 22-24].”
BackgroundArakaki, T. (2016) · theses.fr (ABES) · doi:10.70675/b0711d35z04ebz4e91z8e52zbae5a3e72fb8 · Cited by 4
Kang, K., Antonenko, D., Glöckner, F., Flöel, A., & Li, S. (2024) · Aging Brain · doi:10.1016/j.nbas.2024.100109 · Cited by 1
Optimality Theory of Stigmergic Collective Information Processing by Chemotactic Cells
Kato, M., & Kobayashi, T. J. (2025) · PRX Life · doi:10.1103/tvfy-lbbl · Cited by 3
“It is reasonable for biological organisms with limited memory to evaluate the near future, and mammals have been believed to implement the criterion (S1) by using neurotransmitter concentrations as discount factor γ [83].”
Consolidación de la memoria, sustrato nervioso del refuerzo y adicción
Redolar-Ripoll, E. (2008) · Psiquiatría Biológica · doi:10.1016/s1134-5934(08)76481-9 · Cited by 4
Tan, H. Y., & Weinberger, D. R. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195373035.003.0013 · Cited by 1
Hosaka, H., 青柳, 閣., Kaga, Y., Kanemura, H., Sugita, K., & Aihara, M. (2017) · Brain and Development · doi:10.1016/j.braindev.2017.03.004 · Cited by 1
うつ病の認知に関する神経基盤(シンポジウム : 情動形成とその異常の脳内機構-情動と心身相関のBlack Boxに迫る-,2006年,第47回日本心身医学会総会(東京))
岡本, 泰., 木下, 亜., Yoshimura, S., 小野田, 慶., 松永, 美., 志々田, 一., 上田, 一., 鈴木, 伸., & 山脇, 成. (2007) · 心身医学 · doi:10.15064/jjpm.47.8_705 · Cited by 1
Bellot, J., Khamassi, M., Sigaud, O., & Girard, B. (2013) · BMC Neuroscience · doi:10.1186/1471-2202-14-s1-p144 · Cited by 1
“This assumption was consistent with other studies in the literature [7,8].”
ResultNeuronale Korrelate von nutzenbasierten Entscheidungen
Plaßmann, H. (2010) · Gabler eBooks · doi:10.1007/978-3-8349-6373-4_8 · Cited by 1
Consolidación de la Memoria y Sustrato Nervioso del Refuerzo
Redolar-Ripoll, E. (2012) · Revista Argentina de Ciencias del Comportamiento ( RACC ) · doi:10.32348/1852.4206.v4.n2.5174 · Cited by 3
Bennett, M. R. (2012) · Springer eBooks · doi:10.1007/978-94-007-5748-6_5 · Cited by 1
Cognitive and neural mechanisms underlying product evaluation and memory
Ueda, K., & Yuji, M. E. N. O. (2014) · Transactions of the JSME (in Japanese) · doi:10.1299/transjsme.2014trans0289 · Cited by 4
Self-citationChanging Nonhuman Impulsive Choice
Renda, C. (2018) · Digital Commons - USU (Utah State University) · doi:10.26076/38f0-5725 · Cited by 1
The Neural Correlates of Decision-Making: Review and Research Agenda
Sharda, K. (2018) · Springer eBooks · doi:10.1007/978-981-13-1894-8_13 · Cited by 1
fMRI in Economics: What Functional Imaging of the Brain Can Add to Behavioral Economics Experiments
Kodaverdian, N. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-813092-6.00005-8 · Cited by 1
Predicting Errors and Motivation
Wasserman, T. H., & Wasserman, L. D. (2020) · Springer eBooks · doi:10.1007/978-3-030-58724-6_6 · Cited by 1
Ricker, J. M., Smith, K., Schmidt, A., Cripps, A. E., Thalla, P., Cromwell, H. C., & Wang, X. (2021) · Journal of Sports Medicine and Allied Health Sciences Official Journal of the Ohio Athletic Trainers Association · doi:10.25035/jsmahs.07.02.03 · Cited by 1
Doya, K. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108755610.013 · Cited by 1
Self-citationThe economics, neurobiology and pharmacology of intertemporal choice in humans
Pine, A. (2011) · UCL Discovery (University College London) · Cited by 1
Towards manipulative neuroscience based on Brain Network Interface
Kawato, M. (2007) · International Congress Series · doi:10.1016/j.ics.2007.02.063 · Cited by 2
Borsetti, V., & Ernesto, P. (2008) · Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) · Cited by 4
The role of the medial prefrontal cortex in mediating social event knowledge
Krüger, F. (2011) · edoc Publication server (Humboldt University of Berlin) · doi:10.18452/13977 · Cited by 1
Static and Dynamic Connectivity Analysis of Human Brain via Functional Magnetic Resonance ImagingPreprint
Sen, B. (2022) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/3kunr · Cited by 2
The motivational brain: neural encoding of reward and effort in goal-directed behavior
Vassena, E. (2014) · Ghent University Academic Bibliography (Ghent University) · Cited by 1
Measurement of Social Preference from Utility-Based Choice ExperimentsPreprint
Yamada, K., Sato, M., & Nakamoto, Y. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1503775 · Cited by 2
Chabout, J. (2012) · theses.fr (ABES) · doi:10.70675/0b2d32dez3cb0z4fa0zb737zc6fbbd5c6961 · Cited by 2
Developing translational animal models for decision making: the Iowa Gambling Task case
Mitsogiannis, M. D. (2011) · Utrecht University Repository (Utrecht University)
Vulnerability to cocaine : role of stress hormones
de Jong, I. J. (2007)
Gaznick, N. V. (2015) · doi:10.17077/etd.6vhy5rti
“Basal ganglia imaging implicates the ventral striatum in prediction error and reward (Tanaka et al., 2004), and increased ventral striatum activity correlates with impulsive choices (riskier rewards and temporal discounting) (Ernst et al.”
BackgroundNeuroimaging Studies of Reinforcement-Learning
O’Doherty, J. P. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-397025-1.00257-8
NICOTINIC RECEPTOR MODULATION OF DOPAMINE TRANSPORTERS
Middleton, L. S. (2006) · UKnowledge (University of Kentucky)
Neurobiology of Impulse Control Disorders in Parkinson's Disease
Steeves, T. D. L., Miyasaki, J. M., Lang, A. E., & Strafella, A. P. (2011) · Wiley eBooks · doi:10.1002/9781444397970.ch20
Avances y Desafíos en Neuropsicología
Godoy, J. C. (2012) · Revista Argentina de Ciencias del Comportamiento ( RACC ) · doi:10.30882/1852.4206.v4.n2.5168 · Cited by 1
Role of the subthalamic nucleus in the circuitry mediating food- and cocaine -seeking behavior
Cortright, J. J. (2007) · IUScholarWorks (Indiana University)
Behavioral impulsivity and hallucinations : insights from Parkinson's disease
Ashourian, P. (2011) · DSpace@MIT (Massachusetts Institute of Technology)
Metadata
- Authors
- Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S.
- Affiliations
- Nara Institute of Science and Technology (JP)
- Japan Science and Technology Agency (JP)
- Hiroshima University (JP)
- Corresponding author
- Doya, Kenji
- Venue
- Nature Neuroscience
- Published
- 2004-07-04
- Volume
- 7
- Issue
- 8
- Pages
- 887-893
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2032610016
- Cited by
- 779
- References
- 54
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 16 · 2023: 9 · 2022: 29 · 2021: 28 · 2020: 32 · 2019: 25 · 2018: 32 · 2017: 37 · 2016: 40 · 2015: 45 · 2014: 50 · 2013: 42 · 2012: 47
- FWCI
- 18.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Core Research for Evolutional Science and Technology
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- reward prediction, time scales, cortico-basal ganglia loop, prediction error, insula, striatum, orbitofrontal cortex, dorsolateral prefrontal cortex, dorsal raphe nucleus, cerebellum, computational modeling, reinforcement learning
- MeSH terms
- Adult, Brain, Brain Mapping, Discrimination Learning, Female, Humans, Magnetic Resonance Imaging, Male, Markov Chains, Middle Aged, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.