Modulators of decision making
The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Abstract
Human and animal decisions are modulated by a variety of environmental and intrinsic contexts. Here I consider computational factors that can affect decision making and review anatomical structures and neurochemical systems that are related to contextual modulation of decision making. Expectation of a high reward can motivate a subject to go for an action despite a large cost, a decision that is influenced by dopamine in the anterior cingulate cortex. Uncertainty of action outcomes can promote risk taking and exploratory choices, in which norepinephrine and the orbitofrontal cortex appear to be involved. Predictable environments should facilitate consideration of longer-delayed rewards, which depends on serotonin in the dorsal striatum and dorsal prefrontal cortex. This article aims to sort out factors that affect the process of decision making from the viewpoint of reinforcement learning theory and to bridge between such computational needs and their neurophysiological substrates.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, structures such as the basal ganglia, parietal cortex, and thalamus support procedural learning, visuospatial coordination, and sensory integration (Corbetta and Shulman, 2002; Doya, 2008; Sherman, 2016).”
From Enhancement of modern defense capabilities by convergence of cognitive neuroscience and artificial intelligence (2026) · cites this paper as Doya, 2008
In the citing paper
“Basal ganglia enable procedural learning, habit formation, and reinforcement-driven behaviors (Doya, 2008), i.e., reinforcement-based decision-making, allowing operators to execute complex behaviors automatically under pressure.”
From Enhancement of modern defense capabilities by convergence of cognitive neuroscience and artificial intelligence (2026) · cites this paper as Doya, 2008
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Neural recording experiments in animals reveal that midbrain dopamine neurons encode reward prediction error”
BackgroundMarkov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122 · cited 1×
“In many animal and human choice experiments, subjects tend to be more sensitive to differences in shorter delays than longer delays, which is well modeled by hyperbolic function”
BackgroundMarkov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316887 · Cited by 6,024
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472 · cited 1×
“Norepinephrine is also suggested to be important in regulating the decision to explore alternatives versus exploiting a known resourc”
BackgroundTheory of Games and Economic Behavior
Hawkins, D. (1945) · Philosophy of Science · doi:10.1086/286866 · Cited by 3,887
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 1×
“Also, functional magnetic resonance imaging (fMRI) experiments using a monetary questionnair”
Method
Research works printed but not linked: 1
- Doya, K., Ishii, S., Pouget, A. & Rao, R. Bayesian Brain: Probabilistic Approach to Neural Coding and Learning (MIT Press, Cambridge, Massachusetts, USA, (2007).
Cited by
Items 401–500 of 688
Learning continuous-time working memory tasks with on-policy neural reinforcement learning
Zambrano, D., Roelfsema, P. R., & Bohté, S. M. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.11.072 · Cited by 8
Disaster Series: The Abrupt NICU Evacuation – Disasters without a Plan
van Stralen, D., McKay, S. D., & Mercer, J. T. A. (2021) · Neonatology Today · doi:10.51362/neonatology.today/202116121022 · Cited by 8
Decomposing brain signals involved in value-based decision making
Dreher, J. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00006-6 · Cited by 8
Muscle Synergy–Driven Robust Motion Control
Min, K., Iwamoto, M., Kakei, S., & Kimpara, H. (2018) · Neural Computation · doi:10.1162/neco_a_01063 · Cited by 7
Multilayer adaptive networks in neuronal processing
Hernández, A., & Amigó, J. M. (2018) · The European Physical Journal Special Topics · doi:10.1140/epjst/e2018-800037-y · Cited by 8
Subtraction and division of visual cortical population responses by the serotonergic systemPreprint
Azimi, Z., Spoida, K., Barzan, R., Wollenweber, P., Mark, M. D., Herlitze, S., & Jancke, D. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/444943 · Cited by 10
“On the one hand it may be not too surprising to find serotonergic receptors implicated in normalization, as this is true also for other modulatory transmitter systems (Doya, 2008; Dayan, 2012; Pinto et al., 2013).”
BackgroundIndependent and Interacting Value Systems for Reward and Information in the Human BrainPreprint
Dezza, I. C., Cleeremens, A., & Alexander, W. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.04.075739 · Cited by 8
de Gee, J. W., Corrêa, C. M. C., Weaver, M., Donner, T. H., & van Gaal, S. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.25.164962 · Cited by 7
The role of dopamine in foraging decisions in social insects
Ye, D., Kamhi, J. F., & Gordon, D. M. (2025) · Frontiers in Insect Science · doi:10.3389/finsc.2025.1581307 · Cited by 6
“While many neurotransmitters are likely involved in these behavioral adaptations (12, 13), here we will focus on the biogenic amine dopamine (DA), which plays a central role in regulating decision-making under risk.”
Modification of spectral features by nonhuman primates
Weiss, D. J., Hotchkin, C. F., & Parks, S. E. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13004226 · Cited by 7
Dynamic decision making and value computations in medial frontal cortex
Bari, B. A., & Cohen, J. Y. (2021) · International review of neurobiology · doi:10.1016/bs.irn.2020.12.001 · Cited by 6
“Extensive work, most of it in humans, has correlated changes in activity in multiple brain regions with variables from reinforcement-learning models (e.g., Daw, O’Doherty, Dayan, Seymour, & Dolan, 2006; Doya, 2008).”
BackgroundNeuroheuristics of Decision Making: From Neuronal Activity to EEG
Villa, A. E. P., Missonnier, P., & Lintas, A. (2011) · Intelligent systems reference library · doi:10.1007/978-3-642-24647-0_7 · Cited by 8
“For instance, the brain dopaminergic system has been implicated but the function cannot map directly to this system; so another structure of the circuit is likely to be where the “decision” is made [108, 43, 30, 34].”
BackgroundHumor Improves Women’s but Impairs Men’s Iowa Gambling Task Performance
Flores-Torres, J., Gómez‐Pérez, L., McRae, K., López, V., Rubio, I., & Rodríguez, E. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02538 · Cited by 6
“Frontiers in Psychology | www.frontiersin.org 8 November 2019 | Volume 10 | Article 2538 women, via nucleus accumbens activity (Gray et al., 2002; Ueda et al., 2003; Azim et al., 2005; Tanaka et al., 2007; Doya, 2008; Homberg et al., 2008; Tanaka et al., 2016).”
BackgroundRuocco, L. A., Carnevale, U. A. G., Sica, A., Arra, C., Topo, E., Giovanni, M. D., D’Aniello, A., & Sadile, A. G. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.028 · Cited by 6
A Smart System Facilitating Emotional Regulation in Neurodivergent Children
Tejasvi, P., & Kumar, T. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.04.308 · Cited by 5
Cortical Beta Power Reflects the Influence of Pavlovian Cues on Human Decision-Making
Finotti, G., Degni, L., Badioli, M., Dalbagno, D., Starita, F., Bardi, L., Huang, Y., Wei, J., Sirigu, A., Gazzola, V., et al. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.0414-24.2024 · Cited by 5
Pittaras, E., Artal, J. M., Ajibola, G., Allocca, G., Bennett, M., Camargo, A., Carpio, A., Gessner, N. R., Hinton, M., Pizzitola, R., et al. (2024) · SLEEP · doi:10.1093/sleep/zsae300 · Cited by 7
Computational Models of Cognitive and Motor Control
Minai, A. A. (2015) · Springer eBooks · doi:10.1007/978-3-662-43505-2_35 · Cited by 6
“Excellent reviews of such models are provided by Daw and Doya (2006), Dayan and Niv (2008), and Doya (2008).”
MethodNarasimhan, S., Schriver, B. J., & Wang, Q. (2023) · Journal of Neurophysiology · doi:10.1152/jn.00309.2022 · Cited by 5
Multi-Plasticities: Distinguishing Context-Specific Habits from Complex Perseverations
Banavar, N. V., & Bornstein, A. M. (2024) · Springer eBooks · doi:10.1007/978-3-031-55889-4_5 · Cited by 5
Adaptive circuits for action and value information in rodent operant learning
Ríos, A., Fujita, K., Isomura, Y., & Sato, N. (2024) · Neuroscience Research · doi:10.1016/j.neures.2024.09.003 · Cited by 5
“Doya (2008) has provided a comprehensive framework linking reinforcement learning theory to the neural functions of the cortico-striatal circuits, emphasizing their importance in adaptive behavior and decision-making processes.”
Serotonergic Neurotransmission in Autism Spectrum Disorders
Takeuchi, Y. (2011) · InTech eBooks · doi:10.5772/17509 · Cited by 5
“Recently, serotonin at the dorsal striatum and prefrontal area has been suggested to play an important role in inhibiting impulsivity in decision-making and aggressiveness (Doya, 2008).”
BackgroundRationality and intertemporal choice
Gifford, A. (2009) · Journal of Bioeconomics · doi:10.1007/s10818-009-9068-7 · Cited by 7
“2 Also see Geisler and Diehl (2003), Glimcher (2003), Sharma et al. (2003), Doya (2008) .”
BackgroundFeedback learning and behavior problems after pediatric traumatic brain injury
Königs, M., van Heurn, E. L. W., Vermeulen, R. J., Goslings, J. C., Luitse, J. S. K., Poll‐The, B. T., Beelen, A., van der Wees, M., Kemps, R. J. J. K., Catsman‐Berrevoets, C. E., et al. (2016) · Psychological Medicine · doi:10.1017/s0033291716000106 · Cited by 5
“Typical behavioral development importantly relies on feedback learning (Rushworth & Behrens, 2008), which is mediated by a dopamine-driven frontostriatal network that facilitates the use of positive and negative feedback on current behavior to optimize future behavior (Doya, 2008; Hämmerer & Eppinger, 2012).”
BackgroundBose, T., Reina, A., & Marshall, J. A. R. (2019) · Neural Computation · doi:10.1162/neco_a_01185 · Cited by 5
Scleidorovich, P., Fellous, J., & Weitzenfeld, A. (2022) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2022.1039822 · Cited by 6
“In building the model, as several other models, we used reinforcement learning to simulate the brain’s learning process based on observations where dopaminergic neurons predict error signals as temporal differences (James et al., 1994; Schultz et al., 1997; Doya, 2008).”
MethodDecision-making in autism spectrum conditions
Luke, L. (2011) · Apollo (University of Cambridge) · doi:10.17863/cam.16549 · Cited by 7
“86 (von Neumann & Morgenstern, 1947; Kahneman & Tversky, 1979; Doya, 2008; Lawrence et al., 2009).”
Reduced Pavlovian Value Updating Alters Decision-Making in Sign-Trackers
Degni, L., Mattioni, L., Danti, C., bernardi, V., Finotti, G., Badioli, M., Starita, F., Soltani, A., di Pellegrino, G., & Garofalo, S. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.1465-25.2025 · Cited by 4
Willoughby, K. W. (2019) · Routledge eBooks · doi:10.4324/9780429308444-10 · Cited by 4
Arousability, Personality, and Decision-Making Ability in Dissociative Disorder
Ghosh, D., Mukhopadhyay, P., Chatterjee, I., & Roy, P. K. (2021) · Indian Journal of Psychological Medicine · doi:10.1177/0253717620981555 · Cited by 4
Action control, forward models and expected rewards: representations in reinforcement learning
Rusanen, A., Lappi, O., Kuokkanen, J., & Pekkanen, J. (2021) · Synthese · doi:10.1007/s11229-021-03408-w · Cited by 5
“In RL, the algorithm can use a forward model M for updating (Doya, 2008).”
MethodYi, Y., Kreissl, M. C., Speck, O., Düzel, E., & Hämmerer, D. (2025) · Human Brain Mapping · doi:10.1002/hbm.70124 · Cited by 4
“…that the mid-brain and brainstem neuromodulatory systems, especially those responsive to salient events, play a crucial role in memory consolidation (Aston-Jones and Cohen 2005b; Doya 2008; Grace 2016; McDevitt et al. 2014; Schomaker and Meeter 2015; Takeuchi et al. 2016; O'Carroll et al. 2006).”
Synthetic Spatial Foraging With Active Inference in a Geocaching Task
Neacsu, V., Convertino, L., & Friston, K. J. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.802396 · Cited by 6
“For example, the role of norepinephrine in setting the precision of state transitions—or the role of cholinergic neurotransmission in setting the precision of sensory or likelihood mappings (Doya, 2002, 2008; Parr and Friston, 2017).”
BackgroundHanakawa, T., & Hosoda, C. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13004032 · Cited by 4
Díaz, C., Sánchez‐García, M., Fernández‐Calderón, F., & Lozano, O. M. (2020) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2020.1840519 · Cited by 4
“This subjective value is mediated by factors such as reward intensity, the time taken to gain the reward, the tangibility of the reward, the risk involved, or the uncertainty regarding its delivery (Bechara, 2007; Doya, 2008; Rangel et al., 2008).”
Anorexia nervosa: Aktuelle neurowissenschaftliche Befunde
Kappel, V., van Noort, B. M., Ritschel, F., Seidel, M., & Ehrlich, S. (2013) · Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie · doi:10.1024/1422-4917/a000268 · Cited by 4
Iozzino, L., Canessa, N., Rucci, P., Iommi, M., Dvorak, A., Heitzman, J., Markiewicz, I., Picchioni, M., Pilszyk, A., Wancata, J., et al. (2022) · Schizophrenia Research Cognition · doi:10.1016/j.scog.2022.100257 · Cited by 5
“On the contrary, the notion of “hot executive functions” refers to processes involving an assessment of affective, motivational and/or reward incentive values of the available options, recruiting the meso-corticolimbic pathway (Berridge and Kringelbach, 2008; Doya, 2008).”
When Mere Action Versus Inaction Leads to Robust Preference ChangePreprint
Chen, Z., Holland, R. W., Quandt, J., Dijksterhuis, A., & Veling, H. (2019) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/cg354 · Cited by 3
Adaptive Integration of Perceptual and Reward Information in an Uncertain WorldPreprint
Ganesh, P., Cichy, R. M., Schuck, N. W., Finke, C., & Bruckner, R. (2024) · eLife · doi:10.7554/elife.99266 · Cited by 6
Cosic, K., Kuljanac, A., & Palermo, S. (2026) · Frontiers in psychology · doi:10.3389/fpsyg.2026.1821242 · Cited by 3
“Basal ganglia enable procedural learning, habit formation, and reinforcement-driven behaviors (Doya, 2008), i.e., reinforcement-based decision-making, allowing operators to execute complex behaviors automatically under pressure.”
The role of emotions in reinforcement: response selection in humans
Overskeid, G. (2012) · The Psychological Record · doi:10.1007/bf03395792 · Cited by 3
Stimulation of the human ventral tegmental area increases strategic betting
Hirschbichler, S. T., Lagrata, S., Shedd, N., Akram, H., Schwingenschuh, P., Waiß, C., Oberndorfer, S., Matharu, M. S., & Manohar, S. (2025) · Brain · doi:10.1093/brain/awaf210 · Cited by 3
A formal model inspired on human decision-making process
Cervantes, J.-A., Ramos, F., & Wang, Y. (2015) · IEEE International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) · doi:10.1109/icci-cc.2015.7259413 · Cited by 3
Adult norms for the decision-making MindPulse Digital Test
Ansado, J., Eynard, B., Mirofle, N., Mennetrey, C., Banchereau, J., Sablon, M., Lokietek, E., Vourc’h, F. L., Tissot, J., Wrobel, J. P., et al. (2024) · Applied Neuropsychology Adult · doi:10.1080/23279095.2024.2307413 · Cited by 3
“Thus, the swift decision-making capability arises from the complex interplay among the individual’s emotional, motivational, and cognitive states, in tandem with environmental factors (Doya, 2008; Ernst & Paulus, 2005).”
Probabilistic Computation and Emotion as Self-regulation
von Haugwitz, R., & Dodig-Crnković, G. (2015) · doi:10.1145/2797433.2797442 · Cited by 3
“As noted in [7], although in standard expected utility theory the probability of each outcome is assumed to be 1 and simplified away [26], experiments have shown that subjects are in fact more likely to undervalue the probabilities [20].”
BackgroundModel learning based on grid cell representations
Guanwen, H., Si, B., & Tang, F. (2017) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2017.8324553 · Cited by 3
A plausible method for assembling a neural circuit for decision-making
Wei, H., & Dai, D. (2018) · Biologically Inspired Cognitive Architectures · doi:10.1016/j.bica.2018.07.001 · Cited by 3
Computational Investigation of Probabilistic Learning Task with Use of Machine Learning
Czestochowska, J., Duda, M., Cwojdzińska, K., Drapała, J., Frydecka, D., & Świątek, J. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-99996-8_30 · Cited by 3
Genes Involved in both Dopaminergic and Serotonergic Pathways and Financial Decision Making
GÜNGÖR, S. (2019) · Prizren Social Science Journal · doi:10.32936/pssj.v3i2.111 · Cited by 3
Memory Modification as Treatment for PTSD: Neuroscientific Reality and Ethical Concerns
Liivoja, R., & Kroes, M. C. W. (2020) · Military and humanitarian health ethics · doi:10.1007/978-3-030-36319-2_13 · Cited by 3
Stress, Vulnerability, and Suicide: The Stress–Diathesis Model
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.003 · Cited by 3
Weight loss impacts risky decisions in obesity
Keweloh, B., Terenzi, D., Froehlich, E., Coricelli, C., Stürmer, P., Rohmann, N., Wietzke, P., Beckmann, A., Laudes, M., & Park, S. Q. (2024) · Clinical Nutrition · doi:10.1016/j.clnu.2024.04.002 · Cited by 3
Reinforcement learning with dopamine: A convergence of natural and artificial intelligence
Masset, P., & Gershman, S. J. (2025) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-443-29867-7.00019-0 · Cited by 6
Desseilles, M. (2013) · Santé mentale au Québec · doi:10.7202/1014947ar · Cited by 3
“Récemment, des modèles complexes ont tenté d’intégrer les quatre principaux neuromodulateurs ascendants et plusieurs régions cérébrales dans l’évaluation et dans la décision (Doya, 2002 ; Doya, 2008).”
The Role of Feedback in Decision Making
Osman, M. (2011) · InTech eBooks · doi:10.5772/16669 · Cited by 4
“…rewards and punishments occur), 2) evaluation of actions in relation to a desired goal (e.g., via rewards and punishments that our actions generate), 3) evaluation of future actions based on the outcome that we have achieved in trying to reach a desire goal (Doya, 2008, Schultz, 2006; Yu, 2007).”
BackgroundRuocco, L. A., Pizzo, A. D., Carnevale, U. A. G., Murolo, M., Sadile, A. G., Arra, C., Topo, E., D’Aniello, A., Curcio, A., Melisi, D., et al. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.11.006 · Cited by 4
Extending cortical-basal inspired reinforcement learning model with success-failure experience
Debnath, S., & Nassour, J. (2014) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2014.6982996 · Cited by 3
Ambiguity in Interpersonal Communication and Its Function
Takahashi, H., & Okada, H. (2010) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.22.450 · Cited by 3
Computational Account of Emotion, an Oxymoron?
Dodig-Crnković, G., von Haugwitz, R., & Almér, A. (2015) · ISIS Summit: The Information Society at the Crossroads · doi:10.3390/isis-summit-vienna-2015-t9.2004 · Cited by 3
Neurodynamics of Decision-Making—A Computational Approach
Nazir, A. H., & Liljenström, H. (2016) · Advances in cognitive neurodynamics · doi:10.1007/978-981-10-0207-6_7 · Cited by 3
“(Gold & Shadlen, 2007; Doya, 2008; Bedia et al., 2012).”
BackgroundModeling effects of neural fluctuations and inter-scale interactions
Liljenström, H. (2018) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5044510 · Cited by 3
How exerting control over outcomes affects the neural coding of tasks and outcomesPreprint
Wisniewski, D., Forstmann, B. U., & Braß, M. (2018) · Ghent University Academic Bibliography (Ghent University) · doi:10.1101/375642 · Cited by 3
Extinction burst could be explained by curiosity-driven reinforcement learningPreprint
Yamada, K., Matsui, H., & Toda, K. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.28.610088 · Cited by 5
“This behavioral evidence demonstrates that intrinsic factors expand learning opportunities and promote learning (27, 28).”
BackgroundLeptourgos, P. (2018) · theses.fr (ABES) · doi:10.70675/dafacdb1z9072z4ec2z8cebz0ca09b93b7ce · Cited by 4
Reward magnitude determines reinforcement learning efficiency
Gong, S., Martell, A., Dudman, J. T., & Coddington, L. T. (2026) · Science · doi:10.1126/science.aeb0813 · Cited by 2
Modeling natural neural networks of decision making with artificial neural networks
Funamizu, A., & Karakida, R. (2025) · Neuroscience Research · doi:10.1016/j.neures.2025.104961 · Cited by 3
Decision-making between biases and strategies: The contribution of cognitive neuroscience
Balconi, M., & Crivelli, D. (2025) · Oñati Socio-legal Series · doi:10.35295/osls.iisl.2308 · Cited by 2
“For example, dopamine signalling pathways have been associated with risk preferences and reward sensitivity, while serotonin modulation impacts impulsivity and patience (Doya 2008).”
Test–retest reliability of the gaze index for sign-tracking and goal-tracking
Badioli, M., Danti, C., Degni, L., Finotti, G., bernardi, V., Mattioni, L., Starita, F., di Pellegrino, G., Giovagnoli, S., Benassi, M., et al. (2026) · Behavior Research Methods · doi:10.3758/s13428-025-02919-5 · Cited by 2
“…evidence has revealed substantial inter-individual variability in how environmental cues are processed and exploited for guiding behavior (Badioli et al., 2024; Degni et al., 2024; Degni & Garofalo, 2025; Doya, 2008; Garofalo et al., 2019; Garofalo & di Pellegrino, 2015; Hoga-rth & Duka, 2006).”
Social hierarchy influences monkeys’ risky decisions
Chaix-Eichel, N., Guerillon, A., Bourgeois‐Gironde, S., Rougier, N. P., Boraud, T., & Ballesta, S. (2026) · Communications Biology · doi:10.1038/s42003-026-09817-2 · Cited by 2
“Middle-ranking individuals are more likely to encounter peers with comparable Elo-ratings, leading to more frequent competitive interactions that may, in turn, induce behavioral 36 and physiological changes 37,38 that in fl u-ence cognitive processes involved in risk-taking 39 – 41 .”
A Neurocomputational Model of Observation-Based Decision Making with a Focus on Trust
Nazir, A. H., Kotaleski, J. H., & Liljenström, H. (2026) · Brain Sciences · doi:10.3390/brainsci16050477 · Cited by 2
“The goal of human decision making could be considered maximizing its utility [5,6], where different types of contextual learning (i.e., individual and social context) contribute to the knowledge base for reaching a decision [7,8].”
A biologically based neural network model for decision making
Nazir, A. H., & Liljenström, H. (2015) · BMC Neuroscience · doi:10.1186/1471-2202-16-s1-p146 · Cited by 2
Can physics and neuroscience allow for free will?
Liljenström, H. (2025) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2948/1/012016 · Cited by 2
“In intertemporal DM, where the relative value of a reward at different time points must be considered, the value of the reward (normally) decreases inversely proportional to time (Doya, 2008).”
Emmanouilidis, C., Waschull, S., & Zotelli, J. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-80775-6_26 · Cited by 5
Reinforcement Learning: Psychologische und neurobiologische Aspekte
Tokic, M. (2013) · Künstliche Intell. · doi:10.1007/s13218-013-0261-4 · Cited by 4
“Steuerung zwischen beider Modi das neuromodulatorische System stark involviert zu sein scheint [7, 14].”
BackgroundRewardLearning: Contributions of Corticobasal Ganglia Circuits to Reward Value Signals
Fareri, D. S., & Delgado, M. R. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511843716.024 · Cited by 9
Stress, monoamines, and cognitive flexibility
Snyder, K. P. (2013) · Scholarly Commons (University of Pennsylvania) · Cited by 3
Moral Neuroscience and Moral Philosophy: Interactions for Ecological Validity
Tachibana, K. (2009) · Kagaku tetsugaku · doi:10.4216/jpssj.42.2_41 · Cited by 3
“These regions are said to relate not only to morality but also to many other functions such as working memory, attention, executive function, and goal-directed behavior (Doya 2008; Osaka (ed.)”
BackgroundStimulus sampling as an exploration mechanism for fast reinforcement learning
Vladimirskiy, B., Vasilaki, E., Urbanczik, R., & Senn, W. (2009) · Biological Cybernetics · doi:10.1007/s00422-009-0305-x · Cited by 2
“…response to a stimulus (Montague et al. 1996), generally addresses the temporal credit assignment problem for state-action sequences (Sutton and Barto 1981, 1998; Schultz et al. 1997; McClure et al. 2003; Seymour et al. 2004; Doya 2008) without offering a simple neural network implementation.”
BackgroundStress, noradrenaline, and realistic prediction of mouse behaviour using reinforcement learning
Sandi, C., Gerstner, W., & Lukšys, G. (2008) · neural information processing systems · Cited by 2
Decisions and Downward Causation in Neural Systems
Liljenström, H., & Nazir, A. H. (2016) · Advances in cognitive neurodynamics · doi:10.1007/978-981-10-0207-6_23 · Cited by 2
The Role of the Amygdala in Value-Based Learning
Hassall, C. D., & Williams, C. C. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1073-17.2017 · Cited by 2
“Complicating efforts to distinguish the roles of the amygdala, the OFC, and the MFC in decision-making, neural activation in all three areas is often related during decisionmaking tasks (Doya, 2008).”
BackgroundInfluentialDevelopment of Human-Like Driving Decision Making Model based on Human Brain Mechanism
Sakuma, T., Miura, S., Miyashita, T., Fujie, M. G., & Sugano, S. (2019) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii.2019.8700430 · Cited by 2
“Because of difference of used brain area, decision-making model of these levels must be different [14], and in this paper, we propose a TASK level driver model based on the human brain architecture.”
MethodModels of making choice and control over thought for action
Indrajeet, I., Goyal, S., Miyapuram, K. P., & Ray, S. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819445-4.00004-7 · Cited by 2
Computational approach to depression: From the viewpoint of reinforcement learning
Kunisato, Y., Katahira, K., Okimura, T., & Yamashita, Y. (2019) · doi:10.24602/sjpr.62.1_88 · Cited by 5
“…的神経科学の分野で活躍した研究者が,2010 年 代から精神医学研究を行うようになり(Maia & Frank, 2011;Montague et al., 2012),現在は計算 論的精神医学として研究領域を形成している。計 算論的精神医学はまだ始まって間もない研究領 域であるが,国内外で複数の教科書の出版がなさ れ (Redish & Gordon, 2016;国里ら, 2019),専門 誌 (Computational Psychiatry) も発刊されるように なっている。 計算論的アプローチを精神障害研究に適用す る利点として,新たな疾病分類やバイオマーカー…”
Dynamic Modulation of a Learned Motor Skill for Its Recruitment
Min, K., Lee, J., & Kakei, S. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.457682 · Cited by 2
“In the cortico-BG loop (Barto, 1995; Doya, 2000, 2007, 2008; Ito and Doya, 2011), the BG selectively disinhibits the activities of both M1 and the brainstem to select the optimal tactic for motion control (Hikosaka et al., 2000).”
Des interactions avec des robots: Une étude à partir de mises en jeu
Paré, Z. (2023) · e-Phaïstos · doi:10.4000/ephaistos.10980 · Cited by 2
Cardinal, R. N., & Everitt, B. J. (2010) · Elsevier eBooks · doi:10.1016/b978-0-08-045396-5.00167-6 · Cited by 2
Relative gains and losses in risky choice
Marshall, A. T. (2013) · K-State Research Exchange (Kansas State University) · Cited by 2
Delay discounting as a measure of impulsivity.
Gu, L. (2012) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 2
Pain in context: the effect of goal competition on pain-related fear and avoidance
Claes, N. (2016) · Ghent University Academic Bibliography (Ghent University) · Cited by 3
Motivational modulation of flight speed in foraging bumblebeesPreprint
Willemet, R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.06.583792 · Cited by 3
Adaptive Integration of Perceptual and Reward Information in an Uncertain WorldPreprint
Ganesh, P., Cichy, R. M., Schuck, N. W., Finke, C., & Bruckner, R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.04.24.590947 · Cited by 2
“…stimuli and environmental states is difficult (Bach & Dolan, 2012; Ma & Jazayeri, 2014; Rao, 2010), which makes it challenging to assign experienced rewards to the correct state during credit assignment (Babayan et al., 2018; Courville et al., 2006; Doya, 2008; O’Reilly & Frank, 2006; Rao, 2010).”
BackgroundFrom Fly Detectors to Action Control: Representations in Reinforcement Learning
Rusanen, A., Lappi, O., Pekkanen, J., & Kuokkanen, J. (2021) · Philosophy of Science · doi:10.1086/715513 · Cited by 1
Exploration and behavioral variability
Fauré, P. (2025) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-443-29867-7.00026-8 · Cited by 3
Increased Baseline Pupil Size Linked to Uncertainty Avoidance in Decision Making
Kakaei, E., Schlecht, A., & Hauser, T. U. (2026) · European Journal of Neuroscience · doi:10.1111/ejn.70394 · Cited by 1
“NA is believed to signal different forms of uncertainty (Aston-Jones and Cohen 2005; Dayan and Yu 2006; Doya 2008; Yu and Dayan 2005).”
Integrated Neural Circuitry Supporting Emotion Regulation and Decision-Making
Schmidt, H., & Helion, C. (2026) · Springer eBooks · doi:10.1007/978-3-032-02925-6_20 · Cited by 2
Arousal shapes motivation: an integrative framework for understanding motivational deficits
Thurn, L., Culbreth, A. J., & Hernaus, D. (2026) · Translational Psychiatry · doi:10.1038/s41398-026-04113-3 · Cited by 1
“Large-scale cortical networks and multiple neurochemical systems, including serotonin, dopamine, and acetylcholine, jointly regulate valuation and decision-making in continuous, bidirectional, interaction with arousal-mediating systems [24].”
Tqemaladze, J. (2025) · Longevity Horizon · doi:10.65649/ad885083 · Cited by 1
Learning Nursery Rhymes Using Adaptive Parameter Neurodynamic Programming
Walker, J., & Chalup, S. K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-14803-8_16 · Cited by 2
AD‐Type Neuron Loss in Transgenic Mouse Models
Manaye, K. F., & Mouton, P. R. (2013) · Wiley eBooks · doi:10.1002/9781118444177.ch13 · Cited by 1
Metadata
- Authors
- Doya, K.
- Affiliations
- Okinawa Institute of Science and Technology Graduate University (JP)
- Corresponding author
- Doya, Kenji
- ORCID
- Doya, Kenji
- Venue
- Nature Neuroscience
- Published
- 2008-03-26
- Volume
- 11
- Issue
- 4
- Pages
- 410-416
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W1971976749
- Cited by
- 642
- References
- 93
- Citations by year
- 2026: 22 · 2025: 18 · 2024: 30 · 2023: 15 · 2022: 26 · 2021: 35 · 2020: 34 · 2019: 51 · 2018: 57 · 2017: 31 · 2016: 39 · 2015: 43 · 2014: 43 · 2013: 45 · 2012: 37
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- decision-making, contextual modulation, reward anticipation, risk-taking, uncertainty, delay discounting, dopamine, anterior cingulate cortex, norepinephrine, orbitofrontal cortex, serotonin, dorsal striatum, dorsal prefrontal cortex, reinforcement learning, computational models of decision making
- MeSH terms
- Algorithms, Animals, Decision Making, Environment, Gyrus Cinguli, Humans, Models, Neurological, Models, Psychological, Probability Learning, Reward, Neurotransmitter Agents, Computational Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.