Modulators of decision making
The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Abstract
Human and animal decisions are modulated by a variety of environmental and intrinsic contexts. Here I consider computational factors that can affect decision making and review anatomical structures and neurochemical systems that are related to contextual modulation of decision making. Expectation of a high reward can motivate a subject to go for an action despite a large cost, a decision that is influenced by dopamine in the anterior cingulate cortex. Uncertainty of action outcomes can promote risk taking and exploratory choices, in which norepinephrine and the orbitofrontal cortex appear to be involved. Predictable environments should facilitate consideration of longer-delayed rewards, which depends on serotonin in the dorsal striatum and dorsal prefrontal cortex. This article aims to sort out factors that affect the process of decision making from the viewpoint of reinforcement learning theory and to bridge between such computational needs and their neurophysiological substrates.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, structures such as the basal ganglia, parietal cortex, and thalamus support procedural learning, visuospatial coordination, and sensory integration (Corbetta and Shulman, 2002; Doya, 2008; Sherman, 2016).”
From Enhancement of modern defense capabilities by convergence of cognitive neuroscience and artificial intelligence (2026) · cites this paper as Doya, 2008
In the citing paper
“Basal ganglia enable procedural learning, habit formation, and reinforcement-driven behaviors (Doya, 2008), i.e., reinforcement-based decision-making, allowing operators to execute complex behaviors automatically under pressure.”
From Enhancement of modern defense capabilities by convergence of cognitive neuroscience and artificial intelligence (2026) · cites this paper as Doya, 2008
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Neural recording experiments in animals reveal that midbrain dopamine neurons encode reward prediction error”
BackgroundMarkov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122 · cited 1×
“In many animal and human choice experiments, subjects tend to be more sensitive to differences in shorter delays than longer delays, which is well modeled by hyperbolic function”
BackgroundMarkov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316887 · Cited by 6,024
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472 · cited 1×
“Norepinephrine is also suggested to be important in regulating the decision to explore alternatives versus exploiting a known resourc”
BackgroundTheory of Games and Economic Behavior
Hawkins, D. (1945) · Philosophy of Science · doi:10.1086/286866 · Cited by 3,887
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 1×
“Also, functional magnetic resonance imaging (fMRI) experiments using a monetary questionnair”
Method
Research works printed but not linked: 1
- Doya, K., Ishii, S., Pouget, A. & Rao, R. Bayesian Brain: Probabilistic Approach to Neural Coding and Learning (MIT Press, Cambridge, Massachusetts, USA, (2007).
Cited by
Items 601–688 of 688
Perzeptuelle Entscheidungsfindung
Heekeren, H. R., & Green, N. (2010) · Gabler eBooks · doi:10.1007/978-3-8349-6373-4_5
Computational Psychiatry and the Bayesian Brain
Friston, K. J., & Dolan, R. J. (2017) · Oxford University Press eBooks · doi:10.1093/med/9780190681425.003.0072
van Heeringen, K. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316563205.014
Log, Stock and Two Simple Lotteries: Technical SupplementPreprint
Verstyuk, S. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3120083
Cappa, S. F., & Canessa, N. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.56028-0 · Cited by 1
Hegedűs, K. M. (2021) · SZTE Repository of Dissertations (University of Szeged) · doi:10.14232/phd.11089
Melanopsin cell contributions to visual perception and decision making in humans
Gnyawali, S. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.231544
A Behavioral and Cognitive View of Social Innovation
Deréky, A., & Brusoni, S. (2022) · Issues in business ethics · doi:10.1007/978-3-030-96596-9_4
Collins, A. G. E. (2010) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 5
Nörofinansın Sinirsel Bağlantıları Üzerine
Polat, Y. (2023) · Abant Sosyal Bilimler Dergisi · doi:10.11616/asbi.1213602
Computational Cognitive Models of Reinforcement Learning
Doya, K. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108755610.026
Self-citationIrrelevant comparisons affect people's exploration strategies in different waysPreprint
Zhang, S., Haofei, W. U., Hu, K., Liu, Q., & Wu, H. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/74qvb
Involuntary memories are not déjà vu
Gülgöz, S., & Ergen, İ. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x2300002x
Cuttoli, R. D.-D. (2018) · theses.fr (ABES) · doi:10.70675/5c4cff84za45az4928zb998zb62ea6f6c10f · Cited by 1
Cabeza, L. (2021) · theses.fr (ABES) · doi:10.70675/90e2e128z8bcdz40d6zabedzebf0dc7b7e09
Adaptive learning in humans, brains and neural networks : the role of uncertainty and probabilities
Foucault, C. (2023) · theses.fr (ABES) · doi:10.70675/4308ecd4z4d98z46acz858bz78808e44098f · Cited by 3
DO COGNITIVE BIASES INFLUENCE INVESTMENT DECISIONS BASED ON TECHNICAL FACTORS?
Sharma, D. J. (2024) · Sachetas · doi:10.55955/320003
“Here are a few of them, as outlined by Doya (2008): 1.”
BackgroundThe metacognitive adaptation of mental effort : a computational approach to self-efficacy learning
Hopper, W. (2023) · theses.fr (ABES) · doi:10.70675/adf6f54fzd999z446cza1f0z5723b7e1b20b · Cited by 1
Willentliche Handlungssteuerung und kognitive Kontrolle
Goschke, T. (2024) · Springer eBooks · doi:10.1007/978-3-662-68476-4_9
Adaptive Integration of Perceptual and Reward Information in an Uncertain WorldPreprint
Ganesh, P., Cichy, R. M., Schuck, N. W., Finke, C., & Bruckner, R. (2024) · eLife · doi:10.7554/elife.99266.1
Psychological factors of economic decision-making process
Мишенин, Е. С. (2024) · Vestnik Universiteta · doi:10.26425/1816-4277-2024-10-229-235
Computational Psychiatry and the Bayesian Brain
Friston, K. J., & Gu, X. (2025) · Oxford University Press eBooks · doi:10.1093/med/9780197640654.003.0071
Robertazzi, F., Vissani, M., & Falotico, E. (2025) · International Journal of Neural Systems · doi:10.1142/s0129065725500406
Circular causality in volition
Liljenström, H. (2025) · Frontiers in Network Physiology · doi:10.3389/fnetp.2025.1631899
“Time is a key parameter here: in intertemporal DM, future rewards are often undervalued — a tendency that leads to prioritizing immediate over delayed bene fi ts, although this generally leads to a net loss (Doya, 2008).”
Hodapp, A., & Meyniel, F. (2025) · eLife · doi:10.1101/2025.07.31.667879
“Other receptors that were significant across studies and with a consistent direction of the effect, were also in line with neuromodulatory systems suggested to play a role in the mediation of learning under uncertainty, 5-HT 6 (serotonin), and D 1 and D 2 (dopamine) in particular (Doya, 2002, 2008).”
From optimality to reality: decision-making in basal ganglia outputPreprint
Zur, G., Larry, N., & Joshua, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.10.29.685254
Ke, D., Li, J., Liao, J., Chen, J., Wang, X., Meng, F., & Zhang, D. (2025) · Measurement · doi:10.1016/j.measurement.2025.119973
Une approche neuro-computationnelle de la prise de décision et de sa régulation contextuelle
Domenech, P. (2011) · theses.fr (ABES) · doi:10.70675/99ff5c03z7b62z455azb106z139e15b28c80
Navigational strategy switching in ageing
Harris, M. A. (2014) · ERA
Soegyono, O. (2025) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/31010
Fam, J. P. (2016) · UNSWorks (University of New South Wales, Sydney, Australia) · doi:10.26190/unsworks/18888
Barzan, R. (2023) · Dokumentenrepositorium der RUB (Ruhr University Bochum) · doi:10.13154/294-9957
Diurnal Rhythms in Learning, Motivated Behaviors, and Dopamine Dynamics
Stowe, T. A. (2022) · WakeSpace Scholarship (Wake Forest University)
(18643594), A. H. N. (2024) · Open Archive (Karolinska Institutet)
Muela, I. (2024) · Institutional Repository of the University of Granada (University of Granada) · Cited by 2
Differences in Race and Gender of Retired Servicemembers in the Decision to Reenlist
Loeza, S. R. (2024) · ScholarWorks (Walden University)
Pharmacological and Genetic Effects of Serotonin on Value-Based Decision-Making
Neukam, P. T. (2020) · Qucosa (Saxon State and University Library Dresden)
The cognitive contours of punishment
Sarin, A. (2023) · UCL Discovery (University College London)
Loovuse mudeldamine tehisnärvivõrkudega
Kirikal, J. (2025) · DSpace repository (University of Tartu)
Gladding, J. M., Soegyono, O., Abiero, A., Turner, K. M., Kendig, M. D., Nolan, C., & Bradfield, L. A. (2026) · eNeuro · doi:10.64898/2026.01.12.699167
Yu, Z., Rubin, J. E., & Verstynen, T. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.17.706272
Baier, C., Rivera, D. C., Dubslaff, C., Kiebel, S. J., & Wienhöft, P. (2026) · Elsevier eBooks · doi:10.1016/b978-0-44-330044-8.00026-9
Kim, J., & Kang, D. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3688
Emerging insights in human brain and behavior from intracranial recordings
Tong, A. P. (2026) · Exploration of neuroscience · doi:10.37349/en.2026.1006131
Dopamine et contrôle de l’action : implication et maturation de la voie mésocorticale chez le rat
Naneix, F. (2011) · theses.fr (ABES) · doi:10.70675/001d4221ze950z4b8dz8178z8e2211b1bc4c
Rivalan, M. (2009) · theses.fr (ABES) · doi:10.70675/1bd0ae1dz3ec8z4abez9544z7b0929153e49 · Cited by 3
Fitoussi, A. (2011) · theses.fr (ABES) · doi:10.70675/f12f1cc3z0901z49d6z830az6ab14398a93d
Skvortsova, V. (2015) · theses.fr (ABES) · doi:10.70675/689de32az1e54z4d0cz9034ze64320166cdf
Varazzani, C. (2015) · theses.fr (ABES) · doi:10.70675/5878e729z4cd7z4a4fzb97azcffcb1e3f7ec
Modulation noradrénergique de l’attention
Guedj, C. (2016) · theses.fr (ABES) · doi:10.70675/d208400cz08cez4a3aza0e5z1816500f60a8
“…la sérotonine dans des tâches impliquant un délai de réponse (‘delay discounting tasks’) ou d’inversion d’un apprentissage (‘reversal-learning tasks’) (Doya 2008), l’acétylcholine dans la détection des stimuli (Sarter et al. 2005) et la NA dans des tâches d’attention soutenue et d’exploration…”
Flexibility in value-based decision-making
Jahn, C. I. (2018) · theses.fr (ABES) · doi:10.70675/24ffd7ecz04aez45dez9bfdzff312b4881a8
Damasse, J.-B. (2018) · theses.fr (ABES) · doi:10.70675/193e9600zb9f9z4bcazb4c1z4369b97dce0c
Computational learning noise in human decision-making
Findling, C. (2018) · theses.fr (ABES) · doi:10.70675/32e62279zea97z45b1z9326z06a449dae472
Borderies, N. (2020) · theses.fr (ABES) · doi:10.70675/03f23bddzae42z426aza9e6z34fb21ff3d9e
Evolving principes of artificial neural design
Wilson, D. G. (2019) · theses.fr (ABES) · doi:10.70675/b678f35dz7ee5z441ez93f3ze801472a9a28
Implication of the locus coeruleus in effort processing : electrophysiological studies
Bornert, P. (2021) · theses.fr (ABES) · doi:10.70675/665d6bd7ze2f5z41c9z93f8z764be3c6d822
Metalearning under uncertainty
Beaumont, S. (2022) · theses.fr (ABES) · doi:10.70675/c9e7b8d7z0509z44e7z8933z23ed639ebc4d
Impact of aging on human decision-making in ecological conditions
Aubert, J. D. S. (2023) · theses.fr (ABES) · doi:10.70675/f7143113zd412z4b5fza432z1032ef6ea209
Rôle de l'acétylcholine préfrontale dans les comportements sociaux
Lhopitallier, C. (2022) · theses.fr (ABES) · doi:10.70675/d11e07bfz4199z419azba80z60d0aba3994a
Development and study of coadaptive interactive systems
Dechaux, A. (2024) · theses.fr (ABES) · doi:10.70675/24336488z62bdz4b32zbc69z1620e376bc34
Impact of emotional biases on the fundamental analysis aspect of Investment decision
Sharma, D. J. (2026) · Asian Journal of Management and Commerce · doi:10.22271/27084515.2026.v7.i4a.1165
Cortical beta power reflects the influence of Pavlovian cues on human decision-makingPreprint
Degni, L., Garofalo, S., & Finotti, G. (2026) · OSF Preprints (OSF Preprints)
Multi‐Omics Reveals Dysregulated Neurotransmitter Systems in Aging and CNS Disorders
Niu, R.-Z., Zhang, M., Li, Y., Zhou, X., Liu, X. J., Wu, J., Wang, W. Q., Wang, Y., Ruan, Y., Ding, Y., et al. (2026) · Aging Cell · doi:10.1111/acel.70544
“This distribution suggests their crucial roles in cortical output and neural regulation (Doya 2008; Shepherd 2013; Celada et al. 2013).”
Sunzeri, F. (2026) · Springer eBooks · doi:10.1007/978-3-032-14465-2_14
Chen, J., Taira, M., & Doya, K. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.08.729424
“The classical theories suggest that exploitation and exploration form a trade-off, even though exploration is essential for adaptation to change [42, 43, 44].”
Self-citationPupil responses reveal temporally distinct signatures of value updating and decision strategyPreprint
Dang, S., & Pooresmaeili, A. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.13.732042
“Value ‐ based decisions require the integration of expected rewards, costs, and environmental structure, processes that are critically shaped by interacting neuromodulatory systems (Doya, 2008).”
InfluentialOn pharmacological potential to modify human memory
Pruś, A. (2026) · Ethics & bioethics · doi:10.2478/ebce-2026-0013
Predictive dysfunction: toward a unifying mechanism-based framework for psychiatry
van Fenema, E. M., & Jacobs, G. E. (2026) · Translational Psychiatry · doi:10.1038/s41398-026-04356-0
Creating and Testing a School Evaluation Tool Aligning Education Practices and Neurocognition Theory
Ryan, C., & Leadbetter, R. (2026) · Mind Brain and Education · doi:10.1111/mbe.70057
“To support the desired positive relationships (Giota and Gustafsson 2021), classroom environments need to be predictable (Doya 2008) and fostered in tandem with the development of social–emotional learning environments (Durlak et al. 2011).”
The role of inhibition in modeling decision making with spiking neural networks
Król-Józaga, B., Duggins, P., Broniec, A., & Wichary, S. (2026) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2026.1854811
“Similar findings have been reported in studies exploring neuromodulatory influences on cognitive control and decision-making (Doya, 2008; Wang, 2008).”
Working memory limitations and dopamine modulation in probabilistic reasoningPreprint
Aghamohammadi, C., van Kempen, J., Stapleton, M., Gieselmann, M. A., Langdon, C., Thiele, A., & Engel, T. A. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.08.12.744547
“These adjustments enable dopamine to mediate value-based learning and decision-making during cognitively demanding tasks 32,33 , primarily through D1 receptors (D1Rs) in the prefrontal cortex (PFC) 34,35 .”
Stochastic Decision Policy Is Optimal Under Costly ControlPreprint
Li, J., Louie, K., Vittala, A., Mattar, M., Glimcher, P. W., & Shen, B. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.06.757200
“Tonic dopamine has been proposed to set the e ! ective temperature of a softmax policy (Doya, 2008; Humphries et al., 2012), and noradrenergic gain modulation shifts behavior between focused and labile modes (Aston-Jones and Cohen, 2005; Tervo et al., 2014).”
Choosing between needs: Neural circuits of feeding–social behavioural prioritisation in rodents
Granon, S., & Rappeneau, V. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.107080 · Cited by 1
Anterior cingulate cortex : contributions to social cognition
Apps, M. A. J. (2012) · Royal Holloway Digital Repository (Royal Holloway University of London)
Role of goal-orientated attention and expectations in visual processing and perception
Chalk, M. (2013) · ERA · Cited by 1
Duvelle, É. (2014) · theses.fr (ABES) · doi:10.70675/57a426b7z438fz4b5bz85c8zc7c6a87da958
Synaptic Mechanisms and Cognitive Computations Underlying Stress Effects on Cognitive Function
Lukšys, G., & Sandi, C. (2014) · Springer eBooks · doi:10.1007/978-1-4939-1056-4_12
(2012) · Figshare
Metadata
- Authors
- Doya, K.
- Affiliations
- Okinawa Institute of Science and Technology Graduate University (JP)
- Corresponding author
- Doya, Kenji
- ORCID
- Doya, Kenji
- Venue
- Nature Neuroscience
- Published
- 2008-03-26
- Volume
- 11
- Issue
- 4
- Pages
- 410-416
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W1971976749
- Cited by
- 642
- References
- 93
- Citations by year
- 2026: 22 · 2025: 18 · 2024: 30 · 2023: 15 · 2022: 26 · 2021: 35 · 2020: 34 · 2019: 51 · 2018: 57 · 2017: 31 · 2016: 39 · 2015: 43 · 2014: 43 · 2013: 45 · 2012: 37
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- decision-making, contextual modulation, reward anticipation, risk-taking, uncertainty, delay discounting, dopamine, anterior cingulate cortex, norepinephrine, orbitofrontal cortex, serotonin, dorsal striatum, dorsal prefrontal cortex, reinforcement learning, computational models of decision making
- MeSH terms
- Algorithms, Animals, Decision Making, Environment, Gyrus Cinguli, Humans, Models, Neurological, Models, Psychological, Probability Learning, Reward, Neurotransmitter Agents, Computational Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.