Neural and neurochemical basis of reinforcement-guided decision making
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 3×
“The actor-critic model, a recent model of the reinforcement learning theory, has suggested involvement of two distinct components: a “critic” that uses prediction error information to predict future rewards and an “actor” that uses the same information to update action values to ensure the choice of better ones (O’Doh…”
BackgroundMethodDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 1×
“…range from motivation (Satoh et al. 2003), reward magnitude (Calaminus and Hauber 2009), valence (Koob 1996), and probability and uncertainty (Fiorillo et al. 2003) to reward memory (Yamagata et al. 2015) and are integrated with various other information regarding other aspects of the…”
BackgroundDifferent contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Bechara, A., Damasio, H., Damasio, A. R., & Lee, G. P. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05473.1999 · Cited by 2,001 · cited 2×
“…OFC/vmPFC. Studies have shown that amygdala is important for emotional and autonomic aspects of decision making, and patients with damage to amygdala were unable both to perform optimal decision making and to produce anticipatory skin conductance responses (Bechara et al. 1999; Gupta et al. 2011).”
BackgroundUncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 3×
“Several computational models have also implicated norepinephrine in the processing of decision making (Brown et al. 2005; Shea-Brown et al. 2008; Yu and Dayan 2005).”
BackgroundNeural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Decision making, the P3, and the locus coeruleus–norepinephrine system
Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.4.510 · Cited by 1,678 · cited 1×
“Additionally, it has been suggested that P3, an important component of event-related brain potential during decision processes, reflects phasic activity of LC noradrenergic neurons in response to the outcome of internal decision making processes (for a review, see Nieuwenhuis et al. 2005).”
BackgroundNeurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Reward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426 · cited 1×
“The most prominent role has been the encoding of reward representation and expectation (Burton et al. 2015; O’Doherty 2004; Schultz 2004), but other specific roles have also been suggested.”
BackgroundThe Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
The root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342
Cited by
An Overview of Emotion in Artificial Intelligence
Assunção, G., Patrão, B., Castelo-Branco, M., & Menezes, P. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3159614 · Cited by 103
Joshi, S., & Gold, J. I. (2022) · eLife · doi:10.7554/elife.63490 · Cited by 71
Assaf, M., Rabany, L., Zertuche, L., Bragdon, L., Tolin, D., Goethe, J., & Diefenbach, G. (2018) · Brain and Behavior · doi:10.1002/brb3.1015 · Cited by 48
Metadata
- Authors
- Khani, A., & Rainer, G.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2016-08-01
- Volume
- 116
- Issue
- 2
- Pages
- 724-741
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W2399127861
- Cited by
- 35
- References
- 64
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Neural and neurochemical basis of reinforcement-guided decision making. https://app.cochat.ai/papers/10.1152/jn.01113.2015
- The paper
- Khani, A., & Rainer, G. (2016). Neural and neurochemical basis of reinforcement-guided decision making. Journal of Neurophysiology. https://doi.org/10.1152/jn.01113.2015
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.