The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Dopamine prediction error responses integrate subjective value from different reward dimensions
Open accessAbstract
Significance: Most real-world rewards have multiple dimensions, such as amount, risk, and type. Here we show that within a bounded set of such multidimensional rewards monkeys’ choice behavior fulfilled several core tenets of rational choice theory; namely, their choices were stochastically complete and transitive. As such, in selecting between rewards, the monkeys behaved as if they maximized value on a common scale. Dopamine neurons encoded prediction errors that reflected that scale. A particular reward dimension influenced dopamine activity only to the extent that it influenced choice. Thus, vastly different reward types such as juice and food activated dopamine neurons in accordance with subjective value derived from the different rewards. This neuronal signal could serve to update value signals for economic choice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Dopamine neurons show higher activations in response to the preferred juice, and their activity also correlates with the indifference amounts in choices between risky and safe rewards, indicating that the neurons consistently code subjective rather than objective reward value9.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [9]
In the citing paper
“Stimuli of all sensory modalities are effective in eliciting this initial response component; those tested include loud sounds, intense light flashes, rapidly moving visual objects and liquids touching the mouth2,9,16,19,20,35.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [9]
In the citing paper
“these changes fail to occur with more-controlled arm, mouth and eye movements in a considerable range of studies2,5,9,13,151,152,154”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [9]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationIndividual Choice Behavior: A Theoretical Analysis.
Cane, V. R., & Luce, R. D. (1960) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343282 · Cited by 2,538
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Self-citationRegulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry
Kravitz, A. V., Freeze, B. S., Parker, P. R. L., Kay, K., Thwin, M. T., Deisseroth, K., & Kreitzer, A. C. (2010) · Nature · doi:10.1038/nature09159 · Cited by 1,885
A Discounting Framework for Choice With Delayed and Probabilistic Rewards.
Green, L., & Myerson, J. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.5.769 · Cited by 1,676
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Modulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593 · cited 1×
“D1R-mediated dopamine activity enhances the suppression of working memory fields in the PFC, sculpting and sharpening the response of the PFC network for greater task fidelity (46, 47).”
Background
Cited by
Sorted by citations
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Self-citationDopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036
Self-citationDopamine reward prediction error coding
Schultz, W. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/wschultz · Cited by 597
Self-citationDopamine and Cognitive Control in Prefrontal Cortex
Ott, T., & Nieder, A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.006 · Cited by 530
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437
Metadata
- Authors
- Lak, A., Stauffer, W. R., & Schultz, W.
- Affiliations
- University of Cambridge (GB)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2014-01-22
- Volume
- 111
- Issue
- 6
- Pages
- 2343-2348
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC3926061
- OpenAlex
- W2010297727
- Cited by
- 257
- References
- 51
- Citations by year
- 2026: 8 · 2025: 19 · 2024: 17 · 2023: 23 · 2022: 16 · 2021: 24 · 2020: 15 · 2019: 22 · 2018: 24 · 2017: 26 · 2016: 26 · 2015: 24 · 2014: 13
- FWCI
- 13.55
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- other-oa
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- dopamine, prediction error, subjective value, economic choice, reward magnitude, risk, reward type, single-unit recording, primate decision making, value integration, reinforcement learning
- MeSH terms
- Animals, Dopamine, Macaca mulatta, Male, Neurons, Probability, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
