The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Dopamine prediction error responses integrate subjective value from different reward dimensions
Open accessAbstract
Significance: Most real-world rewards have multiple dimensions, such as amount, risk, and type. Here we show that within a bounded set of such multidimensional rewards monkeys’ choice behavior fulfilled several core tenets of rational choice theory; namely, their choices were stochastically complete and transitive. As such, in selecting between rewards, the monkeys behaved as if they maximized value on a common scale. Dopamine neurons encoded prediction errors that reflected that scale. A particular reward dimension influenced dopamine activity only to the extent that it influenced choice. Thus, vastly different reward types such as juice and food activated dopamine neurons in accordance with subjective value derived from the different rewards. This neuronal signal could serve to update value signals for economic choice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Dopamine neurons show higher activations in response to the preferred juice, and their activity also correlates with the indifference amounts in choices between risky and safe rewards, indicating that the neurons consistently code subjective rather than objective reward value9.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [9]
In the citing paper
“Stimuli of all sensory modalities are effective in eliciting this initial response component; those tested include loud sounds, intense light flashes, rapidly moving visual objects and liquids touching the mouth2,9,16,19,20,35.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [9]
In the citing paper
“these changes fail to occur with more-controlled arm, mouth and eye movements in a considerable range of studies2,5,9,13,151,152,154”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [9]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationIndividual Choice Behavior: A Theoretical Analysis.
Cane, V. R., & Luce, R. D. (1960) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2343282 · Cited by 2,538
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Self-citationRegulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry
Kravitz, A. V., Freeze, B. S., Parker, P. R. L., Kay, K., Thwin, M. T., Deisseroth, K., & Kreitzer, A. C. (2010) · Nature · doi:10.1038/nature09159 · Cited by 1,885
A Discounting Framework for Choice With Delayed and Probabilistic Rewards.
Green, L., & Myerson, J. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.5.769 · Cited by 1,676
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Modulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593 · cited 1×
“D1R-mediated dopamine activity enhances the suppression of working memory fields in the PFC, sculpting and sharpening the response of the PFC network for greater task fidelity (46, 47).”
Background
Cited by
Sorted by citations
Items 201–256 of 256
Kajtor, M., Billes, V., Király, B., Karkusova, P., Kovács, T., Stabb, H., Sviatkó, K., Vizi, A., Ujvári, E., Balázsfi, D., et al. (2024) · eLife · doi:10.7554/elife.90905 · Cited by 1
Composing the value signal for dopamine-mediated learningPreprint
Mahajan, P., & Seymour, B. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.10.10.681616 · Cited by 2
Need-selective gating of dopamine neuron cue responses by real and virtual hungerPreprint
Mamaligas, A. A., Berke, J. D., Kreitzer, A. C., & Knight, Z. A. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.11.29.691326 · Cited by 1
Computational Modeling of the Basal Ganglia : Functional Pathways and Reinforcement Learning
Berthet, P. (2015) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
de Lima, B. F. C. (2014) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Hosking, J. G. (2014) · cIRcle (University of British Columbia) · doi:10.14288/1.0166997
Article Dopamine Reward Prediction Error Responses Reflect Marginal Utility
Stauffer, W. R., Lak, A., & Schultz, W. (2014)
Self-citationReward and Decision Encoding in Basal Ganglia
Tian, J., Uchida, N., & Eshel, N. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00005-1
Brain Reward Processing in Eating Disorders: Opportunities to Build Upon?
Frank, G. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.07.779
Dunn, T. L. (2017) · UWSpace (University of Waterloo)
Neural Circuit Mechanisms Underlying Dopamine Reward Prediction Errors
Tian, J. (2016) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Does the Dopaminergic Error Signal Act Like a Cached-Value Prediction Error?
Sharpe, M. J., & Schoenbaum, G. M. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-812098-9.00011-5
Novelty and surprise-timing are broadcast by the basal forebrainPreprint
Zhang, K., Chen, C. D., & Monosov, I. E. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/397513
Dopamine Transients in the Ventral Tegmental Area Attenuate Aversive Prediction Error
Mahmud, A. (2018) · Spectrum Research Repository (Concordia University)
Neurobehavioral Measurements of Natural and Opioid Reward Value
Smith, A. P. (2019) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2019.316
Changes in subjective preference do not require dopamine signaling or the orbital frontal cortexPreprint
Lefner, M. J., Magnon, A. P., Gutierrez, J. M., Lopez, M. R., & Wanat, M. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/865436
Adaptive Economics: A neuroethological approach to the study of preferences, biases, and choice
Bujold, P. M. (2019) · Apollo (University of Cambridge) · doi:10.17863/cam.48007
Hori, Y., Nagai, Y., Mimura, K., Suhara, T., Higuchi, M., Bouret, S., & Minamimoto, T. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.11.27.400911
Enhanced preference for delayed rewards requires the basolateral amygdala and retrosplenial cortexPreprint
Lefner, M. J., Magnon, A. P., Gutierrez, J. M., Lopez, M. R., & Wanat, M. J. (2021) · bioRxiv · doi:10.1101/2021.01.14.426754
Ferrari-Toniolo, S., Bujold, P. M., Fabian Grabenhorst, B., Báez-Mendoza, R., & Schultz, W. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3542282
Self-citationDistinct cortico-striatal compartments drive competition between adaptive and automatized behaviorPreprint
Barnett, W. H., Kuznetsov, A. S., & Lapish, C. C. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.05.21.445068
Reward Value Revealed by Auction in Rhesus MonkeysPreprint
Al-Mohammad, A., & Schultz, W. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3598157
Self-citationFerrari-Toniolo, S., & Schultz, W. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.13.468353
Self-citationIncertohypothalamic A13 dopaminergic neurons are involved in fine forelimb movements but not rewardPreprint
Garau, C., Hayes, J., Chiacchierini, G., McCutcheon, J. E., & Apergis‐Schoute, J. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.03.30.486380
Lateral Habenula Neurons Signal Step-by-Step Changes of Reward ForecastPreprint
Lee, H., & Hikosaka, O. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4073008
Schultz, W. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.732084303.793565156
Self-citationRisky Choice: Probability Weighting Explains Independence Axiom Violations in MonkeysPreprint
Ferrari-Toniolo, S., Seak, L. C. U., & Schultz, W. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3962167
Self-citationSchultz, W. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.727392887.793565155
Self-citationKalaska, J. F. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.732096470.793560121
(2022) · Society for Neuroscience eBooks · doi:10.1523/hon.012012
Informational communication and metacognition
Proust, J. (2023) · Evolutionary Linguistic Theory · doi:10.1075/elt.00046.pro
Kajtor, M., Billes, V., Király, B., Karkusova, P., Kovács, T., Stabb, H., Sviatkó, K., Vizi, A., Ujvári, E., Balázsfi, D., et al. (2025) · eLife · doi:10.1101/2023.08.29.555311
The role of orbitofrontal cortex in economic choice behavior
Padoa‐Schioppa, C., & Shi, W. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00046-2
Kajtor, M., Billes, V., Király, B., Stabb, H., Sviatkó, K., Ujvári, E., Balázsfi, D., Seidenbecher, S. E., Kvitsiani, D., Vellai, T., et al. (2024) · eLife · doi:10.7554/elife.90905.1
(2024) · Elsevier eBooks · doi:10.1016/b978-0-443-15596-3.16001-1
Rethinking Memory Impairments: Retrieval FailurePreprint
Alfei, J. M., Miller, R. R., Ryan, T. J., & Urcelay, G. P. (2024) · doi:10.31234/osf.io/zjxvu
Kopytin, G., Іванова, М., Ruiz, M. H., & Шестакова, А. Н. (2024) · Behavioral Sciences · doi:10.3390/bs14020124
Dopamine tracks adaptive learning of action representationsPreprint
Côme, M., Lespart, A., Gulmez, A., Keshishian, L., Jehl, J., Bousseyrol, E., Didienne, S., Vicq, É., Borgne, T. L., Mourot, A., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.07.28.605479 · Cited by 1
Balaban, P. M., & Grigoryan, G. A. (2024) · Успехи физиологических наук · doi:10.31857/s0301179824020063
Value coding by primate amygdala neurons complies with economic choice theoryPreprint
Fabian Grabenhorst, B., Schultz, W., & Ferrari-Toniolo, S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.04.15.648888
Self-citationKajtor, M., Billes, V., Király, B., Karkusova, P., Kovács, T., Stabb, H., Sviatkó, K., Vizi, A., Ujvári, E., Balázsfi, D., et al. (2025) · eLife · doi:10.7554/elife.90905.2
Rhesus macaque choices reveal that ambiguity aversion is driven by pessimistic probability estimatesPreprint
Kerkhoff, W. G., & Stauffer, W. R. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.16.694644
Self-citationComparison of independence axiom violations across primates: Humans and monkeys
Seak, L. C. U., Jain, R., Nielsen, K., Schultz, W., & Ferrari-Toniolo, S. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.107332
Self-citationA Computational Model Representation of Task-Set Based on Cognitive Science Evidence
Hernández, O., Cervantes, J.-A., & Ramos, F. (2026) · Studies in computational intelligence · doi:10.1007/978-3-032-13977-1_18
Full dopamine coding of basic economic subjective value: Utility and weighted probability
Ferrari-Toniolo, S., Seak, L. C. U., & Schultz, W. (2026) · Cell Reports · doi:10.1016/j.celrep.2026.116943 · Cited by 3
Self-citationThe Neuroeconomics of Simple and Complex Choice
Bossaerts, P. L., & Schultz, W. (2026) · Annual Review of Economics · doi:10.1146/annurev-economics-051624-062344 · Cited by 3
Self-citationFlexibility in value-based decision-making
Jahn, C. I. (2018) · theses.fr (ABES) · doi:10.70675/24ffd7ecz04aez45dez9bfdzff312b4881a8
Rang social, système dopaminergique et réponse au stress
Battivelli, D. (2019) · theses.fr (ABES) · doi:10.70675/b11d29f4z1bf3z4003z81f9z8c69988b277b
Le choix de la cocaïne, une question de délai
Canchy, L. (2020) · theses.fr (ABES) · doi:10.70675/343233aaz22bez4109za45bz4a1f2c63ee4f
Diversité des effets de la nicotine sur les neurones dopaminergiques de l’aire tegmentale ventrale
Nguyen, C. (2020) · theses.fr (ABES) · doi:10.70675/57dc4740z36f1z4ee7z87e7z960af8c4a43e
Dynamiques dopaminergiques dans la prise de décision : rôle dans la variabilité et l’exploration
Côme, M. (2023) · theses.fr (ABES) · doi:10.70675/a7b03d10z7e3cz45a1z817bza6c6344893af
Sense of agency and decision making
Ashby, F. G. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1816045
Choice-driven remapping of action- and stimulus-anchored value in human single neuronsPreprint
Fransen, A., Grossman, C. D., Reed, C. M., Chung, J. M., Mamelak, A. N., Rutishauser, U., & O’Doherty, J. P. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.28.728546
Who wins The Brain Prize? Mapping modern neuroscience
He, J., Lu, Y., Wang, Z., Tang, C., Liu, B., & Rong, L. (2026) · Journal of Brain and Spine · doi:10.1016/j.jbs.2026.09.001
Metadata
- Authors
- Lak, A., Stauffer, W. R., & Schultz, W.
- Affiliations
- University of Cambridge (GB)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2014-01-22
- Volume
- 111
- Issue
- 6
- Pages
- 2343-2348
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC3926061
- OpenAlex
- W2010297727
- Cited by
- 257
- References
- 51
- Citations by year
- 2026: 8 · 2025: 19 · 2024: 17 · 2023: 23 · 2022: 16 · 2021: 24 · 2020: 15 · 2019: 22 · 2018: 24 · 2017: 26 · 2016: 26 · 2015: 24 · 2014: 13
- FWCI
- 13.55
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Licence
- other-oa
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- dopamine, prediction error, subjective value, economic choice, reward magnitude, risk, reward type, single-unit recording, primate decision making, value integration, reinforcement learning
- MeSH terms
- Animals, Dopamine, Macaca mulatta, Male, Neurons, Probability, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
