The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Adaptive Coding of Reward Value by Dopamine Neurons
Abstract
It is important for animals to estimate the value of rewards as accurately as possible. Because the number of potential reward values is very large, it is necessary that the brain's limited resources be allocated so as to discriminate better among more likely reward outcomes at the expense of less likely outcomes. We found that midbrain dopamine neurons rapidly adapted to the information provided by reward-predicting stimuli. Responses shifted relative to the expected reward value, and the gain adjusted to the variance of reward value. In this way, dopamine neurons maintained their reward sensitivity over a large range of reward values.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neurons in MBD nuclei are believed to encode reward prediction errors (RPEs).45”
From Two prefrontal-subcortical circuits estimate controllability and reflect its impact on learning (2026) · cites this paper as [45]
In the citing paper
“As is the case for dopamine neurons, 46 reward-related BOLD signals should maintain their sensitivity over a large range of reward values.”
From Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings (2015) · cites this paper as [46]
In the citing paper
“Indeed, reward-related responses adapt to the context in which a reward is presented 46, in the sense that they depend on a combination of the overall expected value and their variance rather than the absolute magnitude of reward value.”
From Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings (2015) · cites this paper as [46]
In the citing paper
“Yet, both reward magnitude and reward probability are coded relatively rather than absolutely. 46”
From Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings (2015) · cites this paper as [46]
In the citing paper
“Activity in individual neurons in both habenula and VTA reflects both the value of a stimulus in terms of the reward that it predicts58–60 as well as VoI21,22,27,61”
From Interpretable abstractions of artificial neural networks predict behavior and neural activity during human information gathering (2026) · cites this paper as [59]
In the citing paper
“For example, the gain of RPE signals produced by dopamine neurons in the ventral tegmental area is modulated by the variance of reward value.100,101”
From Serotonin neurons modulate learning rate through uncertainty (2022) · cites this paper as [101]
In the citing paper
“Consistent with a prediction error signal, spiking activity of dopamine neurons increases with both reward magnitude and probability (Fiorillo et al., 2003; Tobler et al., 2005; Roesch et al., 2007).”
From Decision Making in Recurrent Neuronal Circuits (2008) · cites this paper as Tobler et al., 2005
In the citing paper
“Research in non-human primates, confirmed in humans, indicates that differences the probability with which a cue predicts a reward produce a quantitative change in the engagement of dopaminergic systems.46,47”
From Striatal sensitivity during reward processing in attention-deficit/hyperactivity disorder (2012) · cites this paper as [46]
Citations
Cites
Plum, F. (1960) · Archives of Neurology · doi:10.1001/archneur.1960.03840090124020 · Cited by 10,388
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationThe neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Self-citationClassical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Taussig, M. (1991) · Routledge eBooks · doi:10.4324/9780203397244 · Cited by 2,403
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Self-citationNeurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,187
Animal intelligence; experimental studies
Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100
Predictive coding: a fresh view of inhibition in the retina
Srinivasan, M. V., Laughlin, S. B., & Dubs, A. (1982) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1982.0085 · Cited by 1,042
Flagged first, then by citations
Research works printed but not linked: 3
- I. P. Pavlov Conditional Reflexes (Oxford Univ. Press Oxford 1927).
- H. B. Barlow, in Sensory Communication, W. A. Rosenblith, Ed. (MIT Press, Cambridge, MA, 1961), pp. 217–234.
- S. B. Laughlin, Z. Naturforsch. Teil C Biochem. Biophys. Biol. Virol.36, 910 (1981).
Cited by
Sorted by citations
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
“DA neurons can also adapt their reward signals based on higherorder statistics of the reward distribution, such as scaling prediction error signals based on their expected variance (Tobler et al., 2005) and ‘‘spontaneously recovering’’ their responses to extinguished reward cues (Pan et al., 2008).”
BackgroundThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
“…models of reinforcement learning, which incorporates time more explicitly into expectations of reward as a series of future events ðV s t ð Þ ¼ h P i¼0 g i r tþ1 iÞ, (Bayer and Glimcher 2005; Daw et al. 2005; Dayan and Balleine 2002; Montague et al. 2004; Schultz 2002, 2006; Tobler et al. 2005a,b).”
BackgroundA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
“Similar risk and expected-value signals have been found in the midbrain dopamine system in electrophysiology studies in non-human primate”
BackgroundHabits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697
“…error) and motivational state in a context-dependent manner (Bayer & Glimcher 2005, Morris et al. 2004, Nakahara et al. 2004, Satoh et al. 2003, Tobler et al. 2005, Waelti et al. 2001), that they are specialized to respond in relation to positive but not aversive reinforcements, and that they…”
BackgroundBehavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637
Self-citation
Metadata
- Authors
- Tobler, P. N., Fiorillo, C. D., & Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Fiorillo, Christopher D.
- Schultz, Wolfram
- Venue
- Science
- Published
- 2005-03-11
- Volume
- 307
- Issue
- 5715
- Pages
- 1642-1645
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2098534820
- Cited by
- 1,276
- References
- 24
- Citations by year
- 2026: 36 · 2025: 32 · 2024: 47 · 2023: 56 · 2022: 53 · 2021: 72 · 2020: 57 · 2019: 69 · 2018: 63 · 2017: 65 · 2016: 74 · 2015: 58 · 2014: 72 · 2013: 76 · 2012: 72
- FWCI
- 22.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- reroDoc Digital Library (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- dopaminergic neurons, adaptive coding, midbrain, reward prediction, gain modulation, variance, reward sensitivity, neural adaptation
- MeSH terms
- Adaptation, Physiological, Animals, Discrimination, Psychological, Dopamine, Electrophysiology, Female, Learning, Macaca fascicularis, Mesencephalon, Neurons, Photic Stimulation, Probability, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
