The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Adaptive Coding of Reward Value by Dopamine Neurons
Abstract
It is important for animals to estimate the value of rewards as accurately as possible. Because the number of potential reward values is very large, it is necessary that the brain's limited resources be allocated so as to discriminate better among more likely reward outcomes at the expense of less likely outcomes. We found that midbrain dopamine neurons rapidly adapted to the information provided by reward-predicting stimuli. Responses shifted relative to the expected reward value, and the gain adjusted to the variance of reward value. In this way, dopamine neurons maintained their reward sensitivity over a large range of reward values.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neurons in MBD nuclei are believed to encode reward prediction errors (RPEs).45”
From Two prefrontal-subcortical circuits estimate controllability and reflect its impact on learning (2026) · cites this paper as [45]
In the citing paper
“As is the case for dopamine neurons, 46 reward-related BOLD signals should maintain their sensitivity over a large range of reward values.”
From Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings (2015) · cites this paper as [46]
In the citing paper
“Indeed, reward-related responses adapt to the context in which a reward is presented 46, in the sense that they depend on a combination of the overall expected value and their variance rather than the absolute magnitude of reward value.”
From Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings (2015) · cites this paper as [46]
In the citing paper
“Yet, both reward magnitude and reward probability are coded relatively rather than absolutely. 46”
From Increased neural responses to reward in adolescents and young adults with attention-deficit/hyperactivity disorder and their unaffected siblings (2015) · cites this paper as [46]
In the citing paper
“Activity in individual neurons in both habenula and VTA reflects both the value of a stimulus in terms of the reward that it predicts58–60 as well as VoI21,22,27,61”
From Interpretable abstractions of artificial neural networks predict behavior and neural activity during human information gathering (2026) · cites this paper as [59]
In the citing paper
“For example, the gain of RPE signals produced by dopamine neurons in the ventral tegmental area is modulated by the variance of reward value.100,101”
From Serotonin neurons modulate learning rate through uncertainty (2022) · cites this paper as [101]
In the citing paper
“Consistent with a prediction error signal, spiking activity of dopamine neurons increases with both reward magnitude and probability (Fiorillo et al., 2003; Tobler et al., 2005; Roesch et al., 2007).”
From Decision Making in Recurrent Neuronal Circuits (2008) · cites this paper as Tobler et al., 2005
In the citing paper
“Research in non-human primates, confirmed in humans, indicates that differences the probability with which a cue predicts a reward produce a quantitative change in the engagement of dopaminergic systems.46,47”
From Striatal sensitivity during reward processing in attention-deficit/hyperactivity disorder (2012) · cites this paper as [46]
Citations
Cites
Plum, F. (1960) · Archives of Neurology · doi:10.1001/archneur.1960.03840090124020 · Cited by 10,388
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationThe neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Self-citationClassical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Taussig, M. (1991) · Routledge eBooks · doi:10.4324/9780203397244 · Cited by 2,403
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Self-citationNeurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,187
Animal intelligence; experimental studies
Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100
Predictive coding: a fresh view of inhibition in the retina
Srinivasan, M. V., Laughlin, S. B., & Dubs, A. (1982) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1982.0085 · Cited by 1,042
Research works printed but not linked: 3
- I. P. Pavlov Conditional Reflexes (Oxford Univ. Press Oxford 1927).
- H. B. Barlow, in Sensory Communication, W. A. Rosenblith, Ed. (MIT Press, Cambridge, MA, 1961), pp. 217–234.
- S. B. Laughlin, Z. Naturforsch. Teil C Biochem. Biophys. Biol. Virol.36, 910 (1981).
Cited by
Sorted by citations
Items 401–500 of 1,000
An Imperfect Dopaminergic Error Signal Can Drive Temporal-Difference Learning
Potjans, W., Diesmann, M., & Morrison, A. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001133 · Cited by 56
“Dopaminergic activity is typically recorded in classical conditioning [15,16], instructed-choice instrumental conditioning [17] or simple decision trials with only a few number of possible actions [13].”
Brain and autonomic association accompanying stochastic decision-making
Ohira, H., Ichikawa, N., Nomura, M., Isowa, T., Kimura, K., Kanayama, N., Fukuyama, S., Shinoda, J., & Yamada, J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.060 · Cited by 57
Osinsky, R., Mussel, P., & Hewig, J. S. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01473.x · Cited by 56
Over a Decade of Neuroeconomics: What Have We Learned?
Konovalov, A., & Krajbich, I. M. (2016) · Organizational Research Methods · doi:10.1177/1094428116644502 · Cited by 55
Skvortsova, V., Degos, B., Welter, M., Vidailhet, M., & Pessiglione, M. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.2081-16.2017 · Cited by 53
“…recordings linking dopamine to reward prediction or RPE (Schultz et al., 1997; Waelti et al., 2001; Satoh et al., 2003; Bayer and Glimcher, 2005; Tobler et al., 2005) and showed that dopaminergic signals are more sensitive to reward than effort (Gan et al., 2010; Pasquereau and Turner, 2013;…”
BackgroundTransdiagnostic neuroimaging of reward system phenotypes in ADHD and comorbid disorders
Grimm, O., van Rooij, D., Hoogman, M., Klein, M., Buitelaar, J. K., Franke, B., Reif, A., & Plichta, M. M. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.025 · Cited by 62
“be food or sex) predicted by the stimuli (Tobler et al. 2005): thus, these neurons signal reward, and likewise,”
BackgroundDopamine: at the intersection of reward and action
Daw, N. D. (2007) · Nature Neuroscience · doi:10.1038/nn1207-1505 · Cited by 55
Bermúdez, M. A., & Schultz, W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00933.2009 · Cited by 55
“…studies have shown that reward value defined as probability distribution is a viable parameter determining reward responses in prefrontal, parietal, striatal, and dopamine neurons (Cromwell and Schultz 2003; Leon and Shadlen 1999; Musallam et al. 2004; Platt and Glimcher 1999; Tobler et al. 2005).”
Self-citationRausch, F., Mier, D., Eifler, S., Esslinger, C., Schilling, C., Schirmbeck, F., Englisch, S., Meyer-Lindenberg, A., Kirsch, P., & Zink, M. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.04.020 · Cited by 55
“These findings might be interpreted within theories about decision-making in schizophrenia (Fletcher and Frith, 2009) and the functional representation of reward uncertainty by dopaminergic neurotransmission (Fiorillo et al., 2003; Tobler et al., 2005; Schultz et al., 2008; Schultz, 2013).”
Adaptations of Presynaptic Dopamine Terminals Induced by Psychostimulant Self-Administration
Siciliano, C. A., Calipari, E. S., Ferris, M. J., & Jones, S. R. (2014) · ACS Chemical Neuroscience · doi:10.1021/cn5002705 · Cited by 57
Stress, Motivation, and the Gut–Brain Axis: A Focus on the Ghrelin System and Alcohol Use Disorder
Morris, L. S., Voon, V., & Leggio, L. (2018) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13781 · Cited by 57
“However, striatal dopamine has been shown to encode more general rewarding properties of stimuli, as well as an unexpected presence or absence of reward, and their magnitude across species (O’Doherty et al., 2002; Schultz et al., 1992, 1997; Tobler et al., 2005), representations that drive appetitive behaviors more ge…”
Schultz, W. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00021-x · Cited by 55
Self-citationPharmacological evidence for the implication of noradrenaline in effort
Borderies, N., Mattioni, J., Bornert, P., Gilardeau, S., & Bouret, S. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000793 · Cited by 49
“Indeed, dopaminergic activity is reliably related to the value of the upcoming reward (Fiorillo et al, 2003; Tobler et al, 2005; Roesch et al, 2007) but also to the vigor of the animal’s response (Hamid et al., 2016; Niv et al., 2007; Ko & Wanat, 2016, Syied et al, 2016).”
BackgroundEfficiently irrational: deciphering the riddle of human choice
Glimcher, P. W. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.04.007 · Cited by 59
On the normative advantages of dopamine and striatal opponency for learning and choice
Jaskir, A., & Frank, M. J. (2023) · eLife · doi:10.7554/elife.85107 · Cited by 56
Dopamine neurons encode errors in predicting movement trigger occurrence
Pasquereau, B., & Turner, R. S. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00401.2014 · Cited by 54
BMI Modulates Calorie-Dependent Dopamine Changes in Accumbens from Glucose Intake
Wang, G., Tomasi, D. G., Convit, A. J., Logan, J., Wong, C., Shumay, E., Fowler, J. S., & Volkow, N. D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101585 · Cited by 55
Denial in methamphetamine users: Associations with cognition and functional connectivity in brain
Dean, A. C., Kohno, M., Morales, A. M., Ghahremani, D. G., & London, E. D. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.03.004 · Cited by 53
“, 2014), while dopaminergic neurons in the midbrain have been shown to track differences between predicted versus actual rewards (i.e., prediction error; Tobler et al., 2005).”
BackgroundAbundance Compensates Kinetics: Similar Effect of Dopamine Signals on D1 and D2 Receptor Populations
Hunger, L., Kumar, A., & Schmidt, R. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.1951-19.2019 · Cited by 54
“, in the context of reward magnitude or probability (Morris et al., 2004; Tobler et al., 2005; Hamid et al., 2016).”
BackgroundBeyene, M., Carelli, R. M., & Wightman, R. M. (2010) · Neuroscience · doi:10.1016/j.neuroscience.2010.06.047 · Cited by 55
“Similarly, cues that predict larger reinforcer magnitudes produce greater activation of dopamine neurons than do cues predicting smaller reinforcer magnitudes (Tobler et al., 2005).”
BackgroundInfluentialDopamine-associated cached values are not sufficient as the basis for action selection
Hollon, N. G., Arnold, M. M., Gan, J. O., Walton, M. E., & Phillips, P. E. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419770111 · Cited by 55
Differential neurobiological effects of expert advice on risky choice in adolescents and adults
Engelmann, J. B., Moore, S., Monica Capra, C., & Berns, G. S. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss050 · Cited by 52
Neural processes mediating contextual influences on human choice behaviour
Rigoli, F., Friston, K. J., & Dolan, R. J. (2016) · Nature Communications · doi:10.1038/ncomms12416 · Cited by 52
“Note, this form of value coding is different from that observed in regions classically linked to value representation, such as ventral striatum and VTA/SN 6,13,14,60–63 .”
InfluentialThe Dopamine System in Mediating Alcohol Effects in Humans
Charlet, K., Beck, A., & Heinz, A. (2011) · Current topics in behavioral neurosciences · doi:10.1007/978-3-642-28720-6_130 · Cited by 53
Liraglutide restores impaired associative learning in individuals with obesity
Hanssen, R., Rigoux, L., Kuzmanovic, B., Iglesias, S., Kretschmer, A. C., Schlamann, M., Albus, K., Edwin Thanarajah, S., Sitnikow, T., Melzer, C., et al. (2023) · Nature Metabolism · doi:10.1038/s42255-023-00859-y · Cited by 52
“4Faculty of Medicine and University Hospital Cologne, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) and Excellence Center for Medical Mycology (ECMM), University of Cologne, Cologne, Germany.”
MethodInfluentialSymbol addition by monkeys provides evidence for normalized quantity coding
Livingstone, M. S., Pettine, W. W., Srihasam, K., Moore, B., Mórocz, I. Á., & Lee, D. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404208111 · Cited by 53
“That is, the monkeys’ subjective valuation of each symbol was context dependent, as has been previously described for value coding in midbrain dopamine neurons (23), orbitofrontal cortex neurons (24, 25), LIP neurons (26), and for monkey behavioral value choices (27).”
BackgroundA neurobiological perspective on social influence: Serotonin and social adaptation
Duerler, P., Vollenweider, F. X., & Preller, K. H. (2022) · Journal of Neurochemistry · doi:10.1111/jnc.15607 · Cited by 52
“…human and animal studies strongly implicate the DA system in social conformity (Aquili, 2020; Campbell- Meiklejohn et al., 2010; Falk et al., 2012; Tobler et al., 2005; Zhao et al., 2016) results are not always consistent on the specific role of DA and its distinction from 5- HT in the processing…”
BackgroundThe sweetest pill to swallow: How patient neurobiology can be harnessed to maximise placebo effects
Jubb, J., & Bensing, J. M. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.09.006 · Cited by 52
“This provided evidence that expectation of rewards alone will elicit DA release in the nucleus accumbens (NAC), and dopamine has now an established role in reward and expectation mechanisms in general ( Kelley and Berridge, 2002 and Tobler et al., 2005).”
Establishing causality for dopamine in neural function and behavior with optogenetics
Steinberg, E. E., & Janak, P. H. (2012) · Brain Research · doi:10.1016/j.brainres.2012.09.036 · Cited by 56
“…DA neurons in VTA and SNc are briefly activated by primary rewards, reward-predictive cues, salient stimuli, and in some cases, aversive stimuli (Strecker and Jacobs, 1985; Mirenowicz and Schultz, 1994; Tobler et al., 2005; Roesch et al., 2007; Brischoux et al., 2009; Matsumoto and Hikosaka, 2009).”
Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation
Kato, A., & Morita, K. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005145 · Cited by 59
Dopaminergic Modulation of Appetitive and Aversive Predictive Learning
Iordanova, M. D. (2009) · Reviews in the Neurosciences · doi:10.1515/revneuro.2009.20.5-6.383 · Cited by 50
Shao, R., Read, J., Behrens, T. E. J., & Rogers, R. D. (2013) · Translational Psychiatry · doi:10.1038/tp.2012.134 · Cited by 50
“of rewards against their variances in a way that represents expected value.(43) Corresponding signals reflecting linear and non-linear subjective probabilities of reward can also be detected in the human striatum using fMRI;(44,45) representations that may mediate gambling behaviours in humans.”
Adaptive coding of reward prediction errors is gated by striatal coupling
Park, S. Q., Kahnt, T., Talmi, D., Rieskamp, J., Dolan, R. J., & Heekeren, H. R. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119969109 · Cited by 51
“Also, we show that the striatal PE was invariant for high and low rewardmagnitudes, which is in line with other studies showing that PEs are insensitive to different reward magnitudes when cues signal the possible reward magnitude (7, 14, 32, 43).”
BackgroundResultInfluentialSensitivity of the nucleus accumbens to violations in expectation of reward
Spicer, J., Galván, A., Hare, T. A., Voss, H. U., Glover, G. H., & Casey, B. J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.012 · Cited by 52
Shen, X., Ruan, X., & Zhao, H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0034323 · Cited by 50
Endocannabinoids Promote Cocaine-Induced Impulsivity and Its Rapid Dopaminergic Correlates
Hernández, G., Oleson, E. B., Gentry, R. N., Abbas, Z., Bernstein, D. L., Arvanitogiannis, A., & Cheer, J. F. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.09.005 · Cited by 51
The role of reward and reward uncertainty in episodic memory
Mason, A., Farrell, S., Howard‐Jones, P. A., & Ludwig, C. J. H. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2017.05.003 · Cited by 58
“…et al., 2005), and that varying probability of reward is known to produce uncertainty-related activation in striatum (Liu et al., 2011; Preuschoff et al., 2006; Schultz et al., 2008; Tobler et al., 2005, 2007), in Experiment 4 the probability of obtaining a reward of fixed magnitude was varied.”
BackgroundInfluentialDopamine and beta-band oscillations differentially link to striatal value and motor control
Schwerdt, H. N., Amemori, K., Gibson, D. J., Stanwicks, L. L., Yoshida, T., Bichot, N. P., Amemori, S., Desimone, R., Langer, R., Cima, M. J., et al. (2020) · Science Advances · doi:10.1126/sciadv.abb9226 · Cited by 49
Enhanced heroin self-administration and distinct dopamine adaptations in female rats
George, B. E., Barth, S. H., Kuiper, L. B., Holleran, K. M., Lacy, R. T., Raab‐Graham, K. F., & Jones, S. R. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01035-0 · Cited by 52
“In addition, in freely behaving rats, the peak concentration of phasic dopamine release events evoked by reward cues is directly related to the magnitude of the expected reward [89].”
BackgroundModulation of Social Influence by Methylphenidate
Campbell-Meiklejohn, D. K., Simonsen, A., Jensen, M., Wohlert, V., Gjerløff, T., Scheel‐Krüger, J., Møller, A., Frith, C., & Roepstorff, A. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.337 · Cited by 54
“The hypothesis also assumes that the magnitude of a cued incentive is carried by phasic dopamine signals, which has been shown previously (Tobler et al, 2005).”
BackgroundTakakuwa, N., Kato, R., Redgrave, P., & Isa, T. (2017) · eLife · doi:10.7554/elife.24459 · Cited by 48
“DOI: 10.7554/eLife.24459 1 of 17 reward magnitude (Tobler et al., 2005), reward probability (Fiorillo et al., 2003; Nakahara et al., 2004; Matsumoto and Hikosaka, 2009) and reward delay (Kobayashi and Schultz, 2008; Fiorillo et al., 2008).”
BackgroundResultInfluentialDimensionality, information and learning in prefrontal cortex
Bartolo, R., Saunders, R. C., Mitz, A. R., & Averbeck, B. B. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007514 · Cited by 58
Spoelder, M., Tsutsui, K. T., Lesscher, H. M. B., Vanderschuren, L. J. M. J., & Clark, J. J. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.139 · Cited by 48
“Consistent with previous reports (Hart et al, 2014; Tobler et al, 2005), phasic dopamine activity was modulated by reward size and expectation in both groups in a manner consistent with the reporting of a reward prediction error from formal models of reinforcement learning, with increased phasic…”
ResultA choice for ‘me’ or for ‘us’? Using we-reasoning to predict cooperation and coordination in games
Butler, D. (2011) · Theory and Decision · doi:10.1007/s11238-011-9270-7 · Cited by 48
Differential coding of absolute and relative aversive value in the Drosophila brain
Villar, M. E., Pavão-Delgado, M., Amigo, M., Jacob, P. F., Merabet, N., Pinot, A., Perry, S. A., Waddell, S., & Perisse, E. (2022) · Current Biology · doi:10.1016/j.cub.2022.08.058 · Cited by 57
Aging, uncertainty, and decision making—A review
Frank, C. C., & Seaman, K. L. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01064-w · Cited by 60
Multiple routes to enhanced memory for emotionally relevant events
Rouhani, N., Niv, Y., Frank, M. J., & Schwabe, L. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.06.006 · Cited by 52
Monitoring extracellular pH, oxygen, and dopamine during reward delivery in the striatum of primates
Ariansen, J. L., Heien, M. L., Hermans, A., Phillips, P. E. M., Hernádi, I., Bermúdez, M. A., Schultz, W., & Wightman, R. M. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00036 · Cited by 48
“Electrophysiological data have shown that dopamine neurons originating in the ventral tegmental area are activated by unexpected rewards and cues that predict rewards (Fiorillo et al., 2003; Tobler et al., 2005).”
Self-citationPrefrontal Regulation of Neuronal Activity in the Ventral Tegmental Area
Jo, Y. S., & Mizumori, S. J. Y. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv215 · Cited by 51
“These DAergic prediction errors play an essential role in assigning values to reward-predicting stimuli in reinforcement learning (Fiorillo et al. 2003; Tobler et al. 2005; Flagel et al. 2011).”
BackgroundFluorescence detection of dopamine based on the polyphenol oxidase–mimicking enzyme
Huang, H. S., Bai, J., Li, J., Lei, L., Zhang, W., Yan, S., & Li, Y. (2020) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-020-02742-1 · Cited by 48
The bounded rationality of probability distortion
Zhang, H., Ren, X., & Maloney, L. T. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1922401117 · Cited by 48
“There is increasing evidence that dynamic remapping of representational range occurs along more abstract dimensions, such as value (25-29), numerosity (30, 31), relative frequency (32), and variance (33).”
BackgroundThe lateral habenula: A hub for value-guided behavior
Groos, D., & Helmchen, F. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.113968 · Cited by 45
Nagano‐Saito, A., Cisek, P., Perna, A. S., Shirdel, F. Z., Benkelfat, C., Leyton, M., & Dagher, A. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00592.2011 · Cited by 49
“…(Apicella 2007; Kawagoe et al. 1998; Lau and Glimcher 2008; Morris et al. 2006; Samejima et al. 2005; Shimo and Hikosaka 2001; Takikawa et al. 2002; Tobler et al. 2005) and that neurons in the striatum encode the reward value of available actions, the value of the eventually chosen action, and the…”
BackgroundResultReward speeds up and increases consistency of visual selective attention: a lifespan comparison
Störmer, V. S., Eppinger, B., & Li, S. (2014) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-014-0273-z · Cited by 52
Rational Attention and Adaptive Coding: A Puzzle and a Solution
Padoa‐Schioppa, C., & Rustichini, A. (2014) · American Economic Review · doi:10.1257/aer.104.5.507 · Cited by 48
“…Sciences), Università degli Studi di Trento for support in experimental research. ues and choices (Tremblay and Schultz (1999), Tobler, Fiorillo and Schultz (2005), PadoaSchioppa (2009), Kobayashi, Pinto de Carvalho and Schultz (2010), Louie, Grattan, and Glimcher (2011), Cai and Padoa-Schioppa…”
BackgroundTeichert, T., & Ferrera, V. P. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00186 · Cited by 50
“We speculate that neurons coding expected value/utility (Fiorillo et al., 2005; Tobler et al., 2005) could serve as the input to a network that could adjust decision criteria as a function of expected value/utility.”
BackgroundHardin, M. G., & Monique Ernst, D. (2009) · Journal of Addiction Medicine · doi:10.1097/adm.0b013e31819ca788 · Cited by 43
Great Expectations: The Placebo Effect in Parkinson’s Disease
Lidstone, S. C. (2014) · Handbook of experimental pharmacology · doi:10.1007/978-3-662-44519-8_8 · Cited by 46
The Striatum and Subthalamic Nucleus as Independent and Collaborative Structures in Motor Control
Tewari, A., Jog, R., & Jog, M. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00017 · Cited by 46
“In similitude, electrophysiological striatal recordings have identified another component of the limbic circuit, the ACC, in action evaluation and error detection (Carter et al., 1998; Yamada et al., 2011).”
BackgroundProbability differently modulating the effects of reward and punishment on visuomotor adaptation
Song, Y., & Smiley‐Oyen, A. L. (2017) · Experimental Brain Research · doi:10.1007/s00221-017-5082-5 · Cited by 45
'Outlier Blindness': Efficient Coding Generates an Inability to Represent Extreme Values
Payzan-LeNestour, É., & Woodford, M. (2018) · Journal of Financial Economics · doi:10.1016/j.jfineco.2021.06.019 · Cited by 56
Microelectrodes for studying neurobiology
Kita, J. M., & Wightman, R. M. (2008) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2008.06.035 · Cited by 49
“Previously, phasic and tonic changes were measured using electrophysiology [23,24], which is a technique that measures the electrical signals generated during neuronal communication.”
MethodSequential and parallel circuits for emotional processing in primate orbitofrontal cortex
Barbas, H., & Zikopoulos, B. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198565741.003.0004 · Cited by 47
Deficits in context-dependent adaptive coding of reward in schizophrenia
Kirschner, M., Hager, O. M., Bischof, M., Hartmann-Riemer, M. N., Kluge, A., Seifritz, E., Tobler, P. N., & Kaiser, S. (2016) · npj Schizophrenia · doi:10.1038/npjschz.2016.20 · Cited by 43
“The idea of a general dysfunction is in line with the ubiquity of a contextdependent adaptation of dopamine neurons in the human brain.(9,11) An imprecise encoding of reward information could potentially have far-reaching consequences, because precise reward information can be considered a prerequisite for all further…”
BackgroundSelf-citationBaudonnat, M., Huber, A., David, V., & Walton, M. E. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00175 · Cited by 43
“For instance, dopamine cell activity at the time of reward delivery scales to the potential range of available outcomes signaled by a stimulus, with a similar increase in activity across a 10-fold range of reward sizes (Tobler et al., 2005).”
BackgroundSiciliano, C. A., Ferris, M. J., & Jones, S. R. (2015) · European Journal of Neuroscience · doi:10.1111/ejn.12970 · Cited by 50
“This includes a dense innervation of dopaminergic afferents projecting from the ventral tegmental area (VTA) (Doucet et al., 1986), which respond in accordance with previously learned environmental contingences in order to guide goal-directed motor outputs (Waelti et al., 2001; Tobler et al., 2005).”
BackgroundAdvanced Reinforcement Learning
Daw, N. D. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00016-4 · Cited by 46
Burke, C. J., Baddeley, M. C., Tobler, P. N., & Schultz, W. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0487-16.2016 · Cited by 45
Self-citationBuchta, W. C., Mahler, S. V., Harlan, B. A., Aston‐Jones, G., & Riegel, A. C. (2017) · Physiological Reports · doi:10.14814/phy2.13198 · Cited by 48
“In behaving animals, salient environmental stimuli can induce burst firing in VTA dopamine neurons (Schultz, 2002; Fiorillo et al., 2003; Tobler et al., 2005).”
BackgroundMeta‐analytic evidence for altered mesolimbic responses to reward in schizophrenia
Chase, H. W., Loriemi, P., Wensing, T., Eickhoff, S. B., & Nickl‐Jockschat, T. (2018) · Human Brain Mapping · doi:10.1002/hbm.24049 · Cited by 45
Catecholaminergic modulation of the avoidance of cognitive control.
Froböse, M. I., Swart, J. C., Cook, J. L., Geurts, D. E. M., den Ouden, H. E. M., & Cools, R. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000523 · Cited by 53
Reward processing abnormalities in Parkinson's disease
Kapogiannis, D., Mooshagian, E., Campion, P., Grafman, J. H., Zimmermann, T. J., Ladt, K. C., & Wassermann, E. M. (2011) · Movement Disorders · doi:10.1002/mds.23701 · Cited by 48
Neuroeconomics: a view from neuroscience.
Montague, P. R. (2007) · PubMed · Cited by 44
Valuation for Risky and Uncertain Choices
Tobler, P. N., & Weber, E. U. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00009-7 · Cited by 46
“These responses increase with the magnitude of the unpredicted rewards (Tobler et al., 2005).”
BackgroundInfluentialSelf-citationRare rewards amplify dopamine responses
Rothenhoefer, K. M., Hong, T., Alikaya, A., & Stauffer, W. R. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00807-7 · Cited by 45
Opriș, I. C., Hampson, R. E., & Deadwyler, S. A. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.06.002 · Cited by 45
“…inputs to striatal neurons (Vezina 2004, Calabresi et al. 2007, Shultz, 2007) as has been shown in a variety of contexts (Everitt et al. 1999, Tobler et al. 2005, Morris et al. 2006, Grace et al. 2007) including human reward seeking (Risinger et al. 2005, Sinha et al. 2005, Volkow et al.…”
BackgroundResultSackett, D. A., Saddoris, M. P., & Carelli, R. M. (2017) · eNeuro · doi:10.1523/eneuro.0058-17.2017 · Cited by 47
“Indeed, cues predicting larger (versus smaller) reward magnitudes elicit greater dopamine cell firing (Tobler et al., 2005; Roesch et al., 2007) and higher shell dopamine release (Beyene et al.”
BackgroundLiving near the edge: How extreme outcomes and their neighbors drive risky choice.
Ludvig, E. A., Madan, C. R., McMillan, N., Xu, Y., & Spetch, M. L. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000414 · Cited by 49
Klein-Flügge, M. C., Wittmann, M. K., Shpektor, A., Jensen, D. E. A., & Rushworth, M. F. S. (2019) · Nature Communications · doi:10.1038/s41467-019-12557-z · Cited by 44
Dopamine levels modulate the updating of tastant values
Costa, R. M., Gutiérrez, R., de Araújo, I. E., Coelho, M. R. P., Kloth, A. D., Gainetdinov, R. R., Caron, M. G., Nicolelis, M. A. L., & Simon, S. A. (2006) · Genes Brain & Behavior · doi:10.1111/j.1601-183x.2006.00257.x · Cited by 44
“For example, the activity of dopaminergic neurons can adaptively encode reward value (Tobler et al. 2005).”
BackgroundSiessmeier, T., Kienast, T., Wrase, J., Larsen, J. L., Braus, D. F., Smolka, M. N., Buchholz, H. G., Schreckenberger, M., Rösch, F., Cumming, P., et al. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04903.x · Cited by 48
Multi-scale neural decoding and analysis
Lu, H., Lorenc, E. S., Zhu, H., Kilmarx, J., Sulzer, J. S., Xie, C., Tobler, P. N., Watrous, A. J., Orsborn, A. L., Lewis‐Peacock, J. A., et al. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac160f · Cited by 47
“Many cognitive processes have been investigated across multiple modalities independently, including movements [24–29] and decision-making [7, 9, 10, 12, 18], reward [14, 16, 17], memory [6, 8], and arousal [3, 4], and each modality provides a different perspective on the underlying neural activity.”
BackgroundSelf-citationA dopamine mechanism for reward maximization
Schultz, W. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2316658121 · Cited by 47
Self-citationCourtney, N. A., Mamaligas, A. A., & Ford, C. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.2745-12.2012 · Cited by 40
Smith, C. T., Wallace, D. L., Dang, L. C., Aarts, E., Jagust, W. J., D’Esposito, M., & Boettiger, C. A. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00261.2015 · Cited by 48
Dopamine Receptor-Specific Contributions to the Computation of Value
Burke, C. J., Soutschek, A., Weber, S. C., Beharelle, A. R., Fehr, E., Haker, H., & Tobler, P. N. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2017.302 · Cited by 41
“Dopamine neurons encode reward magnitude (Schultz, 1998) and combine reward magnitude with probability (Tobler et al, 2005) into prospect theory- or expected utility-like value signal of gains in both risky and safe options (Stauffer et al, 2014).”
BackgroundSelf-citationA neural mechanism for conserved value computations integrating information and rewards
Bromberg-Martin, E. S., Feng, Y.-Y., Ogasawara, T., White, J. K., Zhang, K., & Monosov, I. E. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01511-4 · Cited by 43
Two sources of uncertainty independently modulate temporal expectancy
Grabenhorst, M., Maloney, L. T., Poeppel, D., & Michalareas, G. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2019342118 · Cited by 44
“Specifically, midbrain dopamine neurons adapt both to discrete (12) and continuous (14) uncertainty.”
Stimulus-Specific Prediction Error Neurons in Mouse Auditory Cortex
Audette, N. J., & Schneider, D. M. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0512-23.2023 · Cited by 49
Sensory perception relies on fitness-maximizing codes
Schaffner, J., Bao, S. D., Tobler, P. N., Hare, T. A., & Polanía, R. H. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01584-y · Cited by 54
“E[ reward loss ] ≡ EEpφ(z|x) [y(x1,x2)(1 − pθ(y = 1|z1, z2)) +(1 − y(x1,x2))pθ(y = 1|z1, z2)] , (29)”
Self-citationDopamine D2 Modulation of Sign and Goal Tracking in Rats
López, J. C., Karlsson, R., & O’Donnell, P. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.68 · Cited by 40
NMDA Receptors on Non-Dopaminergic Neurons in the VTA Support Cocaine Sensitization
Luo, Y., Good, C. H., Dı́az-Ruiz, O., Zhang, Y., Hoffman, A. F., Shan, L., Kuang, S. Y., Malik, N., Chefer, V. I., Tomac, A. C., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012141 · Cited by 42
“It has been proposed that the acquisition of conditioned behavioral responses is governed by the phasic firing of DA neurons initiated by NMDAR activity [21,31,32,33,34].”
BackgroundAuditory Mismatch Negativity Under Predictive Coding Framework and Its Role in Psychotic Disorders
Fong, C. Y., Law, W. H. C., Uka, T., & Koike, S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.557932 · Cited by 48
Hayes, D. J., Mosher, T. M., & Greenshaw, A. J. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.08.034 · Cited by 41
“[8] Tobler PN, Fiorillo CD, Schultz W.”
Dopamine neuronal responses in monkeys performing visually cued reward schedules
Ravel, S., & Richmond, B. J. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04905.x · Cited by 41
Tan, C. O., & Bullock, D. H. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.0259-08.2008 · Cited by 41
“This dual dependence of CS-induced striatal activations is consistent with experimental observations (Tobler et al., 2005).”
InfluentialDopamine, inference, and uncertainty
Gershman, S. J. (2017) · Neural Computation · doi:10.1162/neco_a_01023 · Cited by 40
“This implication disagrees with the work of (Tobler et al., 2005), who paired different cues half the time with a cue-specific reward magnitude (liquid volume) and half the time with no reward.”
BackgroundRisk and Reward Preferences under Time Pressure
Nursimulu, A., & Bossaerts, P. L. (2013) · European Finance Review · doi:10.1093/rof/rft013 · Cited by 39
Reward Acts on the pFC to Enhance Distractor Resistance of Working Memory Representations
Fallon, S. J., & Cools, R. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00676 · Cited by 38
GLP-1 and hunger modulate incentive motivation depending on insulin sensitivity in humans
Hanßen, R., Kretschmer, A. C., Rigoux, L., Albus, K., Thanarajah, S. E., Sitnikow, T., Melzer, C., Cornely, O. A., Brüning, J. C., & Tittgemeyer, M. (2021) · Molecular Metabolism · doi:10.1016/j.molmet.2021.101163 · Cited by 42
Metadata
- Authors
- Tobler, P. N., Fiorillo, C. D., & Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Fiorillo, Christopher D.
- Schultz, Wolfram
- Venue
- Science
- Published
- 2005-03-11
- Volume
- 307
- Issue
- 5715
- Pages
- 1642-1645
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2098534820
- Cited by
- 1,276
- References
- 24
- Citations by year
- 2026: 36 · 2025: 32 · 2024: 47 · 2023: 56 · 2022: 53 · 2021: 72 · 2020: 57 · 2019: 69 · 2018: 63 · 2017: 65 · 2016: 74 · 2015: 58 · 2014: 72 · 2013: 76 · 2012: 72
- FWCI
- 22.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- reroDoc Digital Library (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- dopaminergic neurons, adaptive coding, midbrain, reward prediction, gain modulation, variance, reward sensitivity, neural adaptation
- MeSH terms
- Adaptation, Physiological, Animals, Discrimination, Psychological, Dopamine, Electrophysiology, Female, Learning, Macaca fascicularis, Mesencephalon, Neurons, Photic Stimulation, Probability, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
