Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Uncertainty is critical in the measure of information and in assessing the accuracy of predictions. It is determined by probability P , being maximal at P = 0.5 and decreasing at higher and lower probabilities. Using distinct stimuli to indicate the probability of reward, we found that the phasic activation of dopamine neurons varied monotonically across the full range of probabilities, supporting past claims that this response codes the discrepancy between predicted and actual reward. In contrast, a previously unobserved response covaried with uncertainty and consisted of a gradual increase in activity until the potential time of reward. The coding of uncertainty suggests a possible role for dopamine signals in attention-based learning and risk-taking behavior.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“for exteroception this may involve cholingeric neurotransmission via attention (Yu and Dayan, 2005); for interoception, proprioception, and value-learning, prediction error precision is suggested to be encoded by dopamine”
From An Interoceptive Predictive Coding Model of Conscious Presence (2012) · cites this paper as Fiorillo et al., 2003
In the citing paper
“it is important to distinguish the phasic diachronic role of dopamine in signaling reward prediction error (Schultz and Dickinson, 2000) from its synchronic role in modulating (or optimizing) the precision of prediction errors by modulating signal-to-noise response properties in neuronal signaling (Fiorillo et al., 2003; Friston, 2009, 2010).”
From An Interoceptive Predictive Coding Model of Conscious Presence (2012) · cites this paper as Fiorillo et al., 2003
In the citing paper
“a cue triggering a behavior that yields a reward 50% of the time is by far the most anxiety-inducing of delivery schedules”
From Hypernatural Monitoring: A Social Rehearsal Account of Smartphone Addiction (2018) · cites this paper as Fiorillo et al., 2003
In the citing paper
“reward anticipation is a much more powerful mediator of strong addictions than outcome evaluations of the stimulus itself”
From Hypernatural Monitoring: A Social Rehearsal Account of Smartphone Addiction (2018) · cites this paper as Fiorillo et al., 2003
In the citing paper
“dopaminergic surges typically occur before the reward, or more precisely when a cue (e.g., a beep indicating that one can press a lever) signals the reliable delivery of a reward”
From Hypernatural Monitoring: A Social Rehearsal Account of Smartphone Addiction (2018) · cites this paper as Fiorillo et al., 2003
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Self-citationDynamic predictions: Oscillations and synchrony in top–down processing
Engel, A. K., Fries, P., & Singer, W. (2001) · Nature Reviews Neuroscience · doi:10.1038/35094565 · Cited by 3,454
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Gallistel, C. R. (1990) · Cited by 2,571
Research works printed but not linked: 6
- R. P. N. Rao B. A. Olshausen M. S. Lewicki Eds. Probabilistic Models of the Brain (MIT Press Cambridge MA 2002).
- A. Dickinson Contemporary Animal Learning Theory (Cambridge Univ. Press Cambridge 1980).
- R. A. Rescorla A. R. Wagner in Classical Conditioning II: Current Research and Theory A. H. Black W. S. Prokasy Eds. (Appleton-Century-Crofts New York 1972) pp. 64–69.
- 10.1037/0097-7403.10.1.90 · doi:10.1037/0097-7403.10.1.90 · Paper page
- 10.1037/0033-295x.107.2.289 · doi:10.1037/0033-295x.107.2.289 · Paper page
- 10.1037/0033-295x.108.1.96 · doi:10.1037/0033-295x.108.1.96 · Paper page
Cited by
Items 701–800 of 1,007
Shizgal, P., & Arvanitogiannis, A. (2003) · Science · doi:10.1126/science.1083627 · Cited by 54
Mind racing: The influence of exercise on long-term memory consolidation
McNerney, M. W., & Radvansky, G. A. (2014) · Memory · doi:10.1080/09658211.2014.962545 · Cited by 58
Inactivation of the putamen selectively impairs reward history-based action selection
Muranishi, M., Inokawa, H., Yamada, H., Ueda, Y., Matsumoto, N., Nakagawa, M., & Kimura, M. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2545-y · Cited by 51
“The encoded values are updated by reward prediction error signals provided by midbrain dopaminergic neurons (Schultz et al. 1997; Hollerman et al. 1998; Fiorillo et al. 2003; Satoh et al. 2003; Morris et al. 2004).”
BackgroundDoyon, W. M., Howard, E. C., Shippenberg, T. S., & Gonzales, R. A. (2006) · Neuropharmacology · doi:10.1016/j.neuropharm.2006.04.005 · Cited by 53
Vanni-Mercier, G., Mauguière, F., Isnard, J., & Dreher, J.-C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5298-08.2009 · Cited by 52
“Two important characteristics distinguish uncertainty coding in the hippocampus from the uncertainty signal recorded in monkeys’ dopaminergic neurons (Fiorillo et al., 2003).”
BackgroundResultInfluentialAnterior Cingulate Cortex Modulation of the Ventral Tegmental Area in an Effort Task
Elston, T. W., & Bilkey, D. K. (2017) · Cell Reports · doi:10.1016/j.celrep.2017.05.062 · Cited by 59
Bayesian Integration and Non-Linear Feedback Control in a Full-Body Motor Task
Stevenson, I. H., Fernandes, H. L., Vilares, I., Wei, K., & Kording, K. P. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000629 · Cited by 59
“In the past decade several studies have made progress investigating the neural correlates of uncertainty and Bayesian computations [10,12,13,39–42].”
BackgroundGames in the Brain: Neural Substrates of Gambling Addiction
Murch, W. S., & Clark, L. (2016) · The Neuroscientist · doi:10.1177/1073858415591474 · Cited by 69
Prediction and uncertainty in human Pavlovian to instrumental transfer.
Trick, L., Hogarth, L., & Duka, T. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0022310 · Cited by 46
Sensitivity of the nucleus accumbens to violations in expectation of reward
Spicer, J., Galván, A., Hare, T. A., Voss, H. U., Glover, G. H., & Casey, B. J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.012 · Cited by 57
Antiparkinsonian Medication and Pathological Gambling
LADER, M. H. (2008) · CNS Drugs · doi:10.2165/00023210-200822050-00004 · Cited by 59
Kargo, W. J., Szatmary, B., & Nitz, D. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3604-06.2007 · Cited by 51
“One possibility is that dopaminergic neurons signaling changes in expected reward (Fiorillo et al., 2003; Morris et al., 2004; Bayer and Glimcher, 2005) force activity alterations despite unchanging sensory inputs and motor outputs.”
BackgroundBarakat, B. K., Seitz, A. R., & Shams, L. B. (2013) · Cognition · doi:10.1016/j.cognition.2013.07.003 · Cited by 57
Differential cingulate and caudate activation following unexpected nonrewarding stimuli
Davidson, M. C., Horvitz, J. C., Tottenham, N., Fossella, J., Watts, R., Uluğ, A. M., & Casey, B. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.049 · Cited by 59
Transdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty
Sandhu, T. R., Xiao, B., & Lawson, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105123 · Cited by 51
“Dopamine (DA) is another catecholamine, and it is the direct precursor to NA – animal models have shown that DA signals are heavily influenced by the first-order uncertainty of rewards (Fiorillo et al., 2003; Starkweather et al., 2017).”
BackgroundThe body keeps the score: The neurobiological profile of traumatized adolescents
Laricchiuta, D., Panuccio, A., Picerni, E., Biondo, D., Genovesi, B., & Petrosini, L. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105033 · Cited by 55
“Specifically, the ventral striatum supports reward-related processes, such as reward-based learning (Fiorillo et al., 2003), through reception of dopaminergic inputs from the ventral tegmental area and substantia nigra (Haber, 2011).”
Leland, D. S., Arce, E., Feinstein, J. S., & Paulus, M. P. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.011 · Cited by 57
Prefrontal Regulation of Neuronal Activity in the Ventral Tegmental Area
Jo, Y. S., & Mizumori, S. J. Y. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv215 · Cited by 48
“These DAergic prediction errors play an essential role in assigning values to reward-predicting stimuli in reinforcement learning (Fiorillo et al. 2003; Tobler et al. 2005; Flagel et al. 2011).”
BackgroundCuriosity-driven memory enhancement persists over time but does not benefit from post-learning sleep
Stare, C., Gruber, M. J., Nadel, L., Ranganath, C., & Gómez, R. L. (2018) · Cognitive Neuroscience · doi:10.1080/17588928.2018.1513399 · Cited by 53
Cover, K. K., Gyawali, U., Kerkhoff, W. G., Patton, M. H., Mu, C., White, M. G., Marquardt, A. E., Roberts, B. M., Cheer, J. F., & Mathur, B. N. (2019) · Cell Reports · doi:10.1016/j.celrep.2019.01.044 · Cited by 52
“Whereas DA neuron firing rates ramp up only when reward reinforcement is uncertain (Fiorillo et al., 2003), increases in DA release persists in sessions in which reward is guaranteed (Howe et al., 2013).”
Functional Oxides for Photoneuromorphic Engineering: Toward a Solar Brain
Pérez‐Tomás, A. (2019) · Advanced Materials Interfaces · doi:10.1002/admi.201900471 · Cited by 52
Error detection in the stop signal task
Chevrier, A., & Schachar, R. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.056 · Cited by 57
“The SST maintains an error rate of 50%, which maximises natural variations in predictions and subsequent error magnitudes (Dayan and Abbott, 2001; Fiorillo et al., 2003).”
BackgroundInfluentialIsrael, Z. H., & Bergman, H. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.08.005 · Cited by 52
Environmentally significant behavior in the home
Stern, P. C. (2008) · The Cambridge Handbook of Psychology and Economic Behaviour · doi:10.1017/cbo9780511490118.015 · Cited by 50
Dopaminergic Modulation of Appetitive and Aversive Predictive Learning
Iordanova, M. D. (2009) · Reviews in the Neurosciences · doi:10.1515/revneuro.2009.20.5-6.383 · Cited by 50
Translational Models of Gambling-Related Decision-Making
Winstanley, C. A., & Clark, L. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_5014 · Cited by 53
Zellner, M. R., Kest, K., & Ranaldi, R. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.013 · Cited by 52
“…Queens College/City University of New York, United States r t i c l e i n f o rticle history: eceived 1 May 2008 eceived in revised form 24 July 2008 ccepted 8 October 2008 vailable online 15 October 2008 a b s t r a c t Mechanisms underlying reward-related learning presumably involve…”
BackgroundHikima, T., Lee, C. R., Witkovsky, P., Chesler, J., Ichtchenko, K., & Rice, M. E. (2021) · Cell Reports · doi:10.1016/j.celrep.2021.108951 · Cited by 49
“that accompanies initiation of a motor sequence or the receipt of an unexpected reward) (Fiorillo et al., 2003; Gerfen and Surmeier, 2011; Jin and Costa, 2010; Sulzer et al., 2016).”
BackgroundFraidan, A. A. A. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104684 · Cited by 54
Cocker, P. J., & Winstanley, C. A. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2014.10.043 · Cited by 54
Sense of agency is altered in patients with a putative psychotic prodrome
Hauser, M., Moore, J. W., de Millas, W., Gallinat, J., Heinz, A., Haggard, P., & Voss, M. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.10.031 · Cited by 50
3Mo: A Model for Music-Based Biofeedback
Maes, P., Buhmann, J., & Leman, M. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00548 · Cited by 62
Great Expectations: The Placebo Effect in Parkinson’s Disease
Lidstone, S. C. (2014) · Handbook of experimental pharmacology · doi:10.1007/978-3-662-44519-8_8 · Cited by 52
Siessmeier, T., Kienast, T., Wrase, J., Larsen, J. L., Braus, D. F., Smolka, M. N., Buchholz, H. G., Schreckenberger, M., Rösch, F., Cumming, P., et al. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04903.x · Cited by 48
Reed, D. D., Naudé, G. P., Gelino, B. W., & Amlung, M. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.011 · Cited by 48
Distinct prestimulus and poststimulus activation of VTA neurons correlates with stimulus detection
Totah, N. K. B., Kim, Y., & Moghaddam, B. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00784.2012 · Cited by 53
“Previous work has demonstrated a similar sustained increase in firing rate before an unconditioned stimulus (reward) that was proportional to increased uncertainty about reward delivery (Fiorillo et al. 2003).”
Monitoring extracellular pH, oxygen, and dopamine during reward delivery in the striatum of primates
Ariansen, J. L., Heien, M. L., Hermans, A., Phillips, P. E. M., Hernádi, I., Bermúdez, M. A., Schultz, W., & Wightman, R. M. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00036 · Cited by 56
“Electrophysiological data have shown that dopamine neurons originating in the ventral tegmental area are activated by unexpected rewards and cues that predict rewards (Fiorillo et al., 2003; Tobler et al., 2005).”
Self-citationLloyd, K., & Dayan, P. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004622 · Cited by 50
Buchta, W. C., Mahler, S. V., Harlan, B. A., Aston‐Jones, G., & Riegel, A. C. (2017) · Physiological Reports · doi:10.14814/phy2.13198 · Cited by 56
“In behaving animals, salient environmental stimuli can induce burst firing in VTA dopamine neurons (Schultz, 2002; Fiorillo et al., 2003; Tobler et al., 2005).”
BackgroundTakakuwa, N., Kato, R., Redgrave, P., & Isa, T. (2017) · eLife · doi:10.7554/elife.24459 · Cited by 49
“Thus, in our study and those of others, stimuli are conditioned by Pavlovian association with different levels/probabilities of reward, prior to the recording of DA neurons (Fiorillo et al., 2003; Tobler et al., 2005; Matsumoto and Hikosaka, 2009).”
BackgroundInfluentialProbability differently modulating the effects of reward and punishment on visuomotor adaptation
Song, Y., & Smiley‐Oyen, A. L. (2017) · Experimental Brain Research · doi:10.1007/s00221-017-5082-5 · Cited by 50
From sign-tracking to attentional bias: Implications for gambling and substance use disorders
Anselme, P., & Robinson, M. J. F. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109861 · Cited by 50
Reinforcement Learning and Tourette Syndrome
Palminteri, S., & Pessiglione, M. (2013) · International review of neurobiology · doi:10.1016/b978-0-12-411546-0.00005-6 · Cited by 51
Jones, C. L., Minati, L., Harrison, N. A., Ward, J., & Critchley, H. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020942 · Cited by 54
“We characterized outcome uncertainty as being largest near pwin = 50% [22], where the probability of receiving a reward or a loss are similar.”
BackgroundMedial prefrontal cortex predicts and evaluates the timing of action outcomes
Förster, S., & Brown, J. W. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.035 · Cited by 52
“…to signal both predicted positive (Ljungberg et al., 1992; Schultz et al., 1993) and negative outcomes (Mirenowicz and Schultz, 1996) and have been suggested to signal the occurrence of outcomes that are both better and worse than those predicted (Fiorillo et al., 2003; Schultz et al., 1997).”
Smith, C. T., Wallace, D. L., Dang, L. C., Aarts, E., Jagust, W. J., D’Esposito, M., & Boettiger, C. A. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00261.2015 · Cited by 49
Altered prefrontal correlates of monetary anticipation and outcome in chronic pain
Martucci, K. T., Borg, N., MacNiven, K. H., Knutson, B. D., & Mackey, S. (2018) · Pain · doi:10.1097/j.pain.0000000000001232 · Cited by 52
“The VTA sends direct projections to the NAcc(77) and the mPFC.(24,27) As a post hoc analysis, to better understand altered mPFC activity in patients, we conducted an ROI analysis on the”
Oettl, L., Scheller, M. F., Filosa, C., Wieland, S., Haag, F., Loeb, C., Durstewitz, D., Shusterman, R., Russo, E., & Kelsch, W. (2020) · Nature Communications · doi:10.1038/s41467-020-17257-7 · Cited by 50
A Positive Affective Neuroendocrinology Approach to Reward and Behavioral Dysregulation
Welker, K. M., Gruber, J., & Mehta, P. H. (2015) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2015.00093 · Cited by 51
Parametric modulation of error-related ERP components by the magnitude of visuo-motor mismatch
Vocat, R., Pourtois, G., & Vuilleumier, P. O. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.12.027 · Cited by 52
“…may be sensible to the amount of discrepancy between the actual and intended motor action, consistent with the hypothesis that these early error-related ERPs may reflect reinforcement learning mechanisms that entertain a direct relationship with prediction error magnitude (Fiorillo et al., 2003).”
InfluentialOn Cotransmission & Neurotransmitter Phenotype Plasticity
Trudeau, L.-E., & Gutierrez, R. (2007) · Molecular Interventions · doi:10.1124/mi.7.3.5 · Cited by 46
Valuation for Risky and Uncertain Choices
Tobler, P. N., & Weber, E. U. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00009-7 · Cited by 58
Self-citationBuch, E. R., Brasted, P. J., & Wise, S. P. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0130-y · Cited by 51
Nigrostriatal dopamine pathway regulates auditory discrimination behavior
Chen, A. P. F., Malgady, J. M., Chen, L., Shi, K. W., Cheng, E., Plotkin, J. L., Ge, S., & Xiong, Q. (2022) · Nature Communications · doi:10.1038/s41467-022-33747-2 · Cited by 46
Sensitization of Incentive Salience and the Transition to Addiction
Warlow, S. M., Baumgartner, H. M., Freeland, C. M., Naffziger, E. E., Olney, J. J., Berridge, K. C., & Robinson, M. J. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.006 · Cited by 47
Gambling disorder: an integrative review of animal and human studies
Nautiyal, K. M., Okuda, M., Hen, R., & Blanco, C. (2017) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13356 · Cited by 52
Effects of dopamine on reinforcement learning in Parkinson’s disease depend on motor phenotype
van Nuland, A. J. M., Helmich, R. C. G., Dirkx, M. F., Zach, H., Toni, I., Cools, R., & den Ouden, H. E. M. (2020) · Brain · doi:10.1093/brain/awaa335 · Cited by 50
“…the well-established importance of dopamine in the neural implementation of reinforcement learning (Schultz et al. , 1997; Holroyd and Coles, 2002; Fiorillo et al. , 2003; Steinberg et al. , 2013), there is a puz-zlingly large variability in the effects of dopaminergic medication on reinforcement…”
Neurobiological Foundations of Behavioral Addictions
Vaccaro, A. G., & Potenza, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.016 · Cited by 45
The Prevention and Treatment of Gambling Disorders: Some Art, Some Science
Derevensky, J. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.024 · Cited by 47
Rare rewards amplify dopamine responses
Rothenhoefer, K. M., Hong, T., Alikaya, A., & Stauffer, W. R. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00807-7 · Cited by 51
Two sources of uncertainty independently modulate temporal expectancy
Grabenhorst, M., Maloney, L. T., Poeppel, D., & Michalareas, G. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2019342118 · Cited by 47
“Nonetheless, the effect of event uncertainty in reward anticipation (15, 16), and the certainty effects in decision-making (17, 18), invite the hypothesis that the impact of P O on event anticipation might be dynamic rather than static (Fig.”
The lateral habenula: A hub for value-guided behavior
Groos, D., & Helmchen, F. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.113968 · Cited by 48
Cognitive function in schizophrenia: conflicting findings and future directions
Moustafa, A. A., Garami, J. K., Mahlberg, J., Golembieski, J., Kéri, S., Misiak, B., & Frydecka, D. (2016) · Reviews in the Neurosciences · doi:10.1515/revneuro-2015-0060 · Cited by 50
Chakravarthy, V. S., Balasubramani, P. P., Mandali, A., Jahanshahi, M., & Moustafa, A. A. (2018) · Physiology & Behavior · doi:10.1016/j.physbeh.2018.06.032 · Cited by 48
optoPAD, a closed-loop optogenetics system to study the circuit basis of feeding behaviors
Moreira, J.-M., Itskov, P. M., Goldschmidt, D., Baltazar, C., Steck, K., Tastekin, I., Walker, S. J., & Ribeiro, C. (2019) · eLife · doi:10.7554/elife.43924 · Cited by 47
“…described up to this point have been deterministic in nature, behavioral experiments in which the behavior of the animal is linked to a probabilistic delivery of a reward or punishment have been very powerful in probing the neuronal substrates of complex learned behaviors (Fiorillo et al., 2003).”
BackgroundIglesias, S., Kasper, L., Harrison, S. J., Manka, R., Mathys, C., & Stephan, K. E. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117590 · Cited by 45
Advances in understanding meso‐cortico‐limbic‐striatal systems mediating risky reward seeking
Piantadosi, P. T., Halladay, L. R., Radke, A. K., & Holmes, A. (2021) · Journal of Neurochemistry · doi:10.1111/jnc.15342 · Cited by 48
A shift of paradigm: From noradrenergic to dopaminergic modulation of learning?
Breitenstein, C., Flöel, A., Korsukewitz, C., Wailke, S., Bushuven, S., & Knecht, S. (2006) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2006.05.012 · Cited by 44
“[18] Fiorillo CD, Tobler PN, Schultz W.”
BackgroundConsidering the Overlap and Nonoverlap of Compulsivity, Impulsivity, and Addiction
Blum, A. W., & Grant, J. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.038 · Cited by 44
Neurobiology of Substance Addictions
Christie, N. C., & Bechara, A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.015 · Cited by 44
Striatal dopamine signals reflect perceived cue–action–outcome associations in mice
Bernklau, T. W., Righetti, B., Mehrke, L. S., & Jacob, S. N. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01567-2 · Cited by 51
“Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.”
BackgroundMethodInfluentialThe dorsal raphe nucleus is integral to negative prediction errors in Pavlovian fear
Berg, B. A., Schoenbaum, G., & McDannald, M. A. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12676 · Cited by 45
A neural mechanism for conserved value computations integrating information and rewards
Bromberg-Martin, E. S., Feng, Y.-Y., Ogasawara, T., White, J. K., Zhang, K., & Monosov, I. E. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01511-4 · Cited by 43
Mindfulness-Based Interventions Applied to Addiction Treatments
Kechter, A., & Black, D. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.040 · Cited by 44
Multiple Memory Systems, Addiction, and Health Habits: New Routes for Translational Science
Stacy, A. W., Pike, J. R., & Lee, A. Y. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.017 · Cited by 43
Tanning as an Addiction: The State of the Research and Implications for Intervention
Miller, K. A., & Mays, D. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.037 · Cited by 43
Schulte, E. M., Schiestl, E. T., & Gearhardt, A. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.035 · Cited by 43
From Perception to Pleasure: The Neuroscience of Music and Why We Love It
Zatorre, R. J. (2023) · doi:10.1093/oso/9780197558287.001.0001 · Cited by 65
Lax, E., Friedman, A., Croitoru, O., Sudai, E., Ben‐Moshe, H., Redlus, L., Sasson, E., Blumenfeld‐Katzir, T., Assaf, Y., & Yadid, G. (2013) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.06.034 · Cited by 46
“In addition, the LHb receives low frequency inputs from dopaminergic midbrain neurons, which inhibit LHb activity when positive reward is expected (Fiorillo et al., 2003).”
Baudonnat, M., Huber, A., David, V., & Walton, M. E. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00175 · Cited by 44
“Some dopamine neurons have been shown to exhibit a short-latency, brief phasic response that correlates with reward value, followed by a slower change in activity that scales with reward uncertainty (Fiorillo et al., 2003).”
BackgroundHomeostatic regulation of memory systems and adaptive decisions
Mizumori, S. J. Y., & Jo, Y. S. (2013) · Hippocampus · doi:10.1002/hipo.22176 · Cited by 51
“the brain is driven to resolve uncertainties that arise with prediction errors (Fiorillo et al., 2003; Knill and Pouget, 2004; Doya, 2008; Schultz et al., 2011; Bach and Dolan, 2012; Dayan, 2012)”
BackgroundThe effect of novelty on reinforcement learning
Houillon, A., Lorenz, R. C., Böhmer, W., Rapp, M. A., Heinz, A., Gallinat, J., & Obermayer, K. (2013) · Progress in brain research · doi:10.1016/b978-0-444-62604-2.00021-6 · Cited by 48
Human aging reduces the neurobehavioral influence of motivation on episodic memory
Geddes, M. R., Mattfeld, A. T., Angeles, C. D. L., Keshavan, A., & Gabrieli, J. D. E. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.12.053 · Cited by 43
Dopaminergic D1 Receptor Stimulation Affects Effort and Risk Preferences
Soutschek, A., Gvozdanovic, G., Kozak, R., Duvvuri, S., de Martinis, N., Harel, B., Gray, D. L., Fehr, E., Jetter, A., & Tobler, P. N. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.09.002 · Cited by 44
Self-citationPre-clinical models of reward deficiency syndrome: A behavioral octopus
Gondré-Lewis, M. C., Bassey, R., & Blum, K. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.04.021 · Cited by 42
GLP-1 and hunger modulate incentive motivation depending on insulin sensitivity in humans
Hanssen, R., Kretschmer, A. C., Rigoux, L., Albus, K., Edwin Thanarajah, S., Sitnikow, T., Melzer, C., Cornely, O. A., Brüning, J. C., & Tittgemeyer, M. (2021) · Molecular Metabolism · doi:10.1016/j.molmet.2021.101163 · Cited by 40
“The magnitude and probability of a reward [9,17] is encoded by dopamine (DA) neurons in the ventral tegmental area (VTA) and its mesoaccumbens DA projections.”
BackgroundDopamine neuronal responses in monkeys performing visually cued reward schedules
Ravel, S., & Richmond, B. J. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04905.x · Cited by 41
“From those experiments, dopamine neuronal responses have been interpreted as relating to event salience, subsequent arousal, reward prediction and ⁄ or reward prediction error and reward probability (Schultz & Romo, 1987; Ljungberg et al., 1992; Schultz et al., 1993; Mirenowicz & Schultz, 1994; Schultz et al., 1997; H…”
BackgroundTremblay, A.-M., Desmond, R. C., Poulos, C. X., & Zack, M. (2011) · Addiction Biology · doi:10.1111/j.1369-1600.2010.00208.x · Cited by 41
“CS-induced DA release is greatest when the US is maximally uncertain (i.e. 50% variable ratio schedule) (Fiorillo et al. 2003).”
BackgroundSenn, W., & Fusi, S. (2005) · Neural Computation · doi:10.1162/0899766054615644 · Cited by 45
Behavioral Economics and Addictive Disorders
Jarmolowicz, D. P., & Schneider, T. D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.005 · Cited by 42
Prevention and Treatment of Compulsive Buying Disorder
Galimov, A., & Black, D. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.027 · Cited by 42
Blum, K., Roy, A. K., Podesta, A., Modestino, E. J., Steinberg, B., Gondré-Lewis, M. C., Baron, D. A., Thanos, P. K., Lott, L., Badgaiyan, S., et al. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.031 · Cited by 42
Prevention and Treatment of “Food Addiction”
Davis, C., & Mason, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.023 · Cited by 42
Human Neurobiological Approaches to Hedonically Motivated Behaviors
Burger, K. S., Shearrer, G. E., & Sadler, J. R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.009 · Cited by 42
Feedback Models for Gambling Control: The Use and Efficacy of Online Responsible Gambling Tools
Griffiths, M. D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108632591.034 · Cited by 42
Tradeoffs and Constraints on Neural Representation in Networks of Cortical Neurons
Kermany, E., Gal, A., Lyakhov, V., Meir, R., Marom, S., & Eytan, D. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0661-10.2010 · Cited by 44
“…efficacy of four types of popular schemes, two rate-base and two time-based: population-counthistogram (Schwartz, 1993; Hupé et al., 2001; Fiorillo et al., 2003), spike-count (Arabzadeh et al., 2006; Foffani et al., 2009; Jacobs et al., 2009), time-to-first-spike (Petersen et al.,…”
BackgroundNMDA Receptors on Non-Dopaminergic Neurons in the VTA Support Cocaine Sensitization
Luo, Y., Good, C. H., Diaz-Ruiz, O., Zhang, Y., Hoffman, A. F., Shan, L., Kuang, S. Y., Malik, N., Chefer, V. I., Tomac, A. C., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012141 · Cited by 41
“It has been proposed that the acquisition of conditioned behavioral responses is governed by the phasic firing of DA neurons initiated by NMDAR activity [21,31,32,33,34].”
BackgroundOn the stress potential of an organisational climate of innovation: a survey study in Germany
Fischer, T., & Riedl, R. (2020) · Behaviour and Information Technology · doi:10.1080/0144929x.2020.1836258 · Cited by 51
“This e ff ect can be explained by the human tendency of increasing attention and arousal in uncertain situations (Carretié et al. 2004; Fiorillo, Tobler, and Schultz 2003).”
BackgroundCoding of Reward Probability and Risk by Single Neurons in Animals
Burke, C. J., & Tobler, P. N. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00121 · Cited by 46
“Fiorillo et al. (2003) used a Pavlovian conditioning paradigm with abstract visual cues, with each cue predicting a reward (0.15 ml of juice after 2 s) with a different probability (p = 0.0, p = 0.25, p = 0.5, p = 0.75, and p = 1.0).”
BackgroundMethodInfluentialSelf-citationWojnicki, F. H. E., Babbs, R. K., & Corwin, R. L. (2010) · Physiology & Behavior · doi:10.1016/j.physbeh.2010.03.004 · Cited by 45
“Recent research has indicated the involvement of dopamine in neuronal processing involving reward probability and uncertainty [37,38].”
Metadata
- Authors
- Fiorillo, C. D., Tobler, P. N., & Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Fiorillo, Christopher D.
- Venue
- Science
- Published
- 2003-03-21
- Volume
- 299
- Issue
- 5614
- Pages
- 1898-1902
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2158420012
- Cited by
- 2,085
- References
- 21
- Citations by year
- 2026: 41 · 2025: 41 · 2024: 52 · 2023: 75 · 2022: 72 · 2021: 89 · 2020: 187 · 2019: 88 · 2018: 92 · 2017: 81 · 2016: 95 · 2015: 85 · 2014: 113 · 2013: 111 · 2012: 138
- FWCI
- 27.21
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- reroDoc Digital Library (submittedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- dopaminergic neurons, reward probability, prediction error, risk-taking
- MeSH terms
- Animals, Attention, Conditioning, Classical, Discrimination, Psychological, Dopamine, Electrophysiology, Female, Learning, Macaca fascicularis, Mesencephalon, Motivation, Neurons, Photic Stimulation, Probability, Reinforcement, Psychology, Reward, Risk-Taking, Linear Models, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.