Phasic dopamine signals: from subjective reward value to formal economic utility
Open accessAbstract
Although rewards are physical stimuli and objects, their value for survival and reproduction is subjective. The phasic, neurophysiological and voltammetric dopamine reward prediction error response signals subjective reward value. The signal incorporates crucial reward aspects such as amount, probability, type, risk, delay and effort. Differences of dopamine release dynamics with temporal delay and effort in rodents may derive from methodological issues and require further study. Recent designs using concepts and behavioral tools from experimental economics allow to formally characterize the subjective value signal as economic utility and thus to establish a neuronal value function. With these properties, the dopamine response constitutes a utility prediction error signal.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Dopaminergic signaling in the NAc has been widely studied for its involvement in motivational salience, behavioral reinforcement, and reward prediction error encoding.
“Dopaminergic signaling in the NAc has been widely studied for its involvement in motivational salience, behavioral reinforcement, and reward prediction error encoding (Schultz et al., 2015; Berridge and Robinson, 2016; Watabe-Uchida et al., 2017; Berke, 2018).”
From Ventral striatum dopamine release encodes unique properties of visual stimuli in mice (2023) · cites this paper as Schultz et al., 2015
The Different rewards > Neurobiology section links reward prediction error responses to dopamine concentration changes in rat nucleus accumbens. The Temporal discounting > Neurobiology section also describes an influence of dopamine stimulation on behavioral learning and approach, consistent with the reinforcement part of the claim. The copy does not establish the claimed involvement of NAc dopamine in motivational salience. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Theory of games and economic behavior
Garcia, S. R., & Miller, S. J. (2019) · American Mathematical Society eBooks · doi:10.1090/mbk/121/32 · Cited by 16,777 · see citing works
Anderson, N. H. (2001) · Psychology Press eBooks · doi:10.4324/9781410600004-24 · Cited by 6,939 · see citing works
The Theory of Games and Economic Behavior
Harrison, R. W., von Neumann, J., & Morgenstern, O. (1945) · Journal of Farm Economics · doi:10.2307/1232672 · Cited by 5,258 · see citing works
Increasing risk: I. A definition
Rothschild, M., & Stiglitz, J. (1970) · Journal of Economic Theory · doi:10.1016/0022-0531(70)90038-4 · Cited by 3,760 · see citing works
Hyperlocomotion and indifference to cocaine and amphetamine in mice lacking the dopamine transporter
Giros, B., Jaber, M., Jones, S. R., Wightman, R. M., & Caron, M. G. (1996) · Nature · doi:10.1038/379606a0 · Cited by 2,476 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
Response of brain tissue to chronically implanted neural electrodes
Polikov, V. S., Tresco, P. A., & Reichert, W. M. (2005) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2005.08.015 · Cited by 1,896 · see citing works
Mahalanobis, P. C. (1954) · dialectica · doi:10.1111/j.1746-8361.1954.tb01124.x · Cited by 1,722 · see citing works
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · see citing works
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378 · see citing works
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works
Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Tsai, H.-C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., & Deisseroth, K. (2009) · Science · doi:10.1126/science.1168878 · Cited by 1,266 · see citing works
Choice Under Uncertainty: Problems Solved and Unsolved
Machina, M. J. (1992) · Hübner international series on risk, insurance, and economic security · doi:10.1007/978-94-015-7957-5_2 · Cited by 950 · see citing works
A causal link between prediction errors, dopamine neurons and learning
Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K. A., & Janak, P. H. (2013) · Nature Neuroscience · doi:10.1038/nn.3413 · Cited by 879 · see citing works
Choice Under Uncertainty: Problems Solved and Unsolved
Machina, M. J. (1987) · The Journal of Economic Perspectives · doi:10.1257/jep.1.1.121 · Cited by 878 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
Self-citationAn empirical demonstration of risk-sensitive foraging preferences
Caraco, T. B., Martindale, S., & Whittam, T. S. (1980) · Animal Behaviour · doi:10.1016/s0003-3472(80)80142-4 · Cited by 767 · see citing works
Ainslie, G. W. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.21-485 · Cited by 763 · see citing works
Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710 · see citing works
Monitoring Rapid Chemical Communication in the Brain
Robinson, D. L., Hermans, A., Seipel, A. T., & Wightman, R. M. (2008) · Chemical Reviews · doi:10.1021/cr068081q · Cited by 665 · see citing works
Brain Tissue Responses to Neural Implants Impact Signal Sensitivity and Intervention Strategies
Kozai, T. D. Y., Jaquins-Gerstl, A. S., Vazquez, A. L., Michael, A. C., & Cui, X. T. (2015) · ACS Chemical Neuroscience · doi:10.1021/cn500256e · Cited by 622 · see citing works
Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574 · see citing works
DETERMINATION OF DISCOUNT FUNCTIONS IN RATS WITH AN ADJUSTING‐AMOUNT PROCEDURE
Richards, J. B., Mitchell, S. H., de Wit, H., & Seiden, L. S. (1997) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1997.67-353 · Cited by 493 · see citing works
Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats
Heien, M. L. A. V., Khan, A. S., Ariansen, J. L., Cheer, J. F., Phillips, P. E. M., Wassum, K. M., & Wightman, R. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504657102 · Cited by 482 · see citing works
Varazzani, C., San‐Galli, A., Gilardeau, S., & Bouret, S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0454-15.2015 · Cited by 446 · see citing works
Influence of Reward Delays on Responses of Dopamine Neurons
Kobayashi, S., & Schultz, W. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1600-08.2008 · Cited by 431 · see citing works
Risk-sensitive neurons in macaque posterior cingulate cortex
McCoy, A. N., & Platt, M. L. (2005) · Nature Neuroscience · doi:10.1038/nn1523 · Cited by 380 · see citing works
Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals
Clark, J. J., Sandberg, S. G., Wanat, M. J., Gan, J. O., Horne, E. A., Hart, A. S., Akers, C. A., Parker, J. G., Willuhn, I., Martinez, V., et al. (2010) · Nature Methods · doi:10.1038/nmeth.1412 · Cited by 378 · see citing works
The temporal precision of reward prediction in dopamine neurons
Fiorillo, C. D., Newsome, W. T., & Schultz, W. (2008) · Nature Neuroscience · doi:10.1038/nn.2159 · Cited by 310 · see citing works
Corbett, D., & Wise, R. A. (1980) · Brain Research · doi:10.1016/0006-8993(80)90666-6 · Cited by 264 · see citing works
Coding of Reward Risk by Orbitofrontal Neurons Is Mostly Distinct from Coding of Reward Value
O’Neill, M. J., & Schultz, W. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.031 · Cited by 259 · see citing works
Dopamine prediction error responses integrate subjective value from different reward dimensions
Lak, A., Stauffer, W. R., & Schultz, W. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1321596111 · Cited by 257 · see citing works
Self-citationWilluhn, I., Burgeno, L. M., Everitt, B. J., & Phillips, P. E. M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213460109 · Cited by 241 · see citing works
Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine
Gan, J. O., Walton, M. E., & Phillips, P. E. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2460 · Cited by 235 · see citing works
Economic Choice Theory: An Experimental Analysis of Animal Behavior
Kagel, J. H., Battalio, R. C., & Green, L. (1995) · Cited by 213 · see citing works
Dopamine Reward Prediction Error Responses Reflect Marginal Utility
Stauffer, W. R., Lak, A., & Schultz, W. (2014) · Current Biology · doi:10.1016/j.cub.2014.08.064 · Cited by 204 · see citing works
Two Dimensions of Value: Dopamine Neurons Represent Reward But Not Aversiveness
Fiorillo, C. D. (2013) · Science · doi:10.1126/science.1238699 · Cited by 203 · see citing works
Garris, P. A., Christensen, J. R. C., Rebec, G. V., & Wightman, R. M. (1997) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.1997.68010152.x · Cited by 192 · see citing works
Dopamine release is heterogeneous within microenvironments of the rat nucleus accumbens
Wightman, R. M., Heien, M. L., Wassum, K. M., Sombers, L. A., Aragona, B. J., Khan, A. S., Ariansen, J. L., Cheer, J. F., Phillips, P. E. M., & Carelli, R. M. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05772.x · Cited by 179 · see citing works
Winslow, B. D., & Tresco, P. A. (2010) · Biomaterials · doi:10.1016/j.biomaterials.2009.11.049 · Cited by 178 · see citing works
Dynamic Gain Control of Dopamine Delivery in Freely Moving Animals
Montague, P. R., McClure, S. M., Baldwin, P. R., Phillips, P. E. M., Budygin, E. A., Stuber, G. D., Kilpatrick, M., & Wightman, R. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.4279-03.2004 · Cited by 174 · see citing works
Phasic Nucleus Accumbens Dopamine Release Encodes Effort- and Delay-Related Costs
Day, J. J., Jones, J. L., Wightman, R. M., & Carelli, R. M. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.03.026 · Cited by 160 · see citing works
Adjusting delay to reinforcement: Comparing choice in pigeons and humans.
Rodríguez, M., & Logue, A. W. (1988) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.14.1.105 · Cited by 158 · see citing works
Playing for peanuts: Why is risk seeking more common for low-stakes gambles?
Weber, B. J., & Chapman, G. B. (2005) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2005.03.001 · Cited by 152 · see citing works
Phasic Nucleus Accumbens Dopamine Encodes Risk-Based Decision-Making Behavior
Sugam, J. A., Day, J. J., Wightman, R. M., & Carelli, R. M. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.09.029 · Cited by 142 · see citing works
Dopamine Neuronal Transport Kinetics and Effects of Amphetamine
Jones, S. R., Joseph, J. D., Barak, L. S., Caron, M. G., & Wightman, R. M. (1999) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.1999.0732406.x · Cited by 141 · see citing works
Adjusting delay to reinforcement: Comparing choice in pigeons and humans.
Rodriguez, M. L., & Logue, A. W. (1988) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.14.1.105 · Cited by 129 · see citing works
Perception of biological motion in visual agnosia
Huberle, E., Rupek, P., Lappe, M., & Karnath, H. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00056 · Cited by 126 · see citing works
Saddoris, M. P., Sugam, J. A., Stuber, G. D., Witten, I. B., Deisseroth, K. A., & Carelli, R. M. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.10.024 · Cited by 116 · see citing works
Delays Conferred by Escalating Costs Modulate Dopamine Release to Rewards But Not Their Predictors
Wanat, M. J., Kuhnen, C. M., & Phillips, P. E. M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.2691-10.2010 · Cited by 100 · see citing works
Fiorillo, C. D., Song, M. R., & Yun, S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3883-12.2013 · Cited by 98 · see citing works
Limited Encoding of Effort by Dopamine Neurons in a Cost–Benefit Trade-off Task
Pasquereau, B., & Turner, R. S. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4619-12.2013 · Cited by 94 · see citing works
Transient activation of midbrain dopamine neurons by reward risk
Fiorillo, C. D. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.037 · Cited by 90 · see citing works
Rodeberg, N. T., Johnson, J. A., Cameron, C. M., Saddoris, M. P., Carelli, R. M., & Wightman, R. M. (2015) · Analytical Chemistry · doi:10.1021/acs.analchem.5b03222 · Cited by 67 · see citing works
Cardinal Utility for Even-Chance Mixtures of Pairs of Sure Prospects
Debreu, G. (1959) · The Review of Economic Studies · doi:10.2307/2295745 · Cited by 60 · see citing works
New-generation diabetes management: glucose sensor-augmented insulin pump therapy
Cengiz, E., Sherr, J. L., WEINZIMER, S. A., & Tamborlane, W. V. (2011) · Expert Review of Medical Devices · doi:10.1586/erd.11.22 · Cited by 53 · see citing works
Dopamine-associated cached values are not sufficient as the basis for action selection
Hollon, N. G., Arnold, M. M., Gan, J. O., Walton, M. E., & Phillips, P. E. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419770111 · Cited by 52 · see citing works
Monitoring extracellular pH, oxygen, and dopamine during reward delivery in the striatum of primates
Ariansen, J. L., Heien, M. L., Hermans, A., Phillips, P. E. M., Hernádi, I., Bermúdez, M. A., Schultz, W., & Wightman, R. M. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00036 · Cited by 48 · see citing works
Gerhardt, G. A., Ksir, C. J., Pivik, C., Dickinson, S. D., Sabeti, J., & Zahniser, N. R. (1999) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(98)00158-7 · Cited by 29 · see citing works
A new design of carbon fiber microelectrode for in vivo voltammetry using fused silica
Swiergiel, A. H., Palamarchouk, V., & Dunn, A. J. (1997) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(96)02207-8 · Cited by 27 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [21]Mas-Colell A Whinston M Green J Microeconomic Theory 1995 Oxford University Press
Cited by
Sorted by citations
Sex differences in neural mechanisms mediating reward and addiction
Becker, J. B., & Chartoff, E. H. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0125-6 · Cited by 455 · see citing works
Functional dissociation of stimulus intensity encoding and predictive coding of pain in the insula
Geuter, S., Boll, S., Eippert, F., & Büchel, C. (2017) · eLife · doi:10.7554/elife.24770 · Cited by 184 · see citing works
Reward Processing, Neuroeconomics, and Psychopathology
Zald, D. H., & Treadway, M. T. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044957 · Cited by 181 · see citing works
Learning with three factors: modulating Hebbian plasticity with errors
Kuśmierz, Ł., Isomura, T., & Toyoizumi, T. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.020 · Cited by 145 · see citing works
What Is the Relationship between Dopamine and Effort?
Walton, M. E., & Bouret, S. (2018) · Trends in Neurosciences · doi:10.1016/j.tins.2018.10.001 · Cited by 150 · see citing works
Duda, J., Pötschke, C., & Liss, B. (2016) · Journal of Neurochemistry · doi:10.1111/jnc.13572 · Cited by 149 · see citing works
Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework
Sadacca, B. F., Jones, J. L., & Schoenbaum, G. M. (2016) · eLife · doi:10.7554/elife.13665 · Cited by 137 · see citing works
Arulpragasam, A. R., Cooper, J. A., Nuutinen, M. R., & Treadway, M. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800444115 · Cited by 92 · see citing works
Oxytocin functions as a spatiotemporal filter for excitatory synaptic inputs to VTA dopamine neurons
Xiao, L., Priest, M. F., & Kozorovitskiy, Y. (2018) · eLife · doi:10.7554/elife.33892 · Cited by 83 · see citing works
“…clinical implications, given the involvement of midbrain DA regions in reward-based behavior (Howe and Dombeck, 2016; Russo and Nestler, 2013; Schultz, 1998), drug abuse and addiction (Jones and Bonci, 2005; Kauer and Malenka, 2007; Niehaus et al., 2009; Stelly et al., 2016), as well as…”
BackgroundDopamine and reward: a view from the prefrontal cortex
Chau, B. K. H., Jarvis, H., Law, C.-K., & Chong, T. T. ‐. (2018) · Behavioural Pharmacology · doi:10.1097/fbp.0000000000000424 · Cited by 84 · see citing works
Transient and sustained effects of dopamine and serotonin signaling in motivation‐related behavior
Yagishita, S. (2019) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12942 · Cited by 64 · see citing works
The European Proceedings of Social & Behavioural Sciences
Căpiță, L. E., Huijgen, T., & Căpiță, C. (2016) · Cited by 60 · see citing works
Owesson-White, C., Belle, A. M., Herr, N. R., Peele, J. L., Gowrishankar, P., Carelli, R. M., & Wightman, R. M. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0393-16.2016 · Cited by 55 · see citing works
Parallels and Overlap: The Integration of Homeostatic Signals by Mesolimbic Dopamine Neurons
Hsu, T. M., McCutcheon, J. E., & Roitman, M. F. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00410 · Cited by 57 · see citing works
Distinct regions of the striatum underlying effort, movement initiation and effort discounting
Suzuki, S., Lawlor, V. M., Cooper, J. A., Arulpragasam, A. R., & Treadway, M. T. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00972-y · Cited by 54 · see citing works
Ovarian Hormones and Reward Processes in Palatable Food Intake and Binge Eating
Ma, R., Mikhail, M. E., Culbert, K. M., Johnson, A. W., Sisk, C. L., & Klump, K. L. (2019) · Physiology · doi:10.1152/physiol.00013.2019 · Cited by 55 · see citing works
Robinson, J. E., Coughlin, G. M., Hori, A. M., Cho, J. R., Mackey, E. D., Turan, Z., Patriarchi, T., Tian, L., & Gradinaru, V. (2019) · eLife · doi:10.7554/elife.48983 · Cited by 44 · see citing works
Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation
Kato, A., & Morita, K. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005145 · Cited by 57 · see citing works
Venton, B. J., & DiScenza, D. J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-821203-5.00004-x · Cited by 51 · see citing works
Schelp, S. A., Pultorak, K. J., Rakowski, D. R., Gomez, D. M., Krzystyniak, G., Das, R., & Oleson, E. B. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706969114 · Cited by 50 · see citing works
Fischbach-Weiss, S., Reese, R. M., & Janak, P. H. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2017.12.003 · Cited by 44 · see citing works
Whiteway, M. R., & Butts, D. A. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00698.2016 · Cited by 37 · see citing works
Tanaka, S., O'Doherty, J., & Sakagami, M. (2019) · Nature Communications · doi:10.1038/s41467-019-11334-2 · Cited by 30 · see citing works
The “highs and lows” of the human brain on dopaminergics: Evidence from neuropharmacology
Martins, D., Mehta, M. A., & Prata, D. P. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.06.003 · Cited by 29 · see citing works
Computational Underpinnings of Neuromodulation in HumansPreprint
Montague, P. R., & Kishida, K. T. (2018) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2018.83.038166 · Cited by 27 · see citing works
Hill, D. F., Parent, K. L., Atcherley, C. W., Cowen, S. L., & Heien, M. L. (2017) · Brain stimulation · doi:10.1016/j.brs.2017.11.010 · Cited by 29 · see citing works
Oleson, E. B., Hamilton, L. R., & Gomez, D. M. (2021) · Frontiers in Synaptic Neuroscience · doi:10.3389/fnsyn.2021.660218 · Cited by 27 · see citing works
A Transient Dopamine Signal Represents Avoidance Value and Causally Influences the Demand to Avoid
Pultorak, K. J., Schelp, S. A., Isaacs, D. P., Krzystyniak, G., & Oleson, E. B. (2018) · eNeuro · doi:10.1523/eneuro.0058-18.2018 · Cited by 27 · see citing works
Mesolimbic dopamine D2 receptors and neural representations of subjective value
Castrellon, J. J., Young, J. S., Dang, L. C., Cowan, R. L., Zald, D. H., & Samanez-Larkin, G. R. (2019) · Scientific Reports · doi:10.1038/s41598-019-56858-1 · Cited by 24 · see citing works
Aberg, K. C., Kramer, E. E., & Schwartz, S. (2020) · Nature Communications · doi:10.1038/s41467-020-15542-z · Cited by 24 · see citing works
To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity
Beeler, J. A., & Mourra, D. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00006 · Cited by 27 · see citing works
Detection of evoked acetylcholine release in mouse brain slices
Asri, R., O’Neill, B., Patel, J. C., Siletti, K. A., & Rice, M. E. (2016) · The Analyst · doi:10.1039/c6an01758d · Cited by 24 · see citing works
Endocannabinoid modulation of dopamine release during reward seeking, interval timing, and avoidance
Everett, T. J., Gomez, D. M., Hamilton, L. R., & Oleson, E. B. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.110031 · Cited by 23 · see citing works
Functional architecture of executive control and associated event-related potentials in macaques
Sajad, A., Errington, S. P., & Schall, J. D. (2022) · Nature Communications · doi:10.1038/s41467-022-33942-1 · Cited by 23 · see citing works
When Helping Is Risky: The Behavioral and Neurobiological Trade-off of Social and Risk Preferences
Gross, J., Faber, N. S., Kappes, A., Nußberger, A.-M., Cowen, P. J., Browning, M. D., Kahane, G., Savulescu, J., Crockett, M. J., & Dreu, C. K. W. D. (2021) · Psychological Science · doi:10.1177/09567976211015942 · Cited by 21 · see citing works
Rat behavior and dopamine release are modulated by conspecific distress
Lichtenberg, N. T., Lee, B., Kashtelyan, V., Chappa, B. S., Girma, H. T., Green, E. A., Kantor, S., Lagowala, D. A., Myers, M. A., Potemri, D., et al. (2018) · eLife · doi:10.7554/elife.38090 · Cited by 21 · see citing works
Are ion channels potential therapeutic targets for Parkinson’s disease?
Daniel, N. H., Aravind, A., & Thakur, P. S. (2021) · NeuroToxicology · doi:10.1016/j.neuro.2021.10.008 · Cited by 20 · see citing works
When theory and biology differ: The relationship between reward prediction errors and expectancy
Williams, C. C., Hassall, C. D., Trska, R., Holroyd, C. B., & Krigolson, O. E. (2017) · Biological Psychology · doi:10.1016/j.biopsycho.2017.09.007 · Cited by 20 · see citing works
Beyond the average: The role of variable reward sensitivity in eating disorders
Neuser, M. P., Kühnel, A., Svaldi, J., & Kroemer, N. B. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.112971 · Cited by 20 · see citing works
Ventral striatum dopamine release encodes unique properties of visual stimuli in mice
Gonzalez, L. S., Fisher, A. A., D'Souza, S. P., Cotella, E. M., Lang, R. A., & Robinson, J. E. (2023) · eLife · doi:10.7554/elife.85064 · Cited by 18 · see citing works
Montgomery, E. B. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00469 · Cited by 18 · see citing works
Decreases in Cued Reward Seeking After Reward-Paired Inhibition of Mesolimbic Dopamine
Fischbach-Weiss, S., & Janak, P. H. (2019) · Neuroscience · doi:10.1016/j.neuroscience.2019.04.035 · Cited by 17 · see citing works
Reduced neural encoding of utility prediction errors in cocaine addiction
Konova, A. B., Ceceli, A. O., Horga, G., Moeller, S. J., Nelly Alia-klein, A., & Goldstein, R. Z. (2023) · Neuron · doi:10.1016/j.neuron.2023.09.015 · Cited by 19 · see citing works
Rewarding images do not invoke the reward positivity: They inflate it
Brown, D. R., & Cavanagh, J. F. (2018) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2018.02.012 · Cited by 16 · see citing works
Nunes, E. J., & Addy, N. (2022) · Neuropharmacology · doi:10.1016/j.neuropharm.2022.109336 · Cited by 13 · see citing works
Impaired learning of punishments in Parkinson’s disease with and without impulse control disorder
Leplow, B., Sepke, M., Schönfeld, R., Pohl, J., Oelsner, H., Latzko, L., & Ebersbach, G. (2016) · Journal of Neural Transmission · doi:10.1007/s00702-016-1648-9 · Cited by 15 · see citing works
Unifying ecosystem responses to disturbance into a single statistical framework
Lemoine, N. P. (2020) · Oikos · doi:10.1111/oik.07752 · Cited by 14 · see citing works
Cataldi, S., Lacefield, C., Shashaank, N., Kumar, G., Boumhaouad, S., & Sulzer, D. L. (2022) · eNeuro · doi:10.1523/eneuro.0169-22.2022 · Cited by 13 · see citing works
Nunes, E. J., Kebede, N., Haight, J. L., Foster, D. J., Lindsley, C. W., Conn, P. J., & Addy, N. (2023) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1124/jpet.122.001438 · Cited by 11 · see citing works
Oleson, E. B., & Roberts, J. B. (2018) · Brain Research · doi:10.1016/j.brainres.2018.11.043 · Cited by 11 · see citing works
Stock, A., Colzato, L. S., & Beste, C. (2018) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2018.05.010 · Cited by 10 · see citing works
Subjective utility moderates bidirectional effects of conflicting motivations on pain perception
Becker, S., Gandhi, W., Chen, Y. J., & Schweinhardt, P. (2017) · Scientific Reports · doi:10.1038/s41598-017-08454-4 · Cited by 11 · see citing works
Evaluation of Drug Concentrations Delivered by Microiontophoresis
Kirkpatrick, D. C., & Wightman, R. M. (2016) · Analytical Chemistry · doi:10.1021/acs.analchem.6b01211 · Cited by 8 · see citing works
Evidence of a diurnal rhythm in implicit reward learning
Whitton, A. E., Mehta, M., Ironside, M. L., Murray, G., & Pizzagalli, D. A. (2018) · Chronobiology International · doi:10.1080/07420528.2018.1459662 · Cited by 9 · see citing works
The effect of effort on reward prediction error signals in midbrain dopamine neurons
Tanaka, S., Taylor, J. E., & Sakagami, M. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.07.004 · Cited by 8 · see citing works
Abstract of “Cognitive Innovation: A View from the Bridge”
Denham, S. L., & Punt, M. (2017) · Leonardo · doi:10.1162/leon_a_01386 · Cited by 8 · see citing works
Delayed Reinforcement: Neuroscience☆
Body, S., Bradshaw, C. M., & Szabadi, E. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.02713-9 · Cited by 8 · see citing works
Myles, D., Carter, A., Yücel, M., & Bode, S. (2024) · Psychophysiology · doi:10.1111/psyp.14541 · Cited by 6 · see citing works
When Helping is Risky: The Behavioral and Neurobiological Tradeoff of Social and Risk PreferencesPreprint
Gross, J., Faber, N. S., Kappes, A., Nußberger, A.-M., Cowen, P. J., Browning, M. D., Kahane, G., Savulescu, J., Crockett, M. J., & Dreu, C. K. W. D. (2020) · doi:10.31234/osf.io/n4wqd · Cited by 6 · see citing works
A decision-space model explains context-specific decision-making
Beck, D. W., Heaton, C. N., Davila, L. D., Rakocevic, L. I., Drammis, S. M., Tyulmankov, D., Giri, A., Beck, S. U., Zhang, Q., Pokojovy, M., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-61466-x · Cited by 5 · see citing works
Ioan, G., Pîrju, I. S., Panaitescu, M. C., & Vrabie, T. (2024) · Sustainability · doi:10.3390/su16114340 · Cited by 5 · see citing works
The traps of adaptation: Addiction as maladaptive referent-dependent evaluation
Rigoli, F., & Pezzulo, G. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01086-4 · Cited by 4 · see citing works
Jin, H., Nath, S. S., Schneider, S., Junghaenel, D. U., Wu, S., & Kaplan, C. D. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103913 · Cited by 4 · see citing works
Döringer, D., Rohrsen, C., de Bivort, B. L., Huetteroth, W., & Brembs, B. (2021) · eLife · doi:10.1101/2021.10.04.463010 · Cited by 6 · see citing works
Wells, T., Krejčová, L., Binter, J., Pfaus, J. G., & Horsley, R. R. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274913 · Cited by 3 · see citing works
Adenosinergic Control of Sleep/Wake Behavior
Zhou, X., & Lazarus, M. (2019) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-813743-7.00008-6 · Cited by 3 · see citing works
Dopaminergic encoding of future defensive actions in the mouse nucleus accumbens
Fisher, A. A., Gonzalez, L. S., Cappel, Z., Grover, K. E., Waclaw, R. R., & Robinson, J. E. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf128 · Cited by 2 · see citing works
Nguyen, N. H., Hess, J., Orman, S. V., Forken, P. J., Blatt, S. D., Fremont, W. P., Faraone, S. V., & Glatt, S. J. (2022) · Research Square · doi:10.21203/rs.3.rs-1443111/v1 · Cited by 2 · see citing works
Hansson, M., Pregmark, J. E., & Fredberg, T. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0897-301620250000031013 · Cited by 1 · see citing works
Matsumori, K., Matsuyanagi, K., & Matsumoto, K. (2025) · Neuroscience Research · doi:10.1016/j.neures.2025.104957 · Cited by 1 · see citing works
Subjective Values in Decision-Making Under Uncertainty: A Systematic Review
Zheng, M., Ma, Z., Li, Y., & Liang, D. (2026) · Behavioral Sciences · doi:10.3390/bs16091494 · Cited by 1 · see citing works
Marzilli, E., Ballarotto, G., Cimino, S., Cerniglia, L., Adriani, W., & Pascale, E. (2017) · The European Proceedings of Social & Behavioural Sciences · doi:10.15405/epsbs.2017.09.6
Palmerston, J. B., & Chan, R. H. M. (2021) · IEEE Access · doi:10.1109/access.2021.3081118 · Cited by 1 · see citing works
Distinct striatal subregions and corticostriatal connectivity for effort, action and rewardPreprint
Suzuki, S., Lawlor, V. M., Cooper, J. A., Arulpragasam, A. R., & Treadway, M. T. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.02.12.925313 · Cited by 1 · see citing works
Degoulet, M., Willem, L.-M., Baunez, C., Luchini, S., & Pintus, P. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.01.466806 · Cited by 1 · see citing works
Schultz, W. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.732084303.793565156
Faculty Opinions recommendation of What Is the Relationship between Dopamine and Effort?
Fellows, L. K. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.734283795.793559475
Hill, D. F., Olson, Z. G., Bartlett, M. J., Falk, T., Heien, M. L., & Cowen, S. L. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.31.502221
Degoulet, M., Willem, L.-M., Baunez, C., Luchini, S., & Pintus, P. A. (2024) · eLife · doi:10.7554/elife.98487.1
Degoulet, M., Willem, L.-M., Baunez, C., Luchini, S., & Pintus, P. A. (2024) · eLife · doi:10.7554/elife.98487
Examining the role of the photopigment melanopsin in the striatal dopamine response to light
Gonzalez, L. S., Fisher, A. A., Grover, K. E., & Robinson, J. E. (2025) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2025.1568878
Huo, X., Xun, Z., & Zaman, A. (2026) · Journal of Air Transport Management · doi:10.1016/j.jairtraman.2026.103000
Borderies, N. (2020) · theses.fr (ABES) · doi:10.70675/03f23bddzae42z426aza9e6z34fb21ff3d9e
Learning Mechanisms in Alcohol Use Disorders
Heinz, A., Icoez, S., Treusch, Y., Chiara, G. D., & Halil, M. G. (2026) · Addiction Biology · doi:10.1111/adb.70168
Targeting Dopamine Pathways for the Treatment of Tourette Syndrome
Karkanias, G. B., Flatt, J. A., Korb, R. T., Munschauer, F. E., Wanaski, S. P., Cunniff, T. M., & Gilbert, D. L. (2026) · Journal of Child Neurology · doi:10.1177/08830738261491159
- Authors
- Schultz, W., Carelli, R. M., & Wightman, R. M.
- Affiliations
- University of Cambridge (GB)
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Schultz, Wolfram
- Venue
- Current Opinion in Behavioral Sciences
- Publisher
- Elsevier BV
- Published
- 2015-10
- Volume
- 5
- Pages
- 147-154
- ISSN
- 2352-1546 (ISSN-L)
- PMC
- PMC4692271
- OpenAlex
- W1853541416
- Cited by
- 88
- References
- 60
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 7 · 2023: 4 · 2022: 6 · 2021: 8 · 2020: 9 · 2019: 9 · 2018: 14 · 2017: 11 · 2016: 11
- FWCI
- 1.45
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Current Opinion in Behavioral Sciences (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Wellcome Trust (058365, 093270, 095495)
- European Research Council (293549)
- NIH (P50MH094258, DA034021, DA010900)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- dopamine, reward prediction error, economic utility, reward delay, effort, risk, probability, experimental economics, rodent behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
