The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
A causal link between prediction errors, dopamine neurons and learning
Abstract
Situations in which rewards are unexpectedly obtained or withheld represent opportunities for new learning. Often, this learning includes identifying cues that predict reward availability. Unexpected rewards strongly activate midbrain dopamine neurons. This phasic signal is proposed to support learning about antecedent cues by signaling discrepancies between actual and expected outcomes, termed a reward prediction error. However, it is unknown whether dopamine neuron prediction error signaling and cue-reward learning are causally linked. To test this hypothesis, we manipulated dopamine neuron activity in rats in two behavioral procedures, associative blocking and extinction, that illustrate the essential function of prediction errors in learning. We observed that optogenetic activation of dopamine neurons concurrent with reward delivery, mimicking a prediction error, was sufficient to cause long-lasting increases in cue-elicited reward-seeking behavior. Our findings establish a causal role for temporally precise dopamine neuron signaling in cue-reward learning, bridging a critical gap between experimental evidence and influential theoretical frameworks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Efferent connections of the substantia nigra and ventral tegmental area in the rat
Beckstead, R. M., Domesick, V. B., & Nauta, W. J. H. (1979) · Brain Research · doi:10.1016/0006-8993(79)91001-1 · Cited by 1,293
Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Tsai, H.-C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., & Deisseroth, K. (2009) · Science · doi:10.1126/science.1168878 · Cited by 1,266
Self-citation
Research works printed but not linked: 26
- Schultz, W., Apicella, P. & Ljungberg, T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13, 900–913 (1993). · DOI · Paper page
- Roesch, M.R., Calu, D.J. & Schoenbaum, G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10, 1615–1624 (2007). · DOI · Paper page
- Hollerman, J.R. & Schultz, W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1, 304–309 (1998). · DOI · Paper page
- Takahashi, Y.K. et al. The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62, 269–280 (2009). · DOI · Paper page
- Iordanova, M.D., Westbrook, R.F. & Killcross, A.S. Dopamine activity in the nucleus accumbens modulates blocking in fear conditioning. Eur. J. Neurosci. 24, 3265–3270 (2006). · DOI
- O'Tuathaigh, C.M. et al. The effect of amphetamine on Kamin blocking and overshadowing. Behav. Pharmacol. 14, 315–322 (2003). · DOI · Paper page
- Parker, J.G. et al. Absence of NMDA receptors in dopamine neurons attenuates dopamine release, but not conditioned approach, during Pavlovian conditioning. Proc. Natl. Acad. Sci. USA 107, 13491–13496 (2010). · DOI
- Adamantidis, A.R. et al. Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward-seeking behavior. J. Neurosci. 31, 10829–10835 (2011). · DOI · Paper page
- Domingos, A.I. et al. Leptin regulates the reward value of nutrient. Nat. Neurosci. 14, 1562–1568 (2011). · DOI · Paper page
- Boyden, E.S., Zhang, F., Bamberg, E., Nagel, G. & Deisseroth, K. Millisecond-timescale, genetically targeted optical control of neural activity. Nat. Neurosci. 8, 1263–1268 (2005). · DOI · Paper page
- Zhang, F., Wang, L.P., Boyden, E.S. & Deisseroth, K. Channelrhodopsin-2 and optical control of excitable cells. Nat. Methods 3, 785–792 (2006). · DOI · Paper page
- Kamin, L.J. “Attention-like” processes in classical conditioning. in Miami Symposium on the Prediction of Behavior, 1967: Aversive Stimulation (ed. Jones, M.R.) 9–31 (University of Miami Press, 1968).
- Kamin, L.J. Selective association and conditioning. in Fundamental Issues in Associative Learning (eds. Mackintosh, N.J. & Honig, F.W.K.) 42–64 (Dalhousie University Press, 1969).
- Holland, P.C. Unblocking in Pavlovian appetitive conditioning. J. Exp. Psychol. Anim. Behav. Process. 10, 476–497 (1984). · DOI
- Burke, K.A., Franz, T.M., Miller, D.N. & Schoenbaum, G. The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454, 340–344 (2008). · DOI · Paper page
- Daw, N.D., Kakade, S. & Dayan, P. Opponent interactions between serotonin and dopamine. Neural Netw. 15, 603–616 (2002). · DOI · Paper page
- Becker, J.B. Gender differences in dopaminergic function in striatum and nucleus accumbens. Pharmacol. Biochem. Behav. 64, 803–812 (1999). · DOI · Paper page
- Wassum, K.M., Ostlund, S.B., Balleine, B.W. & Maidment, N.T. Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. Learn. Mem. 18, 475–483 (2011). · DOI
- Fields, H.L., Hjelmstad, G.O., Margolis, E.B. & Nicola, S.M. Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci. 30, 289–316 (2007). · DOI · Paper page
- Reynolds, J.N. & Wickens, J.R. Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw. 15, 507–521 (2002). · DOI · Paper page
- Wickens, J.R., Horvitz, J.C., Costa, R.M. & Killcross, S. Dopaminergic mechanisms in actions and habits. J. Neurosci. 27, 8181–8183 (2007). · DOI · Paper page
- Gerfen, C.R. & Surmeier, D.J. Modulation of striatal projection systems by dopamine. Annu. Rev. Neurosci. 34, 441–466 (2011). · DOI · Paper page
- Stuber, G.D. et al. Reward-predictive cues enhance excitatory synaptic strength onto midbrain dopamine neurons. Science 321, 1690–1692 (2008). · DOI · Paper page
- Brown, M.T. et al. Drug-driven AMPA receptor redistribution mimicked by selective dopamine neuron stimulation. PLoS ONE 5, e15870 (2010). · DOI
- Suri, R.E. TD models of reward predictive responses in dopamine neurons. Neural Netw. 15, 523–533 (2002). · DOI
- Karim, B.O. et al. Estrous cycle and ovarian changes in a rat mammary carcinogenesis model after irradiation, tamoxifen chemoprevention and aging. Comp. Med. 53, 532–538 (2003).
Cited by
Optogenetics: 10 years of microbial opsins in neuroscience
Deisseroth, K. (2015) · Nature Neuroscience · doi:10.1038/nn.4091 · Cited by 1,283
Self-citationNeuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036
Berke, J. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0152-y · Cited by 904
Locus coeruleus and dopaminergic consolidation of everyday memory
Takeuchi, T., Duszkiewicz, A. J., Sonneborn, A., Spooner, P. A., Yamasaki, M., Watanabe, M., Smith, C. C., Fernández, G., Deisseroth, K., Greene, R. W., et al. (2016) · Nature · doi:10.1038/nature19325 · Cited by 827
Self-citationMesolimbic dopamine signals the value of work
Hamid, A. A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Vander Weele, C. M., Kennedy, R. T., Aragona, B. J., & Berke, J. D. (2016) · Nature Neuroscience · doi:10.1038/nn.4173 · Cited by 824
Synaptic Plasticity Forms and Functions
Magee, J. C., & Grienberger, C. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-090919-022842 · Cited by 806
Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits
Lerner, T. N., Shilyansky, C., Davidson, T. J., Evans, K. E., Beier, K. T., Zalocusky, K. A., Crow, A. K., Malenka, R. C., Luo, L., Tomer, R., et al. (2015) · Cell · doi:10.1016/j.cell.2015.07.014 · Cited by 794
“…neurons suggested that a key function of DA is to transmit reward prediction error signals (Mirenowicz and Schultz, 1996; Schultz et al., 1997; Waelti et al., 2001), a hypothesis concordant with temporal difference learning models (Montague et al., 1996, 2004; Steinberg et al., 2013; Sutton, 1988).”
BackgroundDissociable dopamine dynamics for learning and motivation
Mohebi, A., Pettibone, J. R., Hamid, A. A., Wong, J.-M. T., Vinson, L. T., Patriarchi, T., Tian, L., Kennedy, R. T., & Berke, J. D. (2019) · Nature · doi:10.1038/s41586-019-1235-y · Cited by 735
Neuroscience of apathy and anhedonia: a transdiagnostic approach
Husain, M., & Roiser, J. P. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0029-9 · Cited by 640
Prefrontal cortex as a meta-reinforcement learning system
Wang, J. X., Kurth-Nelson, Z., Kumaran, D., Tirumala, D., Soyer, H., Leibo, J. Z., Hassabis, D., & Botvinick, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0147-8 · Cited by 596
Striatal circuits for reward learning and decision-making
Cox, J., & Witten, I. B. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0189-2 · Cited by 568
Self-citationSpecialized coding of sensory, motor and cognitive variables in VTA dopamine neurons
Engelhard, B., Finkelstein, J., Cox, J., Fleming, W., Jang, H. J., Ornelas, S., Koay, S. A., Thiberge, S. Y., Daw, N. D., Tank, D. W., et al. (2019) · Nature · doi:10.1038/s41586-019-1261-9 · Cited by 544
Self-citationDopamine and Cognitive Control in Prefrontal Cortex
Ott, T., & Nieder, A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.006 · Cited by 530
“Eating addiction”, rather than “food addiction”, better captures addictive-like eating behavior
Hebebrand, J., Albayrak, Ö., Adan, R., Antel, J., Dieguez, C., de Jong, J., Leng, G., Menzies, J., Mercer, J. G., Murphy, M., et al. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.08.016 · Cited by 527
Reinforcement learning and episodic memory in humans and animals: an integrative framework
Gershman, S. J., & Daw, N. D. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033625 · Cited by 446
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437
Genetic Dissection of Neural Circuits: A Decade of Progress
Luo, L., Callaway, E. M., & Svoboda, K. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.040 · Cited by 448
Fields, H. L., & Margolis, E. B. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.01.002 · Cited by 432
Dopamine: The Neuromodulator of Long-Term Synaptic Plasticity, Reward and Movement Control
Speranza, L., di Porzio, U., Viggiano, D., de Donato, A., & Volpicelli, F. (2021) · Cells · doi:10.3390/cells10040735 · Cited by 415
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules
Frémaux, N., & Gerstner, W. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2015.00085 · Cited by 413
Kruss, S., Landry, M. P., Vander Ende, E., Lima, B. M. A., Reuel, N. F., Zhang, J., Nelson, J., Mu, B., Hilmer, A., & Strano, M. (2014) · Journal of the American Chemical Society · doi:10.1021/ja410433b · Cited by 391
Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry
Keiflin, R., & Janak, P. H. (2015) · Neuron · doi:10.1016/j.neuron.2015.08.037 · Cited by 382
Self-citationDopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties
Saunders, B. T., Richard, J. M., Margolis, E. B., & Janak, P. H. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0191-4 · Cited by 374
Self-citationMidbrain dopamine neurons control judgment of time
Soares, S., Atallah, B. V., & Paton, J. J. (2016) · Science · doi:10.1126/science.aah5234 · Cited by 360
Diversity of Transgenic Mouse Models for Selective Targeting of Midbrain Dopamine Neurons
Lammel, S., Steinberg, E. E., Földy, C., Wall, N. R., Beier, K., Luo, L., & Malenka, R. C. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.036 · Cited by 358
Self-citationIn vivo imaging identifies temporal signature of D1 and D2 medium spiny neurons in cocaine reward
Calipari, E. S., Bagot, R. C., Purushothaman, I., Davidson, T. J., Yorgason, J. T., Peña, C. J., Walker, D. M., Pirpinias, S. T., Guise, K. G., Ramakrishnan, C., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521238113 · Cited by 335
Self-citationComputational psychiatry: towards a mathematically informed understanding of mental illness
Adams, R. A., Huys, Q. J. M., & Roiser, J. P. (2015) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2015-310737 · Cited by 285
“97 In fMRI paradigms designed to elicit reward prediction error and reward prediction signals, patients with schizophrenia show diminished appropriate activations 98 but greater inappropriate activations in the ventral striatum, 99 compared with controls.”
Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments
Leong, Y. C., Radulescu, A., Daniel, R., DeWoskin, V., & Niv, Y. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.040 · Cited by 294
Novelty and Dopaminergic Modulation of Memory Persistence: A Tale of Two Systems
Duszkiewicz, A. J., McNamara, C. G., Takeuchi, T., & Genzel, L. (2019) · Trends in Neurosciences · doi:10.1016/j.tins.2018.10.002 · Cited by 301
Dopamine transients are sufficient and necessary for acquisition of model-based associations
Sharpe, M. J., Chang, C. Y., Liu, M. A., Batchelor, H. M., Mueller, L. E., Jones, J. L., Niv, Y., & Schoenbaum, G. (2017) · Nature Neuroscience · doi:10.1038/nn.4538 · Cited by 300
Grounding cognitive control in associative learning
Abrahamse, E., Braem, S., Notebaert, W., & Verguts, T. (2016) · Psychological Bulletin · doi:10.1037/bul0000047 · Cited by 276
Hart, A. S., Rutledge, R. B., Glimcher, P. W., & Phillips, P. E. M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2489-13.2014 · Cited by 293
Castro, D. C., & Bruchas, M. R. (2019) · Neuron · doi:10.1016/j.neuron.2019.03.003 · Cited by 290
Computational approaches to psychiatry
Stephan, K. E., & Mathys, C. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.12.007 · Cited by 260
Taylor, N. E., Van Dort, C. J., Kenny, J. D., Pei, J., Guidera, J. A., Vlasov, K. Y., Lee, J. T., Boyden, E. S., Brown, E. N., & Solt, K. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1614340113 · Cited by 269
Reinforcement learning in artificial and biological systems
Neftci, E. O., & Averbeck, B. B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0025-4 · Cited by 268
Hu, H. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-014106 · Cited by 253
Menegas, W., Babayan, B. M., Uchida, N., & Watabe-Uchida, M. (2017) · eLife · doi:10.7554/elife.21886 · Cited by 265
Dopamine prediction error responses integrate subjective value from different reward dimensions
Lak, A., Stauffer, W. R., & Schultz, W. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1321596111 · Cited by 257
Gershman, S. J., & Uchida, N. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0220-7 · Cited by 236
Dopamine Neuron-Specific Optogenetic Stimulation in Rhesus Macaques
Stauffer, W. R., Lak, A., Yang, A., Borel, M., Paulsen, O., Boyden, E. S., & Schultz, W. (2016) · Cell · doi:10.1016/j.cell.2016.08.024 · Cited by 257
Organization of monosynaptic inputs to the serotonin and dopamine neuromodulatory systems
Ogawa, S. K., Cohen, J. Y., Hwang, D., Uchida, N., & Watabe-Uchida, M. (2014) · Cell Reports · doi:10.1016/j.celrep.2014.06.042 · Cited by 249
Deserno, L., Huys, Q. J. M., Boehme, R., Buchert, R., Heinze, H.-J., Grace, A. A., Dolan, R. J., Heinz, A., & Schlagenhauf, F. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417219112 · Cited by 233
Integration of Parallel Opposing Memories Underlies Memory Extinction
Felsenberg, J., Jacob, P. F., Walker, T., Barnstedt, O., Edmondson-Stait, A. J., Pleijzier, M. W., Otto, N., Schlegel, P., Sharifi, N., Perisse, E., et al. (2018) · Cell · doi:10.1016/j.cell.2018.08.021 · Cited by 247
The dopaminergic midbrain encodes the expected certainty about desired outcomes
Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., & Friston, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu159 · Cited by 219
Dopaminergic basis of salience dysregulation in psychosis
Winton-Brown, T. T., Fusar-Poli, P., Ungless, M. A., & Howes, O. D. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2013.11.003 · Cited by 231
Activity patterns of serotonin neurons underlying cognitive flexibility
Matias, S., Lottem, E., Dugué, G. P., & Mainen, Z. F. (2017) · eLife · doi:10.7554/elife.20552 · Cited by 239
Dopamine release in the nucleus accumbens core signals perceived saliency
Kutlu, M. G., Zachry, J. E., Melugin, P. R., Cajigas, S. A., Chevee, M. F., Kelly, S. J., Kutlu, B., Tian, L., Siciliano, C. A., & Calipari, E. S. (2021) · Current Biology · doi:10.1016/j.cub.2021.08.052 · Cited by 238
Circuit Mechanisms of Sensorimotor Learning
Makino, H., Hwang, E. J., Hedrick, N. G., & Komiyama, T. (2016) · Neuron · doi:10.1016/j.neuron.2016.10.029 · Cited by 228
“Furthermore, delivering microstimulation in the striatum or optogenetically activating dopamine neurons during the reinforcement period of correct trials, supposedly mimicking positive prediction error, significantly increased the rate of associative learning or prevented blocking/extinction of association (Steinberg…”
Basal ganglia circuit loops, dopamine and motivation: a review and enquiry
Ikemoto, S., Yang, C., & Tan, A. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.04.018 · Cited by 226
“[96] Steinberg EE, Keiflin R, Boivin JR, Witten IB, Deisseroth K, Janak PH.”
Dopaminergic control of cognitive flexibility in humans and animals
Klanker, M., Feenstra, M., & Denys, D. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00201 · Cited by 209
Dopamine Reward Prediction Error Responses Reflect Marginal Utility
Stauffer, W. R., Lak, A., & Schultz, W. (2014) · Current Biology · doi:10.1016/j.cub.2014.08.064 · Cited by 204
Midbrain dopamine neurons signal belief in choice accuracy during a perceptual decision
Lak, A., Nomoto, K., Keramati, M., Sakagami, M., & Kepecs, A. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.026 · Cited by 170
Mesolimbic Dopamine and the Regulation of Motivated Behavior
Salamone, J. D., Pardo, M., Yohn, S. E., López-Cruz, L., SanMiguel, N., & Correa, M. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_383 · Cited by 204
Dopamine neurons respond to errors in the prediction of sensory features of expected rewards
Takahashi, Y. K., Batchelor, H. M., Liu, B., Khanna, A., Morales, M., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.025 · Cited by 200
The algorithmic anatomy of model-based evaluation
Daw, N. D., & Dayan, P. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0478 · Cited by 195
A neurocomputational account of how inflammation enhances sensitivity to punishments versus rewards
Harrison, N. A., Voon, V., Cercignani, M., Cooper, E. A., Pessiglione, M., & Critchley, H. D. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.07.018 · Cited by 185
How expectations influence pain
Fields, H. L. (2018) · Pain · doi:10.1097/j.pain.0000000000001272 · Cited by 175
Nucleus Accumbens Modulation in Reward and Aversion
Klawonn, A. M., & Malenka, R. C. (2018) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2018.83.037457 · Cited by 163
Cell-type-specific asynchronous modulation of PKA by dopamine in learning
Lee, S. J., Lodder, B., Chen, Y., Patriarchi, T., Tian, L., & Sabatini, B. L. (2021) · Nature · doi:10.1038/s41586-020-03050-5 · Cited by 160
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150
Overriding Phasic Dopamine Signals Redirects Action Selection during Risk/Reward Decision Making
Stopper, C. M., Tse, M. T. L., Montes, D. R., Wiedman, C. R., & Floresco, S. B. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.033 · Cited by 136
Meta-analysis of human prediction error for incentives, perception, cognition, and action
Corlett, P. R., Mollick, J. A., & Kober, H. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01264-3 · Cited by 135
Wenzel, J. M., Rauscher, N. A., Cheer, J. F., & Oleson, E. B. (2015) · ACS Chemical Neuroscience · doi:10.1021/cn500255p · Cited by 131
Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P. (2017) · Brain · doi:10.1093/brain/awx025 · Cited by 124
Dopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112
Kim, Y.-K., Kim, O. Y., & Song, J. (2020) · Frontiers in Pharmacology · doi:10.3389/fphar.2020.01270 · Cited by 109
Yetnikoff, L., Cheng, A. Y., Lavezzi, H. N., Parsley, K. P., & Zahm, D. S. (2015) · Journal of Comparative Neurology · doi:10.1002/cne.23797 · Cited by 101
Ferré, S., Bonaventura, J., Zhu, W., Hatcher-Solis, C., Taura, J., Quiroz, C., Cai, N.-S., Moreno, E., Casadó-Anguera, V., Kravitz, A. V., et al. (2018) · Frontiers in Pharmacology · doi:10.3389/fphar.2018.00243 · Cited by 100
Locus Coeruleus and Dopamine-Dependent Memory Consolidation
Yamasaki, M., & Takeuchi, T. (2017) · Neural Plasticity · doi:10.1155/2017/8602690 · Cited by 91
Ermakova, A. O., Knolle, F., Justicia, A., Bullmore, E. T., Jones, P. B., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0056-2 · Cited by 91
Influences of dopaminergic system dysfunction on late-life depression
Taylor, W. D., Zald, D. H., Felger, J. C., Christman, S., Claassen, D. O., Horga, G., Miller, J. M., Gifford, K., Rogers, B., Szymkowicz, S. M., et al. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01265-0 · Cited by 89
Phasic dopamine signals: from subjective reward value to formal economic utility
Schultz, W., Carelli, R. M., & Wightman, R. M. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.09.006 · Cited by 88
Enhanced predictive signalling in schizophrenia
Schmack, K., Rothkirch, M., Priller, J., & Sterzer, P. (2017) · Human Brain Mapping · doi:10.1002/hbm.23480 · Cited by 81
Time representation in reinforcement learning models of the basal ganglia
Gershman, S. J., Moustafa, A. A., & Ludvig, E. A. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00194 · Cited by 81
Neural circuits regulating prosocial behaviors
Walsh, J. J., Christoffel, D. J., & Malenka, R. C. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-022-01348-8 · Cited by 72
Treanor, M., & Barry, T. J. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.04.009 · Cited by 65
A neuronal mechanism underlying decision-making deficits during hyperdopaminergic states
Verharen, J. P. H., de Jong, J. W., Roelofs, T. J. M., Huffels, C. F. M., van Zessen, R., Luijendijk, M. C. M., Hamelink, R., Willuhn, I., den Ouden, H. E. M., van der Plasse, G., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-03087-1 · Cited by 62
Ventral Tegmental Dopamine Dysregulation Prevents Appetitive Memory Destabilization
Reichelt, A. C., Exton-McGuinness, M. T., & Lee, J. L. C. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1614-13.2013 · Cited by 61
Striatal dopamine, reward, and decision making in schizophrenia
Deserno, L., Schlagenhauf, F., & Heinz, A. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/ldeserno · Cited by 58
Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies
Macoveanu, J. (2014) · Brain Research · doi:10.1016/j.brainres.2014.02.003 · Cited by 55
Nigrostriatal dopamine pathway regulates auditory discrimination behavior
Chen, A. P. F., Malgady, J. M., Chen, L., Shi, K. W., Cheng, E., Plotkin, J. L., Ge, S., & Xiong, Q. (2022) · Nature Communications · doi:10.1038/s41467-022-33747-2 · Cited by 46
Jhou, T. C. (2021) · Neuropharmacology · doi:10.1016/j.neuropharm.2021.108763 · Cited by 40
Klanker, M., Sandberg, T., Joosten, R., Willuhn, I., Feenstra, M., & Denys, D. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2015.08.011 · Cited by 37
“…& Carelli, 2007; Pan et al., 2005; Schultz et al., 1997), consistent with the idea that DA signaling codes a quantitative ‘reward prediction error’ (RPE) that serves as a teaching signal guiding behavior (Montague et al., 1996; Schultz et al., 1997; Steinberg et al., 2013; Waelti et al., 2001).”
Sethi, A., Voon, V., Critchley, H. D., Cercignani, M., & Harrison, N. A. (2018) · Brain · doi:10.1093/brain/awy048 · Cited by 36
Computational approaches to schizophrenia: A perspective on negative symptoms
Deserno, L., Heinz, A., & Schlagenhauf, F. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2016.10.004 · Cited by 31
Fortin, S. M., & Roitman, M. F. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2016.11.021 · Cited by 11
“Dopamine has been hypothesized to serve as a ‘teaching signal’ that can drive the formation of associations between environmental stimuli and positive outcomes [32, 33].”
Background
Metadata
- Authors
- Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K., & Janak, P. H.
- Venue
- Nature Neuroscience
- Published
- 2013-05-26
- Volume
- 16
- Issue
- 7
- Pages
- 966-973
- ISSN
- 1097-6256
- 1546-1726
- Cited by
- 869
- References
- 20
- Language
- en
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.