Two Dimensions of Value: Dopamine Neurons Represent Reward But Not Aversiveness

A neural substrate of prediction and reward

Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works

Emergence of simple-cell receptive field properties by learning a sparse code for natural images

Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · see citing works

Dopamine in motivational control: rewarding, aversive, and alerting

Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works

The “independent components” of natural scenes are edge filters

Bell, A. J., & B, T. J. S. A. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,177 · see citing works

Two types of dopamine neuron distinctly convey positive and negative motivational signals

Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378 · see citing works

Neuron-type-specific signals for reward and punishment in the ventral tegmental area

Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318 · see citing works

Adaptive Coding of Reward Value by Dopamine Neurons

Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works

Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis

Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955 · see citing works

The primate amygdala represents the positive and negative value of visual stimuli during learning

Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · see citing works

Opponent interactions between serotonin and dopamine

Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works

Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli

Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works

The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses.

Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., & Holland, P. C. (2009) · Neuron · doi:10.1016/j.neuron.2009.02.001 · Cited by 696 · see citing works

Representation of negative motivational value in the primate lateral habenula

Matsumoto, M., & Hikosaka, O. (2009) · Nature Neuroscience · doi:10.1038/nn.2233 · Cited by 547 · see citing works

Negative Reward Signals from the Lateral Habenula to Dopamine Neurons Are Mediated by Rostromedial Tegmental Nucleus in Primates

Hong, S., Jhou, T. C., Smith, M., Saleem, K. S., & Hikosaka, O. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1384-11.2011 · Cited by 390 · see citing works

Serotonin in Affective Control

Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381 · see citing works

The temporal precision of reward prediction in dopamine neurons

Fiorillo, C. D., Newsome, W. T., & Schultz, W. (2008) · Nature Neuroscience · doi:10.1038/nn.2159 · Cited by 310 · see citing works

Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm

Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works

Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials

Joshua, M., Adler, A., Mitelman, R., Vaadia, E., & Bergman, H. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3839-08.2008 · Cited by 273 · see citing works

Subsecond Dopamine Release in the Nucleus Accumbens Predicts Conditioned Punishment and Its Successful Avoidance

Oleson, E. B., Gentry, R. N., Chioma, V. C., & Cheer, J. F. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3087-12.2012 · Cited by 272 · see citing works

The convergence of information about rewarding and aversive stimuli in single neurons

Morrison, S. E., & Salzman, C. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1815-09.2009 · Cited by 206 · see citing works

Responses of Tonically Active Neurons in the Monkey Striatum Discriminate between Motivationally Opposing Stimuli

Ravel, S., Legallet, E., & Apicella, P. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-24-08489.2003 · Cited by 116 · see citing works

Convergent Processing of Both Positive and Negative Motivational Signals by the VTA Dopamine Neuronal Populations

Wang, D. V., & Tsien, J. Z. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017047 · Cited by 116 · see citing works

Diversity and Homogeneity in Responses of Midbrain Dopamine Neurons

Fiorillo, C. D., Yun, S. R., & Song, M. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3886-12.2013 · Cited by 99 · see citing works

Multiphasic Temporal Dynamics in Responses of Midbrain Dopamine Neurons to Appetitive and Aversive Stimuli

Fiorillo, C. D., Song, M. R., & Yun, S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3883-12.2013 · Cited by 98 · see citing works

Transient activation of midbrain dopamine neurons by reward risk

Fiorillo, C. D. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.037 · Cited by 90 · see citing works

A temporal difference account of avoidance learning

Moutoussis, M., Bentall, R. P., Williams, J. H., & Dayan, P. (2008) · Network Computation in Neural Systems · doi:10.1080/09548980802192784 · Cited by 82 · see citing works

Neuronal Reward and Decision Signals: From Theories to Data

Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works

Dopamine reward prediction-error signalling: A two-component response

Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works

Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits

Lerner, T. N., Shilyansky, C., Davidson, T. J., Evans, K. E., Beier, K. T., Zalocusky, K. A., Crow, A. K., Malenka, R. C., Luo, L., Tomer, R., et al. (2015) · Cell · doi:10.1016/j.cell.2015.07.014 · Cited by 794 · see citing works

Schizophrenia, dopamine and the striatum: From biology to symptoms

McCutcheon, R. A., Abi-Dargham, A., & Howes, O. D. (2019) · Trends in Neurosciences · doi:10.1016/j.tins.2018.12.004 · Cited by 763 · see citing works

Neural Circuitry of Reward Prediction Error

Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437 · see citing works

Dopaminergic basis of salience dysregulation in psychosis

Winton-Brown, T. T., Fusar-Poli, P., Ungless, M. A., & Howes, O. D. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2013.11.003 · Cited by 231 · see citing works

Activity patterns of serotonin neurons underlying cognitive flexibility

Matias, S., Lottem, E., Dugué, G. P., & Mainen, Z. F. (2017) · eLife · doi:10.7554/elife.20552 · Cited by 239 · see citing works

Basal ganglia circuit loops, dopamine and motivation: a review and enquiry

Ikemoto, S., Yang, C., & Tan, A. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.04.018 · Cited by 226 · see citing works

Midbrain dopamine neurons signal belief in choice accuracy during a perceptual decision

Lak, A., Nomoto, K., Keramati, M., Sakagami, M., & Kepecs, A. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.026 · Cited by 170 · see citing works

Separate neural representations of prediction error valence and surprise: Evidence from an fMRI meta‐analysis

Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176 · see citing works

Functional dissociation of stimulus intensity encoding and predictive coding of pain in the insula

Geuter, S., Boll, S., Eippert, F., & Büchel, C. (2017) · eLife · doi:10.7554/elife.24770 · Cited by 184 · see citing works

Mechanisms of Action and Persistent Neuroplasticity by Drugs of Abuse

Korpi, E. R., den Hollander, B., Farooq, U., Vashchinkina, E., Rajkumar, R., Nutt, D. J., Hyytiä, P., & Dawe, G. S. (2015) · Pharmacological Reviews · doi:10.1124/pr.115.010967 · Cited by 148 · see citing works

Social rewards and social networks in the human brain

Fareri, D. S., & Delgado, M. R. (2014) · The Neuroscientist · doi:10.1177/1073858414521869 · Cited by 124 · see citing works

Dorsal tegmental dopamine neurons gate associative learning of fear

Groessl, F., Munsch, T., Meis, S., Griessner, J., Kaczanowska, J., Pliota, P., Kargl, D., Badurek, S., Kraitsy, K., Rassoulpour, A., et al. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0174-5 · Cited by 118 · see citing works

Does the kappa opioid receptor system contribute to pain aversion?

Cahill, C. M., Taylor, A. M. W., Cook, C., Ong, E., Morón, J. A., & Evans, C. J. (2014) · Frontiers in Pharmacology · doi:10.3389/fphar.2014.00253 · Cited by 105 · see citing works

Neural computations of threat

Levy, I., & Schiller, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.11.007 · Cited by 95 · see citing works

Illicit dopamine transients: reconciling actions of abused drugs

Covey, D. P., Roitman, M. F., & Garris, P. A. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2014.02.002 · Cited by 90 · see citing works

Phasic dopamine signals: from subjective reward value to formal economic utility

Schultz, W., Carelli, R. M., & Wightman, R. M. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.09.006 · Cited by 88 · see citing works

Aversive Prediction Error Signals in the Amygdala

McHugh, S. B., Barkus, C., Huber, A., Capitao, L., Lima, J., Lowry, J. P., & Bannerman, D. M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4465-13.2014 · Cited by 68 · see citing works

Reward Contexts Extend Dopamine Signals to Unrewarded Stimuli

Kobayashi, S., & Schultz, W. (2014) · Current Biology · doi:10.1016/j.cub.2013.10.061 · Cited by 63 · see citing works

Spatiotemporal neural characterization of prediction error valence and surprise during reward learning in humans

Fouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61 · see citing works

Serotonergic modulation of reward and punishment: evidence from pharmacological fMRI studies

Macoveanu, J. (2014) · Brain Research · doi:10.1016/j.brainres.2014.02.003 · Cited by 55 · see citing works

Midbrain fMRI: Applications, Limitations and Challenges

Düzel, E., Guitart-Masip, M., Maass, A., Hämmerer, D., Betts, M. J., Speck, O., Weiskopf, N., & Kanowski, M. (2015) · Biological Magnetic Resonance · doi:10.1007/978-1-4899-7591-1_20 · Cited by 16 · see citing works

Spontaneous activity in the developing mouse midbrain driven by an external pacemaker

Rockhill, W., Kirkman, J. L., & Bosma, M. M. (2009) · Developmental Neurobiology · doi:10.1002/dneu.20725 · Cited by 22 · see citing works

JMJD3 Deficiency in Midbrain Dopamine Neurons Disturbs Dopamine Synthesis and Aggravates Chronic Inflammatory PainPreprint

He, X., Guo, F., Zhang, W., Le, W., Zheng, Y., Ma, Y., Lee, S., Wang, H., Wu, Y., & Zhou, Q. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.01.518657

When does midbrain dopamine activity exert its effects on behavior?

Coddington, L. T. (2020) · Nature Neuroscience · doi:10.1038/s41593-019-0577-y · Cited by 1 · see citing works

The Reward Signal of Midbrain Dopamine Neurons

Schultz, W. (1999) · Physiology · doi:10.1152/physiologyonline.1999.14.6.249 · Cited by 111 · see citing works

Midbrain dopamine neurons encode internal effort signalPreprint

Wang, D. V. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.04.976969