The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Dopamine neurons share common response function for reward prediction error
Open accessAbstract
Dopamine neurons are thought to signal reward prediction error, or the difference between actual and predicted reward. How dopamine neurons jointly encode this information, however, remains unclear. One possibility is that different neurons specialize in different aspects of prediction error; another is that each neuron calculates prediction error in the same way. We recorded from optogenetically identified dopamine neurons in the lateral ventral tegmental area (VTA) while mice performed classical conditioning tasks. Our tasks allowed us to determine the full prediction error functions of dopamine neurons and compare them to each other. We found marked homogeneity among individual dopamine neurons: their responses to both unexpected and expected rewards followed the same function, just scaled up or down. As a result, we were able to describe both individual and population responses using just two parameters. Such uniformity ensures robust information coding, allowing each dopamine neuron to contribute fully to the prediction error signal.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Millisecond-timescale, genetically targeted optical control of neural activity
Boyden, E. S., Zhang, F., Bamberg, E., Nagel, G., & Deisseroth, K. (2005) · Nature Neuroscience · doi:10.1038/nn1525 · Cited by 4,861
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 1×
“Note that the Hill function is not the only possible function that could fit our (1) ⎟⎟ ⎠ ⎞ ⎜⎜ ⎝ ⎛ + = 5 .”
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Neural correlations, population coding and computation
Averbeck, B. B., Latham, P. E., & Pouget, A. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1888 · Cited by 1,743
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Self-citationMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Cited by
Dysregulation of the dopamine system in the pathophysiology of schizophrenia and depression
Grace, A. A. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.57 · Cited by 1,166
Ventral tegmental area: cellular heterogeneity, connectivity and behaviour
Morales, M., & Margolis, E. B. (2017) · Nature reviews. Neuroscience · doi:10.1038/nrn.2016.165 · Cited by 1,108
Berke, J. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0152-y · Cited by 904
Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons
Engelhard, B., Finkelstein, J., Cox, J., Fleming, W., Jang, H. J., Ornelas, S., Koay, S. A., Thiberge, S. Y., Daw, N. D., Tank, D. W., et al. (2019) · Nature · doi:10.1038/s41586-019-1261-9 · Cited by 544
A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System
de Jong, J. W., Afjei, S. A., Pollak Dorocic, I., Peck, J. R., Liu, C., Kim, C. K., Tian, L., Deisseroth, K., & Lammel, S. (2019) · Neuron · doi:10.1016/j.neuron.2018.11.005 · Cited by 511
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437
Self-citationYang, H., de Jong, J. W., Tak, Y., Peck, J., Bateup, H. S., & Lammel, S. (2018) · Neuron · doi:10.1016/j.neuron.2017.12.022 · Cited by 407
Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties
Saunders, B. T., Richard, J. M., Margolis, E. B., & Janak, P. H. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0191-4 · Cited by 374
Midbrain dopamine neurons control judgment of time
Soares, S., Atallah, B. V., & Paton, J. J. (2016) · Science · doi:10.1126/science.aah5234 · Cited by 360
Combined Social and Spatial Coding in a Descending Projection from the Prefrontal Cortex
Murugan, M., Jang, H. J., Park, M., Miller, E. M., Cox, J., Taliaferro, J. P., Parker, N. F., Bhave, V., Hur, H., Liang, Y., et al. (2017) · Cell · doi:10.1016/j.cell.2017.11.002 · Cited by 311
A Unified Framework for Dopamine Signals across Timescales
Kim, H. R., Malik, A. N., Mikhael, J. G., Bech, P., Tsutsui-Kimura, I., Sun, F., Zhang, Y., Li, Y., Watabe-Uchida, M., Gershman, S. J., et al. (2020) · Cell · doi:10.1016/j.cell.2020.11.013 · Cited by 302
Self-citationSpatial and temporal scales of dopamine transmission
Liu, C., Goel, P., & Kaeser, P. S. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-021-00455-7 · Cited by 301
Dopamine transients are sufficient and necessary for acquisition of model-based associations
Sharpe, M. J., Chang, C. Y., Liu, M. A., Batchelor, H. M., Mueller, L. E., Jones, J. L., Niv, Y., & Schoenbaum, G. (2017) · Nature Neuroscience · doi:10.1038/nn.4538 · Cited by 300
Dopamine reward prediction errors reflect hidden-state inference across time
Starkweather, C. K., Babayan, B. M., Uchida, N., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4520 · Cited by 206
Self-citationActivity patterns of serotonin neurons underlying cognitive flexibility
Matias, S., Lottem, E., Dugué, G. P., & Mainen, Z. F. (2017) · eLife · doi:10.7554/elife.20552 · Cited by 239
Dopamine release in the nucleus accumbens core signals perceived saliency
Kutlu, M. G., Zachry, J. E., Melugin, P. R., Cajigas, S. A., Chevee, M. F., Kelly, S. J., Kutlu, B., Tian, L., Siciliano, C. A., & Calipari, E. S. (2021) · Current Biology · doi:10.1016/j.cub.2021.08.052 · Cited by 238
Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons
Tian, J., Huang, R., Cohen, J. Y., Osakada, F., Kobak, D., Machens, C. K., Callaway, E. M., Uchida, N., & Watabe-Uchida, M. (2016) · Neuron · doi:10.1016/j.neuron.2016.08.018 · Cited by 224
Self-citationAn action potential initiation mechanism in distal axons for the control of dopamine release
Liu, C., Cai, X., Ritzau-Jost, A., Kramer, P. F., Li, Y., Khaliq, Z. M., Hallermann, S., & Kaeser, P. S. (2022) · Science · doi:10.1126/science.abn0532 · Cited by 213
The Locus Coeruleus Is a Complex and Differentiated Neuromodulatory System
Totah, N. K., Neves, R. M., Panzeri, S., Logothetis, N. K., & Eschenko, O. (2018) · Neuron · doi:10.1016/j.neuron.2018.07.037 · Cited by 179
Cell-type-specific asynchronous modulation of PKA by dopamine in learning
Lee, S. J., Lodder, B., Chen, Y., Patriarchi, T., Tian, L., & Sabatini, B. L. (2021) · Nature · doi:10.1038/s41586-020-03050-5 · Cited by 160
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150
Belief state representation in the dopamine system
Babayan, B. M., Uchida, N., & Gershman, S. J. (2018) · Nature Communications · doi:10.1038/s41467-018-04397-0 · Cited by 101
Self-citationMoreines, J. L., Owrutsky, Z. L., & Grace, A. A. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2016.249 · Cited by 93
Dopamine signaling in the nucleus accumbens core mediates latent inhibition
Kutlu, M. G., Zachry, J. E., Melugin, P. R., Tat, J., Cajigas, S., Isiktas, A. U., Patel, D. D., Siciliano, C. A., Schoenbaum, G., Sharpe, M. J., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01126-1 · Cited by 78
Watanabe, H., Dijkstra, J. M., & Nagatsu, T. (2024) · International Journal of Molecular Sciences · doi:10.3390/ijms25042009 · Cited by 48
Dopamine, inference, and uncertainty
Gershman, S. J. (2017) · Neural Computation · doi:10.1162/neco_a_01023 · Cited by 40
Targeting IMPACT: A New Psychological Model of User Experience
Kurta, L., & Freeman, J. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-05637-6_12 · Cited by 8
Reward magnitude determines reinforcement learning efficiency
Gong, S., Martell, A., Dudman, J. T., & Coddington, L. T. (2026) · Science · doi:10.1126/science.aeb0813 · Cited by 2
Metadata
- Authors
- Eshel, N., Tian, J., Bukwich, M., & Uchida, N.
- Venue
- Nature Neuroscience
- Published
- 2016-02-08
- Volume
- 19
- Issue
- 3
- Pages
- 479-486
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2259239391
- Cited by
- 316
- References
- 59
- FWCI
- 19.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.