The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Dopamine, Updated: Reward Prediction Error and Beyond
Open accessAbstract
Dopamine neurons have been intensely studied for their roles in reinforcement learning. A dominant theory of how these neurons contribute to learning is through the encoding of a reward prediction error (RPE) signal. Recent advances in dopamine research have added nuance to RPE theory by incorporating the ideas of sensory prediction error, distributional encoding, and belief states. Further nuance is likely to be added shortly by convergent lines of research on dopamine neuron diversity. Finally, a major challenge is to reconcile RPE theory with other current theories of dopamine function to account for dopamine’s role in movement, motivation, and goal-directed planning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Molecular diversity and specializations among the cells of the adult mouse brain
Saunders, A., Macosko, E. Z., Wysoker, A., Goldman, M., Krienen, F. M., de Rivera, H., Bien, E., Baum, M., Bortolin, L., Wang, S., et al. (2018) · Cell · doi:10.1016/j.cell.2018.07.028 · Cited by 1,531
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Input-specific control of reward and aversion in the ventral tegmental area
Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., Deisseroth, K., & Malenka, R. C. (2012) · Nature · doi:10.1038/nature11527 · Cited by 1,300
Circuit architecture of VTA dopamine neurons revealed by systematic input-output mapping
Beier, K. T., Steinberg, E. E., DeLoach, K. E., Xie, S., Miyamichi, K., Schwarz, L., Gao, X. J., Kremer, E. J., Malenka, R. C., & Luo, L. (2015) · Cell · doi:10.1016/j.cell.2015.07.015 · Cited by 1,068
Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system
Lammel, S., Hetzel, A., Häckel, O., Jones, I., Liss, B., & Roeper, J. (2008) · Neuron · doi:10.1016/j.neuron.2008.01.022 · Cited by 976
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955
Sun, F., Zeng, J., Jing, M., Zhou, J., Feng, J., Owen, S. F., Luo, Y., Li, F., Wang, H., Yamaguchi, T., et al. (2018) · Cell · doi:10.1016/j.cell.2018.06.042 · Cited by 837
Molecular diversity of midbrain development in mouse, human, and stem cells
La Manno, G., Gyllborg, D., Codeluppi, S., Nishimura, K., Salto, C., Zeisel, A., Borm, L. E., Stott, S. R. W., Toledo, E. M., Villaescusa, J. C., et al. (2016) · Cell · doi:10.1016/j.cell.2016.09.027 · Cited by 835
Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits
Lerner, T. N., Shilyansky, C., Davidson, T. J., Evans, K. E., Beier, K. T., Zalocusky, K. A., Crow, A. K., Malenka, R. C., Luo, L., Tomer, R., et al. (2015) · Cell · doi:10.1016/j.cell.2015.07.014 · Cited by 794
Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli
Lammel, S., Ion, D. I., Roeper, J., & Malenka, R. C. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.025 · Cited by 766
Dopaminergic neurons inhibit striatal output through non-canonical release of GABA
Tritsch, N. X., Ding, J. B., & Sabatini, B. L. (2012) · Nature · doi:10.1038/nature11466 · Cited by 576
Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., & Graybiel, A. M. (2013) · Nature · doi:10.1038/nature12475 · Cited by 565
Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons
Engelhard, B., Finkelstein, J., Cox, J., Fleming, W., Jang, H. J., Ornelas, S., Koay, S. A., Thiberge, S. Y., Daw, N. D., Tank, D. W., et al. (2019) · Nature · doi:10.1038/s41586-019-1261-9 · Cited by 544
Poulin, J.-F., Caronia, G., Hofer, C., Cui, Q., Helm, B., Ramakrishnan, C., Chan, C. S., Dombeck, D. A., Deisseroth, K., & Awatramani, R. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0203-4 · Cited by 423
Striatal dopamine neurotransmission: Regulation of release and uptake
Sulzer, D., Cragg, S. J., & Rice, M. E. (2016) · Basal Ganglia · doi:10.1016/j.baga.2016.02.001 · Cited by 382
Defining midbrain dopaminergic neuron diversity by single-cell gene expression profiling
Poulin, J.-F., Zou, J., Drouin-Ouellet, J., Kim, K.-Y. A., Cicchetti, F., & Awatramani, R. B. (2014) · Cell Reports · doi:10.1016/j.celrep.2014.10.008 · Cited by 352
Tiklová, K., Björklund, Å. K., Lahti, L., Fiorenzano, A., Nolbrant, S., Gillberg, L., Volakakis, N., Yokota, C., Hilscher, M. M., Hauling, T., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-08453-1 · Cited by 276
Similar roles of substantia nigra and ventral tegmental dopamine neurons in reward and aversion
Ilango, A., Kesner, A. J., Keller, K. L., Stuber, G. D., Bonci, A., & Ikemoto, S. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.1703-13.2014 · Cited by 255
Classification of midbrain dopamine neurons using single-cell gene expression profiling approaches
Poulin, J.-F., Gaertner, Z., Moreno-Ramos, O. A., & Awatramani, R. (2020) · Trends in Neurosciences · doi:10.1016/j.tins.2020.01.004 · Cited by 238
Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons
Tian, J., Huang, R., Cohen, J. Y., Osakada, F., Kobak, D., Machens, C. K., Callaway, E. M., Uchida, N., & Watabe-Uchida, M. (2016) · Neuron · doi:10.1016/j.neuron.2016.08.018 · Cited by 224
Aldehyde dehydrogenase 1a1 mediates a GABA synthesis pathway in midbrain dopaminergic neurons
Kim, J.-I., Ganesan, S., Luo, S. X., Wu, Y.-W., Park, E., Huang, E. J., Chen, L., & Ding, J. B. (2015) · Science · doi:10.1126/science.aac4690 · Cited by 217
Dopamine reward prediction errors reflect hidden-state inference across time
Starkweather, C. K., Babayan, B. M., Uchida, N., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4520 · Cited by 206
Dopamine neurons respond to errors in the prediction of sensory features of expected rewards
Takahashi, Y. K., Batchelor, H. M., Liu, B., Khanna, A., Morales, M., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.025 · Cited by 200
Stable representations of decision variables for flexible behavior
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.001 · Cited by 173
Midbrain dopamine neurons signal belief in choice accuracy during a perceptual decision
Lak, A., Nomoto, K., Keramati, M., Sakagami, M., & Kepecs, A. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.026 · Cited by 170
Cell-type-specific asynchronous modulation of PKA by dopamine in learning
Lee, S. J., Lodder, B., Chen, Y., Patriarchi, T., Tian, L., & Sabatini, B. L. (2021) · Nature · doi:10.1038/s41586-020-03050-5 · Cited by 160
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150
Hook, P. W., McClymont, S. A., Cannon, G. H., Law, W. D., Morton, A. J., Goff, L. A., & McCallion, A. S. (2018) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2018.02.001 · Cited by 136
Operant self-stimulation of dopamine neurons in the substantia nigra
Rossi, M. A., Sukharnikova, T., Hayrapetyan, V. Y., Yang, L., & Yin, H. H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065799 · Cited by 119
Belief state representation in the dopamine system
Babayan, B. M., Uchida, N., & Gershman, S. J. (2018) · Nature Communications · doi:10.1038/s41467-018-04397-0 · Cited by 101
Fortin, G. M., Ducrot, C., Giguère, N., Kouwenhoven, W. M., Bourque, M.-J., Pacelli, C., Varaschin, R. K., Brill, M., Singh, S., Wiseman, P. W., et al. (2019) · The FASEB Journal · doi:10.1096/fj.201800713rr · Cited by 45
Cited by
Anhedonia in eating disorders: A meta-analysis and systematic review
Dolan, S. C., Khindri, R., Franko, D. L., Thomas, J. J., Reilly, E. E., & Eddy, K. T. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23645 · Cited by 47
Nigrostriatal dopamine pathway regulates auditory discrimination behavior
Chen, A. P. F., Malgady, J. M., Chen, L., Shi, K. W., Cheng, E., Plotkin, J. L., Ge, S., & Xiong, Q. (2022) · Nature Communications · doi:10.1038/s41467-022-33747-2 · Cited by 46
Goedhoop, J., Arbab, T., & Willuhn, I. (2023) · The Journal of Neuroscience · doi:10.1523/jneurosci.1527-22.2023 · Cited by 24
Metadata
- Authors
- Lerner, T. N., Holloway, A. L., & Seiler, J. L.
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2021-04
- Volume
- 67
- Pages
- 123-130
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W3104118617
- Cited by
- 167
- References
- 33
- FWCI
- 1.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.