The DOI matches its Crossref record; 201 of the 201 references it cites were found in a registry or an index.
Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry
Open accessAbstract
Summary Midbrain dopamine (DA) neurons are proposed to signal reward prediction error (RPE), a fundamental parameter in associative learning models. This RPE hypothesis provides a compelling theoretical framework for understanding DA function in reward learning and addiction. New studies support a causal role for DA-mediated RPE activity in promoting learning about natural reward; however, this question has not been explicitly tested in the context of drug addiction. In this review, we integrate theoretical models with experimental findings on the activity of DA systems, and on the causal role of specific neuronal projections and cell types, to provide a circuit-based framework for probing DA-RPE function in addiction. By examining error-encoding DA neurons in the neural network in which they are embedded, hypotheses regarding circuit-level adaptations that possibly contribute to pathological error-signaling and addiction can be formulated and tested.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,462
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Koob, G. F., & Volkow, N. D. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.110 · Cited by 5,340
Di Chiara, G., & Imperato, A. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.14.5274 · Cited by 4,733
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785
Cited by
A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System
de Jong, J. W., Afjei, S. A., Pollak Dorocic, I., Peck, J. R., Liu, C., Kim, C. K., Tian, L., Deisseroth, K., & Lammel, S. (2019) · Neuron · doi:10.1016/j.neuron.2018.11.005 · Cited by 511
Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties
Saunders, B. T., Richard, J. M., Margolis, E. B., & Janak, P. H. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0191-4 · Cited by 374
Self-citationAshok, A. H., Mizuno, Y., Volkow, N. D., & Howes, O. D. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0135 · Cited by 330
The Molecular Basis of Drug Addiction: Linking Epigenetic to Synaptic and Circuit Mechanisms
Nestler, E. J., & Lüscher, C. (2019) · Neuron · doi:10.1016/j.neuron.2019.01.016 · Cited by 334
Fettes, P., Schulze, L., & Downar, J. (2017) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2017.00025 · Cited by 299
Linking RDoC and HiTOP: A new interface for advancing psychiatric nosology and neuroscience
Michelini, G., Palumbo, I. M., DeYoung, C. G., Latzman, R. D., & Kotov, R. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102025 · Cited by 273
Hu, H. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-014106 · Cited by 253
Circuit Mechanisms of Reward, Anhedonia, and Depression
Höflich, A., Michenthaler, P., Kasper, S., & Lanzenberger, R. (2019) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyy081 · Cited by 253
The Emergence of a Circuit Model for Addiction
Lüscher, C. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-013920 · Cited by 260
Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons
Tian, J., Huang, R., Cohen, J. Y., Osakada, F., Kobak, D., Machens, C. K., Callaway, E. M., Uchida, N., & Watabe-Uchida, M. (2016) · Neuron · doi:10.1016/j.neuron.2016.08.018 · Cited by 224
Stochastic synaptic plasticity underlying compulsion in a model of addiction
Pascoli, V., Hiver, A., Van Zessen, R., Loureiro, M., Achargui, R., Harada, M., Flakowski, J., & Lüscher, C. (2018) · Nature · doi:10.1038/s41586-018-0789-4 · Cited by 185
Nucleus Accumbens Modulation in Reward and Aversion
Klawonn, A. M., & Malenka, R. C. (2018) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2018.83.037457 · Cited by 163
Dopaminergic Neurotransmission in the Nucleus Accumbens Modulates Social Play Behavior in Rats
Manduca, A., Servadio, M., Damsteegt, R., Campolongo, P., Vanderschuren, L. J., & Trezza, V. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.22 · Cited by 149
Moustafa, A. A., Parkes, D., Fitzgerald, L., Underhill, D., Garami, J., Levy-Gigi, E., Stramecki, F., Valikhani, A., Frydecka, D., & Misiak, B. (2021) · Current Psychology · doi:10.1007/s12144-018-9973-9 · Cited by 128
Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction
Watanabe, E., Kitaoka, A., Sakamoto, K., Yasugi, M., & Tanaka, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00345 · Cited by 101
Hypernatural Monitoring: A Social Rehearsal Account of Smartphone Addiction
Veissière, S. P. L., & Stendel, M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00141 · Cited by 105
“Cravings, on this view, could Frontiers in Psychology | www.frontiersin.org 4 February 2018 | Volume 9 | Article 141 FIGURE 2 | Cue-activated reward anticipation and prediction errors and subsequent dopaminergic activity (adapted from Keiflin and Janak, 2015).”
BackgroundDopamine Circuit Mechanisms of Addiction-Like Behaviors
Poisson, C. L., Engel, L., & Saunders, B. T. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2021.752420 · Cited by 75
A neuronal mechanism underlying decision-making deficits during hyperdopaminergic states
Verharen, J. P. H., de Jong, J. W., Roelofs, T. J. M., Huffels, C. F. M., van Zessen, R., Luijendijk, M. C. M., Hamelink, R., Willuhn, I., den Ouden, H. E. M., van der Plasse, G., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-03087-1 · Cited by 62
Eckstrand, K. L., Forbes, E. E., Bertocci, M. A., Chase, H. W., Greenberg, T., Lockovich, J., Stiffler, R., Aslam, H. A., Graur, S., Bebko, G., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0864 · Cited by 51
Robinson, J. E., Coughlin, G. M., Hori, A. M., Cho, J. R., Mackey, E. D., Turan, Z., Patriarchi, T., Tian, L., & Gradinaru, V. (2019) · eLife · doi:10.7554/elife.48983 · Cited by 44
“Dopaminergic populations have been widely studied for their role in reward learning (Keiflin and Janak, 2015; Schultz et al., 2015; Wise, 2004), so we optically monitored dopaminergic neurotransmission during a Pavlovian conditioning assay in water-restricted Nf1+/+ and Nf1+/- mice.”
MethodMartiros, N., Kapoor, V., Kim, S. E., & Murthy, V. N. (2022) · eLife · doi:10.7554/elife.75463 · Cited by 41
Ahmed, S. H. (2018) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2017.07.005 · Cited by 39
Addressing altered anticipation as a transdiagnostic target through computational psychiatry
Sepúlveda, P., Aitsahalia, I., Kumar, K., Atkin, T., & Iigaya, K. (2025) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2025.02.014 · Cited by 3
Metadata
- Authors
- Keiflin, R., & Janak, P. H.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2015-10
- Volume
- 88
- Issue
- 2
- Pages
- 247-263
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2142671349
- Cited by
- 382
- References
- 201
- FWCI
- 10.72
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.