The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty
Open accessAbstract
Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the environment. The brain structures important in hidden state inference remain unknown. A previous study showed that midbrain dopamine neurons exhibit distinct response patterns depending on whether reward is delivered in 100% (task 1) or 90% of trials (task 2) in a classical conditioning task. Here we found that inactivation of the medial prefrontal cortex (mPFC) affected dopaminergic signaling in task 2, in which the hidden state must be inferred ("will reward come or not?"), but not in task 1, where the state was known with certainty. Computational modeling suggests that the effects of inactivation are best explained by a circuit in which the mPFC conveys inference over hidden states to the dopamine system. VIDEO ABSTRACT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The brain may have dedicated machinery, perhaps in prefrontal cortex [12,13], for computing belief states, which could then be provided to downstream areas, such as the basal ganglia, to perform standard RL algorithms such as TD learning [14].”
From Emergence of belief-like representations through reinforcement learning (2023) · cites this paper as [13]
In the citing paper
“As a working example, we will consider the probabilistic associative learning paradigm where dopamine RPEs were shown to be consistent with a belief representation [7,13].”
From Emergence of belief-like representations through reinforcement learning (2023) · cites this paper as [13]
In the citing paper
“In both tasks, mice were trained to associate an odor cue with probabilistic delivery of a liquid reward 1.2-2.8slater.”
From Emergence of belief-like representations through reinforcement learning (2023) · cites this paper as [13]
In the citing paper
“Previous work has shown that, in animals, prefrontal cortex activity is a necessary component of animals' state representations [13].”
From Emergence of belief-like representations through reinforcement learning (2023) · cites this paper as [13]
In the citing paper
“This work found that inactivating prefrontal cortex in the Starkweather task led to animals' RPEs in Task 2 resembling the RPEs of Task 1.”
From Emergence of belief-like representations through reinforcement learning (2023) · cites this paper as [13]
In the citing paper
“For instance, previous work has suggested that prefrontal cortex may perform state estimation in tasks with hidden states [6,7,12,13].”
From Emergence of belief-like representations through reinforcement learning (2023) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Sesack, S. R., Deutch, A. Y., Roth, R. H., & Bunney, B. S. (1989) · Journal of Comparative Neurology · doi:10.1002/cne.902900205 · Cited by 1,568
Differential projections of the infralimbic and prelimbic cortex in the rat
Vertes, R. P. (2004) · Synapse · doi:10.1002/syn.10279 · Cited by 1,550
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Self-citationMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Whole-Brain Mapping of Direct Inputs to Midbrain Dopamine Neurons
Watabe‐Uchida, M., Zhu, L., Ogawa, S. K., Vamanrao, A., & Uchida, N. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.017 · Cited by 1,277
Self-citationPrefrontal cortex in the rat: Projections to subcortical autonomic, motor, and limbic centers
Gabbott, P. L. A., Warner, T. A., Jays, P. R. L., Salway, P., & Busby, S. J. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20738 · Cited by 1,227
The hippocampus as a predictive map
Stachenfeld, K. L., Botvinick, M. M., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4650 · Cited by 1,000
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System
de Jong, J. W., Afjei, S. A., Dorocic, I. P., Peck, J. R., Liu, C. J., Kim, C. K., Tian, L., Deisseroth, K. A., & Lammel, S. (2018) · Neuron · doi:10.1016/j.neuron.2018.11.005 · Cited by 525
The Relationship Between Uncertainty and Affect
Anderson, E. C., Carleton, R. N., Diefenbach, M., & Han, P. K. J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02504 · Cited by 332
The prefrontal cortex, pathological anxiety, and anxiety disorders
Kenwood, M. M., Kalin, N. H., & Barbas, H. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01109-z · Cited by 379
Reinforcement learning in artificial and biological systems
Neftci, E. O., & Averbeck, B. B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0025-4 · Cited by 268
Dopamine release in the nucleus accumbens core signals perceived saliency
Kutlu, M. G., Zachry, J. E., Melugin, P. R., Cajigas, S. A., Chevee, M. F., Kelly, S. J., Kutlu, B., Tian, L., Siciliano, C. A., & Calipari, E. S. (2021) · Current Biology · doi:10.1016/j.cub.2021.08.052 · Cited by 238
Metadata
- Authors
- Starkweather, C. K., Gershman, S. J., & Uchida, N.
- Affiliations
- Harvard University (US)
- Corresponding author
- Gershman, Samuel J.
- Uchida, Naoshige
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2018-05
- Volume
- 98
- Issue
- 3
- Pages
- 616-629.e6
- ISSN
- 0896-6273 (ISSN-L)
- PMC
- PMC5934341
- OpenAlex
- W2797393690
- Cited by
- 136
- References
- 57
- Citations by year
- 2026: 13 · 2025: 23 · 2024: 14 · 2023: 19 · 2022: 12 · 2021: 17 · 2020: 19 · 2019: 13 · 2018: 6
- FWCI
- 6.26
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- NIH (R01MH095953, R01MH101207)
- CRCNS (R01-1207833, F30MH112242-01A1, T32MH020017, T32GM007753)
- Harvard Brain Science Initiative
- Simons Collaboration on Global Brain
- Harvard Mind Brain and Behavior
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- medial prefrontal cortex, dopamine, reward prediction error, state uncertainty, hidden state inference, midbrain dopaminergic neurons, neural inactivation, classical conditioning, computational modeling
- MeSH terms
- Action Potentials, Animals, Dopamine, Forecasting, Male, Mice, Inbred C57BL, Mice, Transgenic, Nerve Net, Odorants, Reward, Prefrontal Cortex, Uncertainty, Mice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
