The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision
Open accessAbstract
Central to the organization of behavior is the ability to predict the values of outcomes to guide choices. The accuracy of such predictions is honed by a teaching signal that indicates how incorrect a prediction was ("reward prediction error," RPE). In several reinforcement learning contexts, such as Pavlovian conditioning and decisions guided by reward history, this RPE signal is provided by midbrain dopamine neurons. In many situations, however, the stimuli predictive of outcomes are perceptually ambiguous. Perceptual uncertainty is known to influence choices, but it has been unclear whether or how dopamine neurons factor it into their teaching signal. To cope with uncertainty, we extended a reinforcement learning model with a belief state about the perceptually ambiguous stimulus; this model generates an estimate of the probability of choice correctness, termed decision confidence. We show that dopamine responses in monkeys performing a perceptually ambiguous decision task comply with the model's predictions. Consequently, dopamine responses did not simply reflect a stimulus' average expected reward value but were predictive of the trial-to-trial fluctuations in perceptual accuracy. These confidence-dependent dopamine responses emerged prior to monkeys' choice initiation, raising the possibility that dopamine impacts impending decisions, in addition to encoding a post-decision teaching signal. Finally, by manipulating reward size, we found that dopamine neurons reflect both the upcoming reward size and the confidence in achieving it. Together, our results show that dopamine responses convey teaching signals that are also appropriate for perceptual decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous experimental work has shown that the phasic activity of midbrain dopamine neurons resembles the RPEs of TD learning in partially observable environments, where TD learning is performed on belief states rather than observations [6][7][8][9][10][11].”
From Emergence of belief-like representations through reinforcement learning (2023) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–169 of 169
Dopaminergic computations for perceptual decisions
Garcia, S. L., Fritsche, M., & Lak, A. (2024) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2024.101458 · Cited by 6
Self-citationSubstrates of Human Prediction Error for Incentives, Perception, Cognition, and ActionPreprint
Corlett, P. R., Mollick, J., & Hedy Kober, A. (2021) · doi:10.31234/osf.io/pf89k · Cited by 6
Expectancy-related changes in firing of dopamine neurons depend on hippocampusPreprint
Takahashi, Y. K., Zhang, Z., Montesinos-Cartagena, M., Kahnt, T., Langdon, A., & Schoenbaum, G. M. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.19.549728 · Cited by 6
Xu, W., Wang, M., Yang, G., Mo, F., Liu, Y., Shan, J., Jing, L., Li, M., Liu, J., Lv, S., et al. (2024) · Microsystems & Nanoengineering · doi:10.1038/s41378-024-00778-2 · Cited by 5
Shared and Diverging Neural Dynamics Underlying False and Veridical Perception
Haarsma, J., Hetenyi, D., & Kok, P. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.1479-24.2025 · Cited by 6
Decision-Making under UncertaintyPreprint
Bruckner, R., & Nassar, M. R. (2024) · doi:10.31234/osf.io/ce8jf · Cited by 5
Fekih‐Romdhane, F., Kerbage, G., Hachem, N., Murr, M. E., Haddad, G., Loch, A. A., Khalil, R. A., El‐Hayek, E., & Hallit, S. R. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-06275-0 · Cited by 5
Expectancy-related changes in firing of dopamine neurons depend on hippocampus
Zhang, Z., Takahashi, Y. K., Montesinos-Cartagena, M., Kahnt, T., Langdon, A., & Schoenbaum, G. M. (2024) · Nature Communications · doi:10.1038/s41467-024-53308-z · Cited by 10
Research on the shared control technology for robotic wheelchairs based on topological map
Wang, F., Liu, Y., Zhang, Y., Gao, Y. M., Xiao, L., & Wu, C. (2019) · Industrial Robot the international journal of robotics research and application · doi:10.1108/ir-04-2019-0084 · Cited by 4
de la Cuesta‐Ferrer, L., Koß, C., Starosta, S., Kasties, N., Lengersdorf, D., Jäkel, F., & Stüttgen, M. C. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012636 · Cited by 3
Stimulation of the human ventral tegmental area increases strategic betting
Hirschbichler, S. T., Lagrata, S., Shedd, N., Akram, H., Schwingenschuh, P., Waiß, C., Oberndorfer, S., Matharu, M. S., & Manohar, S. (2025) · Brain · doi:10.1093/brain/awaf210 · Cited by 3
Stüttgen, M. C., Dietl, A., Eckert, V. V. S., de la Cuesta‐Ferrer, L., Blanke, J., Koß, C., & Jäkel, F. (2024) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.908 · Cited by 3
The biological and behavioral computations that influence dopamine responses
Stauffer, W. R. (2018) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.02.005 · Cited by 3
The folded X-pattern is not necessarily a statistical signature of decision confidence
Rausch, M., & Zehetleitner, M. (2019) · Publication Server of the Catholic University Eichstätt-Ingolstadt (Catholic University of Eichstätt-Ingolstadt) · Cited by 3
Adaptive neurons compute confidence in a decision network
Li, L., & Wang, D. (2021) · Scientific Reports · doi:10.1038/s41598-021-01523-9 · Cited by 3
The folded X-pattern is not necessarily a statistical signature of decision confidencePreprint
Rausch, M., & Zehetleitner, M. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/426635 · Cited by 3
Metacognition facilitates the exploitation of unconscious brain statesPreprint
Cortese, A., Lau, H. C., & Kawato, M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/548941 · Cited by 3
Refining mechanistic models of hallucinations for enhanced translatability
Buck, J., Iigaya, K., & Horga, G. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03773-x · Cited by 2
Versprille, L. J. F. W., McKenzie, C., Amorim, F. E., Yano, K., Dalley, J. W., & Robbins, T. W. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.1696-25.2026 · Cited by 2
Reconciling Signal-Detection Models of Criterion Learning with the Generalized Matching Law
Koß, C., de la Cuesta‐Ferrer, L., Stüttgen, M. C., & Jäkel, F. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-024-00212-w · Cited by 2
Phasic arousal optimizes decision computations in mice and humans
de Gee, J. W., Tsetsos, K., Schwabe, L., Urai, A. E., McCormick, D. A., McGinley, M. J., & Donner, T. H. (2020) · eLife · Cited by 2
Time estimation and arousal responses in dopa-responsive dystonia
Becker, L. F., Tunç, S., Murphy, P., Bäumer, T., Weißbach, A., Pauly, M. G., Al‐Shorafat, D., Saranza, G., Lang, A. E., Beste, C., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-17545-w · Cited by 3
Reinforcement learning with dopamine: A convergence of natural and artificial intelligence
Masset, P., & Gershman, S. J. (2025) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-443-29867-7.00019-0 · Cited by 3
Perceptual modulation of parietal activity during urgent saccadic choicesPreprint
Seideman, J. A., Salinas, E., & Stanford, T. R. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2019.12.12.874313 · Cited by 2
Dopamine neurons encode trial-by-trial subjective reward value in an auction-like taskPreprint
Hill, D. F., Hickman, R. W., Al-Mohammad, A., Stasiak, A., & Schultz, W. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4331777 · Cited by 2
Adaptive Integration of Perceptual and Reward Information in an Uncertain WorldPreprint
Ganesh, P., Cichy, R. M., Schuck, N. W., Finke, C., & Bruckner, R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.04.24.590947 · Cited by 2
Pupil dilation offers a time-window on prediction errorPreprint
Colizoli, O., van Leeuwen, T. M., Rutar, D., & Harold Bekkering, A. (2025) · eLife · doi:10.7554/elife.105287.1 · Cited by 3
Fritsche, M., Toschi, C., Shevchuk, Y., Didenko, O., Puliyadi, R., Majumdar, A., Bogacz, R., & Lak, A. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.01.696999 · Cited by 4
Self-citationCan the VTA Come Out to Play? Only When the mPFC’s Predictions Go Astray!
Stolyarova, A., & Wikenheiser, A. M. (2020) · Neuron · doi:10.1016/j.neuron.2020.01.036 · Cited by 1
Pupil dilation offers a time-window on prediction error
Colizoli, O., van Leeuwen, T. M., Rutar, D., & Harold Bekkering, A. (2025) · eLife · doi:10.7554/elife.105287.3 · Cited by 4
Towards an integrative neuroscience of metacognition
Fleming, S. M. (2026) · Nature reviews. Neuroscience · doi:10.1038/s41583-026-01081-x · Cited by 3
Jovanović, L., Chassignolle, M., Schmidt‐Mutter, C., Behr, G., Coull, J. T., & Giersch, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-47843-w · Cited by 1
Smith, E. S., Michalski, S., Knauth, K., Tuzsus, D., Theis, H., van Eimeren, T., & Peters, J. (2024) · eNeuro · doi:10.1523/eneuro.0465-23.2024 · Cited by 1
Internal bias controls dopamine perceptual decision-related responsesPreprint
Sarno, S., Beirán, M., Vergara, J., Rossi-Pool, R., Romo, R., & Parga, N. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/431387 · Cited by 1
Harnessing behavioral diversity to understand circuits for cognitionPreprint
Musall, S., Urai, A. E., Sussillo, D., & Churchland, A. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09622 · Cited by 1
Sarno, S., Beirán, M., Falcó-Roget, J., Diaz-deLeon, G., Rossi-Pool, R., Romo, R., & Parga, N. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.01.071977 · Cited by 1
Song, M. R., & Lee, S. W. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/381103 · Cited by 2
Midbrain dopamine neurons provide teaching signals for goal-directed navigationPreprint
Farrell, K., Lak, A., & Saleem, A. B. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.17.431585 · Cited by 1
Self-citationPredictive Motor Control Based on a Generative Adversarial NetworkPreprint
Lenninger, M., Choi, W.-H., & Choi, H. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.17.524156 · Cited by 1
Decision-making under uncertainty
Bruckner, R., & Nassar, M. R. (2024) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00098-x · Cited by 7
Recasting adaptation as strategy inferencePreprint
Beaumont, S., Khamassi, M., & Domenech, P. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.24.645064 · Cited by 2
Interplay of pupil-linked arousal and cortical decision computations in micePreprint
Maheu, M., Copeland, J. B., Cantón, A. C., de la Rocha, J., Wiegert, J. S., & Donner, T. H. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.05.730199 · Cited by 1
Hidden State Inference in the Midbrain Dopamine System
Starkweather, C. K. (2018) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Dopamine responses reveal efficient coding of cognitive variablesPreprint
Motiwala, A., Soares, S., Atallah, B. V., Paton, J. J., & Machens, C. K. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.20.100065
Osako, Y., Ohnuki, T., Tanisumi, Y., Shiotani, K., Manabe, H., Sakurai, Y., & Hirokawa, J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.15.151811
Total recall: episodic memory retrieval, choice, and memory confidence in the ratPreprint
Joo, H. R., Liang, H.-X., Chung, J. E., Geaghan-Breiner, C., Fan, J., Nachman, B., Kepecs, A., & Frank, L. (2020) · bioRxiv · doi:10.1101/2020.12.14.420174
Cools, R. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.735843167.793561832
Fleming, S. M. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.734068306.793559296
Faculty Opinions recommendation of Belief state representation in the dopamine system.
Schultz, W. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.733228055.793565154
Fan, Y., Doi, T., Gold, J. I., & Ding, L. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.12.507621
(2021) · International Journal of Big Data Intelligent Technology · doi:10.38007/ijbdit.2021.020103
Generative Adversarial Implicit Successor RepresentationPreprint
Choi, W.-H., Ha, S., & Choi, H. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.03.581078
Valence ambiguity dynamically shapes striatal dopamine heterogeneityPreprint
Bornhoft, K. N., Prohofsky, J., O’Neal, T. J., Wolff, A. R., & Saunders, B. T. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.17.594692
Raising Social Stakes Raises ConfidencePreprint
Esmaily, J., Abharzad, E., Knogler, S., Deroy, O. D., & Bahrami, B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4844364
Adaptive Integration of Perceptual and Reward Information in an Uncertain WorldPreprint
Ganesh, P., Cichy, R. M., Schuck, N. W., Finke, C., & Bruckner, R. (2024) · eLife · doi:10.7554/elife.99266 · Cited by 4
Adaptive Integration of Perceptual and Reward Information in an Uncertain WorldPreprint
Ganesh, P., Cichy, R. M., Schuck, N. W., Finke, C., & Bruckner, R. (2024) · eLife · doi:10.7554/elife.99266.1
What dopamine teaches depends on what the brain believes
Bano, E., Ryu, S. C., & Kepecs, Á. (2025) · Nature Neuroscience · doi:10.1038/s41593-025-01980-9
Pupil dilation offers a time-window on prediction errorPreprint
Colizoli, O., van Leeuwen, T. M., Rutar, D., & Harold Bekkering, A. (2025) · eLife · doi:10.7554/elife.105287.2
Gharesi, N., Kalaska, J. F., & Baillet, S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.23.701339
Cholinergic–dopaminergic synergy and antagonism shape prediction-error broadcastingPreprint
Király, B., Pillár, V., Szabó, Í., Schlingloff, D., Hegedüs, P., Szigeti, K., Li, Y., & Hangya, B. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.19.706866
Interferences between decisional variables : behavioural and computational studies
Bioud, E. (2019) · theses.fr (ABES) · doi:10.70675/5a7bf3b9zcb60z48bdz8ea4z5effd60bb856
Lousada, E. L. R. D. S. (2023) · theses.fr (ABES) · doi:10.70675/23797e5dz9c89z49a2zafdaz58cbefdf74fa
Macaque Area LIP Reflects Confidence-Dependent Changes in Decision Policy
Tu, M. S., Vivar-Lazo, M., & Fetsch, C. R. (2026) · Journal of Neuroscience · doi:10.64898/2026.04.27.721150
Sense of agency and decision making
Ashby, F. G. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1816045
Pupil dilation as a physiological marker of metacognitive processes
Lenzoni, S., Horngacher, J., Kofler, J., Gat, O., & Hämmerer, D. (2026) · Biological Psychology · doi:10.1016/j.biopsycho.2026.109309
Metacognition and consciousness
Peters, M. A. K. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-29258-3.00052-5
Dopaminergic signatures of state and trait-like pessimism in micePreprint
Biswas, S., & Shabel, S. J. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.30.741818
Pinto, S. R., Hennig, J. A., Burrell, M., Okada, D., Benquet, C., Regester, D., Isogai, Y., Linderman, S. W., Gershman, S. J., & Uchida, N. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.17.752495
Raphe nuclei in cognition: A network-level framework for behavioral-state control
Khalighinejad, N., & Rushworth, M. F. S. (2026) · Neuron · doi:10.1016/j.neuron.2026.09.013 · Cited by 1
Metadata
- Authors
- Lak, A., Nomoto, K., Keramati, M., Sakagami, M., & Kepecs, A.
- Affiliations
- Cold Spring Harbor Laboratory (US)
- Tamagawa University (JP)
- Gatsby Computational Neuroscience Unit (GB)
- Venue
- Current Biology
- Publisher
- Elsevier BV
- Published
- 2017-03
- Volume
- 27
- Issue
- 6
- Pages
- 821-832
- ISSN
- 0960-9822 (ISSN-L)
- PMC
- PMC5819757
- OpenAlex
- W2592093412
- Cited by
- 170
- References
- 52
- Citations by year
- 2026: 14 · 2025: 16 · 2024: 22 · 2023: 19 · 2022: 9 · 2021: 16 · 2020: 24 · 2019: 22 · 2018: 20 · 2017: 8
- FWCI
- 9.90
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Current Biology (publishedVersion)
- PubMed (publishedVersion)
- City Research Online (City University London) (acceptedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Cold Spring Harbor Laboratory Institutional Repository (Cold Spring Harbor Laboratory) (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- Sir Henry Wellcome Trust Postdoctoral Fellowship (106101/Z/14/Z)
- Swartz Foundation
- National Institute of Mental Health (NIH) (R01MH097061)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- midbrain dopaminergic neurons, reward prediction error, perceptual decision making, perceptual uncertainty, decision confidence, belief states, reinforcement learning models, perceptual ambiguity, reward magnitude, teaching signal, choice accuracy
- MeSH terms
- Animals, Choice Behavior, Decision Making, Dopamine, Macaca, Male, Mesencephalon, Perception, Reinforcement, Psychology, Reward, Models, Animal, Dopaminergic Neurons
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
