Dopamine, Prediction Error and Beyond
Open accessAbstract
A large body of work has linked dopaminergic signaling to learning and reward processing. It stresses the role of dopamine in reward prediction error signaling, a key neural signal that allows us to learn from past experiences, and that facilitates optimal choice behavior. Latterly, it has become clear that dopamine does not merely code prediction error size but also signals the difference between the expected value of rewards, and the value of rewards actually received, which is obtained through the integration of reward attributes such as the type, amount, probability and delay. More recent work has posited a role of dopamine in learning beyond rewards. These theories suggest that dopamine codes absolute or unsigned prediction errors, playing a key role in how the brain models associative regularities within its environment, while incorporating critical information about the reliability of those regularities. Work is emerging supporting this perspective and, it has inspired theoretical models of how certain forms of mental pathology may emerge in relation to dopamine function. Such pathology is frequently related to disturbed inferences leading to altered internal models of the environment. Thus, it is critical to understand the role of dopamine in error-related learning and inference.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Both dopamine and noradrenaline seem to play a vital role in processing prediction errors.
“Both neurotransmitters seem to play a vital role in processing prediction errors (Diederen & Fletcher, 2021).”
From Are prediction error modifications domain specific in autism but domain general in ADHD? (2025) · cites this paper as Diederen & Fletcher, 2021
The Introduction and Abstract describe dopamine as central to prediction-error signaling. The section “PEs and Other Neuromodulary Systems” links noradrenergic activity to learning and says norepinephrine has been proposed to signal uncertainty, but it does not say noradrenaline plays a vital role in processing prediction errors. Page numbers were not available in our copy. (LLM, conf=0.86)
Experimental — accuracy not yet measuredDopamine was proposed to modulate the precision weighting of prediction errors, encoding the reliability of a prediction error.
“Specifically, dopamine was proposed to modulate the precision weighting of prediction errors, encoding the reliability of a prediction error (Diederen & Fletcher, 2021).”
From Are prediction error modifications domain specific in autism but domain general in ADHD? (2025) · cites this paper as Diederen & Fletcher, 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810 · cited 1× · see citing works
“In addition, our preference also depends on our ability to accurately learn about each of these reward characteristics and it has been shown that subjects’ estimate of probabilities tends to be distorted (Stauffer and others 2015; Tobler and others 2008; Tversky and Kahneman 1974).”
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 2× · see citing works
“Recent theories relating to the predictive processing framework and active inference have postulated an entirely different role for dopamine (Bastos and others 2012; Friston 2010; Friston and others 2012; Friston and others 2015).”
BackgroundProspect Theory: An Analysis of Decision Under Risk
Kahneman, D., & Tversky, A. (2013) · World Scientific Handbook in Financial Economics Series · doi:10.1142/9789814417358_0006 · Cited by 3,091 · see citing works
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813 · see citing works
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · see citing works
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983 · see citing works
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113 · see citing works
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works
The Predictive Coding Account of Psychosis
Sterzer, P., Adams, R. A., Fletcher, P., Frith, C., Lawrie, S. M., Muckli, L., Petrovic, P., Uhlhaas, P., Voss, M., & Corlett, P. R. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.05.015 · Cited by 941 · see citing works
Self-citationThe Computational Anatomy of Psychosis
Adams, R. A., Stephan, K. E., Brown, H. R., Frith, C. D., & Friston, K. J. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00047 · Cited by 850 · see citing works
Skinner, B. F. (1963) · American Psychologist · doi:10.1037/h0045185 · Cited by 675 · see citing works
Kempadoo, K. A., Mosharov, E. V., Choi, S. J., Sulzer, D., & Kandel, E. R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1616515114 · Cited by 647 · see citing works
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600 · see citing works
Dopamine reward prediction error coding
Schultz, W. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/wschultz · Cited by 597 · see citing works
Substantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532 · see citing works
Computational psychiatry: the brain as a phantastic organ
Friston, K. J., Stephan, K. E., Montague, R., & Dolan, R. J. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70275-5 · Cited by 531 · see citing works
Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · see citing works
Howes, O. D., Bose, S. K., Turkheimer, F., Valli, I., Egerton, A., Valmaggia, L. R., Murray, R. M., & McGuire, P. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11010160 · Cited by 343 · see citing works
Bassareo, V., De Luca, M. A., & Di Chiara, G. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04709.2002 · Cited by 339 · see citing works
A direct projection from superior colliculus to substantia nigra for detecting salient visual events
Comoli, E., Coizet, V., Boyes, J., Bolam, J. P., Canteras, N. S., Quirk, R. H., Overton, P. G., & Redgrave, P. (2003) · Nature Neuroscience · doi:10.1038/nn1113 · Cited by 295 · see citing works
Dopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294 · see citing works
An integrative perspective on the role of dopamine in schizophrenia
Maia, T. V., & Frank, M. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.05.021 · Cited by 293 · see citing works
How visual stimuli activate dopaminergic neurons at short latency
Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J. E. W., Overton, P. G., & Redgrave, P. (2005) · Science · doi:10.1126/science.1107026 · Cited by 285 · see citing works
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284 · see citing works
Do patients with schizophrenia exhibit aberrant salience?
Roiser, J. P., Stephan, K. E., den Ouden, H. E. M., Barnes, T. R. E., Friston, K. J., & Joyce, E. M. (2009) · Psychological Medicine · doi:10.1017/s0033291708003863 · Cited by 262 · see citing works
Dopamine prediction error responses integrate subjective value from different reward dimensions
Lak, A., Stauffer, W. R., & Schultz, W. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1321596111 · Cited by 257 · see citing works
Circular inferences in schizophrenia
Jardri, R., & Denève, S. (2013) · Brain · doi:10.1093/brain/awt257 · Cited by 201 · see citing works
Griffiths, T. L., Chater, N., Norris, D., & Pouget, A. (2012) · Psychological Bulletin · doi:10.1037/a0026884 · Cited by 192 · see citing works
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176 · see citing works
Diederen, K. M. J., Spencer, T., Vestergaard, M. D., Fletcher, P. C., & Schultz, W. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.019 · Cited by 102 · see citing works
Self-citationDopaminergic basis for signaling belief updates, but not surprise, and the link to paranoia
Nour, M. M., Dahoun, T., Schwartenbeck, P., Adams, R. A., FitzGerald, T. H. B., Coello, C., Wall, M. B., Dolan, R. J., & Howes, O. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1809298115 · Cited by 101 · see citing works
Kollins, S. H., & Adcock, R. A. (2014) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2014.02.002 · Cited by 95 · see citing works
Flagged first, then by citations
Research works printed but not linked: 106
- Aitchison L Lengyel M 2017 With or without you: predictive coding and Bayesian inference in the brain. Curr Opin Neurobiol 46:219–27. PMC5836998 28942084
- Arias-Carrión O Pŏppel E 2007 Dopamine, learning, and reward-seeking behavior. Acta Neurobiol Exp (Wars) 67(4):481–8. 18320725
- Ashby WR 1952 Design for a brain. Oxford, England: Wiley. ix, 259-ix, 259 p.
- Bartra O McGuire JT Kable JW 2013 The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76:412–27. PMC3756836 23507394
- Bayer HM Glimcher PW 2005 Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47(1):129–41. PMC1564381 15996553
- Becker GM DeGroot MH Marschak J 1964 Measuring utility by a single-response sequential method. Behav Sci 9(3):226–32. 5888778
- Bissonette G Roesch M 2016 Development and function of the midbrain dopamine system: what we know and what we need to. Genes Brain Behav 15(1): 62– 73. 26548362 PMC5266527
- Boorman ED Rajendran VG O’Reilly JX Behrens TE 2016 Two anatomically and computationally distinct learning signals predict changes to stimulus-outcome associations in hippocampus. Neuron 89(6):1343–54. PMC4819449 26948895
- Bouret S Sara SJ 2004 Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. Eur J Neurosci 20(3): 791– 802. 15255989
- Bromberg-Martin ES Hikosaka O 2009 Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 63(1):119–26. PMC2723053 19607797
- Bunzeck N Düzel E 2006 Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 51(3):369–79. 16880131
- Cartoni E Puglisi-Allegra S Baldassarre G 2013 The three principles of action: a Pavlovian-instrumental transfer hypothesis. Front Behav Neurosci 7: 153. 24312025 PMC3832805
- Chiodo LA Antelman SM Caggiula AR Lineberry CG 1980 Sensory stimuli alter the discharge rate of dopamine (DA) neurons: evidence for two functional types of DA cells in the substantia nigra. Brain Res 189(2):544–9. 7370790
- Clark JJ Sandberg SG Wanat MJ Gan JO Horne EA Hart AS, and others. 2009 Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nat Methods 7(2):126–9. PMC2849934 20037591
- Collins AL Greenfield VY Bye JK Linker KE Wang AS Wassum KM 2016 Dynamic mesolimbic dopamine signaling during action sequence learning and expectation violation. Sci Rep 6: 20231. 26869075 PMC4751524
- Corlett PR Aitken MR Dickinson A Shanks DR Honey GD Honey RA, and others. 2004 Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning. Neuron 44(5):877–88. 15572117
- Corlett PR Honey GD Aitken MR Dickinson A Shanks DR Absalom AR, and others. 2006 Frontal responses during learning predict vulnerability to the psychotogenic effects of ketamine: linking cognition, brain activity, and psychosis. Arch Gen Psychiatry 63(6):611–21 16754834
- D’Ardenne K McClure SM Nystrom LE Cohen JD 2008 BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319(5867):1264–7. 18309087
- Daw ND Kakade S Dayan P 2002a. Opponent interactions between serotonin and dopamine. Neural Netw 15(4):603–16. 12371515
- Daw ND Kakade S Dayan P 2002b. Opponent interactions between serotonin and dopamine. Neural Netw 15(4–6):603–16. 12371515
- Deserno L Boehme R Heinz A Schlagenhauf F 2013 Reinforcement learning and dopamine in schizophrenia: dimensions of symptoms or specific features of a disease group? Front Psychiatry 4: 172. 24391603 PMC3870301
- Dickinson A Balleine B 2002 The role of learning in the operation of motivational systems. In: Pashler H Gallistel R, editors. Stevens’ handbook of experimental psychology. New York: Wiley p 497– 533.
- Düzel E Bunzeck N Guitart-Masip M Düzel S 2010 NOvelty-related Motivation of Anticipation and exploration by Dopamine (NOMAD): implications for healthy aging. Neurosci Biobehav Rev 34(5):660–9. 19715723
- de Wit S Dickinson A 2009 Associative theories of goal-directed behaviour: a case for animal–human translational models. Psychol Res PRPF 73(4):463–76. PMC2694930 19350272
- Den Ouden HE Kok P De Lange FP 2012 How prediction errors shape perception, attention, and motivation. Front Psychol 3: 548. 23248610 PMC3518876
- Diaconescu AO Mathys C Weber LA Kasper L Mauer J Stephan KE 2017 Hierarchical prediction errors in midbrain and septum during social learning. Soc Cogn Affect Neurosci 12(4):618–34. PMC5390746 28119508
- Diederen KMJ Schultz W 2015 Scaling prediction errors to reward variability benefits error-driven learning in humans. J Neurophysiol 114(3):1628–40. PMC4563025 26180123
- Diederen KMJ Ziauddeen H Vestergaard MD Spencer T Schultz W Fletcher PC 2017 Dopamine modulates adaptive prediction error coding in the human midbrain and striatum. J Neurosci 37(7):1708–20. PMC5320604 28202786
- Düzel E Guitart-Masip M Maass A Hämmerer D Betts MJ Speck O, and others. 2015 Midbrain fMRI: applications, limitations and challenges. fMRI: From Nuclear Spins to Brain Functions: Springer p 581– 609.
- Eshel N Bukwich M Rao V Hemmelder V Tian J Uchida N 2015 Arithmetic and local circuitry underlying dopamine prediction errors. Nature 525(7568):243–6. PMC4567485 26322583
- Esber GR Roesch MR Bali S Trageser J Bissonette GB Puche AC, and others. 2012 Attention-related Pearce-Kaye-Hall signals in basolateral amygdala require the midbrain dopaminergic system. Biol Psychiatry 72(12):1012–9. PMC3465645 22763185
- Estes WK 1948 Discriminative conditioning. II. Effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. J Exp Psychol 38(2): 173. 18913666
- Fiorillo CD 2013 Two dimensions of value: dopamine neurons represent reward but not aversiveness. Science 341(6145):546–9. 23908236
- Fletcher PC Anderson JM Shanks DR Honey R Carpenter TA Donovan T, and others. 2001 Responses of human frontal cortex to surprising events are predicted by formal associative learning theory. Nat Neurosci 4: 1043. 11559855
- Fletcher PC Frith CD 2009 Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia. Nat Rev Neurosci 10(1): 48– 58. 19050712
- Friston K 2009 The free-energy principle: a rough guide to the brain? Trends Cogn Sci 13(7): 293– 301. 19559644
- Friston KJ Shiner T FitzGerald T Galea JM Adams R Brown, and others. 2012 Dopamine, affordance and active inference. PLoS Computational Biol 8(1): e1002327. PMC3252266 22241972
- Friston KJ Rigoli F Ognibene D Mathys C Fitzgerald T Pezzulo G 2015 Active inference and epistemic value. Cogn Neurosci 6(4): 187– 214. 25689102
- García-García I Zeighami Y Dagher A 2017 Reward prediction errors in drug addiction and Parkinson’s disease: from neurophysiology to neuroimaging. Curr Neurol Neurosci Rep 17(6): 46. 28417291
- Garrison J Erdeniz B Done J 2013 Prediction error in RL: a meta-analysis of neuroimaging studies. Neurosci Biobehav Rev 37(7):1297–310. 23567522
- Gatt JM Burton KL Williams LM Schofield PR 2015 Specific and common genes implicated across major mental disorders: a review of meta-analysis studies. J Psychiatr Res 60: 1– 13. 25287955
- Gläscher J Daw N Dayan P O’Doherty JP 2010 States versus rewards: dissociable neural prediction error signals underlying model-based and model-free RL. Neuron 66(4):585–95. PMC2895323 20510862
- Haarsma J Fletcher PC Ziauddeen H Spencer TJ Diederen KMJ Murray GK 2019 Precision weighting of cortical unsigned prediction errors is mediated by dopamine and benefits learning. bioRxiv.
- Halliday GM Törk I 1986 Comparative anatomy of the ventromedial mesencephalic tegmentum in the rat, cat, monkey and human. J Comp Neurol 252(4):423–45. 3782510
- Hart AS Rutledge RB Glimcher PW Phillips PEM 2014 Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci 34(3): 698– 704. 24431428 PMC3891951
- Heiss W-D 2009 The potential of PET/MR for brain imaging. Eur J Nucl Med Mol Imaging 36(1):105–12. 19104801
- Heinz A Murray GK Schlagenhauf F Sterzer P Grace AA Waltz JA 2019 Towards a unifying cognitive, neurophysiological, and computational neuroscience account of schizophrenia. Schizophr Bull 45(5):1092–100. PMC6737474 30388260
- Howard JD Kahnt T 2018 Identity prediction errors in the human midbrain update reward-identity expectations in the orbitofrontal cortex. Nat Commun 9(1): 1611. 29686225 PMC5913228
- Howes OD Kambeitz J Kim E Stahl D Slifstein M Abi-Dargham A, and others. 2012 The nature of dopamine dysfunction in schizophrenia and what this means for treat-ment: meta-analysis of imaging studies. Arch Gen Psychiatry 69(8):776–86. PMC3730746 22474070
- Howes OD Murray RM 2014 Schizophrenia: an integrated sociodevelopmental-cognitive model. Lancet 383(9929):1677–87. PMC4127444 24315522
- Iglesias S Mathys C Brodersen KH Kasper L Piccirelli M den Ouden HE, and others. 2013 Hierarchical prediction errors in midbrain and basal forebrain during sensory learning. Neuron 80(2):519–30. 24139048
- Jacobs RA Kruschke JK 2011 Bayesian learning theory applied to human cognition. Wiley Interdiscip Rev Cogn Sci 2(1): 8– 21. 26301909
- Jocham G Klein TA Ullsperger M 2014 Differential modulation of RL by D2 dopamine and NMDA glutamate receptor antagonism. J Neurosci 34(39):13151–62. PMC4262707 25253860
- Kakade S Dayan P 2002 Dopamine: generalization and bonuses. Neural Netw 15(4–6):549–59. 12371511
- Kim KM Baratta MV Yang A Lee D Boyden ES Fiorillo CD 2012 Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement. PloS One 7(4): e33612. 22506004 PMC3323614
- Langdon AJ Sharpe MJ Schoenbaum G Niv Y 2018 Model-based predictions for dopamine. Curr Opin Neurobiol 49: 1– 7. 29096115 PMC6034703
- Lapish CC Shamans JK Judson Chandler L 2006 Glutamate-dopamine cotransmission and reward processing in addiction. Alcohol Clin Exp Res 30(9):1451–65. 16930207
- Levy DJ Glimcher PW 2012 The root of all value: a neural common currency for choice. Curr Opin Neurobiol 22(6):1027–38. PMC4093837 22766486
- Li J Schiller D Schoenbaum G Phelps EA Daw ND 2011 Differential roles of human striatum and amygdala in associative learning. Nat Neurosci 14(10):1250–2. PMC3268261 21909088
- Mantz J Thierry A Glowinski J 1989 Effect of noxious tail pinch on the discharge rate of mesocortical and mesolimbic dopamine neurons: selective activation of the mesocortical system. Brain Res 476(2):377–81. 2702475
- Matias S Lottem E Dugue GP Mainen ZF 2017 Activity patterns of serotonin neurons underlying cognitive flexibility. Elife 6: e20552. 28322190 PMC5360447
- Matsumoto M Hikosaka O 2009 Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459(7248):837–41. PMC2739096 19448610
- McClure SM Berns GS Montague PR 2003 Temporal prediction errors in a passive learning task activate human striatum. Neuron 38(2):339–46. 12718866
- McCutcheon RA Abi-Dargham A Howes OD 2019 Schizophrenia, dopamine and the striatum: from biology to symptoms. Trends Neurosci 42(3):205–20. PMC6401206 30621912
- Miller R. (1976). Schizophrenic psychology, associative learning and the role of forebrain dopamine. Medical Hypotheses, 2(5): 203– 211. 9558
- Nair-Roberts RG Chatelain-Badie S Benson E White-Cooper H Bolam J Ungless M 2008 Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat. Neuroscience 152(4):1024–31. PMC2575227 18355970
- Nestler EJ Carlezon Jr WA 2006 The mesolimbic dopamine reward circuit in depression. Biol Psychiatry 59(12):1151–9. 16566899
- Niv Y Schoenbaum G 2008 Dialogues on prediction errors. Trends Cogn Sci 12(7):265–72. 18567531
- O’Reilly JX 2013 Making predictions in a changing world-inference, uncertainty, and learning. Front Neurosci 7: 105. 23785310 PMC3682109
- Olds J Milner P 1954 Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J Comp Physiol Psychol 47(6):419–27. 13233369
- Papageorgiou GK Baudonnat M Cucca F Walton ME 2016 Mesolimbic dopamine encodes prediction errors in a state-dependent manner. Cell reports 15(2):221–8. PMC4835543 27050518
- Pavlov IP Anrep GV 1928 Conditioned reflexes: an investigation of the physiological activity of the cerebral cortex. London: Oxford University Press. PMC4116985 25205891
- Payzan-LeNestour E Dunne S Bossaerts P O’Doherty JP 2013 The neural representation of unexpected uncertainty during value-based decision making. Neuron 79(1): 191– 201. 23849203 PMC4885745
- Pennartz CMA McNaughton BL Mulder AB 2000 The glutamate hypothesis of reinforcement learning. Prog Brain Res 126:231–53. 11105650
- Pessiglione M Seymour B Flandin G Dolan RJ Frith CD 2006 Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442(7106):1042–5. PMC2636869 16929307
- Radua J Schmidt A Borgwardt S Heinz A Schlagenhauf McGuire, and others. 2015 Ventral striatal activation during reward processing in psychosis: a neurofunctional meta-analysis. JAMA Psychiatry 72(12):1243–51. 26558708
- Rangel-Gomez M Meeter M 2016 Neurotransmitters and novelty: a systematic review. J Psychopharmacol 30(1): 3– 12. 26601905
- Reed P Mitchell C Nokes T 1996 Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task. Anim Learn Behav 24(1): 38– 45.
- Robinson TE Berridge KC 2008 The incentive sensitization theory of addiction: some current issues. Philos Trans R Soc Lond B Biol Sci 363(1507):3137–46. PMC2607325 18640920
- Schultz W 1998 Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1– 27. 9658025
- Schultz W 2016b. Dopamine reward prediction-error signalling: a two-component response. Nat Rev Neurosci 17(3): 183. 26865020 PMC5549862
- Schultz W Dayan P Montague PR 1997 A neural substrate of prediction and reward. Science 275(5306):1593–9. 9054347
- Schultz W Dickinson A 2000 Neuronal coding of prediction errors. Annu Rev Neurosci 23: 473– 500. 10845072
- Schwartenbeck P FitzGerald THB Dolan R 2016 Neural signals encoding shifts in beliefs. Neuroimage 125:578–86. PMC4692512 26520774
- Sescousse G Caldú X Segura B Dreher J-C 2013 Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies. Neurosci Biobehav Rev 37(4):681–96. 23415703
- Sharpe MJ Chang CY Liu MA Batchelor HM Mueller LE Jones JL, and others. 2017 Dopamine transients are sufficient and necessary for acquisition of model-based associations. Nat Neurosci 20: 735. 28368385 PMC5413864
- Sharpe MJ Marchant NJ Whitaker LR Richie CT Zhang YJ Campbell EJ, and others 2017 Lateral hypothalamic GABAergic neurons encode reward predictions that are relayed to the ventral tegmental area to regulate learning. Curr Biol 27(14):2089–100. PMC5564224 28690111
- Solomon RL Corbit JD 1978 An opponent-process theory of motivation. Am Econ Rev 68(6): 12– 24.
- Starkweather CK Babayan BM Uchida N Gershman SJ 2017 Dopamine reward prediction errors reflect hidden-state inference across time. Nat Neurosci 20(4): 581. 28263301 PMC5374025
- Stauffer WR Lak A Bossaerts P Schultz W 2015 Economic choices reveal probability distortion in macaque monkeys. J Neurosci 35(7):3146–54. PMC4331632 25698750
- Stauffer WR Lak A Yang A Borel M Paulsen O Boyden ES, and others. 2016 Dopamine neuron-specific optogenetic stimulation in rhesus macaques. Cell 166(6):1564–71.e6. PMC5018252 27610576
- Suri RE Bargas J Arbib MA 2001 Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience 103(1): 65– 85. 11311788
- Sutton RS Barto AG 1998 Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
- Takahashi YK Batchelor HM Liu B Khanna A Morales M Schoenbaum G 2017 Dopamine neurons respond to errors in the prediction of sensory features of expected rewards. Neuron 95(6):1395–405. PMC5658021 28910622
- Tobler PN Christopoulos GI O’Doherty JP Dolan RJ Schultz W 2008 Neuronal distortions of reward probability without choice. J Neurosci 28(45):11703–11. PMC2628536 18987206
- Tobler PN Dickinson A Schultz W 2003 Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J Neurosci 23(32):10402–10. PMC6741002 14614099
- Turner DC Aitken MRF Shanks DR Sahakian BJ Robbins TW Schwarzbauer C, and others. 2004 The role of the lateral frontal cortex in causal associative learning: exploring preventative and super-learning. Cereb Cortex 14(8):872–80. PMC3492746 15054060
- Tversky A Kahneman D 1974 Judgment under uncertainty: Heuristics and biases. Science 185(4157):1124–31. 17835457
- Ungless MA 2004 Dopamine: the salient issue. Trends Neurosci 27(12):702–6. 15541509
- Ungless MA Magill PJ Bolam JP 2004 Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303(5666):2040–2. 15044807
- Valton V Romaniuk L Steele JD Lawrie S Seriès P 2017 Comprehensive review: computational modelling of schizophrenia. Neurosci Biobehav Rev 83:631–46. 28867653
- Wang JX Kurth-Nelson Z Kumaran D Tirumala D Soyer H Leibo JZ, and others. 2018 Prefrontal cortex as a meta-RL system. Nat Neurosci 21(6):860–8. 29760527
- Watabe-Uchida M Eshel N Uchida N 2017 Neural circuitry of reward prediction error. Annu Rev Neurosci 40(1):373–94. PMC6721851 28441114
- White DM Kraguljac NV Reid MA Lahti AC 2015 Contribution of substantia nigra glutamate to prediction error signals in schizophrenia: a combined magnetic resonance spectroscopy/functional imaging study. NPJ Schizophr 1(1): 1– 7. PMC4752128 26878032
- Wise RA 2002 Brain reward circuitry: insights from unsensed incentives. Neuron 36(2):229–40. 12383779
- Yamada H Tymula A Louie K Glimcher PW 2013 Thirst-dependent risk preferences in monkeys identify a primitive form of wealth. Proc Natl Acad Sci U S A 110(39):15788–93. PMC3785724 24019461
Cited by
Sorted by citations
Understanding visual hallucinations: A new synthesis
Collerton, D., Barnes, J., Diederich, N. J., Dudley, R., ffytche, D., Friston, K., Goetz, C. G., Goldman, J. G., Jardri, R., Kulisevsky, J., et al. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105208 · Cited by 83 · see citing works
The empirical status of predictive coding and active inference
Hodson, R., Mehta, M., & Smith, R. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105473 · Cited by 69 · see citing works
Neural Circuitry of Salience and Reward Processing in Psychosis
Kesby, J. P., Murray, G. K., & Knolle, F. (2023) · Biological Psychiatry Global Open Science · doi:10.1016/j.bpsgos.2021.12.003 · Cited by 55 · see citing works
Liraglutide restores impaired associative learning in individuals with obesity
Hanssen, R., Rigoux, L., Kuzmanovic, B., Iglesias, S., Kretschmer, A. C., Schlamann, M., Albus, K., Edwin Thanarajah, S., Sitnikow, T., Melzer, C., et al. (2023) · Nature Metabolism · doi:10.1038/s42255-023-00859-y · Cited by 52 · see citing works
Negative symptoms, striatal dopamine and model-free reward decision-making in schizophrenia
Brandl, F., Knolle, F., Avram, M., Leucht, C., Yakushev, I., Priller, J., Leucht, S., Ziegler, S., Wunderlich, K., & Sorg, C. (2023) · Brain · doi:10.1093/brain/awac268 · Cited by 24 · see citing works
Are prediction error modifications domain specific in autism but domain general in ADHD?
Plank, I. S., Yurova, A., Pior, A., Nowak, J., Bierlich, A. M., Papazov, B., Shi, Z., & Falter-Wagner, C. M. (2025) · Imaging neuroscience · doi:10.1162/imag.a.942 · Cited by 3 · see citing works
“Both neurotransmitters seem to play a vital role in processing prediction errors ( Diederen & Fletcher, 2021).”
- Authors
- Diederen, K. M. J., & Fletcher, P. C.
- Affiliations
- King's College London (GB)
- University of Cambridge (GB)
- Corresponding author
- Diederen, Kelly M. J.
- Venue
- The Neuroscientist
- Publisher
- SAGE Publications
- Published
- 2020-04-26
- Volume
- 27
- Issue
- 1
- Pages
- 30-46
- ISSN
- 1073-8584 (ISSN-L)
- 1089-4098
- PMC
- PMC7804370
- OpenAlex
- W3007026860
- Cited by
- 106
- References
- 36
- Citations by year
- 2026: 14 · 2025: 24 · 2024: 21 · 2023: 20 · 2022: 16 · 2021: 10 · 2020: 1
- FWCI
- 1.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- The Neuroscientist (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (submittedVersion)
- Apollo
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- dopamine, reward prediction error, prediction error coding, reward processing, learning, inference, mental pathology, optimal choice
- MeSH terms
- Animals, Brain, Dopamine, Humans, Learning, Psychotic Disorders, Thinking, Anticipation, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review