The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Open accessAbstract
Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This quantity is operationalised within computational models of learning as 'prediction error' (PE) (see Supplemental Information box 1) (2, 4-6) and is dopamine-dependent in humans (7).”
From Aberrant Salience, Information Processing, and Dopaminergic Signaling in People at Clinical High Risk for Psychosis (2020) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“First, the signed prediction error indicates whether an outcome is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions [14–21].”
From Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis (2021) · cites this paper as [19]
The cited source says what the claim attributes to it.
In the citing paper
“Functional imaging studies on humans support this model (O’Doherty et al., 2003, 2006; Pessiglione et al., 2006).”
From Top-Down Dysregulation—From ADHD to Emotional Instability (2016) · cites this paper as Pessiglione et al., 2006
In the citing paper
“Studies in healthy human volunteers have shown dopaminergic modulation of the brain response to a reward prediction error response using fMRI (Bernacer et al. 2013; Eisenegger et al. 2014; Pessiglione et al. 2006).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pessiglione et al. 2006
In the citing paper
“Nevertheless, previous studies have shown that both drugs can exert bidirectional effects on reward prediction error–associated responses.”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pessiglione et al. 2006
In the citing paper
“Furthermore, dopamine agonist–like medications have also been shown to be capable of enhancing (Pessiglione et al. 2006) or attenuating (Bernacer et al. 2013) reward prediction error–associated responses, with the directionality of the effect being dependent on the particular task, agonist, and dose employed.”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pessiglione et al. 2006
In the citing paper
“Additionally, we hypothesized the anterior insular activity to be altered, because this region is crucially involved in RPE processing (Pessiglione et al., 2006; Seymour et al., 2004; Voon et al., 2010; Wittmann et al., 2008)”
From Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development (2015) · cites this paper as Pessiglione et al., 2006
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Self-citationBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Zhang, B., Li, C., & Lin, N. (2020) · De Gruyter eBooks · doi:10.1515/9783110595567-011 · Cited by 1,948
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Research works printed but not linked: 1
- Cook, L., Morris, R. W. & Mattis, P. A. Neuropharmacological and behavioral effects of chlorpromazine (thorazine hydrochloride). J. Pharmacol. Exp. Ther. 113, 11–12 (1955)
Cited by
Sorted by citations
Items 101–157 of 157
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111
Ziegler, S., Pedersen, M. L., Mowinckel, A. M., & Biele, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.002 · Cited by 110
Social rewards and social networks in the human brain
Fareri, D. S., & Delgado, M. R. (2014) · The Neuroscientist · doi:10.1177/1073858414521869 · Cited by 124
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118
Pleger, B., Blankenburg, F., Ruff, C. C., Driver, J., & Dolan, R. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1093-08.2008 · Cited by 120
Self-citationMidbrain activation during pavlovian conditioning and delusional symptoms in schizophrenia
Romaniuk, L., Honey, G. D., King, J. R. L., Whalley, H. C., McIntosh, A. M., Levita, L., Hughes, M., Johnstone, E. C., Day, M., Lawrie, S. M., et al. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.169 · Cited by 113
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114
Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum
Diederen, K. M. J., Ziauddeen, H., Vestergaard, M. D., Spencer, T., Schultz, W., & Fletcher, P. C. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1979-16.2016 · Cited by 110
Howes, O. D., Hird, E. J., Adams, R. A., Corlett, P. R., & McGuire, P. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.03.012 · Cited by 110
Kuepper, R., Morrison, P. D., van Os, J., Murray, R. M., Kenis, G., & Henquet, C. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.05.031 · Cited by 116
The role of dopamine in inflammation-associated depression: mechanisms and therapeutic implications
Felger, J. C. (2016) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2016_13 · Cited by 115
Haarsma, J., Fletcher, P. C., Griffin, J. D., Taverne, H. J., Ziauddeen, H., Spencer, T. J., Miller, C., Katthagen, T., Goodyer, I., Diederen, K. M. J., et al. (2021) · Molecular Psychiatry · doi:10.1038/s41380-020-0803-8 · Cited by 108
“…is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions (Schultz et al., 1997; O’Doherty et al., 2003 & 2004; Pessiglione et al., 2006; D’Ardenne et al., 2008; Diederen et al., 2016 & 2017, Tian et al., 2016).”
Backgroundvan der Schaaf, M. E., van Schouwenburg, M. R., Geurts, D. E. M., Schellekens, A. F. A., Buitelaar, J. K., Verkes, R. J., & Cools, R. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs344 · Cited by 102
Reliance on habits at the expense of goal-directed control following dopamine precursor depletion
de Wit, S., Standing, H. R., DeVito, E. E., Robinson, O. J., Ridderinkhof, K. R., Robbins, T. W., & Sahakian, B. J. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2563-2 · Cited by 105
Contextual novelty changes reward representations in the striatum
Guitart-Masip, M., Bunzeck, N., Stephan, K. E., Dolan, R. J., & Düzel, E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5331-09.2010 · Cited by 104
Self-citationCooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00114 · Cited by 101
Experiential reward learning outweighs instruction prior to adulthood
Decker, J. H., Lourenco, F. S., Doll, B. B., & Hartley, C. A. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0332-5 · Cited by 96
Ermakova, A. O., Knolle, F., Justicia, A., Bullmore, E. T., Jones, P. B., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0056-2 · Cited by 91
Oxytocin decreases aversion to angry faces in an associative learning task
Evans, S., Shergill, S. S., & Averbeck, B. B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.110 · Cited by 97
Palminteri, S., Lebreton, M., Worbe, Y., Hartmann, A., Lehéricy, S., Vidailhet, M., Grabli, D., & Pessiglione, M. (2011) · Brain · doi:10.1093/brain/awr147 · Cited by 90
Self-citationInfluences of dopaminergic system dysfunction on late-life depression
Taylor, W. D., Zald, D. H., Felger, J. C., Christman, S., Claassen, D. O., Horga, G., Miller, J. M., Gifford, K., Rogers, B., Szymkowicz, S. M., et al. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01265-0 · Cited by 89
Harrison, N. A., Cercignani, M., Voon, V., & Critchley, H. D. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2014.222 · Cited by 89
Aversive stimuli and loss in the mesocorticolimbic dopamine system
Brooks, A. M., & Berns, G. S. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.04.001 · Cited by 85
Vinckier, F., Gaillard, R., Palminteri, S., Rigoux, L., Salvador, A., Fornito, A., Adapa, R., Krebs, M. O., Pessiglione, M., & Fletcher, P. C. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.73 · Cited by 87
Self-citationHauser, T. U., Iannaccone, R., Dolan, R. J., Ball, J., Hättenschwiler, J., Drechsler, R., Rufer, M., Brandeis, D., Walitza, S., & Brem, S. (2017) · Psychological Medicine · doi:10.1017/s0033291716003305 · Cited by 86
Self-citationMind matters: placebo enhances reward learning in Parkinson's disease
Schmidt, L., Braun, E. K., Wager, T. D., & Shohamy, D. (2014) · Nature Neuroscience · doi:10.1038/nn.3842 · Cited by 84
Striatal structure and function predict individual biases in learning to avoid pain
Eldar, E., Hauser, T. U., Dayan, P., & Dolan, R. J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1519829113 · Cited by 79
Self-citationBernacer, J., Corlett, P. R., Ramachandra, P., McFarlane, B., Turner, D. C., Clark, L., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12070978 · Cited by 77
Dissociable reward and timing signals in human midbrain and ventral striatum
Klein-Flügge, M. C., Hunt, L. T., Bach, D. R., Dolan, R. J., & Behrens, T. E. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.024 · Cited by 75
Self-citationMarsden, K. E., Ma, W. J., Deci, E. L., Ryan, R. M., & Chiu, P. H. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0324-5 · Cited by 75
Brain structures implicated in inflammation-associated depression
Harrison, N. A. (2016) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2016_30 · Cited by 74
Impaired reward-related learning signals in remitted unmedicated patients with recurrent depression
Geugies, H., Mocking, R. J. T., Figueroa, C. A., Groot, P. F. C., Marsman, J.-B. C., Servaas, M. N., Steele, J. D., Schene, A. H., & Ruhé, H. G. (2019) · Brain · doi:10.1093/brain/awz167 · Cited by 67
Jarcho, J. M., Romer, A. L., Shechner, T., Galvan, A., Guyer, A. E., Leibenluft, E., Pine, D. S., & Nelson, E. E. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.03.002 · Cited by 70
Cholinergic modulation of dopamine pathways through nicotinic acetylcholine receptors
de Kloet, S. F., Mansvelder, H. D., & De Vries, T. J. (2015) · Biochemical Pharmacology · doi:10.1016/j.bcp.2015.07.014 · Cited by 69
Circular inference: mistaken belief, misplaced trust
Denève, S., & Jardri, R. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.04.001 · Cited by 65
Bossaerts, P., & Murawski, C. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.07.001 · Cited by 63
Palminteri, S., Clair, A.-H., Mallet, L., & Pessiglione, M. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.028 · Cited by 60
Self-citationNock, N. L., Minnes, S., & Alberts, J. L. (2017) · Birth Defects Research · doi:10.1002/bdr2.1182 · Cited by 61
Dose-response effects of d-amphetamine on effort-based decision-making and reinforcement learning
Soder, H. E., Cooper, J. A., Lopez-Gamundi, P., Hoots, J. K., Nunez, C., Lawlor, V. M., Lane, S. D., Treadway, M. T., & Wardle, M. C. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-0779-8 · Cited by 61
Parr, A. C., Calabro, F., Larsen, B., Tervo-Clemmens, B., Elliot, S., Foran, W., Olafsson, V., & Luna, B. (2021) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2021.101997 · Cited by 60
Murray, G. K., Knolle, F., Ersche, K. D., Craig, K. J., Abbott, S., Shabbir, S. S., Fineberg, N. A., Suckling, J., Sahakian, B. J., Bullmore, E. T., et al. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05292-2 · Cited by 53
Modulation of motivational salience processing during the early stages of psychosis
Smieskova, R., Roiser, J. P., Chaddock, C. A., Schmidt, A., Harrisberger, F., Bendfeldt, K., Simon, A., Walter, A., Fusar-Poli, P., McGuire, P. K., et al. (2015) · Schizophrenia Research · doi:10.1016/j.schres.2015.04.036 · Cited by 56
Wu, K., Politis, M., & Piccini, P. (2009) · Postgraduate Medical Journal · doi:10.1136/pgmj.2008.075820 · Cited by 55
Morein-Zamir, S., Craig, K. J., Ersche, K. D., Abbott, S., Muller, U., Fineberg, N. A., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2010) · Psychopharmacology · doi:10.1007/s00213-010-1963-z · Cited by 54
General functioning predicts reward and punishment learning in schizophrenia
Somlai, Z., Moustafa, A. A., Kéri, S., Myers, C. E., & Gluck, M. A. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2010.07.028 · Cited by 45
Haloperidol blocks dorsal striatum activity but not analgesia in a placebo paradigm
Wrobel, N., Wiech, K., Forkmann, K., Ritter, C., & Bingel, U. (2014) · Cortex · doi:10.1016/j.cortex.2014.02.023 · Cited by 45
The Effect of Dopamine Agonists on Adaptive and Aberrant Salience in Parkinson's Disease
Nagy, H., Levy-Gigi, E., Somlai, Z., Takáts, A., Bereczki, D., & Kéri, S. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.278 · Cited by 42
A selective emotional decision-making bias elicited by facial expressions
Furl, N., Gallagher, S., & Averbeck, B. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033461 · Cited by 36
Nair, A., Rutledge, R. B., & Mason, L. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00140 · Cited by 37
Conditioned associations and economic decision biases.
Guitart-Masip, M., Talmi, D., & Dolan, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.021 · Cited by 36
Self-citationSethi, A., Voon, V., Critchley, H. D., Cercignani, M., & Harrison, N. A. (2018) · Brain · doi:10.1093/brain/awy048 · Cited by 36
A translational perspective on the anti-anhedonic effect of ketamine and its neural underpinnings
Pulcu, E., Guinea, C., Cowen, P. J., Murphy, S. E., & Harmer, C. J. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01183-1 · Cited by 35
Motivation in the Service of Allostasis: The Role of Anterior Mid-Cingulate Cortex
Touroutoglou, A., Andreano, J. M., Adebayo, M., Lyons, S., & Barrett, L. F. (2019) · Advances in Motivation Science · doi:10.1016/bs.adms.2018.09.002 · Cited by 25
Computational psychopharmacology: a translational and pragmatic approach
Robbins, T. W., & Cardinal, R. N. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05302-3 · Cited by 25
Wolpe, N., Nombela, C., & Rowe, J. B. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01514 · Cited by 18
State-dependent value representation: evidence from the striatum
Burke, C. J., Dreher, J.-C., Seymour, B., & Tobler, P. N. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00193 · Cited by 4
Self-citationAddressing altered anticipation as a transdiagnostic target through computational psychiatry
Sepúlveda, P., Aitsahalia, I., Kumar, K., Atkin, T., & Iigaya, K. (2025) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2025.02.014 · Cited by 3
Metadata
- Authors
- Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D.
- Affiliations
- University College London (GB)
- Wellcome Centre for Human Neuroimaging (GB)
- Corresponding author
- Pessiglione, Mathias
- Venue
- Nature
- Published
- 2006-08
- Volume
- 442
- Issue
- 7106
- Pages
- 1042-1045
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- PMC
- PMC2636869
- OpenAlex
- W2046713808
- Cited by
- 1,584
- References
- 39
- Citations by year
- 2026: 42 · 2025: 50 · 2024: 77 · 2023: 86 · 2022: 57 · 2021: 107 · 2020: 149 · 2019: 64 · 2018: 98 · 2017: 100 · 2016: 91 · 2015: 104 · 2014: 80 · 2013: 86 · 2012: 103
- FWCI
- 18.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Funders
- Wellcome Trust (078865)
- Fondation Fyssen
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Clinical Psychology › Gambling Behavior and Treatments
- Keywords
- dopamine, reward prediction error, reward-seeking behavior, operant conditioning, striatum, L-DOPA, haloperidol, decision-making, gambling
- MeSH terms
- Adult, Algorithms, Behavior, Computer Simulation, Computers, Dopamine, Female, Forecasting, Haloperidol, Humans, Learning, Levodopa, Male, Models, Neurological, Punishment, Reward, Dopamine Agents, Neostriatum, Dopamine Antagonists
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
