The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Open accessAbstract
Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“This quantity is operationalised within computational models of learning as 'prediction error' (PE) (see Supplemental Information box 1) (2, 4-6) and is dopamine-dependent in humans (7).”
From Aberrant Salience, Information Processing, and Dopaminergic Signaling in People at Clinical High Risk for Psychosis (2020) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“First, the signed prediction error indicates whether an outcome is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions [14–21].”
From Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis (2021) · cites this paper as [19]
The cited source says what the claim attributes to it.
In the citing paper
“Functional imaging studies on humans support this model (O’Doherty et al., 2003, 2006; Pessiglione et al., 2006).”
From Top-Down Dysregulation—From ADHD to Emotional Instability (2016) · cites this paper as Pessiglione et al., 2006
In the citing paper
“Studies in healthy human volunteers have shown dopaminergic modulation of the brain response to a reward prediction error response using fMRI (Bernacer et al. 2013; Eisenegger et al. 2014; Pessiglione et al. 2006).”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pessiglione et al. 2006
In the citing paper
“Nevertheless, previous studies have shown that both drugs can exert bidirectional effects on reward prediction error–associated responses.”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pessiglione et al. 2006
In the citing paper
“Furthermore, dopamine agonist–like medications have also been shown to be capable of enhancing (Pessiglione et al. 2006) or attenuating (Bernacer et al. 2013) reward prediction error–associated responses, with the directionality of the effect being dependent on the particular task, agonist, and dose employed.”
From Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder (2019) · cites this paper as Pessiglione et al. 2006
In the citing paper
“Additionally, we hypothesized the anterior insular activity to be altered, because this region is crucially involved in RPE processing (Pessiglione et al., 2006; Seymour et al., 2004; Voon et al., 2010; Wittmann et al., 2008)”
From Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development (2015) · cites this paper as Pessiglione et al., 2006
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Self-citationBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Zhang, B., Li, C., & Lin, N. (2020) · De Gruyter eBooks · doi:10.1515/9783110595567-011 · Cited by 1,948
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304
Research works printed but not linked: 1
- Cook, L., Morris, R. W. & Mattis, P. A. Neuropharmacological and behavioral effects of chlorpromazine (thorazine hydrochloride). J. Pharmacol. Exp. Ther. 113, 11–12 (1955)
Cited by
Sorted by citations
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779
Self-citationPerceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia
Fletcher, P. C., & Frith, C. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2536 · Cited by 1,462
Self-citationAn opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381
Affective neuroscience of pleasure: reward in humans and animals
Berridge, K. C., & Kringelbach, M. L. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1099-6 · Cited by 1,254
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Human volition: towards a neuroscience of will
Haggard, P. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2497 · Cited by 1,134
Dysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring
Stephan, K. E., Friston, K. J., & Frith, C. D. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn176 · Cited by 1,134
Self-citationAn Interoceptive Predictive Coding Model of Conscious Presence
Seth, A. K., Suzuki, K., & Critchley, H. D. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00395 · Cited by 950
“More recently, Pessiglione et al. (2006) found that reward prediction errors in humans are modulated by dopamine levels.”
BackgroundInfluentialThe Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
Common genetic variants influence human subcortical brain structures
Initiative, T. A. D. N., Hibar, D. P., The CHARGE Consortium, EPIGEN, IMAGEN, SYS, Stein, J. L., Renteria, M. E., Arias-Vasquez, A., Desrivières, S., et al. (2015) · Nature · doi:10.1038/nature14101 · Cited by 858
Processing of Social and Monetary Rewards in the Human Striatum
Izuma, K., Saito, D. N., & Sadato, N. (2008) · Neuron · doi:10.1016/j.neuron.2008.03.020 · Cited by 855
Predictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
The neurobiology of rewards and values in social decision making
Ruff, C. C., & Fehr, E. (2014) · Nature reviews. Neuroscience · doi:10.1038/nrn3776 · Cited by 716
From prediction error to incentive salience: mesolimbic computation of reward motivation.
Berridge, K. C. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.07990.x · Cited by 700
How the Brain Translates Money into Force: A Neuroimaging Study of Subliminal Motivation
Pessiglione, M., Schmidt, L., Draganski, B., Kalisch, R., Lau, H., Dolan, R. J., & Frith, C. D. (2007) · Science · doi:10.1126/science.1140459 · Cited by 634
Self-citationNeurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Dopamine reward prediction error coding
Schultz, W. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/wschultz · Cited by 597
Spatial Cognition and the Brain
Burgess, N. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.002 · Cited by 614
Effort-Based Cost–Benefit Valuation and the Human Brain
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. J., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4515-08.2009 · Cited by 560
Ashok, A. H., Marques, T. R., Jauhar, S., Nour, M. M., Goodwin, G. M., Young, A. H., & Howes, O. D. (2017) · Molecular Psychiatry · doi:10.1038/mp.2017.16 · Cited by 546
How prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512
Substantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., Seidenbecher, C. I., Coenen, H. H., Heinze, H.-J., Zilles, K., et al. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-08.2008 · Cited by 496
Reinforcement learning and episodic memory in humans and animals: an integrative framework
Gershman, S. J., & Daw, N. D. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033625 · Cited by 446
Expected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485
Serotonin and dopamine: unifying affective, activational, and decision functions.
Cools, R., Nakamura, K., & Daw, N. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.121 · Cited by 464
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
A computational and neural model of momentary subjective well-being
Rutledge, R. B., Skandali, N., Dayan, P., & Dolan, R. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1407535111 · Cited by 444
Self-citationToward a neurobiology of delusions
Corlett, P. R., Taylor, J. R., Wang, X.-J., Fletcher, P. C., & Krystal, J. H. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.06.007 · Cited by 394
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Mood as representation of momentum
Eldar, E., Rutledge, R. B., Dolan, R. J., & Niv, Y. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.010 · Cited by 383
Medication-Related Impulse Control and Repetitive Behaviors in Parkinson Disease
Voon, V., & Fox, S. H. (2007) · Archives of Neurology · doi:10.1001/archneur.64.8.1089 · Cited by 397
Dopaminergic mechanisms of individual differences in human effort-based decision-making
Treadway, M. T., Buckholtz, J. W., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., Baldwin, R. M., Schwartzman, A. N., Kessler, R. M., & Zald, D. H. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6459-11.2012 · Cited by 385
Abnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374
Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E. M., & Stephan, K. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.009 · Cited by 342
Serotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381
How social learning amplifies moral outrage expression in online social networks
Brady, W. J., McLoughlin, K., Doan, T. N., & Crockett, M. J. (2021) · Science Advances · doi:10.1126/sciadv.abe5641 · Cited by 375
Social and monetary reward learning engage overlapping neural substrates
Lin, A., Adolphs, R., & Rangel, A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr006 · Cited by 351
A computational framework for the study of confidence in humans and animals
Kepecs, A., & Mainen, Z. F. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0037 · Cited by 305
How the Opinion of Others Affects Our Valuation of Objects
Campbell-Meiklejohn, D. K., Bach, D. R., Roepstorff, A., Dolan, R. J., & Frith, C. D. (2010) · Current Biology · doi:10.1016/j.cub.2010.04.055 · Cited by 339
Self-citationThe role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328
A Dual Role for Prediction Error in Associative Learning
den Ouden, H. E. M., Friston, K. J., Daw, N. D., McIntosh, A. R., & Stephan, K. E. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn161 · Cited by 306
Reward, Addiction, and Emotion Regulation Systems Associated With Rejection in Love
Fisher, H. E., Brown, L. L., Aron, A., Strong, G., & Mashek, D. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00784.2009 · Cited by 328
Striatal Prediction Error Modulates Cortical Coupling
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304
Subliminal Instrumental Conditioning Demonstrated in the Human Brain
Pessiglione, M., Petrovic, P., Daunizeau, J., Palminteri, S., Dolan, R. J., & Frith, C. D. (2008) · Neuron · doi:10.1016/j.neuron.2008.07.005 · Cited by 308
Self-citationNeural mechanisms underlying motivation of mental versus physical effort
Schmidt, L., Lebreton, M., Cléry-Melin, M.-L., Daunizeau, J., & Pessiglione, M. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001266 · Cited by 310
Self-citationJocham, G., Klein, T. A., & Ullsperger, M. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3904-10.2011 · Cited by 278
van den Bos, W., Cohen, M. X., Kahnt, T., & Crone, E. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr198 · Cited by 276
Dopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294
Self-citationInteroception and drug addiction
Paulus, M. P., & Stewart, J. L. (2014) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.07.002 · Cited by 281
Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors
Voon, V., Pessiglione, M., Brezing, C., Gallea, C., Fernandez, H. H., Dolan, R. J., & Hallett, M. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.027 · Cited by 280
Self-citationStriatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277
Self-citationPhillips, M. L., Chase, H. W., Sheline, Y. I., Etkin, A., Almeida, J. R. C., Deckersbach, T., & Trivedi, M. H. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14010076 · Cited by 267
Dopamine modulates novelty seeking behavior during decision making.
Costa, V. D., Tran, V. L., Turchi, J., & Averbeck, B. B. (2014) · Behavioral Neuroscience · doi:10.1037/a0037128 · Cited by 263
Testing the Reward Prediction Error Hypothesis with an Axiomatic Model
Rutledge, R. B., Dean, M., Caplin, A., & Glimcher, P. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1747-10.2010 · Cited by 244
Düzel, E., Bunzeck, N., Guitart-Masip, M., & Düzel, S. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.08.006 · Cited by 249
Do patients with schizophrenia exhibit aberrant salience?
Roiser, J. P., Stephan, K. E., den Ouden, H. E. M., Barnes, T. R. E., Friston, K. J., & Joyce, E. M. (2009) · Psychological Medicine · doi:10.1017/s0033291708003863 · Cited by 262
Serotonin Selectively Modulates Reward Value in Human Decision-Making
Seymour, B., Daw, N. D., Roiser, J. P., Dayan, P., & Dolan, R. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0053-12.2012 · Cited by 252
Self-citationThe dopaminergic midbrain encodes the expected certainty about desired outcomes
Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., & Friston, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu159 · Cited by 219
Self-citationDopaminergic basis of salience dysregulation in psychosis
Winton-Brown, T. T., Fusar-Poli, P., Ungless, M. A., & Howes, O. D. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2013.11.003 · Cited by 231
Separate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241
Functional imaging of the human dopaminergic midbrain
Düzel, E., Bunzeck, N., Guitart-Masip, M., Wittmann, B., Schott, B. H., & Tobler, P. N. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.02.005 · Cited by 216
Impaired reward prediction error encoding and striatal-midbrain connectivity in depression
Kumar, P., Goer, F., Murray, L., Dillon, D. G., Beltzer, M. L., Cohen, A. L., Brooks, N. H., & Pizzagalli, D. A. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0032-x · Cited by 219
Age-related changes in midbrain dopaminergic regulation of the human reward system
Dreher, J.-C., Meyer-Lindenberg, A., Kohn, P., & Berman, K. F. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802127105 · Cited by 230
Circuit Mechanisms of Sensorimotor Learning
Makino, H., Hwang, E. J., Hedrick, N. G., & Komiyama, T. (2016) · Neuron · doi:10.1016/j.neuron.2016.10.029 · Cited by 228
“…continuously computes the discrepancy between the expected reward and the actual outcome following each executed behavior, and reinforces the weights of active synapses after positive prediction error, while weakening them after negative error (Pessiglione et al., 2006; Sutton and Barto, 1998).”
BackgroundThe formation of abnormal associations in schizophrenia: Neural and behavioral evidence
Jensen, J., Willeit, M., Zipursky, R. B., Savina, I., Smith, A. J., Menon, M., Crawley, A. P., & Kapur, S. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301437 · Cited by 225
Krugel, L. K., Biele, G., Mohr, P. N. C., Li, S.-C., & Heekeren, H. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905191106 · Cited by 229
Pizzagalli, D. A., Evins, A. E., Schetter, E. C., Frank, M. J., Pajtas, P. E., Santesso, D. L., & Culhane, M. (2008) · Psychopharmacology · doi:10.1007/s00213-007-0957-y · Cited by 219
Hauser, T. U., Iannaccone, R., Walitza, S., Brandeis, D., & Brem, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.09.018 · Cited by 203
Neural and Behavioral Correlates of Aberrant Salience in Individuals at Risk for Psychosis
Roiser, J. P., Howes, O. D., Chaddock, C. A., Joyce, E. M., & McGuire, P. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs147 · Cited by 205
Morris, L. S., Kundu, P., Dowell, N., Mechelmans, D. J., Favre, P., Irvine, M. A., Robbins, T. W., Daw, N., Bullmore, E. T., Harrison, N. A., et al. (2016) · Cortex · doi:10.1016/j.cortex.2015.11.004 · Cited by 198
Remember the future II: Meta-analyses and functional overlap of working memory and delay discounting
Wesley, M. J., & Bickel, W. K. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.08.008 · Cited by 205
Association of neural and emotional impacts of reward prediction errors with major depression
Rutledge, R. B., Moutoussis, M., Smittenaar, P., Zeidman, P., Taylor, T., Hrynkiewicz, L., Lam, J., Skandali, N., Siegel, J. Z., Ousdal, O. T., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1713 · Cited by 209
Self-citationReward system activation in schizophrenic patients switched from typical neuroleptics to olanzapine
Schlagenhauf, F., Juckel, G., Koslowski, M., Kahnt, T., Knutson, B., Dembler, T., Kienast, T., Gallinat, J., Wrase, J., & Heinz, A. (2008) · Psychopharmacology · doi:10.1007/s00213-007-1016-4 · Cited by 204
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Computational substrates of norms and their violations during social exchange
Xiang, T., Lohrenz, T., & Montague, P. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1642-12.2013 · Cited by 197
A neurocomputational account of how inflammation enhances sensitivity to punishments versus rewards
Harrison, N. A., Voon, V., Cercignani, M., Cooper, E. A., Pessiglione, M., & Critchley, H. D. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.07.018 · Cited by 185
Self-citationInteroceptive basis to craving
Gray, M. A., & Critchley, H. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.024 · Cited by 189
Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180
Dopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias
Doll, B. B., Hutchison, K. E., & Frank, M. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6486-10.2011 · Cited by 184
Functional dissociation of stimulus intensity encoding and predictive coding of pain in the insula
Geuter, S., Boll, S., Eippert, F., & Büchel, C. (2017) · eLife · doi:10.7554/elife.24770 · Cited by 184
Top-Down Dysregulation—From ADHD to Emotional Instability
Petrovic, P., & Castellanos, F. X. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00070 · Cited by 179
“Functional imaging studies on humans support this model (O’Doherty et al., 2003, 2006; Pessiglione et al., 2006).”
MethodSkvortsova, V., Palminteri, S., & Pessiglione, M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.1350-14.2014 · Cited by 177
Self-citationDifferent neural systems adjust motor behavior in response to reward and punishment
Wrase, J., Kahnt, T., Schlagenhauf, F., Beck, A., Cohen, M. X., Knutson, B., & Heinz, A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.001 · Cited by 172
Hauser, T. U., Iannaccone, R., Ball, J., Mathys, C., Brandeis, D., Walitza, S., & Brem, S. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1093 · Cited by 168
Enhanced habit formation in Gilles de la Tourette syndrome
Delorme, C., Salvador, A., Valabrègue, R., Roze, E., Palminteri, S., Vidailhet, M., de Wit, S., Robbins, T., Hartmann, A., & Worbe, Y. (2016) · Brain · doi:10.1093/brain/awv307 · Cited by 154
Assessing inter individual differences with task related functional neuroimaging
Lebreton, M., Bavard, S., Daunizeau, J., & Palminteri, S. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0681-8 · Cited by 160
Aarts, E., Roelofs, A., Franke, B., Rijpkema, M., Fernández, G., Helmich, R. C., & Cools, R. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.68 · Cited by 157
Brain networks for confidence weighting and hierarchical inference during probabilistic learning
Meyniel, F., & Dehaene, S. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1615773114 · Cited by 138
The Neural Basis of Following Advice
Biele, G., Rieskamp, J., Krugel, L. K., & Heekeren, H. R. (2011) · PLoS Biology · doi:10.1371/journal.pbio.1001089 · Cited by 157
Luciana, M., Wahlstrom, D., Porter, J. N., & Collins, P. F. (2012) · Developmental Psychology · doi:10.1037/a0027432 · Cited by 156
Effects of Direct Social Experience on Trust Decisions and Neural Reward Circuitry
Fareri, D. S., Chang, L. J., & Delgado, M. R. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00148 · Cited by 147
Weeland, J., Overbeek, G., de Castro, B. O., & Matthys, W. (2015) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-015-0196-4 · Cited by 138
Novelty, conditioning and attentional bias to sexual rewards
Banca, P., Morris, L. S., Mitchell, S., Harrison, N. A., Potenza, M. N., & Voon, V. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.10.017 · Cited by 137
Role of Dopamine D2 Receptors in Human Reinforcement Learning
Eisenegger, C., Naef, M., Linssen, A., Clark, L., Gandamaneni, P. K., Müller, U., & Robbins, T. W. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.84 · Cited by 134
Dopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112
Self-citationNeural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P. (2017) · Brain · doi:10.1093/brain/awx025 · Cited by 124
Metadata
- Authors
- Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D.
- Affiliations
- University College London (GB)
- Wellcome Centre for Human Neuroimaging (GB)
- Corresponding author
- Pessiglione, Mathias
- Venue
- Nature
- Published
- 2006-08
- Volume
- 442
- Issue
- 7106
- Pages
- 1042-1045
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- PMC
- PMC2636869
- OpenAlex
- W2046713808
- Cited by
- 1,584
- References
- 39
- Citations by year
- 2026: 42 · 2025: 50 · 2024: 77 · 2023: 86 · 2022: 57 · 2021: 107 · 2020: 149 · 2019: 64 · 2018: 98 · 2017: 100 · 2016: 91 · 2015: 104 · 2014: 80 · 2013: 86 · 2012: 103
- FWCI
- 18.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Max Planck Digital Library (submittedVersion, other-oa)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Funders
- Wellcome Trust (078865)
- Fondation Fyssen
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Clinical Psychology › Gambling Behavior and Treatments
- Keywords
- dopamine, reward prediction error, reward-seeking behavior, operant conditioning, striatum, L-DOPA, haloperidol, decision-making, gambling
- MeSH terms
- Adult, Algorithms, Behavior, Computer Simulation, Computers, Dopamine, Female, Forecasting, Haloperidol, Humans, Learning, Levodopa, Male, Models, Neurological, Punishment, Reward, Dopamine Agents, Neostriatum, Dopamine Antagonists
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
