Adaptive and aberrant reward prediction signals in the human brain
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Theories of the positive symptoms of schizophrenia hypothesize a role for aberrant reinforcement signaling driven by dysregulated dopamine transmission. Recently, we provided evidence of aberrant reward learning in symptomatic, but not asymptomatic patients with schizophrenia, using a novel paradigm, the Salience Attribution Test (SAT). The SAT is a probabilistic reward learning game that employs cues that vary across task-relevant and task-irrelevant dimensions; it provides behavioral indices of adaptive and aberrant reward learning. As an initial step prior to future clinical studies, here we used functional magnetic resonance imaging to examine the neural basis of adaptive and aberrant reward learning during the SAT in healthy volunteers. As expected, cues associated with high relative to low reward probabilities elicited robust hemodynamic responses in a network of structures previously implicated in motivational salience; the midbrain, in the vicinity of the ventral tegmental area, and regions targeted by its dopaminergic projections, i.e. medial dorsal thalamus, ventral striatum and prefrontal cortex (PFC). Responses in the medial dorsal thalamus and polar PFC were strongly correlated with the degree of adaptive reward learning across participants. Finally, and most importantly, differential dorsolateral PFC and middle temporal gyrus (MTG) responses to cues with identical reward probabilities were very strongly correlated with the degree of aberrant reward learning. Participants who showed greater aberrant learning exhibited greater dorsolateral PFC responses, and reduced MTG responses, to cues erroneously inferred to be less strongly associated with reward. The results are discussed in terms of their implications for different theories of associative learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · cited 2×
“Contrasting these cue features revealed robust responses in a well-characterized circuit innervated by dopaminergic projections as described above, suggesting an important role for the affective cortico-striatal loop in associative learning from predictable cues (Mackintosh, 1975).”
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Recent developments in modeling preferences: Uncertainty and ambiguity
Camerer, C., & Weber, M. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122575 · Cited by 1,795
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
The neuropsychology of schizophrenia
Gray, J. A., Feldon, J., Rawlins, J. N. P., Hemsley, D. R., & Smith, A. D. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065055 · Cited by 1,350
Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Tsai, H.-C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., & Deisseroth, K. (2009) · Science · doi:10.1126/science.1168878 · Cited by 1,266
Regulation of firing of dopaminergic neurons and control of goal-directed behaviors
Grace, A. A., Floresco, S. B., Goto, Y., & Lodge, D. J. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.003 · Cited by 1,034
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
Architectonic subdivision of the human orbital and medial prefrontal cortex
Öngür, D., Ferry, A. T., & Price, J. L. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10609 · Cited by 944
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692
Substantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532
Disrupted prediction-error signal in psychosis: Evidence for an associative account of delusions
Corlett, P. R., Murray, G. K., Honey, G. D., Aitken, M. R. F., Shanks, D. R., Robbins, T. W., Bullmore, E. T., Dickinson, A., & Fletcher, P. C. (2007) · Brain · doi:10.1093/brain/awm173 · Cited by 460
Waltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331
Do patients with schizophrenia exhibit aberrant salience?
Roiser, J. P., Stephan, K. E., den Ouden, H. E. M., Barnes, T. R. E., Friston, K. J., & Joyce, E. M. (2009) · Psychological Medicine · doi:10.1017/s0033291708003863 · Cited by 262
Self-citationMonetary Incentives Enhance Processing in Brain Regions Mediating Top-down Control of Attention
Small, D. M., Gitelman, D., Simmons, K., Bloise, S. M., Parrish, T., & Mesulam, M.-M. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi063 · Cited by 242
The formation of abnormal associations in schizophrenia: Neural and behavioral evidence
Jensen, J., Willeit, M., Zipursky, R. B., Savina, I., Smith, A. J., Menon, M., Crawley, A. P., & Kapur, S. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301437 · Cited by 225 · cited 2×
“Following this initial study in healthy volunteers, it will be important in future work to assess the neural mechanisms underpinning aberrant reward processing in patients with psychosis, since maladaptive reinforcement signaling has been posited as a central mechanism underlying psychotic symptoms (Kapur, 2003; Jense…”
Amphetamine modulates human incentive processing
Knutson, B., Bjork, J. M., Fong, G. W., Hommer, D., Mattay, V. S., & Weinberger, D. R. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.030 · Cited by 174 · cited 6×
“…interested in exploring responses in the ventral striatum and MD thalamus, since these regions have previously been implicated in reward processing (Knutson et al., 2004; Pessiglione et al., 2006) and are innervated by dopamine (Brown et al., 1979; Knutson et al., 2004; Sanchez-Gonzalez et al.,…”
Influential
Cited by
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782
Koutsouleris, N., Kambeitz-Ilankovic, L., Ruhrmann, S., Rosen, M., Ruef, A., Dwyer, D. B., Paolini, M., Chisholm, K., Kambeitz, J., Haidl, T., et al. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.2165 · Cited by 341
Dopaminergic basis of salience dysregulation in psychosis
Winton-Brown, T. T., Fusar-Poli, P., Ungless, M. A., & Howes, O. D. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2013.11.003 · Cited by 231
Neural and Behavioral Correlates of Aberrant Salience in Individuals at Risk for Psychosis
Roiser, J. P., Howes, O. D., Chaddock, C. A., Joyce, E. M., & McGuire, P. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs147 · Cited by 205
Self-citationModulation of motivational salience processing during the early stages of psychosis
Smieskova, R., Roiser, J. P., Chaddock, C. A., Schmidt, A., Harrisberger, F., Bendfeldt, K., Simon, A., Walter, A., Fusar-Poli, P., McGuire, P. K., et al. (2015) · Schizophrenia Research · doi:10.1016/j.schres.2015.04.036 · Cited by 56
“Adaptive and aberrantmotivational saliences have been operationalized using aprobabilistic reward-learning task, the SalienceAttribution Task (SAT) (Roiser et al., 2009).”
BackgroundMethodResultInfluentialSelf-citation
Metadata
- Authors
- Roiser, J. P., Stephan, K. E., den Ouden, H. E. M., Friston, K. J., & Joyce, E. M.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2010-04
- Volume
- 50
- Issue
- 2
- Pages
- 657-664
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2018759523
- Cited by
- 52
- References
- 21
- FWCI
- 1.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.