Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
The goal of the present study was to elucidate the role of the human striatum in learning via reward and punishment during an associative learning task. Previous studies have identified the striatum as a critical component in the neural circuitry of reward-related learning. It remains unclear, however, under what task conditions, and to what extent, the striatum is modulated by punishment during an instrumental learning task. Using high-resolution functional magnetic resonance imaging (fMRI) during a reward- and punishment-based probabilistic associative learning task, we observed activity in the ventral putamen for stimuli learned via reward regardless of whether participants were correct or incorrect (i.e., outcome). In contrast, activity in the dorsal caudate was modulated by trials that received feedback—either correct reward or incorrect punishment trials. We also identified an anterior/posterior dissociation reflecting reward and punishment prediction error estimates. Additionally, differences in patterns of activity that correlated with the amount of training were identified along the anterior/posterior axis of the striatum. We suggest that unique subregions of the striatum—separated along both a dorsal/ventral and anterior/posterior axis— differentially participate in the learning of associations through reward and punishment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551 · cited 2×
“the BOLD signal suggest that it more likely reflects afferent input as well as intrinsic processing within a brain region (Logothetis et al. 2001).”
BackgroundWIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · cited 3×
“An alternative hypothesis for the anatomical separation may reflect modulation of neural activity by different neuromodulators (Daw et al. 2002; Doya 2002; Bromberg-Martin et al. 2010).”
BackgroundAbstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · cited 3×
“…studies have used gambling tasks (Delgado et al. 2000, 2003; Elliott et al. 2000; Breiter et al. 2001; Yacubian et al. 2006; Liu et al. 2007; Tom et al. 2007), Pavlovian conditioning (Büchel et al. 1998; Jensen et al. 2003, 2007; Seymour et al. 2004, 2005, 2007), “oddball” tasks (Tricomi…”
BackgroundMethodDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479 · cited 3×
“We note that the OFC and anterior insula predominately project to the ventral striatum (Chikama et al. 1997; Haber 2003), which potentially accounts for the subtle anatomical separation observed in the Seymour et al. (2007) study.”
BackgroundResultIkemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Reward representations and reward-related learning in the human brain: Insights from neuroimaging
O’Doherty, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.016 · Cited by 1,426 · cited 2×
“While the dorsal striatum has consistently been identified as a region integral to reward learning (O’Doherty 2004), its observation in aversive learning tasks has been less consistent (Büchel et al. 1998; Becerra et al. 2001; Breiter et al. 2001; Seymour et al. 2005, 2007; Yacubian et al. 2006).”
BackgroundResultMultiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · cited 1×
“Evidence suggests that the striatum, along with its dopaminergic projections, is critical for learning from reward (Schultz 2007).”
BackgroundFunctional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378 · cited 7×
“that are excited by both reward and aversive stimuli and their predictors (Matsumoto and Hikosaka 2009).”
BackgroundInfluentialYin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · cited 1×
“To this end, seminal work by Yin et al. (2004, 2005) in rats has demonstrated a functional subdivision between the dorsomedial and dorsolateral striatum during instrumental learning tasks.”
BackgroundModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116 · cited 3×
“…were predetermined (not contingent on the participants’ responses) have consistently observed striatal activity correlated with aversive events (Delgado et al. 2000, 2003; Elliott et al. 2000; Breiter et al. 2001; Tricomi et al. 2004; Yacubian et al. 2006; Liu et al. 2007; Tom et al. 2007).”
BackgroundMethodResultBrain systems mediating aversive conditioning: an event-related fMRI study
Büchel, C., Morris, J., Dolan, R. J., & Friston, K. J. (1998) · Neuron · doi:10.1016/s0896-6273(00)80476-6 · Cited by 951 · cited 3×
“While the dorsal striatum has consistently been identified as a region integral to reward learning (O’Doherty 2004), its observation in aversive learning tasks has been less consistent (Büchel et al. 1998; Becerra et al. 2001; Breiter et al. 2001; Seymour et al. 2005, 2007; Yacubian et al. 2006).”
BackgroundOpponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740 · cited 5×
“To increase our power, we constrained our analyses to the striatum and medial temporal lobe (MTL) based on prior evidence implicating these regions in reward and aversive learning and memory (Elliott et al. 2000; Delgado 2007; Delgado et al. 2008).”
BackgroundMethodInfluentialReward‐Related Responses in the Human Striatum
DELGADO, M. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.002 · Cited by 736
Metalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · cited 2×
“…Breiter et al. 2001; Yacubian et al. 2006; Liu et al. 2007; Tom et al. 2007), Pavlovian conditioning (Büchel et al. 1998; Jensen et al. 2003, 2007; Seymour et al. 2004, 2005, 2007), “oddball” tasks (Tricomi et al. 2004), reversal learning (Klein et al. 2007; Wheeler and Fellows 2008; Kahnt et…”
BackgroundResultYacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., & Büchel, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2915-06.2006 · Cited by 537
Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · cited 4×
“The pattern and location of activity correspond very nicely to an ROI identified by Jensen et al. (2007)”
BackgroundResultInfluentialYin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · cited 2×
“To this end, seminal work by Yin et al. (2004, 2005) in rats has demonstrated a functional subdivision between the dorsomedial and dorsolateral striatum during instrumental learning tasks.”
BackgroundOpponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · cited 3×
“While the dorsal striatum has consistently been identified as a region integral to reward learning (O’Doherty 2004), its observation in aversive learning tasks has been less consistent (Büchel et al. 1998; Becerra et al. 2001; Breiter et al. 2001; Seymour et al. 2005, 2007; Yacubian et al. 2006).”
BackgroundResultDorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations
DELGADO, M. R., LOCKE, H. M., STENGER, V. A., & FIEZ, J. A. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.1.27 · Cited by 431
Differential roles of monkey striatum in learning of sequential hand movement
Miyachi, S., Hikosaka, O., Miyashita, K., Kárádi, Z., & Rand, M. K. (1997) · Experimental Brain Research · doi:10.1007/pl00005669 · Cited by 374 · cited 1×
“Work by Miyachi et al. (1997, 2002) has shown a similar dissociation along the anterior/posterior axis of the striatum in nonhuman primates.”
Miyachi, S., Hikosaka, O., & Lu, X. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1213-7 · Cited by 262 · cited 1×
“Work by Miyachi et al. (1997, 2002) has shown a similar dissociation along the anterior/posterior axis of the striatum in nonhuman primates.”
Lynd-Balta, E., & Haber, S. N. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90182-1 · Cited by 233 · cited 1×
“The former are located in the dorsolateral substantia nigra pars compacta which projects mainly to the dorsal striatum in monkeys and rats (Lynd-Balta and Haber 1994; Ikemoto 2007).”
Background
Cited by
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Guyer, A. E., Benson, B., Choate, V. R., Bar-Haim, Y., Perez-Edgar, K., Jarcho, J. M., Pine, D. S., Ernst, M., Fox, N. A., & Nelson, E. E. (2014) · Development and Psychopathology · doi:10.1017/s0954579413000941 · Cited by 109
Caouette, J. D., & Guyer, A. E. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2013.10.003 · Cited by 108
“The striatum and nucleus accumbens receive dopaminergic inputs from the substantia nigra and ventral tegmental area of the midbrain, respectively, and are involved in associating motivationally salient stimuli, such as rewards and punishments with anticipated outcomes to guide approach or avoidance behavioral response…”
Altered brain response to reward and punishment in adolescents with Anorexia nervosa
Bischoff-Grethe, A., McCurdy, D., Grenesko-Stevens, E., (Zoe) Irvine, L. E., Wagner, A., Wendy Yau, W.-Y., Fennema-Notestine, C., Wierenga, C. E., Fudge, J. L., Delgado, M. R., et al. (2013) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2013.07.004 · Cited by 99
Aversive stimuli and loss in the mesocorticolimbic dopamine system
Brooks, A. M., & Berns, G. S. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.04.001 · Cited by 85
Metadata
- Authors
- Mattfeld, A. T., Gluck, M. A., & Stark, C. E. L.
- Venue
- Learning & Memory
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2011-10-21
- Volume
- 18
- Issue
- 11
- Pages
- 703-711
- ISSN
- 1072-0502 (ISSN-L)
- 1549-5485
- OpenAlex
- W2115557609
- Cited by
- 69
- References
- 30
- Type
- posted content
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.