CoChat
Sign Up
Cited by 317Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorMemory and Neural Mechanisms

Contributions of the striatum to learning, motivation, and performance: an associative account

Open access
Liljeholm, Mimi, O’Doherty, John P.·2012·Trends in Cognitive Sciences
DOI 10.1016/j.tics.2012.07.007PMC PMC3449003
Open this paper in CoChat — free account

Abstract

It has long been recognized that the striatum is composed of distinct functional sub-units that are part of multiple cortico-striatal-thalamic circuits. Contemporary research has focused on the contribution of striatal sub-regions to three main phenomena: learning of associations between stimuli, actions and rewards; selection between competing response alternatives; and motivational modulation of motor behavior. Recent proposals have argued for a functional division of the striatum along these lines, attributing, for example, learning to one region and performance to another. Here, we consider empirical data from human and animal studies, as well as theoretical notions from both the psychological and computational literatures, and conclude that striatal sub-regions instead differ most clearly in terms of the associations being encoded in each region.

AI snapshot

Written from the paper’s full text.

TL;DR

This review argues that striatal subregions are best distinguished by the type of associative content they encode, not by a simple learning-versus-performance or motivation-versus-performance division. It proposes that ventral striatum supports Pavlovian associations, dorsomedial striatum supports goal-directed instrumental associations, and dorsolateral striatum supports habitual stimulus–response associations.

Key findings

  • The paper concludes that ventral and dorsal striatum are both implicated in learning and performance, so functional divisions along learning vs. performance lines are unlikely; instead, striatal regions support dissociable associative learning strategies.
  • Ventral striatum is linked to Pavlovian associations, including conditioned skeletomotor responses and modulatory influences on instrumental performance such as general and specific Pavlovian-instrumental transfer.
  • Within dorsal striatum, dorsomedial striatum is associated with goal-directed instrumental actions, whereas dorsolateral striatum is associated with habitual stimulus–response associations.
  • The review notes unresolved issues, including whether Pavlovian signals in ventral striatum are model-free, model-based, or both, and inconsistent findings on ventral striatal responses in aversive contexts.

Methods

  • Narrative review synthesizing empirical data from human and animal studies plus theoretical notions from psychological and computational literatures.
  • Main analysis contrasts accounts that delineate striatal subregions by learning, performance, or motivation with an associative account emphasizing the content and nature of associative encoding.
  • No original quantitative results or new empirical data are reported.

Limitations

  • The paper states that very few human studies have empirically assessed the mapping of model-based and model-free reinforcement-learning signals to dorsomedial and dorsolateral striatum.
  • The paper states that the neuroimaging literature is profoundly inconsistent regarding ventral striatal activity in aversive contexts, with some studies reporting increased and others decreased activity.
  • The paper states that much less is understood about how dissociable striatal modules interact with each other and with cortex; it also notes its own discussion is geared toward appetitive learning, partly reflecting a general literature emphasis on reward processing in the striatum.
  • Evident from the text: this is a narrative review without systematic search or meta-analysis, so its conclusions depend on the selected cited literature.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.tics.2012.07.007

Cites

Statistics

Nothing to recompute.

Claims the paper makes

0 of 135 cited sources checked · 0 supported · 0 flagged

  • Premisecitation

    The ventral striatum is connected with limbic structures, including the amygdala, hippocampus, and medial orbitofrontal and anterior cingulate cortices.

    “whereas the ventral striatum is connected with limbic structures, including the amygdala, hippocampus, and medial orbitofrontal and anterior cingulate cortices [1,2].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [1] Lynd-Balta E Haber SN The organization of midbrain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum. Neuroscience 1994 59 625 640 7516506 source

      Not checked in the free run.

    • cites [2] Zahm DS Ventral striatopallidothalamic projection: IV. Relative involvements of neurochemically distinct subterritories in the ventral pallidum and adjacent parts of the rostroventral forebrain. J. Comp. Neurol 1996 364 340 362 8788254 source

      Not checked in the free run.

  • Premisecitation

    The ventral striatum is implicated in Pavlovian learning.

    “Considerable evidence has amassed to implicate the ventral striatum (VS) in Pavlovian learning”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [16] Day JJ Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat. Neurosci 2007 10 1020 1028 17603481 source

      Not checked in the free run.

    • cites [17] Day JJ Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm. Eur. J. Neurosci 2006 23 1341 1351 16553795 source

      Not checked in the free run.

  • Premisecitation

    In humans, activity in the DMS is correlated with computations of action-outcome contingency, a hallmark of goal-directed learning.

    “in humans, activity in the DMS has been found to be correlated with computations of action-outcome contingency, a hallmark of goal-directed learning”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [21] Liljeholm M Neural correlates of instrumental contingency learning: differential effects of action-reward conjunction and disjunction. J. Neurosci 2011 31 2474 2480 21325514 PMC3269757 source

      Not checked in the free run.

    • cites [22] Tanaka SC Calculating consequences: brain systems that encode the causal effects of actions. J. Neurosci 2008 28 6750 6755 18579749 PMC3071565 source

      Not checked in the free run.

    • cites [23] Tricomi E A specific role for posterior dorsolateral striatum in human habit learning. Eur. J. Neurosci 2009 29 2225 2232 19490086 PMC2758609 source

      Not checked in the free run.

  • Premisecitation

    In humans, activity in a region of right posterior DLS tracks the behavioral development of habits.

    “whereas activity in a region of right posterior DLS was found to track the behavioral development of habits”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [21] Liljeholm M Neural correlates of instrumental contingency learning: differential effects of action-reward conjunction and disjunction. J. Neurosci 2011 31 2474 2480 21325514 PMC3269757 source

      Not checked in the free run.

    • cites [22] Tanaka SC Calculating consequences: brain systems that encode the causal effects of actions. J. Neurosci 2008 28 6750 6755 18579749 PMC3071565 source

      Not checked in the free run.

    • cites [23] Tricomi E A specific role for posterior dorsolateral striatum in human habit learning. Eur. J. Neurosci 2009 29 2225 2232 19490086 PMC2758609 source

      Not checked in the free run.

  • Premisecitation

    The dorsomedial region of the striatum (caudate) is connected with frontal and parietal association cortices.

    “In contrast, a dorsomedial region (i.e., caudate) is connected with frontal and parietal association cortices”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [1] Lynd-Balta E Haber SN The organization of midbrain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum. Neuroscience 1994 59 625 640 7516506 source

      Not checked in the free run.

    • cites [2] Zahm DS Ventral striatopallidothalamic projection: IV. Relative involvements of neurochemically distinct subterritories in the ventral pallidum and adjacent parts of the rostroventral forebrain. J. Comp. Neurol 1996 364 340 362 8788254 source

      Not checked in the free run.

  • May combine two claims. 19
  • Classified as probably not a substantial claim. 11

  • May combine two claims.

    Premisecitation

    Amphetamine injection into the Nacc enhances Pavlovian-instrumental transfer without affecting base rates of instrumental responding.

    “amphetamine injection into the Nacc enhances PIT, without affecting base rates of instrumental responding [45].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [45] Wyvell CL Berridge KC Incentive sensitization by previous amphetamine exposure: increased cue-triggered ‘wanting’ for sucrose reward. J. Neurosci 2001 21 7831 7840 11567074 PMC6762900 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The actor/critic model cannot account for the known differences between goal-directed and habitual instrumental actions, and the differential functions of the DMS and DLS.

    “A major limitation of the actor/critic model is that it cannot account for the known differences between goal-directed and habitual instrumental actions, and the differential functions of the DMS and DLS in supporting these mechanisms.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    A large body of research implicates the dorsal striatum in the implementation of already learned instrumental motor behaviors, with dissociations between the DLS and DMS.

    “A large body of research has also implicated the dorsal striatum in the implementation of already learned instrumental motor behaviors, often with dissociations emerging between the DLS and DMS [7–10].”
    Quote in the paperNot a substantial claim0 of 4 sources checked
    • cites [7] Grafton ST Functional mapping of sequence learning in normal humans. Cogn. Neurosci 1995 7 497 510 23961907

      Not checked in the free run.

    • cites [8] Jueptner M Anatomy of motor learning. I. Frontal cortex and attention to action. J. Neurophysiol 1997 77 1313 1324 9084599

      Not checked in the free run.

    • cites [9] Miyachi S Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp. Brain Res 2002 146 122 126 12192586 source

      Not checked in the free run.

    • cites [10] Yin HH Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat. Neurosci 2009 12 333 341 19198605 PMC2774785 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Another human study found evidence for a linear mix of model-based and model-free signals within the same overlapping areas.

    “whereas another study, using a similar design, instead found evidence for a linear mix of model-based and model-free signals within the same overlapping areas [32].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [32] Daw ND Model-based influences on humans’ choices and striatal prediction errors. Neuron 2011 69 1204 1215 21435563 PMC3077926 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Cues indicating reward availability elicit increases in VS activity proportional to the amount of signaled reward, and these signals correlate with performance enhancement for larger compared to smaller rewards.

    “Cues that indicate that a certain amount of reward is available given successful performance of an instrumental action, or even of a complex cognitive task, elicit increases in VS activity proportional to the amount of signaled reward and these signals correlate with the degree of performance enhancement found for larger compared to smaller rewards [12,13].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [12] Pessiglione M How the brain translates money into force: a neuroimaging study of subliminal motivation. Science 2007 316 904 906 17431137 PMC2631941 source

      Not checked in the free run.

    • cites [13] Schmidt L Neural mechanisms underlying motivation of mental versus physical effort. PLoS Biol 2012 10 e1001266 22363208 PMC3283550 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In serial reaction time tasks, the DMS appears active during learning of novel sequences, whereas the DLS is active during performance of well-learned sequences.

    “using a serial reaction time (SRT) task, in which participants respond to a sequence of consecutively presented stimuli, several neuroimaging studies have reported that, whereas the DMS appears to be active during learning of novel sequences, the DLS is active during performance of well-learned sequences [7,8]”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [7] Grafton ST Functional mapping of sequence learning in normal humans. Cogn. Neurosci 1995 7 497 510 23961907

      Not checked in the free run.

    • cites [8] Jueptner M Anatomy of motor learning. I. Frontal cortex and attention to action. J. Neurophysiol 1997 77 1313 1324 9084599

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Both lesions and transient inactivation of the DMS abolish the sensitivity of previously acquired actions to outcome devaluation and contingency degradation.

    “both lesions and transient inactivation of the DMS abolish the sensitivity of previously acquired actions to outcome devaluation and contingency degradation – behavioral assays of goal-directed performance [20].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20] Yin HH The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci 2005 22 513 523 16045504 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Pavlovian-instrumental transfer effects can be general, emerging even when the instrumental action earns a different reward than that signaled by the cue and being attenuated by general motivational shifts from hunger to satiety.

    “PIT effects emerge even when the instrumental action earns a different reward than that signaled by the cue and are attenuated by general motivational shifts from hunger to satiety [42], suggesting that the cue induces a general motivational state (i.e., general PIT).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [42] Corbit LH General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. Eur. J. Neurosci 2007 26 3141 3149 18005062 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Goal-directed instrumental behavior can be accounted for by a model-based type of reinforcement learning.

    “This shortcoming has been addressed by the proposal that goal-directed instrumental behavior can be accounted for by means of a ‘model-based’ type of RL”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [25] Daw ND Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci 2005 8 1704 1711 16286932 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    DMS disruptions impair the expression of goal-directed behavior, suggesting that the DMS plays a critical role during performance.

    “Thus, DMS disruptions impair the expression of goal-directed behavior, suggesting that this structure plays a critical role during performance.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20] Yin HH The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci 2005 22 513 523 16045504 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Findings from rodent lesion and inactivation studies suggest that the Nacc shell and core may mediate specific and general Pavlovian-instrumental transfer, respectively.

    “Findings from rodent lesion and inactivation studies suggest that the Nacc shell and core may mediate specific and general PIT, respectively [41].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [41] Corbit LH Balleine BW The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J. Neurosci 2011 31 11786 11794 21849539 PMC3208020

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Pavlovian conditioned responses, as well as BOLD signals in the VS, show clear sensitivity to outcome-specific devaluation.

    “Pavlovian CRs, as well as BOLD signals in the VS, show clear sensitivity to outcome-specific devaluation [55–57].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [55] Gottfried JA Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 2003 301 1104 1107 12934011 source

      Not checked in the free run.

    • cites [56] Lex B Hauber W The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning. Neurobiol. Learn. Mem 2010 93 283 290 19931626

      Not checked in the free run.

    • cites [57] Singh T Nucleus accumbens core and shell are necessary for reinforcer devaluation effects on pavlovian conditioned responding. Front. Integr. Neurosci 2010 4 126 21088698 PMC2981418

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Both dopaminergic and opioidergic manipulations of the Nacc modulate the firing of VP neurons in response to reward-proximal Pavlovian cues, but only opioid manipulations alter VP firing in response to unconditioned stimuli.

    “although both dopaminergic and opioidergic manipulations of the Nacc modulate the firing of VP neurons in response to (reward proximal) Pavlovian cues, only opioid manipulations alter VP firing in response to unconditioned stimuli”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [44] Smith KS Disentangling pleasure from incentive salience and learning signals in brain reward circuitry. Proc. Natl. Acad. Sci. U.S.A 2011 108 E255 E264 21670308 PMC3131314 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The evidence reviewed implicates the ventral and dorsal striatum (both the DLS and DMS) in the learning as well as the performance of reward-related behaviors.

    “The evidence reviewed here has implicated the ventral and dorsal striatum (both the DLS and DMS) in the learning as well as the performance of reward-related behaviors.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The functional roles of striatal sub-regions can be inferred by comparing lesion, inactivation, and neuroimaging findings across rodents, non-human primates, and humans.

  • May combine two claims.

    Premisecitation

    Human neuroimaging studies have demonstrated involvement of the medial VS in a form of Pavlovian-instrumental transfer that may depend on general motivational processes, and of the ventrolateral striatum in specific Pavlovian-instrumental transfer.

    “More recently, the involvement of the medial VS in a form of PIT that may depend on general motivational processes [46], and of the ventrolateral striatum in specific PIT [47], has been demonstrated in human neuroimaging studies”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [46] Talmi D Human pavlovian-instrumental transfer. J. Neurosci 2008 28 360 368 18184778 PMC2636904

      Not checked in the free run.

    • cites [47] Bray S The neural mechanisms underlying the influence of Pavlovian cues on human decision making. J. Neurosci 2008 28 5861 5866 18509047 PMC6670800

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    The ventral striatum is involved in the encoding of Pavlovian associations, supporting generation of conditioned skeletomotor responses.

    “the ventral striatum is involved in the encoding of Pavlovian associations, supporting generation of conditioned skeletomotor responses”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The functional roles of striatal sub-regions can be inferred by comparing lesion, inactivation, and neuroimaging findings across rodents, non-human primates, and humans.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Some studies have reported that aversive stimuli inhibit DA activity of midbrain neurons, whereas others have found that they elicit phasic DA release in the VS.

    “whereas some studies have reported that aversive stimuli inhibit the DA activity of midbrain neurons (e.g., [67]), others have found that they elicit phasic DA release in the VS (e.g., [68]).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [67] Mirenowicz J Schultz W Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996 379 449 451 8559249 source

      Not checked in the free run.

    • cites [68] Budygin EA Aversive stimulus differentially triggers subsecond dopamine release in reward regions. Neuroscience 2012 201 331 337 22108611 PMC3258373 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).

    Premisecitation

    With extended training, control is transferred to less plastic but considerably faster cortical-cortical projections.

    “with extended training, control is transferred to these less plastic, but considerably faster, cortical-cortical projections [78]”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [78] Ashby FG Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci 2010 14 208 215 20207189 PMC2862890 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Exploratory sampling might be guided by uncertainty about the relationships between actions and rewards.

    “For example, exploratory sampling might be guided by uncertainty about the relationships between actions and rewards [82].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [82] Badre D Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron 2012 73 595 607 22325209 PMC3285405

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).

    Premisecitation

    Reinforcement-learning in the striatum provides a basis for successful Hebbian learning in sensory and premotor cortices.

    “it has been suggested that reinforcement-learning in the striatum provides a basis for successful Hebbian learning in sensory and premotor cortices”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [78] Ashby FG Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci 2010 14 208 215 20207189 PMC2862890 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationcitation

    Ventral striatal responses are strongly contextually dependent.

    “One possible reason for these variable findings might be that ventral striatal responses are strongly contextually dependent.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The functional roles of striatal sub-regions can be inferred by comparing lesion, inactivation, and neuroimaging findings across rodents, non-human primates, and humans.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    In many cases, the basis for exploration of non-optimal response alternatives is likely more principled than that afforded by the soft-max rule.

    “However, in many cases, the basis for exploration of non-optimal response alternatives, permitting discovery of actions that are more rewarding than those sampled thus far, is likely more principled than that afforded by the soft-max rule.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In RL theory, one simple way to implement action selection in either a model-based or model-free learner is to use a soft-max distribution, in which a free parameter controls the degree to which choices are biased towards the highest valued action.

    “In RL theory, one simple way to implement action selection in either a model-based or model-free learner is to use a soft-max distribution [24,25], in which a free parameter controls the degree to which choices are biased towards the highest valued action.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [24] Sutton R Barto A Reinforcement Learning: An Introduction 1998 MIT Press

      Not checked in the free run.

    • cites [25] Daw ND Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci 2005 8 1704 1711 16286932 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Several modified RL algorithms have been proposed that incorporate novel event signaling, either as a surrogate of reward or as a component of the estimated state value.

    “Several modified RL algorithms have been proposed that incorporate novel event signaling, either as a surrogate of reward or as a component of the estimated state value [75].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [75] Kakade S Dayan P Dopamine: generalization and bonuses. Neural Netw 2002 15 549 559 12371511

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Humans, as well as other animals, are capable of learning about the specific features of Pavlovian outcomes, and the VS appears to play a role in such effects.

    “it is clear that humans, as well as other animals, are capable of learning about the specific features of Pavlovian outcomes and that the VS appears to play a role in such effects.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The functional roles of striatal sub-regions can be inferred by comparing lesion, inactivation, and neuroimaging findings across rodents, non-human primates, and humans.

  • May combine two claims.

    Interpretationreasoning

    The striatum as a whole is implicated in learning of both instrumental actions and Pavlovian conditioned responses, in the expression of such learned behaviors, and in controlling the motivation to respond.

    “In this article, we have reviewed evidence implicating the striatum as a whole in a number of distinct processes underlying reinforcement-related motor behavior: in learning of both instrumental actions and Pavlovian conditioned responses, in the expression of such learned behaviors, and in controlling the motivation to respond.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Drift diffusion models have been shown to successfully capture perceptual decision-making, value-based decision-making, and the firing rates of neurons in the lateral intraparietal area of the monkey brain.

    “DDMs have been shown to successfully capture perceptual [84] and value-based [85] decision-making, as well as the firing rates of neurons in the lateral intraparietal area of the monkey brain [84].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [84] Churchland AK Decision-making with multiple alternatives. Nat. Neurosci 2008 11 693 702 18488024 PMC2453226 source

      Not checked in the free run.

    • cites [85] Krajbich I Visual fixations and the computation and comparison of value in simple choice. Nat. Neurosci 2010 13 1292 1298 20835253

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The ventral striatum is more involved in Pavlovian conditioned responses, whereas the dorsal striatum is involved in instrumental action.

    “Specifically, the ventral striatum is more involved in Pavlovian conditioned responses, whereas the dorsal striatum is involved in instrumental action.”
    Quote in the paperNot a substantial claim
28 of 28

  • The paper relies on this without support.

    The functional roles of striatal sub-regions can be inferred by comparing lesion, inactivation, and neuroimaging findings across rodents, non-human primates, and humans.

    “Here, we consider empirical data from human and animal studies, as well as theoretical notions from both the psychological and computational literatures”

  • The paper relies on this without support.

    Deductive reasoning and problem solving have no obvious connection to reward learning.

    “which have no obvious connection to reward learning”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The dorsolateral striatum is more involved in stimulus-response learning and habitual control, the dorsomedial striatum is linked to action-outcome learning and goal-directed action, and ventral striatum to Pavlovian values.

    “For example, the dorsolateral striatum is thought to be more involved in stimulus-response learning and habitual control, the dorsomedial striatum has been linked to action-outcome learning and goal-directed action, and ventral striatum to Pavlovian values (Glascher et al., 2010, Liljeholm and O’Doherty, 2012, Mannella et al., 2013, O’Doherty et al., 2004).”

    From Active Inference, homeostatic regulation and adaptive behavioural control (2015) · cites this paper as Liljeholm and O’Doherty, 2012

  • The striatum is a key neural structure involved in reward-related processing, from recognizing and evaluating rewards to learning from them to predict the best potential reward in the future.

    “The striatum is a key neural structure involved in reward-related processing, from recognizing and evaluating rewards to learning from them as to predict the best potential reward in the future for review see 1, 10, 11.”

    From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [11]

  • Reward-related signals in the striatum are crucial for alerting and motivating an organism to a reward opportunity, associating predictive cues with reward outcomes, and learning through trial and error in order to adapt behavior to attain rewards in the future.

    “Thus, reward-related signals in the striatum appear to be crucial for alerting and motivating an organism to a reward opportunity, associating predictive cues with reward outcomes, and learning through trial and error in order to adapt behavior to attain rewards in the future1, 10, 11.”

    From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [11]

The citation lists haven’t been fetched yet

References 107 · Cited by 317

Authors
Liljeholm, M., & O’Doherty, J. P.
Affiliations
California Institute of Technology (US)
Corresponding author
  • Liljeholm, Mimi
  • O’Doherty, John P.
ORCID
Venue
Trends in Cognitive Sciences
Publisher
Elsevier BV
Published
2012-09
Volume
16
Issue
9
Pages
467-475
ISSN
1364-6613 (ISSN-L)
DOI
10.1016/j.tics.2012.07.007
PMC
PMC3449003
OpenAlex
W2008441351
Semantic Scholar
7bfa5ff0c9c4c443185c7c6bb00c721a495a204d
Cited by
317
References
107
Citations by year
2026: 11 · 2025: 17 · 2024: 22 · 2023: 21 · 2022: 17 · 2021: 33 · 2020: 25 · 2019: 23 · 2018: 25 · 2017: 34 · 2016: 19 · 2015: 30 · 2014: 23 · 2013: 14 · 2012: 2
FWCI
1.75
Type
journal article
Language
en
Open access
Licence
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations
  • Trends in Cognitive Sciences (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
  • CaltechAUTHORS (California Institute of Technology) (submittedVersion)
Funders
National Institute on Drug Abuse (R01DA033077)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords
striatum, associative learning, reward learning, motivation, response selection, functional specialization, computational models of learning, motor behavior
MeSH terms
Animals, Association Learning, Basal Ganglia, Brain Mapping, Corpus Striatum, Humans, Inhibition, Psychological, Motivation, Neural Pathways, Psychomotor Performance, Reward, Functional Neuroimaging

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review