Differentiating neural systems mediating the acquisition vs. expression of goal‐directed and habitual behavioral control
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Considerable behavioral data indicate that operant actions can become habitual, as demonstrated by insensitivity to changes in the action–outcome contingency and in subjective outcome values. Notably, although several studies have investigated the neural substrates of habits, none has clearly differentiated the areas of the human brain that support habit formation from those that implement habitual control. We scanned participants with functional magnetic resonance imaging as they learned and performed an operant task in which the conditional structure of the environment encouraged either goal‐directed encoding of the consequences of actions, or a habit‐like mapping of actions to antecedent cues. Participants were also scanned during a subsequent assessment of insensitivity to outcome devaluation. We identified dissociable roles of the cerebellum and ventral striatum, across learning and test performance, in behavioral insensitivity to outcome devaluation. We also showed that the inferior parietal lobule (an area previously implicated in several aspects of goal‐directed action selection, including the attribution of intent and awareness of agency) predicted sensitivity to outcome devaluation. Finally, we revealed a potential functional homology between the human subgenual cortex and rodent infralimbic cortex in the implementation of habitual control. In summary, our findings suggested a broad systems division, at the cortical and subcortical levels, between brain areas mediating the encoding and expression of action–outcome and stimulus–response associations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The reorienting system of the human brain: from environment to theory of mind
Corbetta, M., Patel, G., & Shulman, G. L. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.017 · Cited by 3,889 · cited 2×
“The posterior ventral region of the IPL has been proposed to function as a ‘circuit break’ that redirects attention towards behaviorally relevant information that is either exogenously presented (Corbetta & Shulman, 2002; Corbetta et al., 2008; Cabeza et al., 2012) or retrieved into working memory (Cabeza et al.”
Ongur, D. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.206 · Cited by 2,627
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Greicius, M. D., Flores, B. H., Menon, V., Glover, G. H., Solvason, H. B., Kenna, H., Reiss, A. L., & Schatzberg, A. F. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.09.020 · Cited by 2,214
A cortical area selective for visual processing of the human body
Downing, P. E., Jiang, Y., Shuman, M., & Kanwisher, N. (2001) · Science · doi:10.1126/science.1063414 · Cited by 2,043
Neurons in medial prefrontal cortex signal memory for fear extinction
Milad, M. R., & Quirk, G. J. (2002) · Nature · doi:10.1038/nature01138 · Cited by 1,836 · cited 1×
“It should be noted, however, that the rodent infralimbic cortex is primarily known for its involvement in the extinction of Pavlovian responses (Milad & Quirk, 2002; Rhodes & Killcross, 2004, 2007; Santini et al., 2008), whereas the human subgenual cortex has predominantly featured in studies on…”
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Ridderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407 · cited 1×
“…with the adjacent dorsal anterior cingulate, has been implicated in tasks in which the attainment of goals and rewards requires high levels of cognitive control, such as when monitoring for unfavorable outcomes, and during response conflict and decision uncertainty (Ridderinkhof et al., 2004a,b).”
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · cited 3×
“Pre-training lesions of the dorsolateral striatum abolish habit formation (Yin et al., 2004), and distinct changes in neuronal activity patterns (Jog et al.”
The subgenual anterior cingulate cortex in mood disorders
Drevets, W. C., Savitz, J., & Trimble, M. (2008) · CNS Spectrums · doi:10.1017/s1092852900013754 · Cited by 1,109
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076
Self-citationArchitectonic subdivision of the human orbital and medial prefrontal cortex
Öngür, D., Ferry, A. T., & Price, J. L. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10609 · Cited by 944 · cited 6×
“nated areas located ventrally on the medial wall (Gabbott et al., 1997; Ongur & Price, 2000; Ongur et al., 2003).”
InfluentialBuilding neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834
A specific role for posterior dorsolateral striatum in human habit learning
Tricomi, E., Balleine, B. W., & O’Doherty, J. P. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06796.x · Cited by 769 · cited 13×
“Finally, several human neuroimaging studies have implicated a posterior region of the putamen ( 33, 24, 0) in habit formation (Tricomi et al., 2009; de Wit et al., 2012; Wunderlich et al., 2012; Lee et al., 2014), and the ventromedial prefrontal cortex ( 4, 55, 7) in goal-directed processes…”
InfluentialSelf-citationCoordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710
Instrumental Responding following Reinforcer Devaluation
Adams, C. D., & Dickinson, A. (1981) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748108400816 · Cited by 687 · cited 1×
“The persistent execution of an action after its outcome has been devalued is a defining feature of habitual performance (Adams and Dickinson, 1981; Adams, 1982).”
Imaging brain plasticity during motor skill learning
Ungerleider, L. (2002) · Neurobiology of Learning and Memory · doi:10.1006/nlme.2002.4091 · Cited by 641 · cited 2×
“We did, however, find S-R selective decreases in right putamen activity across blocks of training – an effect that is consistent with a substantial literature demonstrating a decreased dependence on the putamen with extended (Ungerleider et al., 2002; Poldrack et al., 2005; Turner et al., 2005; Ashby et al., 2010), as…”
Extrastriate body area in human occipital cortex responds to the performance of motor actions
Astafiev, S. V., Stanley, C. M., Shulman, G. L., & Corbetta, M. (2004) · Nature Neuroscience · doi:10.1038/nn1241 · Cited by 629 · cited 3×
“As the name implies, this region is known for its responses to images of human body parts, and has also been frequently implicated in action observation as well as execution (Astafiev et al., 2004; Kuhn et al., 2011; Liljeholm et al., 2012).”
The Neural Correlates of Motor Skill Automaticity
Poldrack, R. A., Sabb, F. W., Foerde, K., Tom, S. M., Asarnow, R. F., Bookheimer, S. Y., & Knowlton, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3880-04.2005 · Cited by 600 · cited 2×
“…of training, an effect that is consistent with a substantial literature demonstrating a decreased dependence on the putamen with extended (Ungerleider et al., 2002; Poldrack et al., 2005; Turner et al., 2005; Ashby et al., 2010), as well as intermediate (Brovelli et al., 2011), levels of training.”
Johansen-Berg, H., Gutman, D. A., Behrens, T. E. J., Matthews, P. M., Rushworth, M. F. S., Katz, E., Lozano, A. M., & Mayberg, H. S. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm167 · Cited by 561
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529
Self-citationHampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Self-citationCortical and basal ganglia contributions to habit learning and automaticity
Ashby, F. G., Turner, B. O., & Horvitz, J. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.001 · Cited by 481 · cited 2×
“…of training, an effect that is consistent with a substantial literature demonstrating a decreased dependence on the putamen with extended (Ungerleider et al., 2002; Poldrack et al., 2005; Turner et al., 2005; Ashby et al., 2010), as well as intermediate (Brovelli et al., 2011), levels of training.”
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · cited 1×
“…research on humans and rodents has demonstrated that the brain areas mediating habitual performance are dissociable from those supporting more deliberate, goal-directed, action selection (Balleine & Dickinson, 1998; Yin et al., 2004, 2005; Valentin et al., 2007; Tricomi et al., 2009).”
Relations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388
Cognitive contributions of the ventral parietal cortex: an integrative theoretical account
Cabeza, R., Ciaramelli, E., & Moscovitch, M. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.04.008 · Cited by 373 · cited 3×
“, 2012) or retrieved into working memory (Cabeza et al., 2012).”
de Wit, S., Watson, P., Harsay, H. A., Cohen, M. X., van de Vijver, I., & Ridderinkhof, K. R. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.1088-12.2012 · Cited by 373
The effect of the instrumental training contingency on susceptibility to reinforcer devaluation
Dickinson, A., Nicholas, D. J., & Adams, C. D. (1983) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748308400912 · Cited by 338
A dual operator view of habitual behavior reflecting cortical and striatal dynamics
Smith, K. S., & Graybiel, A. M. (2013) · Neuron · doi:10.1016/j.neuron.2013.05.038 · Cited by 324 · cited 3×
“…m.liljeholm@uci.edu Received 3 October 2014, revised 6 March 2015, accepted 12 March 2015 © 2015 Federation of European Neuroscience Societies and John Wiley & Sons Ltd area occur very late in training and closely track the behavioral manifestation of habitual control (Smith & Graybiel, 2013).”
Mapping value based planning and extensively trained choice in the human brain
Wunderlich, K., Dayan, P., & Dolan, R. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3068 · Cited by 310
Corbit, L. H., & Balleine, B. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2711-11.2011 · Cited by 309 · cited 1×
“…and expression of Pavlovian (stimulus–outcome) associations (Day et al., 2007; Blaiss & Janak, 2009), and to mediate the general motivational influence of such associations on instrumental performance, a phenomenon referred to as Pavlovian-instrumental transfer (Corbit & Balleine, 2011).”
Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions
Tanaka, S. C., Balleine, B. W., & O'Doherty, J. P. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1808-08.2008 · Cited by 268 · cited 2×
“…posterior region of the putamen ( 33, 24, 0) in habit formation (Tricomi et al., 2009; de Wit et al., 2012; Wunderlich et al., 2012; Lee et al., 2014), and the ventromedial prefrontal cortex ( 4, 55, 7) in goal-directed processes (Hampton et al., 2006; Tanaka et al., 2008; Liljeholm et al., 2011).”
Self-citationQuantitative Analysis of Attention and Detection Signals During Visual Search
Shulman, G. L., McAvoy, M. P., Cowan, M. C., Astafiev, S. V., Tansy, A. P., d'Avossa, G., & Corbetta, M. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00343.2003 · Cited by 266 · cited 1×
“Importantly, substantial evidence also indicates that the posterior ventral region of the IPL is deactivated when the new information is not relevant to the current task (Shulman et al., 2003).”
Basal Ganglia Circuits for Reward Value–Guided Behavior
Hikosaka, O., Kim, H. F., Yasuda, M., & Yamamoto, S. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071013-013924 · Cited by 259 · cited 2×
“…caudate, this area is specifically involved in encoding stable, non-flexible, values of visual cues (Kim & Hikosaka, 2013; Yamamoto et al., 2013; Hikosaka et al., 2014; Kim et al., 2014), consistent with its role in devaluation insensitivity demonstrated here and elsewhere (Valentin et al.,…”
Characterizing the neural mechanisms of skill learning and repetition priming
Poldrack, R. A., & Gabrieli, J. D. E. (2001) · Brain · doi:10.1093/brain/124.1.67 · Cited by 244
Smith, K. S., Virkud, A., Deisseroth, K., & Graybiel, A. M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1216264109 · Cited by 173 · cited 3×
“In rodents, the infralimbic cortex has been shown to make specialized contributions to executive control processes facilitating the deployment of habits (Coutureau & Killcross, 2003; Haddon & Killcross, 2011; Smith et al., 2012; Smith & Graybiel, 2013).”
Liljeholm, M., Tricomi, E., O'Doherty, J. P., & Balleine, B. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3354-10.2011 · Cited by 130
Self-citationChanges in activity of the striatum during formation of a motor habit
Tang, C., Pawlak, A. P., Prokopenko, V., & West, M. O. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05353.x · Cited by 122
Carelli, R. M., Wolske, M., & West, M. O. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-05-01804.1997 · Cited by 114
Blaiss, C. A., & Janak, P. H. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.024 · Cited by 95 · cited 1×
“The VS has been frequently shown to support both the acquisition and expression of Pavlovian (stimulus–outcome) associations (Day et al., 2007; Blaiss & Janak, 2009), and to mediate the general motivational influence of such associations on instrumental performance, a phenomenon referred to as…”
Turner, R. S., McCairn, K., Simmons, D., & Bar-Gad, I. (2005) · The Basal Ganglia VIII · doi:10.1007/0-387-28066-9_54 · Cited by 9 · cited 2×
“…of training, an effect that is consistent with a substantial literature demonstrating a decreased dependence on the putamen with extended (Ungerleider et al., 2002; Poldrack et al., 2005; Turner et al., 2005; Ashby et al., 2010), as well as intermediate (Brovelli et al., 2011), levels of training.”
Cited by
Wood, W., & Rünger, D. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033417 · Cited by 1,445
Rethinking avoidance: Toward a balanced approach to avoidance in treating anxiety disorders
Hofmann, S. G., & Hay, A. C. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.03.004 · Cited by 303
The role of habit in compulsivity
Gillan, C. M., Robbins, T. W., Sahakian, B. J., van den Heuvel, O. A., & van Wingen, G. (2016) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.12.033 · Cited by 292
Conflicted between goal-directed and habitual control, an fMRI investigation
Watson, P., van Wingen, G., & de Wit, S. (2018) · eneuro · doi:10.1523/eneuro.0240-18.2018 · Cited by 84
“…between responses and outcomes (Tanaka et al., 2008), forcing participants to rely on S-R or R-O strategies during learning (de Wit et al., 2009; Liljeholm et al., 2012, 2015), or using a computational modeling framework to assess the degree to which participants use a flexible model-based…”
Rasgon, A., Lee, W. H., Leibu, E., Laird, A., Glahn, D., Goodman, W., & Frangou, S. (2017) · European Psychiatry · doi:10.1016/j.eurpsy.2017.08.001 · Cited by 73
Metadata
- Authors
- Liljeholm, M., Dunne, S., & O'Doherty, J. P.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2015-04-18
- Volume
- 41
- Issue
- 10
- Pages
- 1358-1371
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W1965553673
- Cited by
- 72
- References
- 42
- FWCI
- 4.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.