Phasic transition from goal‐directed to habitual control over drug‐seeking produced by conflicting reinforcer expectancy
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The transition from goal‐directed to habitual control over drug‐seeking has been experimentally demonstrated in animals, but there have been no comparable reports in humans. Following a recent animal design, the current study employed an outcome‐devaluation procedure to test whether goal‐directed control over tobacco seeking would be abolished by alcohol expectancy. Eighty smokers first learned that two responses earned tobacco or chocolate points, respectively, before tobacco was devalued by health warnings and smoking satiety. Participants were then presented with either a glass of beer/wine or water with instructions that this item could be consumed after the task (alternative reward). Then choice between the tobacco and chocolate response was measured in extinction to assess goal‐directed control of tobacco seeking, in a nominal P avlovian to instrumental transfer (PIT) test to assess stimulus control of tobacco seeking, and in a reacquisition test to assess the impact of direct feedback from the outcomes. The results showed that alcohol expectancy selectively abolished goal‐directed control of tobacco seeking but not stimulus control or the impact of feedback from outcomes. These data suggest that ‘endogenous’ retrieval of low drug value governing goal‐directed regulation of drug seeking is disrupted by conflicting appraisal of an alternative reinforcer, promoting habitual control, which may play a role in relapse.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“Precisely what difference between these protocols promoted goal-directed action versus habit remains unclear, but the position of the response within the instrumental sequence or chain (Balleine et al., 1995; Daw et al., 2005; Dezfouli and Balleine, 2012) or the amount of training (Dickinson et”
Fagerström, K.-O. (1978) · Addictive Behaviors · doi:10.1016/0306-4603(78)90024-2 · Cited by 2,221
Fifty years of the Barratt Impulsiveness Scale: an update and review
Stanford, M. S., Mathias, C. W., Dougherty, D. M., Lake, S. L., Anderson, N. E., & Patton, J. H. (2009) · Personality and Individual Differences · doi:10.1016/j.paid.2009.04.008 · Cited by 1,609 · cited 1×
“…disorders tobacco dependence questionnaire (Grant et al. 2003); the substance misuse scale (Willner 2000); the Barratt impulsivity scale (BIS-11 Stanford et al. 2009); the World Health Organisation alcohol use disorders inventory (AUDIT—Babor et al. 2001); the alcohol use timeline follow-back…”
Cox, L. S., Tiffany, S. T., & Christen, A. G. (2001) · Nicotine & Tobacco Research · doi:10.1080/14622200020032051 · Cited by 1,188
Grant, B. F., Dawson, D. A., Stinson, F. S., Chou, P. S., Kay, W., & Pickering, R. (2003) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(03)00070-x · Cited by 1,110
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · cited 2×
“…& Killcross 2006; Zapata et al. 2010; Corbit et al. 2012), brain lesions prior to training (Corbit & Balleine 2003; Killcross & Coutureau 2003; Yin et al. 2005) and from procedural variables that operate exclusively during training (Balleine et al. 1995; Dickinson et al. 1995; Kosaki &…”
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
Gillan, C. M., Papmeyer, M., Morein-Zamir, S., Sahakian, B. J., Fineberg, N. A., Robbins, T. W., & de Wit, S. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10071062 · Cited by 609 · cited 2×
“Although the discussion thus far as focused on phasic impairments in goal-directed control at test, substantial evidence has shown that a seemingly equivalent impairment can arise from chronic psychiatric or spectrum traits (Klossek, Russell & Dickinson 2008; de Wit et al. 2011; Gillan et al. 2011; Hogarth, Chase & Ba…”
Stress prompts habit behavior in humans
Schwabe, L., & Wolf, O. T. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.0979-09.2009 · Cited by 606 · cited 4×
“…of goal-directed control over action selection in the extinction test has been produced by stress induction prior to instrumental training (Schwabe & Wolf 2009) or prior to the extinction test (Schwabe & Wolf 2010) in humans, by conducting the extinction test in an alcohol paired context…”
InfluentialChoosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529
Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum
Corbit, L. H., Nie, H., & Janak, P. H. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.024 · Cited by 486 · cited 2×
“2011; Hogarth, Chase & Baess 2012b), from chronic drug exposure prior to training (Dickinson et al. 2002; Miles et al. 2003; Nelson & Killcross 2006; Zapata et al. 2010; Corbit et al. 2012), brain lesions prior to training (Corbit & Balleine 2003; Killcross & Coutureau 2003; Yin et al.”
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445
Associative theories of goal-directed behaviour: a case for animal–human translational models
Wit, S., & Dickinson, A. (2009) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-009-0230-6 · Cited by 424
The role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423
Relations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388 · cited 1×
“Moreover, as the PIT effect is not modified by outcome devaluation (Colwill & Rescorla 1990; Rescorla 1994; Holland 2004; Corbit, Janak & Balleine 2007; Hogarth, Dickinson & Duka 2010; Hogarth & Chase 2011; Hogarth 2012), stimuli are thought to retrieve the perceptual identity but not value of the…”
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297 · cited 2×
“…goal-directed action versus habit remains unclear, but the position of the response within the instrumental sequence or chain (Balleine et al. 1995; Daw, Niv & Dayan 2005; Dezfouli & Balleine 2012) or the amount of training (Dickinson et al. 1995; Killcross & Coutureau 2003) may have been relevant.”
Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats
Zapata, A., Minney, V. L., & Shippenberg, T. S. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4072-10.2010 · Cited by 296 · cited 2×
“…Hogarth, Chase & Baess 2012b), from chronic drug exposure prior to training (Dickinson et al. 2002; Miles et al. 2003; Nelson & Killcross 2006; Zapata et al. 2010; Corbit et al. 2012), brain lesions prior to training (Corbit & Balleine 2003; Killcross & Coutureau 2003; Yin et al. 2005) and…”
The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects
FitzGerald, T. H. B., Seymour, B., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0717-09.2009 · Cited by 279
Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions
Tanaka, S. C., Balleine, B. W., & O'Doherty, J. P. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1808-08.2008 · Cited by 268 · cited 1×
“One reconciliation of the collected action-habit literature is to assume that variables which either reduce the perception of the response-outcome contingency during training (Kosaki and Dickinson, 2010; Tanaka et al., 2008) or reduce”
Alcohol seeking by rats: action or habit?
Dickinson, A., Wood, N., & Smith, J. W. (2002) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/0272499024400016 · Cited by 268
Corbit, L. H., Janak, P. H., & Balleine, B. W. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05934.x · Cited by 231
Hogarth, L., & Chase, H. W. (2011) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/a0022913 · Cited by 225
Self-citationde Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1639-09.2009 · Cited by 200
Oral cocaine seeking by rats: Action or habit?
Miles, F. J., Everitt, B. J., & Dickinson, A. (2003) · Behavioral Neuroscience · doi:10.1037/0735-7044.117.5.927 · Cited by 175 · cited 2×
“…2008; de Wit et al. 2011; Gillan et al. 2011; Hogarth, Chase & Baess 2012b), from chronic drug exposure prior to training (Dickinson et al. 2002; Miles et al. 2003; Nelson & Killcross 2006; Zapata et al. 2010; Corbit et al. 2012), brain lesions prior to training (Corbit & Balleine 2003;…”
Impaired goal-directed behavioural control in human impulsivity
Hogarth, L., Chase, H. W., & Baess, K. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2010.518242 · Cited by 129 · cited 2×
“Second, Hogarth et al. (2012a) found that administering alcohol prior to training abolished the devaluation effect on natural reward seeking in extinction but not reacquisition, suggesting a comparability between alcohol intoxication and alcohol expectancy in impairing goal-directed control.”
Self-citationHabitual versus goal-directed action control in Parkinson disease
de Wit, S., Barker, R. A., Dickinson, A. D., & Cools, R. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21514 · Cited by 116 · cited 1×
“…has shown that a seemingly equivalent impairment can arise from chronic psychiatric or spectrum traits (Klossek, Russell & Dickinson 2008; de Wit et al. 2011; Gillan et al. 2011; Hogarth, Chase & Baess 2012b), from chronic drug exposure prior to training (Dickinson et al. 2002; Miles et al.…”
Hogarth, L. (2012) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/a0028914 · Cited by 99 · cited 3×
“…as the PIT effect is not modified by outcome devaluation (Colwill & Rescorla 1990; Rescorla 1994; Holland 2004; Corbit, Janak & Balleine 2007; Hogarth, Dickinson & Duka 2010; Hogarth & Chase 2011; Hogarth 2012), stimuli are thought to retrieve the perceptual identity but not value of the outcome.”
Self-citationStimulus-outcome interactions during instrumental discrimination learning by rats and humans.
de Wit, S., Niry, D., Wariyar, R., Aitken, M. R. F., & Dickinson, A. (2007) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.33.1.1 · Cited by 93 · cited 1×
“R under heavy cognitive demands or conflict (de Wit et al. 2007).”
The orbitofrontal cortex, predicted value and choice
Balleine, B. W., Leung, B. K., & Ostlund, S. B. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06270.x · Cited by 80
Acute alcohol impairs human goal-directed action
Hogarth, L., Attwood, A. S., Bate, H. A., & Munafò, M. R. (2012) · Biological Psychology · doi:10.1016/j.biopsycho.2012.02.016 · Cited by 58 · cited 2×
“Second, Hogarth et al. (2012a) found that administering alcohol prior to training abolished the devaluation effect on natural reward seeking in extinction but not reacquisition, suggesting a comparability between alcohol intoxication and alcohol expectancy in impairing goal-directed control.”
Self-citationConditioned associations and economic decision biases.
Guitart-Masip, M., Talmi, D., & Dolan, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.021 · Cited by 36 · cited 1×
“Third, a number of studies have shown that tasks in which participants must choose between incommensurable rewards (e.g. food vs. shoes: FitzGerald et al., 2009; Guitart-Masip et al., 2010) activate similar frontal cortical”
Cited by
Appetitive Pavlovian-instrumental Transfer: A review
Cartoni, E., Balleine, B., & Baldassarre, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.09.020 · Cited by 317
Hogarth, L. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0600-8 · Cited by 281
Self-citationHabitual versus goal-directed action control in Parkinson disease
de Wit, S., Barker, R. A., Dickinson, A. D., & Cools, R. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21514 · Cited by 116
Sebold, M., Schad, D. J., Nebe, S., Garbusow, M., Jünger, E., Kroemer, N. B., Kathmann, N., Zimmermann, U. S., Smolka, M. N., Rapp, M. A., et al. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00945 · Cited by 41
Metadata
- Authors
- Hogarth, L., Field, M., & Rose, A. K.
- Venue
- Addiction Biology
- Publisher
- Wiley
- Published
- 2012-11-21
- Volume
- 18
- Issue
- 1
- Pages
- 88-97
- ISSN
- 1355-6215 (ISSN-L)
- 1369-1600
- OpenAlex
- W1554178914
- Cited by
- 41
- References
- 33
- FWCI
- 2.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.