The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Contextual control of instrumental actions and habits.
Open accessAbstract
After a relatively small amount of training, instrumental behavior is thought to be an action under the control of the motivational status of its goal or reinforcer. After more extended training, behavior can become habitual and insensitive to changes in reinforcer value. Recently, instrumental responding has been shown to weaken when tested outside of the training context. The present experiments compared the sensitivity of instrumental responding in rats with a context switch after training procedures that might differentially generate actions or habits. In Experiment 1, lever pressing was decremented in a new context after either short, medium, or long periods of training on either random-ratio or yoked random-interval reinforcement schedules. Experiment 2 found that more minimally trained responding was also sensitive to a context switch. Moreover, Experiment 3 showed that when the goal-directed component of responding was removed by devaluing the reinforcer, the residual responding that remained was still sensitive to the change of context. Goal-directed responding, in contrast, transferred across contexts. Experiment 4 then found that after extensive training, a habit that was insensitive to reinforcer devaluation was still decremented by a context switch. Overall, the results suggest that a context switch primarily influences instrumental habit rather than action. In addition, even a response that has received relatively minimal training may have a habit component that is insensitive to reinforcer devaluation but sensitive to the effects of a context switch.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“By contrast, when a behavior is stably rewarded in a specific context, this contextual stability has been proposed to facilitate execution of a habitual behavior, possibly through serving the contextual information as a promoter8,14,53.”
From Dissociable roles of prefrontal plasticity in decision-making strategy and execution of habitual behavior (2026) · cites this paper as [53]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775
Habits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · cited 6×
“2000; see Rosas, Todd, & Bouton, 2013, for a recent review), an instrumental response trained in one context is weaker when it tested in a different context. For example, in studies of the renewal of instrumental responding after extinction, Bouton, Todd, Vurbic, and Winterbauer (2011) found that responding was weaker…”
BackgroundResultInfluentialGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Neurocognitive endophenotypes of impulsivity and compulsivity: Towards dimensional psychiatry
Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., & Ersche, K. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.009 · Cited by 1,003
Latent inhibition: The effect of nonreinforced pre-exposure to the conditional stimulus.
Lubow, R. E., & Moore, A. U. (1959) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0046700 · Cited by 806
Bouton, M. E., & King, D. A. (1983) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.9.3.248 · Cited by 796
Self-citationCoordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
Instrumental Responding following Reinforcer Devaluation
Adams, C. D., & Dickinson, A. (1981) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748108400816 · Cited by 687
Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation
Adams, C. D. (1982) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748208400878 · Cited by 635
Gillan, C. M., Papmeyer, M., Morein-Zamir, S., Sahakian, B. J., Fineberg, N. A., Robbins, T. W., & de Wit, S. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10071062 · Cited by 609 · cited 1×
“…proven useful when applied to a range of psychological problems, including drug addiction (Everitt & Robbins, 2005; Hogarth, Balleine, Corbit, & Killcross, 2013), schizophrenia (Graybiel, 2008), and obsessive–compulsive disorder (Gillan et al., 2011; Robbins, Gillan, Smith, de Wit, & Ersche, 2012).”
BackgroundSteiger, J. H. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.164 · Cited by 592
Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum
Corbit, L. H., Nie, H., & Janak, P. H. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.02.024 · Cited by 486
Associative theories of goal-directed behaviour: a case for animal–human translational models
Wit, S., & Dickinson, A. (2009) · Psychological Research Psychologische Forschung · doi:10.1007/s00426-009-0230-6 · Cited by 424
Coutureau, E., & Killcross, S. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.025 · Cited by 342
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297
Renewal after the extinction of free operant behavior
Bouton, M. E., Todd, T. P., Vurbic, D., & Winterbauer, N. E. (2011) · Learning & Behavior · doi:10.3758/s13420-011-0018-6 · Cited by 281
Self-citationCalculating Consequences: Brain Systems That Encode the Causal Effects of Actions
Tanaka, S. C., Balleine, B. W., & O'Doherty, J. P. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1808-08.2008 · Cited by 268
Dezfouli, A., & Balleine, B. W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003364 · Cited by 239
Associative learning mechanisms underpinning the transition from recreational drug use to addiction
Hogarth, L., Balleine, B. W., Corbit, L. H., & Killcross, S. (2012) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2012.06768.x · Cited by 219
Associative learning and animal cognition
Dickinson, A. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0220 · Cited by 219
Contextual control over conditioned responding in an extinction paradigm.
Harris, J. A., Jones, M. L., Bailey, G. K., & Westbrook, R. F. (2000) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.26.2.174 · Cited by 210
Effect of reinforcer devaluation on discriminative control of instrumental behavior.
Colwill, R. M., & Rescorla, R. A. (1990) · PubMed · Cited by 163
Mechanisms of renewal after the extinction of instrumental behavior.
Todd, T. P. (2013) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0032236 · Cited by 125
Context change and associative learning
Rosas, J. M., Todd, T. P., & Bouton, M. E. (2013) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1225 · Cited by 110
Self-citationOmission Learning after Instrumental Pretraining
Dickinson, A. (2010) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/713932679 · Cited by 88
Brackney, R. J., Cheung, T. H. C., Neisewander, J. L., & Sanabria, F. (2011) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.2011.96-17 · Cited by 77
Trask, S., & Bouton, M. E. (2014) · Learning & Behavior · doi:10.3758/s13420-014-0145-y · Cited by 59
Self-citationContextual Control of Discriminated Operant Behavior
Bouton, M., Todd, T. P., & León, S. P. (2014) · Journal of Experimental Psychology: Animal Learning and Cognition · doi:10.1037/xan0000002 · Cited by 56
Self-citationReed, P. (2010) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0019387 · Cited by 32
Actions and Habits: Variations in Associative Representations During Instrumental Learning
Adams, C., & Dickinson, A. (2014) · doi:10.4324/9781315798820-10 · Cited by 21
Research works printed but not linked: 9
- Colwill RM 1994 Associative representations of instrumental contingencies Medin DL The Psychology of Learning and Motivation 31 1 72 San Diego, California Academic Press
- Colwill RM Rescorla RA 1985a Postconditioning devaluation of a reinforcer affects instrumental responding Journal of Experimental Psychology: Animal Behavior Processes 11 120 132 2303793
- Colwill RM Rescorla RA 1985b Instrumental responding remains sensitive to reinforcer devaluation after extensive training Journal of Experimental Psychology: Animal Behavior Processes 11 520 536 2303793
- Dickinson A 1985 Actions and habits: The development of behavioral autonomy Philosophical Transactions of the Royal Society of London Series B, Biological Sciences 308 67 78
- Dickinson A 1994 Instrumental conditioning Mackintosh NJ Animal Learning and Cognition Handbook of Perception and Cognition Series 2nd 45 79 San Diego, CA Academic Press
- Dickinson A 2011 Goal-directed behavior and future planning in animals Menzel R Fischer J Animal Thinking: Contemporary issues in Comparative Cognition 79 91 Cambridge, MA MIT Press
- Dickinson A Balleine BW 2002 The role of learning in the operation of motivational systems Pashler H Gallistel R Steven' Handbook of Experimental Psychology Vol 3: Learning, Motivation, and Emotion 497 534 New York, NY Wiley
- Dickinson A Nicholas DJ Adams CD 1983 The effect of instrumental training contingency on susceptibility to reinforcer devaluation Quarterly Journal of Experimental Psychology Section B: Comparative and Physiological Psychology 35 35 51
- Rescorla RA 1982 Comments on a technique for assessing associative learning Commons ML Herrnstein RJ Wagner AR Quantitative Analysis of Behavior: Acquisition 3 41 61 Cambridge, MA Ballinger
Cited by
Sorted by citations
Wood, W., & Rünger, D. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033417 · Cited by 1,445
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., O⿿Doherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Behavioral and neurobiological mechanisms of pavlovian and instrumental extinction learning
Bouton, M. E., Maren, S., & McNally, G. P. (2020) · Physiological Reviews · doi:10.1152/physrev.00016.2020 · Cited by 440
Self-citationNisa, C. F., Bélanger, J. J., Schumpe, B. M., & Faller, D. G. (2019) · Nature Communications · doi:10.1038/s41467-019-12457-2 · Cited by 349
Why behavior change is difficult to sustain
Bouton, M. E. (2014) · Preventive Medicine · doi:10.1016/j.ypmed.2014.06.010 · Cited by 322
Self-citation
Metadata
- Authors
- Thrailkill, E. A., & Bouton, M. E.
- Affiliations
- University of Vermont (US)
- Venue
- Journal of Experimental Psychology: Animal Learning and Cognition
- Published
- 2015
- Volume
- 41
- Issue
- 1
- Pages
- 69-80
- ISSN
- 2329-8456 (ISSN-L)
- 2329-8464
- PMC
- PMC4339261
- OpenAlex
- W2323515383
- Cited by
- 165
- References
- 34
- Citations by year
- 2026: 8 · 2025: 8 · 2024: 12 · 2023: 30 · 2022: 9 · 2021: 12 · 2020: 27 · 2019: 13 · 2018: 11 · 2017: 15 · 2016: 11 · 2015: 4
- FWCI
- 6.32
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Experimental Psychology Animal Learning and Cognition (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (RO1 DA033123)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- instrumental behavior, habit formation, goal-directed behavior, context switching, reinforcer devaluation, context sensitivity, lever pressing, rats, transfer of learning
- MeSH terms
- Analysis of Variance, Animals, Conditioning, Operant, Extinction, Psychological, Female, Food Deprivation, Habits, Motivation, Reinforcement, Psychology, Time Factors, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
