Cited by 165Neural and Behavioral Psychology StudiesBehavioral Health and InterventionsMemory and Neural Mechanisms

Contextual control of instrumental actions and habits.

Open access
Thrailkill, Eric A., Bouton, Mark E.·2015·Journal of Experimental Psychology: Animal Learning and Cognition

Abstract

After a relatively small amount of training, instrumental behavior is thought to be an action under the control of the motivational status of its goal or reinforcer. After more extended training, behavior can become habitual and insensitive to changes in reinforcer value. Recently, instrumental responding has been shown to weaken when tested outside of the training context. The present experiments compared the sensitivity of instrumental responding in rats with a context switch after training procedures that might differentially generate actions or habits. In Experiment 1, lever pressing was decremented in a new context after either short, medium, or long periods of training on either random-ratio or yoked random-interval reinforcement schedules. Experiment 2 found that more minimally trained responding was also sensitive to a context switch. Moreover, Experiment 3 showed that when the goal-directed component of responding was removed by devaluing the reinforcer, the residual responding that remained was still sensitive to the change of context. Goal-directed responding, in contrast, transferred across contexts. Experiment 4 then found that after extensive training, a habit that was insensitive to reinforcer devaluation was still decremented by a context switch. Overall, the results suggest that a context switch primarily influences instrumental habit rather than action. In addition, even a response that has received relatively minimal training may have a habit component that is insensitive to reinforcer devaluation but sensitive to the effects of a context switch.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1037/xan0000045

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Contextual stability facilitates execution of a habitual behavior, possibly through serving contextual information as a promoter.

    “By contrast, when a behavior is stably rewarded in a specific context, this contextual stability has been proposed to facilitate execution of a habitual behavior, possibly through serving the contextual information as a promoter8,14,53.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 9

  1. Colwill RM 1994 Associative representations of instrumental contingencies Medin DL The Psychology of Learning and Motivation 31 1 72 San Diego, California Academic Press
  2. Colwill RM Rescorla RA 1985a Postconditioning devaluation of a reinforcer affects instrumental responding Journal of Experimental Psychology: Animal Behavior Processes 11 120 132 2303793
  3. Colwill RM Rescorla RA 1985b Instrumental responding remains sensitive to reinforcer devaluation after extensive training Journal of Experimental Psychology: Animal Behavior Processes 11 520 536 2303793
  4. Dickinson A 1985 Actions and habits: The development of behavioral autonomy Philosophical Transactions of the Royal Society of London Series B, Biological Sciences 308 67 78
  5. Dickinson A 1994 Instrumental conditioning Mackintosh NJ Animal Learning and Cognition Handbook of Perception and Cognition Series 2nd 45 79 San Diego, CA Academic Press
  6. Dickinson A 2011 Goal-directed behavior and future planning in animals Menzel R Fischer J Animal Thinking: Contemporary issues in Comparative Cognition 79 91 Cambridge, MA MIT Press
  7. Dickinson A Balleine BW 2002 The role of learning in the operation of motivational systems Pashler H Gallistel R Steven' Handbook of Experimental Psychology Vol 3: Learning, Motivation, and Emotion 497 534 New York, NY Wiley
  8. Dickinson A Nicholas DJ Adams CD 1983 The effect of instrumental training contingency on susceptibility to reinforcer devaluation Quarterly Journal of Experimental Psychology Section B: Comparative and Physiological Psychology 35 35 51
  9. Rescorla RA 1982 Comments on a technique for assessing associative learning Commons ML Herrnstein RJ Wagner AR Quantitative Analysis of Behavior: Acquisition 3 41 61 Cambridge, MA Ballinger

Cited by

Sorted by citations

Authors
Thrailkill, E. A., & Bouton, M. E.
Affiliations
University of Vermont (US)
Venue
Journal of Experimental Psychology: Animal Learning and Cognition
Published
2015
Volume
41
Issue
1
Pages
69-80
ISSN
  • 2329-8456 (ISSN-L)
  • 2329-8464
OpenAlex
W2323515383
Cited by
165
References
34
Citations by year
2026: 8 · 2025: 8 · 2024: 12 · 2023: 30 · 2022: 9 · 2021: 12 · 2020: 27 · 2019: 13 · 2018: 11 · 2017: 15 · 2016: 11 · 2015: 4 · 2014: 4
FWCI
6.32
Type
journal article
Language
en
Open access
Locations
  • Journal of Experimental Psychology Animal Learning and Cognition (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
National Institute on Drug Abuse (RO1 DA033123)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
  • Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords
instrumental behavior, habit formation, goal-directed behavior, context switching, reinforcer devaluation, context sensitivity, lever pressing, rats, transfer of learning
MeSH terms
Analysis of Variance, Animals, Conditioning, Operant, Extinction, Psychological, Female, Food Deprivation, Habits, Motivation, Reinforcement, Psychology, Time Factors, Rats

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review