CoChat
Sign Up
Cited by 118Memory and Neural MechanismsNeurotransmitter Receptor Influence on BehaviorBehavioral and Psychological Studies

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

Open access
Bouton, Mark E.·2019·Psychopharmacology
DOI 10.1007/s00213-018-5076-4PMC PMC6374202
Open this paper in CoChat — free account

Abstract

This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s00213-018-5076-4

Cites

133 of 133 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Extinction weakens instrumental responding but does not erase the original learning; instead it involves context-specific inhibition of the response.

    “We and others have shown that extinction weakens instrumental responding, but does not erase the original learning. Instead, extinction involves a form of context-specific inhibition (rather than unlearning) of the response”

    From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019

  • In the renewal effect, if the context is changed after extinction has been learned, the original response can return.

    “For example, we have performed many studies of the renewal effect: If the context is changed after extinction has been learned, the original response can return.”

    From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019

  • Extinction does not erase what was learned before it, but instead interferes with it.

    “Over the years, our extinction research has documented that extinction does not erase what has been learned before it, but instead interferes with it.”

    From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019

  • The range of cues that can constitute context is arguably very wide, potentially including time, drug states, deprivation and stress states, and other behaviors.

    “It is worth noting that the range of cues that can constitute context is arguably very wide, potentially including time, drug states, deprivation and stress states, and other behaviors among other things (e.g., Bouton, 2019; Bouton et al., 2021a, b).”

    From Context, attention, and the switch between habit and goal-direction in behavior (2021) · cites this paper as Bouton, 2019

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Bouton ME, Winterbauer NE, & Vurbic D (2012). Context and extinction: Mechanisms of relapse in drug self-administration. In Haselgrove M & Hogarth L (Eds.), Clinical applications of learning theory (pp. 103– 133). East Sussex, UK: Psychology Press.
  2. Rescorla RA (1995). Full preservation of a response-outcome association through training with a second outcome. The Quarterly Journal of Experimental Psychology, 48b, 252– 261.

Cited by

Sorted by citations

Related

Authors
Bouton, M. E.
Affiliations
University of Vermont (US)
Corresponding author
Bouton, Mark E.
ORCID
Bouton, Mark E.
Venue
Psychopharmacology
Publisher
Springer Science and Business Media LLC
Published
2018-10-22
Volume
236
Issue
1
Pages
7-19
ISSN
  • 0033-3158 (ISSN-L)
  • 1432-2072
DOI
10.1007/s00213-018-5076-4
PMC
PMC6374202
OpenAlex
W2897986552
Cited by
118
References
131
Citations by year
2026: 14 · 2025: 14 · 2024: 7 · 2023: 14 · 2022: 7 · 2021: 26 · 2020: 23 · 2019: 12 · 2017: 1
FWCI
2.04
Type
journal article
Language
en
Open access
Licence
Locations
  • Psychopharmacology (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
National Institutes of Health (RO1 DA033123)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
  • Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
Keywords
extinction, operant conditioning, retroactive interference, contextual control, contextual cues, punishment, discrimination reversal, differential reinforcement of alternative behavior, habit learning, stress, deprivation, temporal cues
MeSH terms
Animals, Conditioning, Classical, Conditioning, Operant, Cues, Discrimination Learning, Extinction, Psychological, Humans, Reinforcement, Psychology, Reversal Learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review