Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
This article reviews research on the behavioral and neural mechanisms of extinction as it is represented in both Pavlovian and instrumental learning. In Pavlovian extinction, repeated presentation of a signal without its reinforcer weakens behavior evoked by the signal; in instrumental extinction, repeated occurrence of a voluntary action without its reinforcer weakens the strength of the action. In either case, contemporary research at both the behavioral and neural levels of analysis has been guided by a set of extinction principles that were first generated by research conducted at the behavioral level. The review discusses these principles and illustrates how they have informed the study of both Pavlovian and instrumental extinction. It shows that behavioral and neurobiological research efforts have been tightly linked and that their results are readily integrated. Pavlovian and instrumental extinction are also controlled by compatible behavioral and neural processes. Since many behavioral effects observed in extinction can be multiply determined, we suggest that the current close connection between behavioral-level and neural-level analyses will need to continue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval
Nader, K., Schafe, G. E., & Le Doux, J. E. (2000) · Nature · doi:10.1038/35021052 · Cited by 2,706
Context, time, and memory retrieval in the interference paradigms of Pavlovian learning
Bouton, M. E. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.1.80 · Cited by 1,896
Self-citationContext and Behavioral Processes in Extinction: Table 1.
Bouton, M. E. (2004) · Learning & Memory · doi:10.1101/lm.78804 · Cited by 1,808
Self-citationContext, ambiguity, and unlearning: sources of relapse after behavioral extinction
Bouton, M. E. (2002) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01546-9 · Cited by 1,662
Self-citationNeural Mechanisms of Extinction Learning and Retrieval
Quirk, G. J., & Mueller, D. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301555 · Cited by 1,645
Optimizing inhibitory learning during exposure therapy
Craske, M. G., Kircanski, K., Zelikowsky, M., Mystkowski, J., Chowdhury, N., & Baker, A. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.10.003 · Cited by 1,607
Preventing the return of fear in humans using reconsolidation update mechanisms
Schiller, D., Monfils, M.-H., Raio, C. M., Johnson, D. C., LeDoux, J. E., & Phelps, E. A. (2010) · Nature · doi:10.1038/nature08637 · Cited by 1,248
Ressler, K. J., Rothbaum, B. O., Tannenbaum, L., Anderson, P., Graap, K., Zimand, E., Hodges, L., & Davis, M. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.11.1136 · Cited by 1,063
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Extinction-Reconsolidation Boundaries: Key to Persistent Attenuation of Fear Memories
Monfils, M.-H., Cowansage, K. K., Klann, E., & LeDoux, J. E. (2009) · Science · doi:10.1126/science.1167975 · Cited by 960
Reinstatement of cocaine-reinforced responding in the rat
de Wit, H., & Stewart, J. (1981) · Psychopharmacology · doi:10.1007/bf00432175 · Cited by 928
Behavioral and Neural Analysis of Extinction
Myers, K. M., & Davis, M. (2002) · Neuron · doi:10.1016/s0896-6273(02)01064-4 · Cited by 918
The circuitry mediating cocaine-induced reinstatement of drug-seeking behavior
McFarland, K., & Kalivas, P. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-21-08655.2001 · Cited by 905
Misanin, J. R., Miller, R. R., & Lewis, D. J. (1968) · Science · doi:10.1126/science.160.3827.554 · Cited by 872
Beyond extinction: erasing human fear responses and preventing the return of fear
Kindt, M., Soeter, M., & Vervliet, B. (2009) · Nature Neuroscience · doi:10.1038/nn.2271 · Cited by 826
Walker, D. L., Ressler, K. J., Lu, K.-T., & Davis, M. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-06-02343.2002 · Cited by 815
A single standard for memory: The case for reconsolidation
Nader, K., & Hardt, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2590 · Cited by 811
Nader, K. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)00042-5 · Cited by 763
Extinction circuits for fear and addiction overlap in prefrontal cortex
Peters, J., Kalivas, P. W., & Quirk, G. J. (2009) · Learning & Memory · doi:10.1101/lm.1041309 · Cited by 736
Extinction of fear-potentiated startle: blockade by infusion of an NMDA antagonist into the amygdala
Falls, W., Miserendino, M., & Davis, M. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-03-00854.1992 · Cited by 673 · cited 1×
“(BLA; Falls et al., 1992) are necessary during extinction training, whereas those in the infralimbic area of the medial prefrontal cor-”
BackgroundFlagel, S. B., Akil, H., & Robinson, T. E. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2008.06.027 · Cited by 561
Infralimbic Prefrontal Cortex Is Responsible for Inhibiting Cocaine Seeking in Extinguished Rats
Peters, J., LaLumiere, R. T., & Kalivas, P. W. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1045-08.2008 · Cited by 537
A Memory Retrieval-Extinction Procedure to Prevent Drug Craving and Relapse
Xue, Y.-X., Luo, Y.-X., Wu, P., Shi, H.-S., Xue, L.-F., Chen, C., Zhu, W.-L., Ding, Z.-B., Bao, Y.-P., Shi, J., et al. (2012) · Science · doi:10.1126/science.1215070 · Cited by 511
Reconsolidation and Extinction of Conditioned Fear: Inhibition and Potentiation
Lee, J. L. C., Milton, A. L., & Everitt, B. J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2466-06.2006 · Cited by 479
Hippocampal Inactivation Disrupts Contextual Retrieval of Fear Memory after Extinction
Corcoran, K. A., & Maren, S. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-05-01720.2001 · Cited by 455
Bossert, J. M., Marchant, N. J., Calu, D. J., & Shaham, Y. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3120-y · Cited by 453
Effects of D-cycloserine on extinction of conditioned freezing.
Ledgerwood, L., Richardson, R., & Cranney, J. (2003) · Behavioral Neuroscience · doi:10.1037/0735-7044.117.2.341 · Cited by 388
Santini, E., Muller, R. U., & Quirk, G. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-22-09009.2001 · Cited by 358
A learning theory perspective on lapse, relapse, and the maintenance of behavior change.
Bouton, M. E. (2000) · Health Psychology · doi:10.1037/0278-6133.19.suppl1.57 · Cited by 341
Self-citationOrsini, C. A., Kim, J. H., Knapska, E., & Maren, S. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4095-11.2011 · Cited by 315
Laurent, V., & Westbrook, R. F. (2009) · Learning & Memory · doi:10.1101/lm.1474609 · Cited by 311
Renewal after the extinction of free operant behavior
Bouton, M. E., Todd, T. P., Vurbic, D., & Winterbauer, N. E. (2011) · Learning & Behavior · doi:10.3758/s13420-011-0018-6 · Cited by 281 · cited 1×
“Interestingly, although the other forms of renewal (AAB and ABC) have now been clearly demonstrated with food-reinforced responses (Bouton et al., 2011; Todd, 2013), these forms have yet to be convincingly demonstrated in drug self-administration.”
BackgroundSelf-citationThe persistence of maladaptive memory: Addiction, drug memories and anti-relapse treatments
Milton, A. L., & Everitt, B. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.002 · Cited by 279
Effect of response-independent reinforcers during extinction.
Rescorla, R. A., & Skucy, J. C. (1969) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0026793 · Cited by 266
Disrupting reconsolidation: Pharmacological and behavioral manipulations
Soeter, M., & Kindt, M. (2011) · Learning & Memory · doi:10.1101/lm.2148511 · Cited by 262
Lin, C.-H., Yeh, S.-H., Lu, H.-Y., & Gean, P.-W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-23-08310.2003 · Cited by 251
Efficacy of D-Cycloserine for Enhancing Response to Cognitive-Behavior Therapy for Panic Disorder
Otto, M. W., Tolin, D. F., Simon, N. M., Pearlson, G. D., Basden, S., Meunier, S. A., Hofmann, S. G., Eisenmenger, K., Krystal, J. H., & Pollack, M. H. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.07.036 · Cited by 251
A Role of Ventral Tegmental Area Glutamate in Contextual Cue-Induced Relapse to Heroin Seeking
Bossert, J. M., Liu, S. Y., Lu, L., & Shaham, Y. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3207-04.2004 · Cited by 241 · cited 2×
“have failed to demonstrate AAB renewal (Bossert et al., 2004; Crombag & Shaham, 2002) or ABC renewal (Zironi et al.”
BackgroundReconsolidation in a human fear conditioning study: A test of extinction as updating mechanism
Kindt, M., & Soeter, M. (2013) · Biological Psychology · doi:10.1016/j.biopsycho.2011.09.016 · Cited by 240
Role of inhibition in exposure therapy
Craske, M. G., Liao, B., Brown, L., & Vervliet, B. (2012) · Journal of Experimental Psychopathology · doi:10.5127/jep.026511 · Cited by 237
Quartermain, D., Mower, J., Rafferty, M. F., Herting, R. L., & Lanthorn, T. H. (1994) · European Journal of Pharmacology · doi:10.1016/0014-2999(94)90687-4 · Cited by 190
Still at the Choice‐Point: Action Selection and Initiation in Instrumental Conditioning
BALLEINE, B. W., & OSTLUND, S. B. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.006 · Cited by 184
Soeter, M., & Kindt, M. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.307 · Cited by 150
Smits, J. A. J., Rosenfield, D., Otto, M. W., Powers, M. B., Hofmann, S. G., Telch, M. J., Pollack, M. H., & Tart, C. D. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.12.009 · Cited by 142 · cited 3×
“The generality of these effects across different learning paradigms suggests that DCS may have translational potential when administered alongside extinction-based clinical treatments, and indeed some human studies have shown significant benefits for exposure therapy (e.g., Otto et al., 2010; Ressler et al., 2004; Smi…”
BackgroundResultWoods, A. M., & Bouton, M. E. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.5.1159 · Cited by 133
Self-citationD-cycloserine facilitates context-specific fear extinction learning
Bouton, M. E., Vurbic, D., & Woods, A. M. (2008) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2008.07.003 · Cited by 118 · cited 3×
“above, studies of fear extinction have shown that DCS-treated animals remain vulnerable to renewal, indicating that extinction learning remains context specific (Bouton et al., 2008; Woods & Bouton, 2006).”
BackgroundSelf-citationBehavioural memory reconsolidation of food and fear memories
Flavell, C. R., Barber, D. J., & Lee, J. L. C. (2011) · Nature Communications · doi:10.1038/ncomms1515 · Cited by 104 · cited 1×
“, 2010), they have not been obtained universally (Chan, Leung, Westbrook, & McNally, 2010; Flavell et al., 2011; Ishii et al., 2012; Kindt & Soeter, 2013; Soeter & Kindt, 2011).”
BackgroundHoltzman-Assif, O., Laurent, V., & Westbrook, R. F. (2010) · Learning & Memory · doi:10.1101/lm.1668310 · Cited by 96
Effects of D-cycloserine on extinction of learned fear to an olfactory cue
Weber, M., Hart, J., & Richardson, R. (2007) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2006.12.010 · Cited by 83
Todd, T. P., Winterbauer, N. E., & Bouton, M. E. (2012) · Appetite · doi:10.1016/j.appet.2011.12.006 · Cited by 60
Self-citationThompson, L. T., & Disterhoft, J. F. (1997) · Behavioral Neuroscience · doi:10.1037/0735-7044.111.6.1303 · Cited by 57
Kamboj, S. K., Joye, A., Das, R. K., Gibson, A. J. W., Morgan, C. J. A., & Curran, H. V. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2571-2 · Cited by 44
Winterbauer, N. E., & Bouton, M. E. (2011) · Learning and Motivation · doi:10.1016/j.lmot.2011.01.002 · Cited by 35
Self-citationBaker, A. G. (1990) · Animal Learning & Behavior · doi:10.3758/bf03205240 · Cited by 27
Weerts, E. M., Kaminski, B. J., & Griffiths, R. R. (1998) · Psychopharmacology · doi:10.1007/s002130050487 · Cited by 15
Cited by
Going and stopping: dichotomies in behavioral control by the prefrontal cortex
Gourley, S. L., & Taylor, J. R. (2016) · Nature Neuroscience · doi:10.1038/nn.4275 · Cited by 195
“This process is thought to reflect new learning rather than memory erasure 8,27 .”
BackgroundLipids in Psychiatric Disorders and Preventive Medicine
Schneider, M., Levant, B., Reichel, M., Gulbins, E., Kornhuber, J., & Müller, C. P. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.002 · Cited by 175
A fundamental role for context in instrumental learning and extinction
Bouton, M. E., & Todd, T. P. (2014) · Behavioural Processes · doi:10.1016/j.beproc.2014.02.012 · Cited by 152
Self-citationSchaumberg, K., Reilly, E. E., Gorrell, S., Levinson, C. A., Farrell, N. R., Brown, T. A., Smith, K. M., Schaefer, L. M., Essayli, J. H., Haynos, A. F., et al. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101952 · Cited by 121
“Recent research in ADs has proposed that identification of biological mechanisms of psychological treatments may result in enhanced intervention efficacy (McNally, 2007; Todd et al., 2014); in a parallel manner, increased understanding of the extent to which biological mechanisms in EDs overlap with those in ADs may f…”
BackgroundDymond, S. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.01.007 · Cited by 79
Metadata
- Authors
- Todd, T. P., Vurbic, D., & Bouton, M. E.
- Venue
- Neurobiology of Learning and Memory
- Publisher
- Elsevier BV
- Published
- 2014-02
- Volume
- 108
- Pages
- 52-64
- ISSN
- 1074-7427 (ISSN-L)
- OpenAlex
- W1983680712
- Cited by
- 131
- References
- 57
- FWCI
- 7.41
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.