Extinction learning, reconsolidation and the internal reinforcement hypothesis

Eisenhardt, Dorothea; Menzel, Randolf

doi:10.1016/j.nlm.2006.09.005

Cited by 89Memory and Neural MechanismsMemory Processes and InfluencesNeurobiology and Insect Physiology Research

Extinction learning, reconsolidation and the internal reinforcement hypothesis

Eisenhardt, Dorothea, Menzel, Randolf·2007·Neurobiology of Learning and Memory

DOI 10.1016/j.nlm.2006.09.005

Open this paper in CoChat — free account

Abstract

Retrieving a consolidated memory--by exposing an animal to the learned stimulus but not to the associated reinforcement--leads to two opposing processes: one that weakens the old memory as a result of extinction learning, and another that strengthens the old, already-consolidated memory as a result of some less well-understood form of learning. This latter process of memory strengthening is often referred to as "reconsolidation", since protein synthesis can inhibit this form of memory formation. Although the behavioral phenomena of the two antagonizing forms of learning are well documented, the mechanisms behind the corresponding processes of memory formation are still quite controversial. Referring to results of extinction/reconsolidation experiments in honeybees, we argue that two opposing learning processes--with their respective consolidation phases and memories--are initiated by retrieval trials: extinction learning and reminder learning, the latter leading to the phenomenon of spontaneous recovery from extinction, a process that can be blocked with protein synthesis inhibition.

Integrity signals

Registry

Crossref · 10.1016/j.nlm.2006.09.005

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

In animal conditioning, pairings of a stimulus with a salient event teach the animal that the stimulus predicts the event; presenting the stimulus without the event produces extinction learning.
“when an animal is exposed to pairings between an environmental stimulus (eg, a tone) and a salient event (eg, an electric shock), it learns that the tone predicts the shock.If the tone is then presented in the absence of shock, extinction learning occurs.”
From Computational psychiatry: a Rosetta Stone linking the brain to mental illness (2014) · cites this paper as [23]
Animal behaviour can be viewed as mediated by competition between prior learning and new experiences.
“The animal's behaviour can be thought of as being mediated by a competition between its previous learning and its new experiences.23”
From Computational psychiatry: a Rosetta Stone linking the brain to mental illness (2014) · cites this paper as [23]

Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval
Nader, K., Schafe, G. E., & Le Doux, J. E. (2000) · Nature · doi:10.1038/35021052 · Cited by 2,706 · see citing works
Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex.
Pavlov, P. I. (1930) · Archives of Neurology And Psychiatry · doi:10.1001/archneurpsyc.1930.02220110256018 · Cited by 2,681 · see citing works
Conditioned Reflexes: an Investigation of the Physiological Activity of the Cerebral Cortex
Denny-Brown, D. E. (1928) · Nature · doi:10.1038/121662a0 · Cited by 1,854 · see citing works
The Neurobiology of Consolidations, Or, How Stable is the Engram?
Dudai, Y. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142050 · Cited by 1,671 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
Time-Dependent Processes in Memory Storage: Recent studies of learning and memory indicate that memory storage involves time-dependent processes.
McGaugh, J. L. (1966) · Science · doi:10.1126/science.153.3742.1351 · Cited by 1,468 · see citing works
Memory Reconsolidation and Extinction Have Distinct Temporal and Biochemical Signatures
Suzuki, A., Josselyn, S. A., Frankland, P. W., Masushige, S., Silva, A. J., & Kida, S. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5491-03.2004 · Cited by 1,127 · see citing works
Retrieval and reconsolidation: Toward a neurobiology of remembering
Sara, S. J. (2000) · Learning & Memory · doi:10.1101/lm.7.2.73 · Cited by 919 · see citing works
Retrograde Amnesia Produced by Electroconvulsive Shock after Reactivation of a Consolidated Memory Trace
Misanin, J. R., Miller, R. R., & Lewis, D. J. (1968) · Science · doi:10.1126/science.160.3827.554 · Cited by 872 · see citing works
Memory traces unbound
Nader, K. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)00042-5 · Cited by 763 · see citing works
Cellular and Systems Reconsolidation in the Hippocampus
Dębiec, J., LeDoux, J. E., & Nader, K. (2002) · Neuron · doi:10.1016/s0896-6273(02)01001-2 · Cited by 758 · see citing works
An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees
Hammer, M. (1993) · Nature · doi:10.1038/366059a0 · Cited by 692 · see citing works
Mechanisms of memory stabilization: are consolidation and reconsolidation similar or distinct processes?
Alberini, C. M. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2004.11.001 · Cited by 594 · see citing works
Cognitive architecture of a mini-brain: the honeybee
Menzel, R., & Giurfa, M. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01601-6 · Cited by 563 · see citing works
Self-citation
Stability of retrieved memory: Inverse correlation with trace dominance
Eisenberg, M., Kobilo, T., Berman, D. E., & Dudai, Y. (2003) · Science · doi:10.1126/science.1086881 · Cited by 518 · see citing works
Reconsolidation of memory after its reactivation
Przybyslawski, J., & Sara, S. J. (1997) · Behavioural Brain Research · doi:10.1016/s0166-4328(96)00153-2 · Cited by 493 · see citing works
Psychobiology of active and inactive memory.
Lewis, D. J. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.5.1054 · Cited by 486 · see citing works
Consolidation of Fear Extinction Requires Protein Synthesis in the Medial Prefrontal Cortex
Santini, E., Ge, H., Ren, K., de Ortiz, S. P., & Quirk, G. J. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0786-04.2004 · Cited by 479 · see citing works
Memory extinction, learning anew, and learning the new: dissociations in the molecular machinery of learning in cortex
Berman, D. E., & Dudai, Y. (2001) · Science · doi:10.1126/science.1058165 · Cited by 472 · see citing works
Rites of Passage of the Engram
Dudai, Y., & Eisenberg, M. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.003 · Cited by 455 · see citing works
Temporally graded requirement for protein synthesis following memory reactivation
Milekic, M. H., & Alberini, C. M. (2002) · Neuron · doi:10.1016/s0896-6273(02)00976-5 · Cited by 455 · see citing works
Is there a cell-biological alphabet for simple forms of learning?
Hawkins, R. D., & Kandel, E. R. (1984) · Psychological Review · doi:10.1037/0033-295x.91.3.375 · Cited by 436 · see citing works
Protein Synthesis Subserves Reconsolidation or Extinction Depending on Reminder Duration
Pedreira, M. E., & Maldonado, H. (2003) · Neuron · doi:10.1016/s0896-6273(03)00352-0 · Cited by 406 · see citing works
Spontaneous recovery
Rescorla, R. A. (2004) · Learning & Memory · doi:10.1101/lm.77504 · Cited by 380 · see citing works
Mismatch Between What Is Expected and What Actually Occurs Triggers Memory Reconsolidation or Extinction
Pedreira, M. E., Pérez-Cuesta, L. M., & Maldonado, H. (2004) · Learning & Memory · doi:10.1101/lm.76904 · Cited by 367 · see citing works
Reconsolidation: the advantage of being refocused
Dudai, Y. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.010 · Cited by 357 · see citing works
Punishment Prediction by Dopaminergic Neurons in Drosophila
Riemensperger, T. D., Völler, T., Stock, P., Buchner, E., & Fiala, A. (2005) · Current Biology · doi:10.1016/j.cub.2005.09.042 · Cited by 350 · see citing works
Retrieval of memory for fear-motivated training initiates extinction requiring protein synthesis in the rat hippocampus
Vianna, M., Szapiro, G., McGaugh, J. D., Medina, J., & Izquierdo, I. (2001) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.211433298 · Cited by 301 · see citing works
The neural basis of associative reward learning in honeybees
Hammer, M. (1997) · Trends in Neurosciences · doi:10.1016/s0166-2236(96)01019-3 · Cited by 220 · see citing works
Behavioral impairments caused by injections of the protein synthesis inhibitor anisomycin after contextual retrieval reverse with time
Lattal, K. M., & Abel, T. G. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0306546101 · Cited by 220 · see citing works
The influence of duration of protein synthesis inhibition on memory
Flood, J. F., Rosenzweig, M. R., Bennett, E. L., & Orme, A. E. (1973) · Physiology & Behavior · doi:10.1016/0031-9384(73)90221-7 · Cited by 216 · see citing works
Reactivation and Reconsolidation of Long-Term Memory in the CrabChasmagnathus: Protein Synthesis Requirement and Mediation by NMDA-Type Glutamatergic Receptors
Pedreira, M. E., Pérez-Cuesta, L. M., & Maldonado, H. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-18-08305.2002 · Cited by 213 · see citing works
Memory processes in classical conditioning.
Bouton, M., & Moody, E. W. (2004) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.001 · Cited by 208 · see citing works
Reminder effects – reconsolidation or retrieval deficit? Pharmacological dissection with protein synthesis inhibitors following reminder for a passive‐avoidance task in young chicks
Anokhin, K. V., Тиунова, А. А., & Rose, S. P. R. (2002) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2002.02023.x · Cited by 207 · see citing works
Reconsolidation of fresh, remote, and extinguished fear memory in medaka: old fears don't die
Eisenberg, M., & Dudai, Y. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03818.x · Cited by 204 · see citing works
Reconsolidation of a Long-Term Memory inLymnaeaRequires New Protein and RNA Synthesis and the Soma of Right Pedal Dorsal 1
Sangha, S., Scheibenstock, A., & Lukowiak, K. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-22-08034.2003 · Cited by 190 · see citing works
Using Pavlovian Higher-Order Conditioning Paradigms to Investigate the Neural Substrates of Emotional Learning and MemoryPreprint
Gewirtz, J. C., & Davis, M. E. (2000) · Learning & Memory · doi:10.1101/lm.35200 · Cited by 168 · see citing works
Anisomycin infused into the hippocampus fails to block “reconsolidation” but impairs extinction: The role of re-exposure durationPreprint
Power, A. E., Berlau, D. J., McGaugh, J. L., & Steward, O. (2006) · Learning & Memory · doi:10.1101/lm.91206 · Cited by 159 · see citing works
Spontaneous Recovery from Extinction Depends on the Reconsolidation of the Acquisition Memory in an Appetitive Learning Paradigm in the Honeybee ( Apis mellifera )
Stollhoff, N., Menzel, R., & Eisenhardt, D. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.0117-05.2005 · Cited by 126 · see citing works
Self-citation
Extinction is not a sufficient condition to prevent fear memories from undergoing reconsolidation in the basolateral amygdala
Duvarci, S., Mamou, C. B., & Nader, K. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04907.x · Cited by 125 · see citing works
Anisomycin and the reconsolidation hypothesisPreprint
Rudy, J. W., Biedenkapp, J. C., Moineau, J., & Bolding, K. A. (2006) · Learning & Memory · doi:10.1101/lm.157806 · Cited by 92 · see citing works
Memory extinction requires gene expression in rat hippocampus.
Vianna, M., Igaz, L., Coitinho, A., Medina, J., & Izquierdo, I. (2003) · Neurobiology of Learning and Memory · doi:10.1016/s1074-7427(03)00003-0 · Cited by 89 · see citing works
Effects of protein synthesis inhibition on memory for active avoidance training
Flood, J. F., Bennett, E. L., Orme, A. E., & Rosenzweig, M. R. (1975) · Physiology & Behavior · doi:10.1016/0031-9384(75)90163-8 · Cited by 72 · see citing works
Interpretations of retrograde amnesia: old problems redux
Millin, P. M., Moody, E. W., & Riccio, D. C. (2001) · Nature reviews. Neuroscience · doi:10.1038/35049075 · Cited by 70 · see citing works
Mechanisms of Memory Reorganization during Retrieval of Acquired Behavioral Experience in Chicks: the Effects of Protein Synthesis Inhibition in the Brain
Litvin, O., & Anokhin, K. V. (2000) · Neuroscience and Behavioral Physiology · doi:10.1023/a:1026698700139 · Cited by 69 · see citing works
Reminder effects: the molecular cascade following a reminder in young chicks does not recapitulate that following training on a passive avoidance task
Salińska, E., Bourne, R. C., & Rose, S. P. R. (2004) · European Journal of Neuroscience · doi:10.1111/j.0953-816x.2004.03407.x · Cited by 52 · see citing works
Amygdala or hippocampus inactivation after retrieval induces temporary memory deficit☆
Prado-Alcalá, R. A., del Guante, M. Á. D., Garín-Aguilar, M. E., Díaz-Trujillo, A., Quirarte, G. L., & McGaugh, J. L. (2006) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2006.01.006 · Cited by 51 · see citing works
Lesions of basolateral amygdala impair extinction of CS motivational value, but not of explicit conditioned responses, in Pavlovian appetitive second‐order conditioning
Lindgren, J. L., Gallagher, M., & Holland, P. C. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02421.x · Cited by 43 · see citing works
Reconsolidation reconsidered
Riccio, D. C., Moody, E. W., & Millin, P. M. (2002) · Integrative Psychological and Behavioral Science · doi:10.1007/bf02734247 · Cited by 43 · see citing works
Cognitive Architecture of a Mini-Brain
Giurfa, M., & Menzel, R. (2003) · Springer eBooks · doi:10.1007/978-3-662-05594-6_4 · Cited by 16 · see citing works
Self-citation

Flagged first, then by citations

Sorted by citations

A single standard for memory: The case for reconsolidation
Nader, K., & Hardt, O. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2590 · Cited by 811 · see citing works
The evolution of misbelief
McKay, R. T., & Dennett, D. C. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09990975 · Cited by 474 · see citing works
Toward a neurobiology of delusions
Corlett, P. R., Taylor, J. R., Wang, X.-J., Fletcher, P. C., & Krystal, J. H. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.06.007 · Cited by 394 · see citing works
Learning to forget: manipulating extinction and reconsolidation processes to treat addiction
Torregrossa, M. M., & Taylor, J. R. (2013) · Psychopharmacology · doi:10.1007/s00213-012-2750-9 · Cited by 172 · see citing works
Sleep and memory in mammals, birds and invertebrates
Vorster, A. P., & Born, J. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.09.020 · Cited by 169 · see citing works
Why do delusions persist?
Corlett, P. R. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.012.2009 · Cited by 146 · see citing works
Computational psychiatry: a Rosetta Stone linking the brain to mental illness
Corlett, P. R., & Fletcher, P. C. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70298-6 · Cited by 105 · see citing works
Ketamine effects on memory reconsolidation favor a learning model of delusions
Corlett, P. R., Cambridge, V., Gardner, J. M., Piggot, J. S., Turner, D. C., Everitt, J. C., Arana, F. S., Morgan, H. L., Milton, A. L., Lee, J. L., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065088 · Cited by 105 · see citing works
A mismatch-based model for memory reconsolidation and extinction in attractor networks
Osan, R., Tort, A. B. L., & Amaral, O. B. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023113 · Cited by 63 · see citing works
Amygdala Dopamine Receptors Are Required for the Destabilization of a Reconsolidating Appetitive Memory
Merlo, E., Ratano, P., Ilioi, E. C., Robbins, M. A. L. S., Everitt, B. J., & Milton, A. L. (2015) · eneuro · doi:10.1523/eneuro.0024-14.2015 · Cited by 38 · see citing works

Preventing the Return of Fear Using Reconsolidation Update Mechanisms Depends on the Met-Allele of the Brain Derived Neurotrophic Factor Val66Met Polymorphism
Asthana, M. K., Brunhuber, B. S., Mühlberger, A., Reif, A., Schneider, S., & Herrmann, M. J. (2015) · The International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyv137 · Cited by 50 · see citing works
Brain metabolic activity associated with long-term memory consolidation
Sedman, G. L., O'Dowd, B. S., Rickard, N. S., et al. (1991) · Molecular Neurobiology · doi:10.1007/bf02935557 · Cited by 46 · see citing works
Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval
Nader, K., Schafe, G. E., & Le Doux, J. E. (2000) · Nature · doi:10.1038/35021052 · Cited by 2,706 · see citing works
Susceptibility of memory consolidation during lapses in recall
Marra, V., O’Shea, M., Benjamin, P. R., et al. (2013) · Nature Communications · doi:10.1038/ncomms2591 · Cited by 58 · see citing works
The many faces of amnesiaPreprint
Gold, P. E. (2006) · Learning & Memory · doi:10.1101/lm.277406 · Cited by 103 · see citing works

Authors: Eisenhardt, D., & Menzel, R.
Affiliations: Freie Universität Berlin (DE)
Corresponding author: Menzel, Randolf
ORCID: Eisenhardt, Dorothea
Menzel, Randolf
Venue: Neurobiology of Learning and Memory
Publisher: Elsevier BV
Published: 2007-02
Volume: 87
Issue: 2
Pages: 167-173
ISSN: 1074-7427 (ISSN-L)
DOI: 10.1016/j.nlm.2006.09.005
OpenAlex: W2054695727
Cited by: 89
References: 50
Citations by year: 2026: 1 · 2025: 1 · 2023: 1 · 2022: 2 · 2021: 4 · 2020: 2 · 2019: 3 · 2018: 6 · 2017: 4 · 2016: 6 · 2015: 4 · 2014: 7 · 2013: 6 · 2012: 8
FWCI: 0.60
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Neurobiology of Learning and Memory (publishedVersion)
PubMed (publishedVersion)
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurobiology and Insect Physiology Research
Keywords: extinction learning, memory reconsolidation, spontaneous recovery, memory retrieval, protein synthesis inhibition, associative memory, memory consolidation
MeSH terms: Animals, Extinction, Psychological, Humans, Learning, Reinforcement, Psychology, Retention, Psychology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Extinction learning, reconsolidation and the internal reinforcement hypothesis

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks