Nonmonotonic Plasticity: How Memory Retrieval Drives Learning
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
What are the principles that govern whether neural representations move apart (differentiate) or together (integrate) as a function of learning? According to supervised learning models that are trained to predict outcomes in the world, integration should occur when two stimuli predict the same outcome. Numerous findings support this, but — paradoxically — some recent fMRI studies have found that pairing different stimuli with the same associate causes differentiation, not integration. To explain these and related findings, we argue that supervised learning needs to be supplemented with unsupervised learning that is driven by spreading activation in a U-shaped way, such that inactive memories are not modified, moderate activation of memories causes weakening (leading to differentiation), and higher activation causes strengthening (leading to integration).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256 · cited 3×
“These changes to the similarity structure of memories have an enormous effect on subsequent retrieval, affecting how much memories compete (less overlap results in less competition and thus better recall of distinctive features [1]) and how much generalization occurs (more overlap leads to more generalization [2]).”
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Bienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896 · cited 2×
“, [46,87]) also incorporate metaplasticity, whereby the ‘transition point’ between strengthening and weakening is adjusted as a function of the average activity of the neuron; high average activity makes it easier to weaken connections into the neuron, and low average activity makes it easier to strengthen connections.”
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771
CORTICAL PLASTICITY: From Synapses to Maps
Buonomano, D. V., & Merzenich, M. M. (1998) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.21.1.149 · Cited by 2,083 · cited 1×
“At the level of neural representations, this Hebbian rule predicts that correlated neural firing will lead to integration [40,41], even in the absence of explicit teaching signals [42–44].”
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Pattern separation in the hippocampus
Yassa, M. A., & Stark, C. E. L. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.06.006 · Cited by 1,544
Remembering can cause forgetting: Retrieval dynamics in long-term memory.
Anderson, M. C., Bjork, R. A., & Bjork, E. L. (1994) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.20.5.1063 · Cited by 1,482
Norman, K. A., & O'Reilly, R. C. (2003) · Psychological Review · doi:10.1037/0033-295x.110.4.611 · Cited by 1,312
Self-citationClosed-loop brain training: the science of neurofeedback
Sitaram, R., Ros, T., Stoeckel, L., Haller, S., Scharnowski, F., Lewis-Peacock, J., Weiskopf, N., Blefari, M. L., Rana, M., Oblak, E., et al. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.164 · Cited by 1,306
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 1×
“Crucially, neither of these scenarios explains why retrieval of ‘hollow’ is a strongly positive (reinforcing) learning experience, as has been demonstrated by myriad studies [35].”
Predictive Processing: A Canonical Cortical Computation
Keller, G. B., & Mrsic-Flogel, T. D. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.003 · Cited by 836
Theta and gamma oscillations during encoding predict subsequent recall
Sederberg, P. B., Kahana, M. J., Howard, M. W., Donner, E. J., & Madsen, J. R. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-34-10809.2003 · Cited by 750
Theta and gamma oscillations predict encoding and retrieval of declarative memory
Osipova, D., Takashima, A., Oostenveld, R., Fernández, G., Maris, E., & Jensen, O. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1948-06.2006 · Cited by 671
Neural representations of events arise from temporal community structure
Schapiro, A. C., Rogers, T. T., Cordova, N. I., Turk-Browne, N. B., & Botvinick, M. M. (2013) · Nature Neuroscience · doi:10.1038/nn.3331 · Cited by 556 · cited 3×
“Supervised learning also explains how community structure affected neural representations in another study [7].”
Self-citationShaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities
Schapiro, A. C., Kustner, L. V., & Turk-Browne, N. B. (2012) · Current Biology · doi:10.1016/j.cub.2012.06.056 · Cited by 430 · cited 1×
“This fits with the idea that moderate activation of B that co-occurs with strong activation of A leads to ‘shearing’ of B’s connections with A (for an alternative explanation see [67]; for a related result see ‘weak pairs’ in [68]).”
Self-citationTheories of Error Back-Propagation in the Brain
Whittington, J. C. R., & Bogacz, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.005 · Cited by 420 · cited 1×
“Several recurrent algorithms have been shown to mathematically approximate feedforward backpropagation [17,20], and thus the same learning outcomes should occur.”
Schlichting, M. L., Mumford, J. A., & Preston, A. R. (2015) · Nature Communications · doi:10.1038/ncomms9151 · Cited by 381
O'Reilly, R. C. (1996) · Neural Computation · doi:10.1162/neco.1996.8.5.895 · Cited by 352 · cited 1×
“Several recurrent algorithms have been shown to mathematically approximate feedforward backpropagation [17,20], and thus the same learning outcomes should occur.”
MCCANDLISS, B. D., FIEZ, J. A., PROTOPAPAS, A., CONWAY, M., & MCCLELLAND, J. L. (2002) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.2.2.89 · Cited by 303 · cited 1×
“At the same time, unsupervised learning has its costs – it can cause networks to become entrenched in particular knowledge states and make them less able to adapt to new inputs [43]; also, in pathological cases, it can lead the network to erroneous conclusions – with the NMPH, strongly retrieving a false memory can fu…”
Retrieval induces adaptive forgetting of competing memories via cortical pattern suppression
Wimber, M., Alink, A., Charest, I., Kriegeskorte, N., & Anderson, M. C. (2015) · Nature Neuroscience · doi:10.1038/nn.3973 · Cited by 282
Bidirectional synaptic plasticity: from theory to reality
Bear, M. F. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1255 · Cited by 260 · cited 1×
“This metaplasticity principle is well supported by neural data [53]; functionally, it is important for preventing runaway synaptic modification (whereby strong connections keep getting stronger).”
Retrieval as a fast route to memory consolidation
Antony, J. W., Ferreira, C. S., Norman, K. A., & Wimber, M. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.05.001 · Cited by 242 · cited 1×
“During retrieval, activation spreads to related memories, causing the representational changes outlined earlier, which reduce competition on subsequent retrieval attempts and thus improve accuracy [34].”
Self-citationDynamic updating of hippocampal object representations reflects new conceptual knowledge
Mack, M. L., Love, B. C., & Preston, A. R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1614048113 · Cited by 223
A neural network model of retrieval-induced forgetting
Norman, K. A., Newman, E. L., & Detre, G. (2007) · Psychological Review · doi:10.1037/0033-295x.114.4.887 · Cited by 218
Self-citationDimsdale-Zucker, H. R., Ritchey, M., Ekstrom, A. D., Yonelinas, A. P., & Ranganath, C. (2018) · Nature Communications · doi:10.1038/s41467-017-02752-1 · Cited by 205 · cited 3×
“This view also fits with the aforementioned finding [12] that – within the hippocampus – subregions with very sparse activity (CA2/3/DG) [69] tend to show differentiation, whereas subregions with less sparse activity (CA1) [69] tend to show integration, as well as the finding from [11] that posterior hippocampus (hypo…”
Deep Predictive Learning: A Comprehensive Model of Three Visual Streams
O'Reilly, R. C., Wyatte, D. R., & Rohrlich, J. (2017) · arXiv · doi:10.48550/arxiv.1709.04654 · Cited by 26
Cited by
Unsupervised neural network models of the ventral visual stream
Zhuang, C., Yan, S., Nayebi, A., Schrimpf, M., Frank, M. C., DiCarlo, J. J., & Yamins, D. L. K. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2014196118 · Cited by 337
Prediction errors disrupt hippocampal representations and update episodic memories
Sinclair, A. H., Manalili, G. M., Brunec, I. K., Adcock, R. A., & Barense, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2117625118 · Cited by 121
From remembering to reconstruction: The transformative neural representation of episodic memory.
Xue, G. (2022) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2022.102351 · Cited by 49
Martin, C. B., Hong, B., Newsome, R. N., Savel, K., Meade, M. E., Xia, A., Honey, C. J., & Barense, M. D. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2214285119 · Cited by 47
Suppression weakens unwanted memories via a sustained reduction of neural reactivation
Meyer, A.-K., & Benoit, R. G. (2022) · eLife · doi:10.7554/elife.71309 · Cited by 27
Metadata
- Authors
- Ritvo, V. J. H., Turk-Browne, N. B., & Norman, K. A.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 23
- Issue
- 9
- Pages
- 726-742
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2965736624
- Cited by
- 145
- References
- 30
- FWCI
- 2.07
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.