Representational drift: Emerging theories for continual learning and experimental future directions
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Recent work has revealed that the neural activity patterns correlated with sensation, cognition, and action often are not stable and instead undergo large scale changes over days and weeks-a phenomenon called representational drift. Here, we highlight recent observations of drift, how drift is unlikely to be explained by experimental confounds, and how the brain can likely compensate for drift to allow stable computation. We propose that drift might have important roles in neural computation to allow continual learning, both for separating and relating memories that occur at distinct times. Finally, we present an outlook on future experimental directions that are needed to further characterize drift and to test emerging theories for drift's role in computation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771 · cited 2×
“It has been proposed that memories are actively or passively reor-ganized over time for optimal storage [65].”
BackgroundFully integrated silicon probes for high-density recording of neural activity
Jun, J. J., Steinmetz, N. A., Siegle, J. H., Denman, D. J., Bauza, M., Barbarits, B., Lee, A. K., Anastassiou, C. A., Andrei, A., Aydın, Ç., et al. (2017) · Nature · doi:10.1038/nature24636 · Cited by 2,190
Experience-dependent structural synaptic plasticity in the mammalian brain
Holtmaat, A., & Svoboda, K. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2699 · Cited by 1,934 · cited 1×
“However, a subset of cortical spines nonetheless appears to be stable over extended periods [44].”
BackgroundDynamics of hippocampal neurogenesis in adult humans
Spalding, K. L., Bergmann, O., Alkass, K., Bernard, S., Salehpour, M., Huttner, H. B., Boström, E., Westerlund, I., Vial, C., Buchholz, B. A., et al. (2013) · Cell · doi:10.1016/j.cell.2013.05.002 · Cited by 1,841
Spontaneous behaviors drive multidimensional, brainwide activity
Stringer, C., Pachitariu, M., Steinmetz, N., Reddy, C. B., Carandini, M., & Harris, K. D. (2019) · Science · doi:10.1126/science.aav7893 · Cited by 1,510 · cited 1×
“Great efforts must be taken to record and model as many features of behavior as possible to better understand the evolving relationship between neuronal activity and behavior [16,37,38,39,40,41].”
BackgroundVariability, compensation and homeostasis in neuron and network function
Marder, E., & Goaillard, J.-M. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1949 · Cited by 1,212
Neuropixels 2.0: A miniaturized high-density probe for stable, long-term brain recordings.
Steinmetz, N. A., Aydin, C., Lebedeva, A., Okun, M., Pachitariu, M., Bauza, M., Beau, M., Bhagat, J., Böhm, C., Broux, M., et al. (2021) · Science · doi:10.1126/science.abf4588 · Cited by 1,173 · cited 2×
“Recent advances in experimental recording techniques have made it possible to record large populations of neurons with high spatial resolution [1,2,3].”
BackgroundLong-term dynamics of CA1 hippocampal place codes
Ziv, Y., Burns, L. D., Cocker, E. D., Hamel, E. O., Ghosh, K. K., Kitch, L. J., Gamal, A. E., & Schnitzer, M. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3329 · Cited by 1,155
Memory engrams: Recalling the past and imagining the future
Josselyn, S. A., & Tonegawa, S. (2020) · Science · doi:10.1126/science.aaw4325 · Cited by 1,087 · cited 1×
“As just one example, memory engrams are a prominent concept for hippocampal memory [89].”
BackgroundComputation Through Neural Population Dynamics
Vyas, S., Golub, M. D., Sussillo, D., & Shenoy, K. V. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092619-094115 · Cited by 671
Increased Attention to Spatial Context Increases Both Place Field Stability and Spatial Memory
Kentros, C. G., Agnihotri, N. T., Streater, S., Hawkins, R. D., & Kandel, E. R. (2004) · Neuron · doi:10.1016/s0896-6273(04)00192-8 · Cited by 537 · cited 3×
“These findings are suggestive that continuous interactions with a particular stimulus might stabilize representations as they continue to be relevant in the environment, which is consistent with previous work in the hippocampus [9,80,81].”
BackgroundMethodResultDynamic Reorganization of Neuronal Activity Patterns in Parietal Cortex
Driscoll, L. N., Pettit, N. L., Minderer, M., Chettih, S. N., & Harvey, C. D. (2017) · Cell · doi:10.1016/j.cell.2017.07.021 · Cited by 445
Self-citationImpermanence of dendritic spines in live adult CA1 hippocampus
Attardo, A., Fitzgerald, J. E., & Schnitzer, M. J. (2015) · Nature · doi:10.1038/nature14467 · Cited by 399
Local and global influences on protein turnover in neurons and glia
Dörrbaum, A. R., Kochen, L., Langer, J. D., & Schuman, E. M. (2018) · eLife · doi:10.7554/elife.34202 · Cited by 249
Causes and consequences of representational drift
Rule, M. E., O’Leary, T., & Harvey, C. D. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.08.005 · Cited by 227 · cited 2×
“In addition to these experimental re-sults, theoretical work has focused on how these changes may arise, how downstream areas may overcome nonstationarities upstream, as well as potential computational benefits [24,25,26,23,27,28].”
BackgroundResultSelf-citationAutomated long-term recording and analysis of neural activity in behaving animals
Dhawale, A. K., Poddar, R., Wolff, S. B., Normand, V. A., Kopelowitz, E., & Ölveczky, B. P. (2017) · eLife · doi:10.7554/elife.27702 · Cited by 159 · cited 2×
“Drift has generally not been observed in motor areas [18,19,20,21] (although see Refs.”
BackgroundStable task information from an unstable neural population
Rule, M. E., Loback, A. R., Raman, D. V., Driscoll, L. N., Harvey, C. D., & O'Leary, T. (2020) · eLife · doi:10.7554/elife.51121 · Cited by 106
Self-citationManipulating Hippocampal Place Cell Activity by Single-Cell Stimulation in Freely Moving Mice
Diamantaki, M., Coletta, S., Nasr, K., Zeraati, R., Laturnus, S., Berens, P., Preston-Ferrer, P., & Burgalossi, A. (2018) · Cell Reports · doi:10.1016/j.celrep.2018.03.031 · Cited by 85
Cited by
Vishne, G., Gerber, E. M., Knight, R. T., & Deouell, L. Y. (2023) · Cell Reports · doi:10.1016/j.celrep.2023.112752 · Cited by 46
Metadata
- Authors
- Driscoll, L. N., Duncker, L., & Harvey, C. D.
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2022-10
- Volume
- 76
- Pages
- 102609
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W4290098532
- Cited by
- 158
- References
- 19
- FWCI
- 4.30
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.