Reactivation, Replay, and Preplay: How It Might All Fit Together
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Sequential activation of neurons that occurs during “offline” states, such as sleep or awake rest, is correlated with neural sequences recorded during preceding exploration phases. This so-called reactivation, or replay, has been observed in a number of different brain regions such as the striatum, prefrontal cortex, primary visual cortex and, most prominently, the hippocampus. Reactivation largely co-occurs together with hippocampal sharp-waves/ripples, brief high-frequency bursts in the local field potential. Here, we first review the mounting evidence for the hypothesis that reactivation is the neural mechanism for memory consolidation during sleep. We then discuss recent results that suggest that offline sequential activity in the waking state might not be simple repetitions of previously experienced sequences. Some offline sequential activity occurs before animals are exposed to a novel environment for the first time, and some sequences activated offline correspond to trajectories never experienced by the animal. We propose a conceptual framework for the dynamics of offline sequential activity that can parsimoniously describe a broad spectrum of experimental results. These results point to a potentially broader role of offline sequential activity in cognitive functions such as maintenance of spatial representation, learning, or planning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Place navigation impaired in rats with hippocampal lesions
Morris, R. G. M., Garrud, P., Rawlins, J. N. P., & O'Keefe, J. (1982) · Nature · doi:10.1038/297681a0 · Cited by 6,340
The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat
O'Keefe, J., & Dostrovsky, J. (1971) · Brain Research · doi:10.1016/0006-8993(71)90358-1 · Cited by 6,151
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256 · cited 1×
“It has been suggested that memories are initially stored in the hippocampus and then gradually transferred to neocortical areas through reactivation in a two-stage process [10, 69].”
BackgroundBower, G. H. (1981) · American Psychologist · doi:10.1037/0003-066x.36.2.129 · Cited by 4,154 · cited 1×
“Reward and affective state are known to influence memory formation [75–78].”
BackgroundSimple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771 · cited 1×
“This view of consolidation would strongly suggest that it takes place during sleep, as others have suggested before [68, 20].”
ResultModality-Specific Retrograde Amnesia of Fear
Kim, J. J., & Fanselow, M. S. (1992) · Science · doi:10.1126/science.1585183 · Cited by 2,483
Sleep function and synaptic homeostasis
Tononi, G., & Cirelli, C. (2006) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2005.05.002 · Cited by 2,151 · cited 1×
“These suggestions are consistent with the broader hypothesis that the main purpose of sleep is synaptic downscaling to restore encoding capabilities of the network [102].”
Memory consolidation, retrograde amnesia and the hippocampal complex
Nadel, L., & Moscovitch, M. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80010-4 · Cited by 1,924
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727 · cited 12×
“While Foster and Wilson [24] originally reported awake replay in the reverse order, later studies reported awake replay in both the forward and reverse directions on a linear track [64, 65], and in an open environment [63].”
BackgroundInfluentialTwo-stage model of memory trace formation: A role for “noisy” brain states
Buzsáki, G. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90423-5 · Cited by 1,709 · cited 5×
“It is remarkable that this stunning experimental observation had been predicted by Buzsáki [10]”
BackgroundInfluentialCoordinated memory replay in the visual cortex and hippocampus during sleep
Ji, D., & Wilson, M. A. (2007) · Nature Neuroscience · doi:10.1038/nn1825 · Cited by 1,669
The role of phase synchronization in memory processes
Fell, J., & Axmacher, N. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn2979 · Cited by 1,620
Selective suppression of hippocampal ripples impairs spatial memory
Girardeau, G., Benchenane, K., Wiener, S. I., Buzsáki, G., & Zugaro, M. B. (2009) · Nature Neuroscience · doi:10.1038/nn.2384 · Cited by 1,560
Cellular networks underlying human spatial navigation
Ekstrom, A. D., Kahana, M. J., Caplan, J. B., Fields, T. A., Isham, E. A., Newman, E. L., & Fried, I. (2003) · Nature · doi:10.1038/nature01964 · Cited by 1,425 · cited 1×
“Interestingly, single-units in the human hippocampus appear to represent spatial locations not unlike place cells in rodents [31].”
BackgroundInternally Generated Cell Assembly Sequences in the Rat Hippocampus
Pastalkova, E., Itskov, V., Amarasingham, A., & Buzsáki, G. (2008) · Science · doi:10.1126/science.1159775 · Cited by 1,301
Memory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep
Louie, K., & Wilson, M. A. (2001) · Neuron · doi:10.1016/s0896-6273(01)00186-6 · Cited by 1,148 · cited 2×
“These studies reveal that place cells are activated in a consistent sequential order both during rapid eye movement (REM) sleep [65] and during slow-wave sleep (SWS) [63].”
BackgroundCoordinated interactions between hippocampal Ripples and Cortical Spindles during Slow-Wave Sleep
Siapas, A. G., & Wilson, M. A. (1998) · Neuron · doi:10.1016/s0896-6273(00)80629-7 · Cited by 1,052 · cited 1×
“For instance, the occurrence of prefrontal sleep spindles and that of SWRs are correlated [93], as are SWR-like events in rhinal cortex and hippocampus [2].”
BackgroundNeural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 2×
“Johnson and Redish [53] suggest that the sequential activity of hippocampal neurons seem to represent future situation rather than recent experience.”
BackgroundPath integration and cognitive mapping in a continuous attractor neural network model
Samsonovich, A., & McNaughton, B. L. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-15-05900.1997 · Cited by 989 · cited 3×
“Hoffman and McNaughton [54] studied cell pairs in different neocortical areas of nonhuman primates during a visual task and subsequent sleep.”
MethodHippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval
Carr, M. F., Jadhav, S. P., & Frank, L. M. (2011) · Nature Neuroscience · doi:10.1038/nn.2732 · Cited by 958
Replay and Time Compression of Recurring Spike Sequences in the Hippocampus
Nádasdy, Z., Hirase, H., Czurkó, A., Csicsvari, J., & Buzsáki, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-21-09497.1999 · Cited by 932 · cited 1×
“It has been claimed that replayed sequences are compressed in time by a factor of about 20 relative to the sensory-driven sequences [73, 63].”
BackgroundCommunication between neocortex and hippocampus during sleep in rodents
Sirota, A., Csicsvari, J., Buhl, D., & Buzsáki, G. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0437938100 · Cited by 930
Critical role of the hippocampus in memory for sequences of events
Fortin, N. J., Agster, K. L., & Eichenbaum, H. B. (2002) · Nature Neuroscience · doi:10.1038/nn834 · Cited by 881 · cited 1×
“Since the rodent hippocampus is required for learning about new places [72], as well as sequences of non-spatial items [36], it was suggested early on that reactivation might be involved in learning.”
BackgroundCrick, F., & Mitchison, G. (1983) · Nature · doi:10.1038/304111a0 · Cited by 865
Disruption of ripple‐associated hippocampal activity during rest impairs spatial learning in the rat
Ego‐Stengel, V., & Wilson, M. A. (2010) · Hippocampus · doi:10.1002/hipo.20707 · Cited by 842
Stress and memory: opposing effects of glucocorticoids on memory consolidation and memory retrieval
Roozendaal, B. (2002) · Neurobiology of Learning and Memory · doi:10.1006/nlme.2002.4080 · Cited by 838
Hippocampal replay of extended experience
Davidson, T. J., Kloosterman, F., & Wilson, M. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.027 · Cited by 806 · cited 3×
“However, it seems that awake replay can be initiated at remote locations on the track [24] and may correspond to a different track altogether [58].”
BackgroundResultAwake replay of remote experiences in the hippocampus
Karlsson, M. P., & Frank, L. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2344 · Cited by 769 · cited 1×
“However, it seems that awake replay can be initiated at remote locations on the track [24] and may correspond to a different track altogether [58].”
BackgroundThe reorganization and reactivation of hippocampal maps predict spatial memory performance
Dupret, D., O'Neill, J., Pleydell-Bouverie, B., & Csicsvari, J. (2010) · Nature Neuroscience · doi:10.1038/nn.2599 · Cited by 769 · cited 3×
“Interestingly in this context, the number of goal-associated eSWRs in a spatial task is correlated with memory performance [28].”
BackgroundInfluentialReplay of rule-learning related neural patterns in the prefrontal cortex during sleep
Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., & Battaglia, F. P. (2009) · Nature Neuroscience · doi:10.1038/nn.2337 · Cited by 767
Kudrimoti, H. S., Barnes, C. A., & McNaughton, B. L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-10-04090.1999 · Cited by 753
Hippocampal replay is not a simple function of experience
Gupta, A. S., van der Meer, M. A. A., Touretzky, D. S., & Redish, A. D. (2010) · Neuron · doi:10.1016/j.neuron.2010.01.034 · Cited by 733
Preplay of future place cell sequences by hippocampal cellular assemblies
Dragoi, G., & Tonegawa, S. (2011) · Nature · doi:10.1038/nature09633 · Cited by 716 · cited 10×
“Dragoi and Tonegawa [27] showed preplay during “sleep/rest” periods.”
BackgroundResultInfluentialFast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep
Euston, D. R., Tatsuno, M., & McNaughton, B. L. (2007) · Science · doi:10.1126/science.1148979 · Cited by 586 · cited 3×
“These sequences are compressed in time compared to the average activity during behavior as it is in the hippocampus, but with a factor of 6 to 7 [36].”
BackgroundIsomura, Y., Sirota, A., Özen, S., Montgomery, S., Mizuseki, K., Henze, D. A., & Buzsáki, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.10.023 · Cited by 500
Song replay during sleep and computational rules for sensorimotor vocal learning
Dave, A. S., & Margoliash, D. (2000) · Science · doi:10.1126/science.290.5492.812 · Cited by 458 · cited 1×
“Finally, replay has been observed in at least one non-mammalian system: area RA of songbirds [23].”
BackgroundCoordinated Reactivation of Distributed Memory Traces in Primate Neocortex
Hoffman, K. L., & McNaughton, B. L. (2002) · Science · doi:10.1126/science.1073538 · Cited by 420
The Role of the Hippocampus in Prediction and Imagination
Buckner, R. L. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163508 · Cited by 419 · cited 1×
“As preplay occurs before the exploration task, we believe it to be consistent with the notion of planning [24, 8].”
ResultHippocampus leads ventral striatum in replay of place-reward information
Lansink, C. S., Goltstein, P. M., Lankelma, J. V., McNaughton, B. L., & Pennartz, C. M. A. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000173 · Cited by 400
Temporal coupling of parahippocampal ripples, sleep spindles and slow oscillations in humans
Clemens, Z., Molle, M., Eross, L., Barsi, P., Halasz, P., & Born, J. (2007) · Brain · doi:10.1093/brain/awm146 · Cited by 398
Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus
Singer, A. C., & Frank, L. M. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.016 · Cited by 385
Ripples in the medial temporal lobe are relevant for human memory consolidation
Axmacher, N., Elger, C. E., & Fell, J. (2008) · Brain · doi:10.1093/brain/awn103 · Cited by 372
Reactivation of experience-dependent cell assembly patterns in the hippocampus
O'Neill, J., Senior, T. J., Allen, K., Huxter, J. R., & Csicsvari, J. (2008) · Nature Neuroscience · doi:10.1038/nn2037 · Cited by 318
Hippocampal sharp wave bursts coincide with neocortical “up-state” transitions
Battaglia, F. P., Sutherland, G. R., & McNaughton, B. L. (2004) · Learning & Memory · doi:10.1101/lm.73504 · Cited by 310 · cited 1×
“SWRs in the hippocampus apparently appear more frequently during down states, particularly near the transition from the down to the up state [46–48].”
BackgroundState-dependent spike-timing relationships between hippocampal and prefrontal circuits during sleep
Wierzynski, C. M., Lubenov, E. V., Gu, M., & Siapas, A. G. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.011 · Cited by 289
Volgushev, M., Chauvette, S., Mukovski, M., & Timofeev, I. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0279-06.2006 · Cited by 289 · cited 1×
“Consistent with the hypothesis that different neocortical areas need to be coordinated during consolidation, up-down transitions are correlated across different neocortical sites [103], as well as between cortical areas and hippocampal subareas [50].”
BackgroundNew Experiences Enhance Coordinated Neural Activity in the Hippocampus
Cheng, S., & Frank, L. M. (2008) · Neuron · doi:10.1016/j.neuron.2007.11.035 · Cited by 286 · cited 4×
“We previously suggested that SWR-associated activity might drive the formation of spatial representation in novel environments, since SWR-associated activity is enhanced while spatiotemporal spiking is less organized [14].”
InfluentialSelf-citationPennartz, C. M. A., Lee, E., Verheul, J., Lipa, P., Barnes, C. A., & McNaughton, B. L. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0575-04.2004 · Cited by 282 · cited 4×
“Furthermore, hippocampal SWRs are associated with reactivation of neurons in PFC [84, 104] and in ventral striatum [83, 62], which receives direct inputs from CA1 and subiculum [44].”
BackgroundInfluentialO'Neill, J., Senior, T., & Csicsvari, J. (2006) · Neuron · doi:10.1016/j.neuron.2005.10.037 · Cited by 281
Sustained increase in hippocampal sharp-wave ripple activity during slow-wave sleep after learning
Eschenko, O., Ramadan, W., Mölle, M., Born, J., & Sara, S. J. (2008) · Learning & Memory · doi:10.1101/lm.726008 · Cited by 277 · cited 1×
“Other studies also reported an increase in SWRs during sleep after exposure to novelty in an association task [33] and a spatial discrimination experiment [86].”
BackgroundRibeiro, S., Gervasoni, D., Soares, E. S., Zhou, Y., Lin, S.-C., Pantoja, J., Lavine, M., & Nicolelis, M. A. L. (2004) · PLoS Biology · doi:10.1371/journal.pbio.0020024 · Cited by 272 · cited 1×
“Enhanced replay of memory traces during SWS due to learning was also observed in the hippocampus, neocortex, putamen and thalamus [88], although there are methodological concerns with their data analysis [100].”
BackgroundMaintaining memories by reactivation
Rasch, B., & Born, J. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.11.007 · Cited by 240
Theta-Coupled Periodic Replay in Working Memory
Fuentemilla, L., Penny, W. D., Cashdollar, N., Bunzeck, N., & Düzel, E. (2010) · Current Biology · doi:10.1016/j.cub.2010.01.057 · Cited by 216 · cited 1×
“recall of movie sequences [39], working memory maintenance [38], and internal dynamics in sensorimotor learning [15, 16].”
BackgroundHippocampal Sharp Wave/Ripples during Sleep for Consolidation of Associative Memory
Ramadan, W., Eschenko, O., & Sara, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006697 · Cited by 173 · cited 1×
“Other studies also reported an increase in SWRs during sleep after exposure to novelty in an association task [33] and a spatial discrimination experiment [86].”
BackgroundPreferential Reactivation of Motivationally Relevant Information in the Ventral Striatum
Lansink, C. S., Goltstein, P. M., Lankelma, J. V., Joosten, R. N. J. M. A., McNaughton, B. L., & Pennartz, C. M. A. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1054-08.2008 · Cited by 168
Bliss, T. V. P., & Lømo, T. (1973) · The Journal of Physiology · doi:10.1113/jphysiol.1973.sp010273 · Cited by 135
Neurodynamics of mental exploration
Hopfield, J. J. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0913991107 · Cited by 96
Tatsuno, M., Lipa, P., & McNaughton, B. L. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3317-06.2006 · Cited by 86
Cited by
Tononi, G., & Cirelli, C. (2014) · Neuron · doi:10.1016/j.neuron.2013.12.025 · Cited by 2,356
“Thus, the interactions between cortex and hippocampus during sleep are most likely bidirectional (Buhry et al., 2011; Diekelmann and Born, 2010; Ji and Wilson, 2007; Tononi et al., 2006), with up states in the cortex activating the hippocampus in a feedforward manner, prompting the hippocampus…”
BackgroundPrioritized memory access explains planning and hippocampal replay
Mattar, M. G., & Daw, N. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0232-z · Cited by 393
“It has been suggested that replay tends to increase within session with exposure, but decrease across sessions as the animal becomes familiar with a novel environment (Buhry et al., 2011).”
BackgroundHippocampal place cells construct reward related sequences through unexplored space
Ólafsdóttir, H. F., Barry, C., Saleem, A. B., Hassabis, D., & Spiers, H. J. (2015) · eLife · doi:10.7554/elife.06063 · Cited by 319
“…is that paths towards the goal might be simulated using forwards preplay then evaluated and learnt from during reverse preplay, in a manner similar to that proposed to exist for periods of exploration and postexploration rest (Foster and Wilson, 2006; Diekelmann and Born, 2010; Buhry et al., 2011).”
MethodSleep and synaptic down-selection
Tononi, G., & Cirelli, C. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14335 · Cited by 217
Dark control: The default mode network as a reinforcement learning agent
Dohmatob, E., Dumas, G., & Bzdok, D. (2020) · Human Brain Mapping · doi:10.1002/hbm.25019 · Cited by 121
“The HC is a strong candidate for contributing to such neural reinstantiation of behavioral episodes as neuroscience experiments have repeatedly indicated in rats, mice, cats, rabbits, songbirds, and monkeys (Buhry et al., 2011; Nokia et al., 2010; Dave and Margoliash, 2000; Skaggs et al., 2007).”
Background
Metadata
- Authors
- Buhry, L., Azizi, A. H., & Cheng, S.
- Venue
- Neural Plasticity
- Publisher
- Wiley
- Published
- 2011
- Volume
- 2011
- Pages
- 1-11
- ISSN
- 1687-5443 (ISSN-L)
- 2090-5904
- OpenAlex
- W2018414805
- Cited by
- 133
- References
- 61
- FWCI
- 4.22
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.