Reverse replay of behavioural sequences in hippocampal place cells during the awake state
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
The hippocampus has long been known to be involved in spatial navigational learning in rodents, and in memory for events in rodents, primates and humans. A unifying property of both navigation and event memory is a requirement for dealing with temporally sequenced information. Reactivation of temporally sequenced memories for previous behavioural experiences has been reported in sleep in rats. Here we report that sequential replay occurs in the rat hippocampus during awake periods immediately after spatial experience. This replay has a unique form, in which recent episodes of spatial experience are replayed in a temporally reversed order. This replay is suggestive of a role in the evaluation of event sequences in the manner of reinforcement learning models. We propose that such replay might constitute a general mechanism of learning and memory.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Neuronal replay typically occurs in a temporally compressed fashion and can recapitulate the original event sequence in forward or reverse order.”
From Sleep—A brain-state serving systems memory consolidation (2023) · cites this paper as [81]
In the citing paper
“representations of rewarded spatial locations are preferentially reactivated in both wake and sleep states, 80,81,[142][143][144] although there are also findings of a bias of reactivations in the opposite direction.”
From Sleep—A brain-state serving systems memory consolidation (2023) · cites this paper as [81]
In the citing paper
“this temporal dynamic likely represents a general feature of reactivations showing maximum rates within 30 min after encoding also during wakefulness.”
From Sleep—A brain-state serving systems memory consolidation (2023) · cites this paper as [81]
In the citing paper
“Reactivation of ensemble firing patterns was first identified during sleep, 79,136 but the phenomenon occurs likewise during quiet rest as well as during active behavior, in rodents 80,81,137,138 as well as in humans.”
From Sleep—A brain-state serving systems memory consolidation (2023) · cites this paper as [81]
In the citing paper
“They also share the factors that select which content is preferably reactivated, due to saliency or relevance, including novelty and reward.”
From Sleep—A brain-state serving systems memory consolidation (2023) · cites this paper as [81]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Numerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
Numerical recipes in Pascal: the art of scientific computing
(1990) · Choice Reviews Online · doi:10.5860/choice.27-5158 · Cited by 11,811
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
(1978) · UA Campus Repository (The University of Arizona) · Cited by 8,010
LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS
Scoville, W. B., & Milner, B. (1957) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.20.1.11 · Cited by 7,322
Place navigation impaired in rats with hippocampal lesions
Morris, R. G. M., Garrud, P., Rawlins, J. N. P., & O'Keefe, J. (1982) · Nature · doi:10.1038/297681a0 · Cited by 6,340
The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat
O'Keefe, J., & Dostrovsky, J. (1971) · Brain Research · doi:10.1016/0006-8993(71)90358-1 · Cited by 6,151
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
The hippocampus as a cognitive map
Passingham, R. E. (1979) · Neuroscience · doi:10.1016/0306-4522(79)90015-0 · Cited by 5,128
Dynamics of the Hippocampal Ensemble Code for Space
Wilson, M. A., & McNaughton, B. L. (1993) · Science · doi:10.1126/science.8351520 · Cited by 2,350
Self-citationRemembrance of places passed: Spatial memory in rats.
Olton, D. S., & Samuelson, R. J. (1976) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.2.2.97 · Cited by 1,998
Two-stage model of memory trace formation: A role for “noisy” brain states
Buzsáki, G. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90423-5 · Cited by 1,709
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564
Studies on single neurons in dorsal hippocampal formation and septum in unrestrained rats
Ranck, J. B. (1973) · Experimental Neurology · doi:10.1016/0014-4886(73)90290-2 · Cited by 1,331
Memory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Self-citationTemporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep
Louie, K., & Wilson, M. A. (2001) · Neuron · doi:10.1016/s0896-6273(01)00186-6 · Cited by 1,148
Self-citationCoordinated interactions between hippocampal Ripples and Cortical Spindles during Slow-Wave Sleep
Siapas, A. G., & Wilson, M. A. (1998) · Neuron · doi:10.1016/s0896-6273(00)80629-7 · Cited by 1,052
Self-citationHippocampal sharp waves: Their origin and significance
Buzsáki, G. (1986) · Brain Research · doi:10.1016/0006-8993(86)91483-6 · Cited by 925
Steele, R. J., & Morris, R. G. M. (1999) · Hippocampus · doi:10.1002/(sici)1098-1063(1999)9:2<118::aid-hipo4>3.0.co;2-8 · Cited by 561
Visual Discrimination Task Improvement: A Multi-Step Process Occurring During Sleep
Stickgold, R., Whidbee, D., Schirmer, B., Patel, V., & Hobson, J. A. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562075 · Cited by 560
Gaffan, D. (1994) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1994.6.4.305 · Cited by 484
A model of hippocampally dependent navigation, using the temporal difference learning rule
Foster, D. J., Morris, R. G. M., & Dayan, P. (2000) · Hippocampus · doi:10.1002/(sici)1098-1063(2000)10:1<1::aid-hipo1>3.0.co;2-1 · Cited by 290
Self-citationAN ANALYSIS OF EXPERIENCE REPLAY IN TEMPORAL DIFFERENCE LEARNING
Cichosz, P. (1999) · Cybernetics & Systems · doi:10.1080/019697299125127 · Cited by 22
Research works printed but not linked: 2
- Sutton, R. S. & Singh, S. P. in Proceedings of the Eighth Yale Workshop on Adaptive and Learning Systems 31–36 (Yale Univ., New Haven, 1994)
- Reynolds, S. Experience Stack Reinforcement Learning for Off-policy Control. Cognitive Science Technical Report CSRP-02–1 (Birmingham Univ., Birmingham, 2002)
Cited by
Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging
Fox, M. D., & Raichle, M. E. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2201 · Cited by 6,700
Diekelmann, S., & Born, J. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2762 · Cited by 3,760
“Moreover, unlike re-activations that occur during wakefulness, re-activations during SWS almost always occur in the order in which they were experience”
BackgroundSchaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Rasch, B., & Born, J. (2013) · Physiological Reviews · doi:10.1152/physrev.00032.2012 · Cited by 2,783
Buckner, R. L., & Carroll, D. C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.11.004 · Cited by 2,691
Metadata
- Authors
- Foster, D. J., & Wilson, M. A.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Foster, David J.
- Venue
- Nature
- Published
- 2006-02-12
- Volume
- 440
- Issue
- 7084
- Pages
- 680-683
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2115107366
- Semantic Scholar
- 80159c6b24653d8d9797075d2b96dccc3c39a345
- Cited by
- 1,727
- References
- 24
- Citations by year
- 2026: 87 · 2025: 108 · 2024: 100 · 2023: 90 · 2022: 94 · 2021: 88 · 2020: 91 · 2019: 117 · 2018: 102 · 2017: 93 · 2016: 90 · 2015: 82 · 2014: 90 · 2013: 79 · 2012: 55
- FWCI
- 30.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Institutes of Health
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Sleep and Wakefulness Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Keywords
- place cells, awake state, behavioral sequences, spatial learning, event memory, memory reactivation, temporal sequence, reinforcement learning, spaced learning, hippocampus
- MeSH terms
- Action Potentials, Animals, Behavior, Electrophysiology, Hippocampus, Learning, Memory, Models, Neurological, Rest, Running, Space Perception, Wakefulness, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.