Sequence learning and the role of the hippocampus in rodent navigation
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
The hippocampus has long been associated with navigation and spatial representations, but it has been difficult to link directly the neurophysiological correlates of hippocampal place cells with navigational planning and action. In recent years, large-scale population recordings of place cells have revealed that spatial sequences are stored and activated in ways that may support navigational strategies. Plasticity mechanisms allow the hippocampus to store learned sequences of locations that may allow predictions of future locations based on past experience. These sequences can also be activated during navigational behavior in ways that may allow the animal to learn trajectories toward goals. Task-dependent alterations in place cell firing patterns may reflect the operation of the hippocampus in associating locations with navigationally relevant decision variables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Microstructure of a spatial map in the entorhinal cortex
Hafting, T., Fyhn, M., Molden, S., Moser, M.-B., & Moser, E. I. (2005) · Nature · doi:10.1038/nature03721 · Cited by 4,068
Dynamics of the Hippocampal Ensemble Code for Space
Wilson, M. A., & McNaughton, B. L. (1993) · Science · doi:10.1126/science.8351520 · Cited by 2,350 · cited 1×
“Nevertheless, the place fields of hippocampal cells are both highly localized and cover the entire environment in a relatively uniform way [14].”
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 1×
“action representation in dorsal striatum [86]).”
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727 · cited 3×
“Consistent with a role in learning, reverse replay appears to be more prevalent on a novel track than a familiar one [52], whereas forward ordered sequences display the opposite pattern [54].”
Self-citationThe effects of changes in the environment on the spatial firing of hippocampal complex-spike cells
Muller, R., & Kubie, J. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-07-01951.1987 · Cited by 1,581
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564 · cited 1×
“Interestingly, reverse replay has been proposed repeatedly in the machine learning literature as a way to speed up learning within temporal difference learning models [59–61].”
Cellular networks underlying human spatial navigation
Ekstrom, A. D., Kahana, M. J., Caplan, J. B., Fields, T. A., Isham, E. A., Newman, E. L., & Fried, I. (2003) · Nature · doi:10.1038/nature01964 · Cited by 1,425 · cited 1×
“Place cells have been recorded from the hippocampus of mice [70,71], rabbits [72], bats [73], and monkeys [74,75], and there is evidence that they may exist in humans as well [76].”
Internally Generated Cell Assembly Sequences in the Rat Hippocampus
Pastalkova, E., Itskov, V., Amarasingham, A., & Buzsáki, G. (2008) · Science · doi:10.1126/science.1159775 · Cited by 1,301
Memory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
Hippocampal ‘time cells’ bridge the gap in memory for discontiguous events
MacDonald, C. J., Lepage, K. Q., Eden, U. T., & Eichenbaum, H. (2011) · Neuron · doi:10.1016/j.neuron.2011.07.012 · Cited by 1,193 · cited 1×
“However, the development of multi-electrode recording techniques, which allow the simultaneous recording of dozens of neurons, has allowed quantitative analyses of neural populations that have begun to shed light on how the hippocampus can create representations of spatial (and perhaps temporal [2,3 ]) sequences that…”
Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep
Louie, K., & Wilson, M. A. (2001) · Neuron · doi:10.1016/s0896-6273(01)00186-6 · Cited by 1,148 · cited 1×
“First shown in sleep [48–50], where they were hypothesized to be involved in long-term memory consolidation [51], they have more recently been shown to occur robustly during the awake state as well.”
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 1×
“Thus, although they potentially allow information to be accessed relating to places immediately ahead of an animal, and may even allow exploration of alternatives at a choice point up to 1 m [47], they do not allow information to be accessed corresponding to longer”
Wood, E. R., Dudchenko, P. A., Robitsek, R. J., & Eichenbaum, H. (2000) · Neuron · doi:10.1016/s0896-6273(00)00071-4 · Cited by 992 · cited 2×
“When within the same task the same place must be associated with different actions at different times, this distinction can be handled by using different cells for the same place [10,16,17,18 ,19,20].”
Functional imaging of hippocampal place cells at cellular resolution during virtual navigation
Dombeck, D. A., Harvey, C. D., Tian, L., Looger, L. L., & Tank, D. W. (2010) · Nature Neuroscience · doi:10.1038/nn.2648 · Cited by 873 · cited 1×
“However, with recent advances in recording technology [84] and the ability to stimulate neural activity [85], these issues are likely to be addressed.”
Hippocampal replay of extended experience
Davidson, T. J., Kloosterman, F., & Wilson, M. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.027 · Cited by 806 · cited 1×
“The phenomenon has been extensively replicated [53,54,55 ,56 ,57].”
Awake replay of remote experiences in the hippocampus
Karlsson, M. P., & Frank, L. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2344 · Cited by 769 · cited 1×
“The phenomenon has been extensively replicated [53,54,55 ,56 ,57].”
Hippocampal remapping and grid realignment in entorhinal cortex
Fyhn, M., Hafting, T., Treves, A., Moser, M.-B., & Moser, E. I. (2007) · Nature · doi:10.1038/nature05601 · Cited by 749 · cited 1×
“Both grid cells and head direction cells appear to be rather rigid and inflexible spatial representations, firing in similar patterns relative to each other across environments [7,8].”
Hippocampal replay is not a simple function of experience
Gupta, A. S., van der Meer, M. A. A., Touretzky, D. S., & Redish, A. D. (2010) · Neuron · doi:10.1016/j.neuron.2010.01.034 · Cited by 733
Preplay of future place cell sequences by hippocampal cellular assemblies
Dragoi, G., & Tonegawa, S. (2011) · Nature · doi:10.1038/nature09633 · Cited by 716 · cited 1×
“Awake replay events have been reported in mice [50], whereas sleep replay has been reported in the song system of zebra finches [69].”
Human theta oscillations exhibit task dependence during virtual maze navigation
Kahana, M. J., Sekuler, R., Caplan, J. B., Kirschen, M., & Madsen, J. R. (1999) · Nature · doi:10.1038/21645 · Cited by 649 · cited 1×
“Moreover, the theta rhythm has also been recorded during alert behavior in different species [79–81], and place cells in mice demonstrate theta phase precession [82], thereby raising the possibility that theta sequences are present as well across species.”
Impaired Hippocampal Representation of Space in CA1-Specific NMDAR1 Knockout Mice
McHugh, T. J., Blum, K. I., Tsien, J. Z., Tonegawa, S., & Wilson, M. A. (1996) · Cell · doi:10.1016/s0092-8674(00)81828-0 · Cited by 593 · cited 1×
“Place cells have been recorded from the hippocampus of mice [70,71], rabbits [72], bats [73], and monkeys [74,75], and there is evidence that they may exist in humans as well [76].”
Song replay during sleep and computational rules for sensorimotor vocal learning
Dave, A. S., & Margoliash, D. (2000) · Science · doi:10.1126/science.290.5492.812 · Cited by 458 · cited 1×
“Awake replay events have been reported in mice [50], whereas sleep replay has been reported in the song system of zebra finches [69].”
Hippocampus leads ventral striatum in replay of place-reward information
Lansink, C. S., Goltstein, P. M., Lankelma, J. V., McNaughton, B. L., & Pennartz, C. M. A. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000173 · Cited by 400
Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus
Singer, A. C., & Frank, L. M. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.016 · Cited by 385
A Model of Spatial Map Formation in the Hippocampus of the Rat
Blum, K. I., & Abbott, L. F. (1996) · Neural Computation · doi:10.1162/neco.1996.8.1.85 · Cited by 352 · cited 1×
“Computational models have shown that the temporal asymmetry of long-term potentiation can encode such sequences in the synaptic weights of a place cell matrix [29–31].”
Hippocampal cellular and network activity in freely moving echolocating bats
Ulanovsky, N., & Moss, C. F. (2007) · Nature Neuroscience · doi:10.1038/nn1829 · Cited by 283 · cited 3×
“Rather, the theta appears to be correlated with the echolocating vocalizations, at least in the brown bat [73].”
Pennartz, C. M. A., Lee, E., Verheul, J., Lipa, P., Barnes, C. A., & McNaughton, B. L. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0575-04.2004 · Cited by 282 · cited 1×
“Moreover, ventral striatum neurons exhibit a close connection to fine-timescale dynamics in the hippocampal representation of state, specifically theta phase precession [25 ], forward sweeps [23 ], and replay [22,27,28], which are discussed in the following sections.”
Attention-like modulation of hippocampus place cell discharge
Fenton, A. A., Lytton, W. W., Barry, J. M., Lenck-Santini, P.-P., Zinyuk, L. E., Kubík, Š., Bureš, J., Poucet, B., Muller, R. U., & Olypher, A. V. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5576-09.2010 · Cited by 170 · cited 1×
“This variability, coupled with the variability of place cell firing rates from trial to trial [40] and the dependence of the rate of precession on the size of a place field [41,42], made the prediction of sequences nontrivial.”
Preferential Reactivation of Motivationally Relevant Information in the Ventral Striatum
Lansink, C. S., Goltstein, P. M., Lankelma, J. V., Joosten, R. N. J. M. A., McNaughton, B. L., & Pennartz, C. M. A. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1054-08.2008 · Cited by 168
Cited by
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216
Self-citationBehavioral time scale synaptic plasticity underlies CA1 place fields
Bittner, K. C., Milstein, A. D., Grienberger, C., Romani, S., & Magee, J. C. (2017) · Science · doi:10.1126/science.aan3846 · Cited by 707
Foster, D. J. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031538 · Cited by 375
Self-citationThe Role of Hippocampal Replay in Memory and Planning
Ólafsdóttir, H. F., Bush, D., & Barry, C. (2018) · Current Biology · doi:10.1016/j.cub.2017.10.073 · Cited by 413
“In turn, reverse replay during behaviour has been implicated as a possible solution to the temporal credit assignment problem in reinforcement learning [55,70].”
BackgroundThe successor representation in human reinforcement learning
Momennejad, I., Russek, E. M., Cheong, J. H., Botvinick, M. M., Daw, N. D., & Gershman, S. J. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0180-8 · Cited by 390
Metadata
- Authors
- Foster, D. J., & Knierim, J. J.
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2012-04
- Volume
- 22
- Issue
- 2
- Pages
- 294-300
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W1998078493
- Cited by
- 125
- References
- 30
- FWCI
- 0.62
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.