Context Learning in the Rodent Hippocampus
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
We present a Bayesian statistical theory of context learning in the rodent hippocampus. While context is often defined in an experimental setting in relation to specific background cues or task demands, we advance a single, more general notion of context that suffices for a variety of learning phenomena. Specifically, a context is defined as a statistically stationary distribution of experiences, and context learning is defined as the problem of how to form contexts out of groups of experiences that cluster together in time. The challenge of context learning is solving the model selection problem: How many contexts make up the rodent's world? Solving this problem requires balancing two opposing goals: minimize the variability of the distribution of experiences within a context and minimize the likelihood of transitioning between contexts. The theory provides an understanding of why hippocampal place cell remapping sometimes develops gradually over many days of experience and why even consistent landmark differences may need to be relearned after other environmental changes. The theory provides an explanation for progressive performance improvements in serial reversal learning, based on a clear dissociation between the incremental process of context learning and the relatively abrupt context selection process. The impact of partial reinforcement on reversal learning is also addressed. Finally, the theory explains why alternating sequence learning does not consistently result in unique context-dependent sequence representations in hippocampus.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Microstructure of a spatial map in the entorhinal cortex
Hafting, T., Fyhn, M., Molden, S., Moser, M.-B., & Moser, E. I. (2005) · Nature · doi:10.1038/nature03721 · Cited by 4,068
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 2×
“In addition, the partial reinforcement conditions are not well explained by these models, or other delta-rule based models (e.g., Rescorla & Wagner, 1972; Pearce & Hall, 1980), since learning is not adjusted based on the entropy of the trial’s outcome.”
BackgroundMethodSimple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771 · cited 4×
“Marr (1971) first proposed that the architecture of the hippocampus is well suited to encode new memory traces using orthogonalized representations, which minimize interference between stored patterns.”
BackgroundInfluentialDaw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Path integration and the neural basis of the 'cognitive map'
McNaughton, B. L., Battaglia, F. P., Jensen, O., Moser, E. I., & Moser, M.-B. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1932 · Cited by 2,024
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“More recently, Yu and Dayan (2005) have proposed a theory of acetylcholine and noradrenaline in which acetylcholine represents expected uncertainty, whether due to the context being new or to known unpredictability within a familiar context.”
BackgroundReverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727 · cited 2×
“An alternative hypothesis, adopted by Hasselmo and Eichenbaum (2005), is that sequence replay (Foster and Wilson, 2006) in the hippocampus”
BackgroundThe effects of changes in the environment on the spatial firing of hippocampal complex-spike cells
Muller, R., & Kubie, J. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-07-01951.1987 · Cited by 1,581
Spatial representation in the entorhinal cortex
Fyhn, M., Molden, S., Witter, M. P., Moser, E. I., & Moser, M.-B. (2004) · Science · doi:10.1126/science.1099901 · Cited by 1,339
Hippocampal synaptic enhancement and information storage within a distributed memory system
McNaughton, B. L., & Morris, R. G. M. (1987) · Trends in Neurosciences · doi:10.1016/0166-2236(87)90011-7 · Cited by 1,304
Computational analysis of the role of the hippocampus in memory
Treves, A., & Rolls, E. T. (1994) · Hippocampus · doi:10.1002/hipo.450040319 · Cited by 1,272
On the role of the hippocampus in learning and memory in the rat.
Jarrard, L. E. (1993) · Behavioral and Neural Biology · doi:10.1016/0163-1047(93)90664-4 · Cited by 1,125
Wood, E. R., Dudchenko, P. A., Robitsek, R. J., & Eichenbaum, H. (2000) · Neuron · doi:10.1016/s0896-6273(00)00071-4 · Cited by 992 · cited 2×
“Some studies have confirmed this finding (Frank, Brown, & Wilson, 2000; Wood et al., 2000), while others found no path-related differences (Lenck-Santini et al.”
ResultPath integration and cognitive mapping in a continuous attractor neural network model
Samsonovich, A., & McNaughton, B. L. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-15-05900.1997 · Cited by 989
The hippocampus and contextual retrieval of information from memory: A theory
Hirsh, R. (1974) · Behavioral Biology · doi:10.1016/s0091-6773(74)92231-7 · Cited by 957
Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off
O'Reilly, R. C., & McClelland, J. L. (1994) · Hippocampus · doi:10.1002/hipo.450040605 · Cited by 914
Critical role of the hippocampus in memory for sequences of events
Fortin, N. J., Agster, K. L., & Eichenbaum, H. B. (2002) · Nature Neuroscience · doi:10.1038/nn834 · Cited by 881 · cited 2×
“For example, Fortin et al. (2002) found that after being presented with a random sequence of odors, hippocampal rats could not choose the earlier of two odors from the sequence.”
BackgroundMethodHasselmo, M. E., Bodelón, C., & Wyble, B. P. (2002) · Neural Computation · doi:10.1162/089976602317318965 · Cited by 875
The global record of memory in hippocampal neuronal activity
Wood, E. R., Dudchenko, P. A., & Eichenbaum, H. (1999) · Nature · doi:10.1038/17605 · Cited by 707
Dissociating hippocampal subregions: A double dissociation between dentate gyrus and CA1
Gilbert, P. E., Kesner, R. P., & Lee, I. (2001) · Hippocampus · doi:10.1002/hipo.1077 · Cited by 641
Place cells, head direction cells, and the learning of landmark stability
Knierim, J., Kudrimoti, H., & McNaughton, B. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-03-01648.1995 · Cited by 608
Abolition of Long-Term Stability of New Hippocampal Place Cell Maps by NMDA Receptor Blockade
Kentros, C., Hargreaves, E., Hawkins, R. D., Kandel, E. R., Shapiro, M., & Muller, R. V. (1998) · Science · doi:10.1126/science.280.5372.2121 · Cited by 484
Hasselmo, M., & Schnell, E. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-06-03898.1994 · Cited by 466 · cited 1×
“…supporting the notion that increased cholinergic modulation decreases the contribution of CA3 to the CA1 representation, but increases plasticity of both the CA3 recurrent and Schaffer collaterals (Hasselmo & Schnell, 1994; Hasselmo, Schnell, & Barkai, 1995; Hasselmo, Wyble, & Wallenstein, 1996).”
BackgroundLong-term plasticity in hippocampal place-cell representation of environmental geometry
Lever, C., Wills, T., Cacucci, F., Burgess, N., & O'Keefe, J. (2002) · Nature · doi:10.1038/416090a · Cited by 465
Vazdarjanova, A., & Guzowski, J. F. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0350-04.2004 · Cited by 465 · cited 2×
“Vazdarjanova and Guzowski (2004) found in an immediateearly gene expression study that similar environments were represented with a greater similarity in CA3 than CA1, while two very different environments were represented with less similarity in CA3 than CA1.”
BackgroundEnsemble Dynamics of Hippocampal Regions CA3 and CA1
Guzowski, J. F., Knierim, J. J., & Moser, E. I. (2004) · Neuron · doi:10.1016/j.neuron.2004.11.003 · Cited by 354 · cited 1×
“While dMEC grid cells change phase when the arena is placed in a novel room (Hafting et al., 2005), preliminary findings by J. Leutgeb et al. (2006) show that grid cell phases remain constant when the arena changes shape in the same room, while DG and CA3 undergo rate remapping (see also Quirk, Muller, Kubie, & Ranck,…”
BackgroundSkaggs, W. E., & McNaughton, B. L. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-20-08455.1998 · Cited by 287 · cited 1×
“Very similar contexts show partially overlapping representations (partial remapping), especially when only a change in task is involved (e.g., Markus et al., 1995; Shapiro, Tanila, & Eichenbaum, 1997; Skaggs & McNaughton, 1998; Wood, Dudchenko, Robitsek, & Eichenbaum, 2000; Jeffery, 2000).”
BackgroundHoward, M. W., Fotedar, M. S., Datey, A. V., & Hasselmo, M. E. (2005) · Psychological Review · doi:10.1037/0033-295x.112.1.75 · Cited by 283
Representation and timing in theories of the dopamine system
Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1637 · Cited by 173 · cited 1×
“However, Daw, Courville, and Touretzky (2006) have suggested that a more sophisticated semi-Markov process better explains physiology studies of the dopamine system.”
BackgroundSelf-citation
Cited by
Viewpoints: how the hippocampus contributes to memory, navigation and cognition
Lisman, J., Buzsáki, G., Eichenbaum, H., Nadel, L., Ranganath, C., & Redish, A. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4661 · Cited by 851
Context, learning, and extinction
Gershman, S. J., Blei, D. M., & Niv, Y. (2010) · Psychological Review · doi:10.1037/a0017808 · Cited by 386
Gershman, S. J., & Uchida, N. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0220-7 · Cited by 236
Retrospective revaluation in sequential decision making: a tale of two systems
Gershman, S. J., Markman, A. B., & Otto, A. R. (2014) · Journal of Experimental Psychology General · doi:10.1037/a0030844 · Cited by 217
Hippocampal remapping as hidden state inference
Sanders, H., Wilson, M. A., & Gershman, S. J. (2020) · eLife · doi:10.7554/elife.51140 · Cited by 163
Metadata
- Authors
- Fuhs, M. C., & Touretzky, D. S.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2007-12
- Volume
- 19
- Issue
- 12
- Pages
- 3173-3215
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2058358833
- Cited by
- 62
- References
- 29
- FWCI
- 0.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.