Predicting the past, remembering the future
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Rational analyses of memory suggest that retrievability of past experience depends on its usefulness for predicting the future: memory is adapted to the temporal structure of the environment. Recent research has enriched this view by applying it to semantic memory and reinforcement learning. This paper describes how multiple forms of memory can be linked via common predictive principles, possibly subserved by a shared neural substrate in the hippocampus. Predictive principles offer an explanation for a wide range of behavioral and neural phenomena, including semantic fluency, temporal contiguity effects in episodic memory, and the topological properties of hippocampal place cells.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Remembering the past to imagine the future: the prospective brain
Schacter, D. L., Addis, D. R., & Buckner, R. L. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2213 · Cited by 2,394 · cited 1×
“Fourth, the hippocampus is activated when humans engage in episodic future-thinking [45], and damage to the hippocampus appears to severely impair this ability [46] (though this finding is controversial; see [47]).”
BackgroundSpike Timing–Dependent Plasticity: A Hebbian Learning Rule
Caporale, N., & Dan, Y. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125639 · Cited by 1,997 · cited 1×
“Brea and colleagues [64 ] have developed a framework for resolving this puzzle, using a variant of traditional spike timingdependent plasticity [65].”
The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells
Muller, R., & Kubie, J. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-07-01951.1987 · Cited by 1,581
Patients with hippocampal amnesia cannot imagine new experiences
Hassabis, D., Kumaran, D., Vann, S. D., & Maguire, E. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610561104 · Cited by 1,414
A Distributed Representation of Temporal Context
Howard, M. W., & Kahana, M. J. (2002) · Journal of Mathematical Psychology · doi:10.1006/jmps.2001.1388 · Cited by 1,174 · cited 2×
“However, the temporal difference learning update is equivalent to the originally proposed Hebbian update rule [28] only when items are presented once per list.”
BackgroundNeural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 2×
“First, place cells in the hippocampus sweep ahead of an animal’s current position when it is at a choice point [37]; these forward sweeps may arise from phase precession, the progressive shift in spike timing relative to the ongoing theta oscillation as an animal moves through a place field [38,39,4 ].”
BackgroundReward-motivated learning: mesolimbic activation precedes memory formation
Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.036 · Cited by 977
What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
Kumaran, D., Hassabis, D., & McClelland, J. L. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.05.004 · Cited by 759
Wittmann, B. C., Schott, B. H., Guderian, S., Frey, J. U., Heinze, H.-J., & Düzel, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.010 · Cited by 698
Neural representations of events arise from temporal community structure
Schapiro, A. C., Rogers, T. T., Cordova, N. I., Turk-Browne, N. B., & Botvinick, M. M. (2013) · Nature Neuroscience · doi:10.1038/nn.3331 · Cited by 556 · cited 1×
“Predictive spiking offers an explanation for widespread anticipatory responses in the brain [66,43,67].”
BackgroundWinocur, G., Moscovitch, M., & Bontempi, B. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.04.016 · Cited by 486
Prospective coding for objects in primate prefrontal cortex
Rainer, G., Rao, S. C., & Miller, E. K. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05493.1999 · Cited by 432 · cited 1×
“Predictive spiking offers an explanation for widespread anticipatory responses in the brain [66,43,67].”
BackgroundShaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities
Schapiro, A. C., Kustner, L. V., & Turk-Browne, N. B. (2012) · Current Biology · doi:10.1016/j.cub.2012.06.056 · Cited by 430 · cited 1×
“Predictive spiking offers an explanation for widespread anticipatory responses in the brain [66,43,67].”
BackgroundAdaptive constructive processes and the future of memory
Schacter, D. L. (2012) · American Psychologist · doi:10.1037/a0029869 · Cited by 417 · cited 1×
“However, researchers have increasingly come to appreciate the fact that memory is organized around predictive design principles [8], evident in multiple forms of memory (semantic, episodic, short-term and procedural).”
BackgroundEvent boundaries in perception affect memory encoding and updating
Swallow, K. M., Zacks, J. M., & Abrams, R. A. (2009) · Journal of Experimental Psychology: General · doi:10.1037/a0015631 · Cited by 382
A map of abstract relational knowledge in the human hippocampal-entorhinal cortex
Garvert, M. M., Dolan, R. J., & Behrens, T. E. (2017) · eLife · doi:10.7554/elife.17086 · Cited by 379
Ezzyat, Y., & Davachi, L. (2014) · Neuron · doi:10.1016/j.neuron.2014.01.042 · Cited by 321
Interdependence of episodic and semantic memory: evidence from neuropsychology
GREENBERG, D. L., & VERFAELLIE, M. (2010) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617710000676 · Cited by 320
Hippocampal place cells construct reward related sequences through unexplored space
Ólafsdóttir, H. F., Barry, C., Saleem, A. B., Hassabis, D., & Spiers, H. J. (2015) · eLife · doi:10.7554/elife.06063 · Cited by 319
What constitutes an episode in episodic memory?
Ezzyat, Y., & Davachi, L. (2011) · Psychological Science · doi:10.1177/0956797610393742 · Cited by 298
The influence of context boundaries on memory for the sequential order of events
DuBrow, S., & Davachi, L. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034024 · Cited by 289
Skaggs, W. E., & McNaughton, B. L. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-20-08455.1998 · Cited by 287
Predictive information in a sensory population
Palmer, S. E., Marre, O., Berry, M. J., & Bialek, W. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1506855112 · Cited by 257
Heeger, D. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1619788114 · Cited by 220
Role of the hippocampus in remembering the past and imagining the future
Squire, L. R., van der Horst, A. S., McDuff, S. G. R., Frascino, J. C., Hopkins, R. O., & Mauldin, K. N. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014391107 · Cited by 206 · cited 1×
“Fourth, the hippocampus is activated when humans engage in episodic future-thinking [45], and damage to the hippocampus appears to severely impair this ability [46] (though this finding is controversial; see [47]).”
BackgroundHippocampal Replay Captures the Unique Topological Structure of a Novel Environment
Wu, X., & Foster, D. J. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3414-13.2014 · Cited by 201
The algorithmic anatomy of model-based evaluation
Daw, N. D., & Dayan, P. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0478 · Cited by 195
Mechanisms for widespread hippocampal involvement in cognition.
Shohamy, D., & Turk-Browne, N. B. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034461 · Cited by 187
The successor representation and temporal context
Gershman, S. J., Moore, C. D., Todd, M. T., Norman, K. A., & Sederberg, P. B. (2012) · Neural Computation · doi:10.1162/neco_a_00282 · Cited by 117 · cited 2×
“It can be shown (see [26] for details) that the temporal context representation corresponds to the eligibility trace et, and the matrix of item-context associations corresponds to M̂.”
BackgroundMethodSelf-citationNeural context reinstatement predicts memory misattribution
Gershman, S. J., Schapiro, A. C., Hupbach, A., & Norman, K. A. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.0096-13.2013 · Cited by 105
Self-citationStatistical computations underlying the dynamics of memory updating
Gershman, S. J., Radulescu, A., Norman, K. A., & Niv, Y. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003939 · Cited by 101 · cited 1×
“For example, Gershman and colleagues [12] developed a Bayesian nonparametric model in which the environmental dynamics can switch between an unknown number of ‘modes.”
BackgroundSelf-citationThe context repetition effect: Predicted events are remembered better, even when they don’t happen
Smith, T. A., Hasinski, A. E., & Sederberg, P. B. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034067 · Cited by 33
A temporal context repetition effect in rats during a novel object recognition memory task
Manns, J. R., Galloway, C. R., & Sederberg, P. B. (2015) · Animal Cognition · doi:10.1007/s10071-015-0871-3 · Cited by 4 · cited 1×
“The context repetition effect was also recently demonstrated in rats using an object recognition task [34].”
Method
Cited by
Buzsáki, G. (2019) · doi:10.1093/oso/9780190905385.001.0001 · Cited by 358
Prediction and memory: A predictive coding account
Barron, H. C., Auksztulewicz, R., & Friston, K. (2020) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101821 · Cited by 220
Planning and navigation as active inference
Kaplan, R., & Friston, K. J. (2018) · Biological Cybernetics · doi:10.1007/s00422-018-0753-2 · Cited by 203
The successor representation: Its computational logic and neural substrates
Gershman, S. J. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0151-18.2018 · Cited by 191
“The linear function approximation architecture described above has been widely used in neural models of reinforcement learning(Schultzetal.,1997;DawandTouretzky,2002;Ludviget al.,2008;Gershman,2017a),butitwillfailforvaluefunctions thatarenonlinear.”
BackgroundMethodSelf-citationDegeneracy and Redundancy in Active Inference
Sajid, N., Parr, T., Hope, T. M., Price, C. J., & Friston, K. J. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa148 · Cited by 49
Metadata
- Authors
- Gershman, S. J.
- Venue
- Current Opinion in Behavioral Sciences
- Publisher
- Elsevier BV
- Published
- 2017-10
- Volume
- 17
- Pages
- 7-13
- ISSN
- 2352-1546 (ISSN-L)
- OpenAlex
- W2622233359
- Cited by
- 58
- References
- 34
- FWCI
- 1.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.