Internally generated hippocampal sequences as a vantage point to probe future‐oriented cognition
The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Abstract
Information processing in the rodent hippocampus is fundamentally shaped by internally generated sequences (IGSs), expressed during two different network states: theta sequences, which repeat and reset at the ∼8 Hz theta rhythm associated with active behavior, and punctate sharp wave‐ripple (SWR) sequences associated with wakeful rest or slow‐wave sleep. A potpourri of diverse functional roles has been proposed for these IGSs, resulting in a fragmented conceptual landscape. Here, we advance a unitary view of IGSs, proposing that they reflect an inferential process that samples a policy from the animal's generative model, supported by hippocampus‐specific priors. The same inference affords different cognitive functions when the animal is in distinct dynamical modes, associated with specific functional networks. Theta sequences arise when inference is coupled to the animal's action–perception cycle, supporting online spatial decisions, predictive processing, and episode encoding. SWR sequences arise when the animal is decoupled from the action–perception cycle and may support offline cognitive processing, such as memory consolidation, the prospective simulation of spatial trajectories, and imagination. We discuss the empirical bases of this proposal in relation to rodent studies and highlight how the proposed computational principles can shed light on the mechanisms of future‐oriented cognition in humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
Human Memory: A Proposed System and its Control Processes
Atkinson, R. C., & Shiffrin, R. M. (1968) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60422-3 · Cited by 7,216
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Episodic memory: from mind to brain
Tulving, E. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135114 · Cited by 4,950
Buzsáki, G. (2006) · doi:10.1093/acprof:oso/9780195301069.001.0001 · Cited by 4,873
Dynamic predictions: Oscillations and synchrony in top–down processing
Engel, A. K., Fries, P., & Singer, W. (2001) · Nature Reviews Neuroscience · doi:10.1038/35094565 · Cited by 3,454
A new one-trial test for neurobiological studies of memory in rats. 1: behavioral data
Ennaceur, A., & Delacour, J. (1988) · Behavioural Brain Research · doi:10.1016/0166-4328(88)90157-x · Cited by 3,223
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Dynamics of the Hippocampal Ensemble Code for Space
Wilson, M. A., & McNaughton, B. L. (1993) · Science · doi:10.1126/science.8351520 · Cited by 2,350
Smallwood, J., & Schooler, J. W. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.6.946 · Cited by 2,067
Memory, navigation and theta rhythm in the hippocampal-entorhinal system
Buzsáki, G., & Moser, E. I. (2013) · Nature Neuroscience · doi:10.1038/nn.3304 · Cited by 1,847
The cognitive neuroscience of constructive memory: remembering the past and imagining the future
Schacter, D. L., & Addis, D. R. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2087 · Cited by 1,836
Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning
Buzsáki, G. (2015) · Hippocampus · doi:10.1002/hipo.22488 · Cited by 1,759
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727
Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection
Lakatos, P., Karmos, G., Mehta, A. D., Ulbert, I., & Schroeder, C. E. (2008) · Science · doi:10.1126/science.1154735 · Cited by 1,719
Coordinated memory replay in the visual cortex and hippocampus during sleep
Ji, D., & Wilson, M. A. (2007) · Nature Neuroscience · doi:10.1038/nn1825 · Cited by 1,669
Lisman, J. E., & Jensen, O. (2013) · Neuron · doi:10.1016/j.neuron.2013.03.007 · Cited by 1,609
Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus
Leutgeb, J. K., Leutgeb, S., Moser, M.-B., & Moser, E. I. (2007) · Science · doi:10.1126/science.1135801 · Cited by 1,601
Selective suppression of hippocampal ripples impairs spatial memory
Girardeau, G., Benchenane, K., Wiener, S. I., Buzsáki, G., & Zugaro, M. B. (2009) · Nature Neuroscience · doi:10.1038/nn.2384 · Cited by 1,560
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473
Storage of 7 +/- 2 short-term memories in oscillatory subcycles
Lisman, J. E., & Idiart, M. A. P. (1995) · Science · doi:10.1126/science.7878473 · Cited by 1,471
Patients with hippocampal amnesia cannot imagine new experiences
Hassabis, D., Kumaran, D., Vann, S. D., & Maguire, E. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610561104 · Cited by 1,414
The future of memory: remembering, imagining, and the brain
Schacter, D. L., Addis, D. R., Hassabis, D., Martin, V. C., Spreng, R. N., & Szpunar, K. K. (2012) · Neuron · doi:10.1016/j.neuron.2012.11.001 · Cited by 1,398
Mind-wandering as spontaneous thought: a dynamic framework
Christoff, K., Irving, Z. C., Fox, K. C. R., Spreng, R. N., & Andrews-Hanna, J. R. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.113 · Cited by 1,376
Internally Generated Cell Assembly Sequences in the Rat Hippocampus
Pastalkova, E., Itskov, V., Amarasingham, A., & Buzsáki, G. (2008) · Science · doi:10.1126/science.1159775 · Cited by 1,301
Memory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
Hippocampal ‘time cells’ bridge the gap in memory for discontiguous events
MacDonald, C. J., Lepage, K. Q., Eden, U. T., & Eichenbaum, H. (2011) · Neuron · doi:10.1016/j.neuron.2011.07.012 · Cited by 1,193
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156
Self-citationTemporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep
Louie, K., & Wilson, M. A. (2001) · Neuron · doi:10.1016/s0896-6273(01)00186-6 · Cited by 1,148
Cortical oscillations and sensory predictions
Arnal, L. H., & Giraud, A.-L. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.05.003 · Cited by 1,114
Episodic memory and beyond: the hippocampus and neocortex in transformation
Moscovitch, M., Cabeza, R., Winocur, G., & Nadel, L. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143733 · Cited by 1,062
Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task
Jones, M. W., & Wilson, M. A. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030402 · Cited by 1,036
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003
Prefrontal and medial temporal lobe interactions in long-term memory
Simons, J. S., & Spiers, H. J. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1178 · Cited by 961
Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval
Carr, M. F., Jadhav, S. P., & Frank, L. M. (2011) · Nature Neuroscience · doi:10.1038/nn.2732 · Cited by 958
Hierarchical Models in the Brain
Friston, K. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000211 · Cited by 952
Awake hippocampal sharp-wave ripples support spatial memory
Jadhav, S. P., Kemere, C., German, P. W., & Frank, L. M. (2012) · Science · doi:10.1126/science.1217230 · Cited by 924
Self-citationHasselmo, M. E., Bodelón, C., & Wyble, B. P. (2002) · Neural Computation · doi:10.1162/089976602317318965 · Cited by 875
Disruption of ripple‐associated hippocampal activity during rest impairs spatial learning in the rat
Ego‐Stengel, V., & Wilson, M. A. (2010) · Hippocampus · doi:10.1002/hipo.20707 · Cited by 842
Hippocampal replay of extended experience
Davidson, T. J., Kloosterman, F., & Wilson, M. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.027 · Cited by 806
Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment
Berkes, P., Orbán, G., Lengyel, M., & Fiser, J. (2011) · Science · doi:10.1126/science.1195870 · Cited by 782
Awake replay of remote experiences in the hippocampus
Karlsson, M. P., & Frank, L. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2344 · Cited by 769
Replay of rule-learning related neural patterns in the prefrontal cortex during sleep
Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., & Battaglia, F. P. (2009) · Nature Neuroscience · doi:10.1038/nn.2337 · Cited by 767
What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
Kumaran, D., Hassabis, D., & McClelland, J. L. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.05.004 · Cited by 759
Sleep-dependent memory triage: evolving generalization through selective processing
Stickgold, R., & Walker, M. P. (2013) · Nature Neuroscience · doi:10.1038/nn.3303 · Cited by 755
Kudrimoti, H. S., Barnes, C. A., & McNaughton, B. L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-10-04090.1999 · Cited by 753
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Self-citationLearning and inference in the brain
Friston, K. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.06.005 · Cited by 724
Preplay of future place cell sequences by hippocampal cellular assemblies
Dragoi, G., & Tonegawa, S. (2011) · Nature · doi:10.1038/nature09633 · Cited by 716
The global record of memory in hippocampal neuronal activity
Wood, E. R., Dudchenko, P. A., & Eichenbaum, H. (1999) · Nature · doi:10.1038/17605 · Cited by 707
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Self-citationStatistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672
Rhythms of the hippocampal network
Colgin, L. L. (2016) · Nature reviews. Neuroscience · doi:10.1038/nrn.2016.21 · Cited by 654
Active Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650
Self-citationThe construction system of the brain
Hassabis, D., & Maguire, E. A. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0296 · Cited by 483 · cited 2×
“SWR sequences • The content of SWRs emitted during sleep will reflect experience according to (1) its recency and (2) its informativeness,”
BackgroundThe Role of the Hippocampus in Prediction and Imagination
Buckner, R. L. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163508 · Cited by 419
Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
Self-citationHippocampus leads ventral striatum in replay of place-reward information
Lansink, C. S., Goltstein, P. M., Lankelma, J. V., McNaughton, B. L., & Pennartz, C. M. A. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000173 · Cited by 400
Morris, R. G. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04888.x · Cited by 398
The hippocampus: a manifesto for change
Maguire, E. A., & Mullally, S. L. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0033650 · Cited by 393
Buesing, L., Bill, J., Nessler, B., & Maass, W. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002211 · Cited by 384
Theta-paced flickering between place-cell maps in the hippocampus
Jezek, K., Henriksen, E. J., Treves, A., Moser, E. I., & Moser, M.-B. (2011) · Nature · doi:10.1038/nature10439 · Cited by 359
Cannabinoids reveal importance of spike timing coordination in hippocampal function
Robbe, D., Montgomery, S. M., Thome, A., Rueda-Orozco, P. E., McNaughton, B. L., & Buzsaki, G. (2006) · Nature Neuroscience · doi:10.1038/nn1801 · Cited by 333
Hippocampal place cells construct reward related sequences through unexplored space
Ólafsdóttir, H. F., Barry, C., Saleem, A. B., Hassabis, D., & Spiers, H. J. (2015) · eLife · doi:10.7554/elife.06063 · Cited by 319
Reverse replay of hippocampal place cells is uniquely modulated by changing reward
Ambrose, R. E., Pfeiffer, B. E., & Foster, D. J. (2016) · Neuron · doi:10.1016/j.neuron.2016.07.047 · Cited by 292
State-dependent spike-timing relationships between hippocampal and prefrontal circuits during sleep
Wierzynski, C. M., Lubenov, E. V., Gu, M., & Siapas, A. G. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.011 · Cited by 289
New Experiences Enhance Coordinated Neural Activity in the Hippocampus
Cheng, S., & Frank, L. M. (2008) · Neuron · doi:10.1016/j.neuron.2007.11.035 · Cited by 286
Pennartz, C. M. A., Lee, E., Verheul, J., Lipa, P., Barnes, C. A., & McNaughton, B. L. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0575-04.2004 · Cited by 282
O'Neill, J., Senior, T., & Csicsvari, J. (2006) · Neuron · doi:10.1016/j.neuron.2005.10.037 · Cited by 281
Sustained increase in hippocampal sharp-wave ripple activity during slow-wave sleep after learning
Eschenko, O., Ramadan, W., Mölle, M., Born, J., & Sara, S. J. (2008) · Learning & Memory · doi:10.1101/lm.726008 · Cited by 277
Active inference and agency: optimal control without cost functions
Friston, K., Samothrakis, S., & Montague, R. (2012) · Biological Cybernetics · doi:10.1007/s00422-012-0512-8 · Cited by 241
Prospective representation of navigational goals in the human hippocampus
Brown, T. I., Carr, V. A., LaRocque, K. F., Favila, S. E., Gordon, A. M., Bowles, B., Bailenson, J. N., & Wagner, A. D. (2016) · Science · doi:10.1126/science.aaf0784 · Cited by 233
Internally generated sequences in learning and executing goal-directed behavior
Pezzulo, G., van der Meer, M. A. A., Lansink, C. S., & Pennartz, C. M. A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.011 · Cited by 217
Self-citationHippocampal awake replay in fear memory retrieval
Wu, C.-T., Haggerty, D., Kemere, C., & Ji, D. (2017) · Nature Neuroscience · doi:10.1038/nn.4507 · Cited by 210
Self-citationHippocampal Replay Captures the Unique Topological Structure of a Novel Environment
Wu, X., & Foster, D. J. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3414-13.2014 · Cited by 201
The algorithmic anatomy of model-based evaluation
Daw, N. D., & Dayan, P. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0478 · Cited by 195
Hippocampal contributions to the episodic simulation of specific and general future events
Addis, D. R., Cheng, T., P. Roberts, R., & Schacter, D. L. (2011) · Hippocampus · doi:10.1002/hipo.20870 · Cited by 182
Memory trace replay: The shaping of memory consolidation by neuromodulation
Atherton, L. A., Dupret, D., & Mellor, J. R. (2015) · Trends in Neurosciences · doi:10.1016/j.tins.2015.07.004 · Cited by 180
Superficial layers of the medial entorhinal cortex replay independently of the hippocampus
O’Neill, J., Boccara, C. N., Stella, F., Schoenenberger, P., & Csicsvari, J. (2017) · Science · doi:10.1126/science.aag2787 · Cited by 177
Brain mechanisms associated with internally directed attention and self-generated thought
Benedek, M., Jauk, E., Beaty, R. E., Fink, A., Koschutnig, K., & Neubauer, A. C. (2016) · Scientific Reports · doi:10.1038/srep22959 · Cited by 175
Coordinated grid and place cell replay during rest
Ólafsdóttir, H. F., Carpenter, F., & Barry, C. (2016) · Nature Neuroscience · doi:10.1038/nn.4291 · Cited by 175
Pezzulo, G., Rigoli, F., & Chersi, F. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00092 · Cited by 163
Self-citationA role for the hippocampus in encoding simulations of future events
Martin, V. C., Schacter, D. L., Corballis, M. C., & Addis, D. R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1105816108 · Cited by 144
Gaesser, B., Spreng, R. N., McLelland, V. C., Addis, D. R., & Schacter, D. L. (2013) · Hippocampus · doi:10.1002/hipo.22152 · Cited by 78
Prefrontal Goal Codes Emerge as Latent States in Probabilistic Value Learning
Stoianov, I., Genovesio, A., & Pezzulo, G. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00886 · Cited by 44
Self-citationTracing the Roots of Cognition in Predictive Processing
Pezzulo, G. (2017) · Theoretical Philosophy/MIND Group – JGU Mainz · doi:10.15502/9783958573215 · Cited by 33
Self-citation
Cited by
Buzsáki, G. (2019) · doi:10.1093/oso/9780190905385.001.0001 · Cited by 358
Hierarchical active inference: A theory of motivated control
Pezzulo, G., Rigoli, F., & Friston, K. J. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.009 · Cited by 334
“Our proposal emphasizes the centrality of goals and goal directedness for motivated control [10,14,29,42,54,71 – 79].”
Self-citationPrediction and memory: A predictive coding account
Barron, H. C., Auksztulewicz, R., & Friston, K. (2020) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2020.101821 · Cited by 220
Corcoran, A. W., Pezzulo, G., & Hohwy, J. (2020) · Biology & Philosophy · doi:10.1007/s10539-020-09746-2 · Cited by 161
Self-citationReward revaluation biases hippocampal replay content away from the preferred outcome
Carey, A. A., Tanaka, Y., & van der Meer, M. A. A. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0464-6 · Cited by 106
Metadata
- Authors
- Pezzulo, G., Kemere, C., & van der Meer, M. A. A.
- Venue
- Annals of the New York Academy of Sciences
- Publisher
- Wiley
- Published
- 2017-05
- Volume
- 1396
- Issue
- 1
- Pages
- 144-165
- ISSN
- 0077-8923 (ISSN-L)
- 1749-6632
- OpenAlex
- W2617753547
- Cited by
- 96
- References
- 89
- FWCI
- 6.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.