Generalisation of structural knowledge in the hippocampal-entorhinal system
Open accessAbstract
A central problem to understanding intelligence is the concept of generalisation. This allows previously learnt structure to be exploited to solve tasks in novel situations differing in their particularities. We take inspiration from neuroscience, specifically the hippocampal-entorhinal system known to be important for generalisation. We propose that to generalise structural knowledge, the representations of the structure of the world, i.e. how entities in the world relate to each other, need to be separated from representations of the entities themselves. We show, under these principles, artificial neural networks embedded with hierarchy and fast Hebbian memory, can learn the statistics of memories and generalise structural knowledge. Spatial neuronal representations mirroring those found in the brain emerge, suggesting spatial cognition is an instance of more general organising principles. We further unify many entorhinal cell types as basis functions for constructing transition graphs, and show these representations effectively utilise memories. We experimentally support model assumptions, showing a preserved relationship between entorhinal grid and hippocampal place cells across environments.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
According to IWMT, coherent self-world modeling likely requires organizing information into spatiotemporal trajectories.
“According to IWMT, coherent self-world modeling likely also requires organizing this information into spatiotemporal trajectories”
From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Whittington et al., 2018
The hippocampal system and machine learning architectures that attempt to reproduce its functioning afford spatiotemporal trajectories.
“as afforded by the hippocampal system and machine learning architectures that attempt to reproduce its functioning”
From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Whittington et al., 2018
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641 · see citing works
The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat
O'Keefe, J., & Dostrovsky, J. (1971) · Brain Research · doi:10.1016/0006-8993(71)90358-1 · Cited by 6,151 · see citing works
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256 · see citing works
Microstructure of a spatial map in the entorhinal cortex
Hafting, T., Fyhn, M., Molden, S., Moser, M.-B., & Moser, E. I. (2005) · Nature · doi:10.1038/nature03721 · Cited by 4,068 · see citing works
Taube, J., Muller, R., & Ranck, J. (1990) · The Journal of Neuroscience · doi:10.1523/jneurosci.10-02-00420.1990 · Cited by 1,809 · see citing works
Patients with hippocampal amnesia cannot imagine new experiences
Hassabis, D., Kumaran, D., Vann, S. D., & Maguire, E. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610561104 · Cited by 1,414 · see citing works
Representation of Geometric Borders in the Entorhinal Cortex
Solstad, T., Boccara, C. N., Kropff, E., Moser, M.-B., & Moser, E. I. (2008) · Science · doi:10.1126/science.1166466 · Cited by 1,213 · see citing works
The hippocampus as a predictive map
Stachenfeld, K. L., Botvinick, M. M., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4650 · Cited by 1,000 · see citing works
Organizing conceptual knowledge in humans with a gridlike code
Constantinescu, A. O., O’Reilly, J. X., & Behrens, T. E. J. (2016) · Science · doi:10.1126/science.aaf0941 · Cited by 937 · see citing works
Self-citationMapping of a non-spatial dimension by the hippocampal-entorhinal circuit
Aronov, D., Nevers, R., & Tank, D. W. (2017) · Nature · doi:10.1038/nature21692 · Cited by 773 · see citing works
Hippocampal remapping and grid realignment in entorhinal cortex
Fyhn, M., Hafting, T., Treves, A., Moser, M.-B., & Moser, E. I. (2007) · Nature · doi:10.1038/nature05601 · Cited by 749 · see citing works
The global record of memory in hippocampal neuronal activity
Wood, E. R., Dudchenko, P. A., & Eichenbaum, H. (1999) · Nature · doi:10.1038/17605 · Cited by 707 · see citing works
The entorhinal grid map is discretized
Stensola, H., Stensola, T., Solstad, T., Frøland, K., Moser, M., & Moser, E. I. (2012) · Nature · doi:10.1038/nature11649 · Cited by 702 · see citing works
The hippocampus and memory for orderly stimulus relations
Dusek, J. A., & Eichenbaum, H. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.13.7109 · Cited by 610 · see citing works
Integrating time from experience in the lateral entorhinal cortex
Tsao, A., Sugar, J., Lu, L., Wang, C., Knierim, J. J., Moser, M.-B., & Moser, E. I. (2018) · Nature · doi:10.1038/s41586-018-0459-6 · Cited by 490 · see citing works
Using Fast Weights to Attend to the Recent PastPreprint
Ba, J., Hinton, G. E., Mnih, V., Leibo, J., & Ionescu, C. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1610.06258 · Cited by 386 · see citing works
Robust Conjunctive Item–Place Coding by Hippocampal Neurons Parallels Learning What Happens Where
Komorowski, R. W., Manns, J. R., & Eichenbaum, H. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1378-09.2009 · Cited by 372 · see citing works
Using Grid Cells for Navigation
Bush, D., Barry, C., Manson, D., & Burgess, N. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.006 · Cited by 334 · see citing works
Self-citationTracking the emergence of conceptual knowledge during human decision making
Kumaran, D., Summerfield, J. J., Hassabis, D., & Maguire, E. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.030 · Cited by 260 · see citing works
Entorhinal Cortex Lesions Disrupt the Relational Organization of Memory in Monkeys
Buckmaster, C. A., Eichenbaum, H., Amaral, D. G., SUZUKI, W. A., & Rapp, P. R. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.1532-04.2004 · Cited by 198 · see citing works
Modular Realignment of Entorhinal Grid Cell Activity as a Basis for Hippocampal Remapping
Monaco, J. D., & Abbott, L. F. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1433-11.2011 · Cited by 113 · see citing works
Generative Temporal Models with MemoryPreprint
Gemici, M., Hung, C.-C., Santoro, A., Wayne, G., Mohamed, S., Rezende, D. J., Amos, D., & Lillicrap, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.04649 · Cited by 35 · see citing works
Generative Temporal Models with Spatial Memory for Partially Observed EnvironmentsPreprint
Fraccaro, M., Rezende, D. J., Zwólš, Y., Pritzel, A., Eslami, S. M. A., & Viola, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09401 · Cited by 15 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Whittington, J. C. R., Muller, T. H., Mark, S., Chen, G., Barry, C., Burgess, N., & Behrens, T. E. J. (2020) · Cell · doi:10.1016/j.cell.2020.10.024 · Cited by 660 · see citing works
Self-citationHuman replay spontaneously reorganizes experience
Liu, Y., Dolan, R. J., Kurth-Nelson, Z., & Behrens, T. E. J. (2019) · Cell · doi:10.1016/j.cell.2019.06.012 · Cited by 497 · see citing works
Self-citationSafron, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00030 · Cited by 133 · see citing works
“…the hippocampal system and machine learning architectures that attempt to reproduce its functioning (Fraccaro et al., 2017; Ha and Schmidhuber, 2018; Whittington et al., 2018; Wu et al., 2018), and as suggested by impaired counterfactual modeling with medial temporal lobe damage (Hassabis and…”
BackgroundA unified theory for the computational and mechanistic origins of grid cells
Sorscher, B., Mel, G. C., Ocko, S. A., Giocomo, L. M., & Ganguli, S. (2022) · Neuron · doi:10.1016/j.neuron.2022.10.003 · Cited by 126 · see citing works
How many neurons are sufficient for perception of cortical activity?
Dalgleish, H. W. P., Russell, L. E., Packer, A. M., Roth, A., Gauld, O. M., Greenstreet, F., Thompson, E. J., & Häusser, M. (2020) · eLife · doi:10.7554/elife.58889 · Cited by 121 · see citing works
George, D., Rikhye, R. V., Gothoskar, N., Guntupalli, J. S., Dedieu, A., & Lázaro-Gredilla, M. (2021) · Nature Communications · doi:10.1038/s41467-021-22559-5 · Cited by 109 · see citing works
An Active Inference Approach to Modeling Structure Learning: Concept Learning as an Example Case
Smith, R. S., Schwartenbeck, P., Parr, T., & Friston, K. J. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00041 · Cited by 111 · see citing works
Stoianov, I. P., Maisto, D., & Pezzulo, G. (2022) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2022.102329 · Cited by 68 · see citing works
Song, Y., Lukasiewicz, T., Xu, Z., & Bogacz, R. (2020) · PubMed · Cited by 60 · see citing works
A model of egocentric to allocentric understanding in mammalian brains
Uria, B., Ibarz, B., Banino, A., Zambaldi, V., Kumaran, D., Hassabis, D., Barry, C., & Blundell, C. (2020) · doi:10.1101/2020.11.11.378141 · Cited by 48 · see citing works
Self-citationThe Neuroscience of Spatial Navigation and the Relationship to Artificial Intelligence
Bermudez-Contreras, E. J., Clark, B. J., & Wilber, A. A. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00063 · Cited by 50 · see citing works
Emergence of a predictive model in the hippocampus
Miller, A. M. P., Jacob, A. D., Ramsaran, A. I., de Snoo, M. L., Josselyn, S. A., & Frankland, P. W. (2023) · Neuron · doi:10.1016/j.neuron.2023.03.011 · Cited by 43 · see citing works
Reward-predictive representations generalize across tasks in reinforcement learning
Lehnert, L., Littman, M. L., & Frank, M. J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008317 · Cited by 43 · see citing works
Cognitive maps and novel inferences: a flexibility hierarchy
Boorman, E. D., Sweigart, S. C., & Park, S. A. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.02.017 · Cited by 36 · see citing works
Safron, A., Çatal, O., & Verbelen, T. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.787659 · Cited by 33 · see citing works
Space is a latent sequence: A theory of the hippocampus
Raju, R. V., Guntupalli, J. S., Zhou, G., Wendelken, C., Lázaro-Gredilla, M., & George, D. (2024) · Science Advances · doi:10.1126/sciadv.adm8470 · Cited by 25 · see citing works
An Active Inference Approach to Modeling Structure Learning: Concept Learning as an Example Case
Smith, R., Schwartenbeck, P., Parr, T., & Friston, K. J. (2020) · UCL Discovery (University College London) · Cited by 26 · see citing works
Distinct Neural Representations of Content and Ordinal Structure in Auditory Sequence Memory
Fan, Y., Han, Q., Guo, S., & Luo, H. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.0320-21.2021 · Cited by 22 · see citing works
Why grid cells function as a metric for space
Dang, S., Wu, Y., Yan, R., & Tang, H. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.04.031 · Cited by 20 · see citing works
Map making: Constructing, combining, and inferring on abstract cognitive mapsPreprint
Park, S. A., Miller, D. S., Nili, H., Ranganath, C., & Boorman, E. D. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/810051 · Cited by 17 · see citing works
Transition Scale-Spaces: A Computational Theory for the Discretized Entorhinal Cortex
Waniek, N. (2019) · Neural Computation · doi:10.1162/neco_a_01255 · Cited by 12 · see citing works
What is a cognitive map? Organising knowledge for flexible behaviourPreprint
Behrens, T. E. J., Müller, T., Whittington, J. C. R., Mark, S., Baram, A. B., Stachenfeld, K., & Kurth-Nelson, Z. L. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/365593 · Cited by 11 · see citing works
Self-citationPeople are represented and remembered through their relationships with othersPreprint
Jolly, E., Sadhukha, S., Iqbal, M., Molani, Z., Walsh, T., Manning, J. R., & Chang, L. J. (2023) · doi:10.31234/osf.io/bw9r2 · Cited by 9 · see citing works
An active inference approach to modeling structure learning: concept learning as an example casePreprint
Smith, R., Schwartenbeck, P., Parr, T., & Friston, K. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/633677 · Cited by 8 · see citing works
Successive POI Recommendation via Brain-Inspired Spatiotemporal Aware Representation
Ma, G., Wang, H., Zhao, J., Yan, R., & Tang, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i1.27813 · Cited by 7 · see citing works
Replay as structural inference in the hippocampal-entorhinal systemPreprint
Evans, T., & Burgess, N. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.07.241547 · Cited by 7 · see citing works
Determinantal Point Processes for Memory and Structured Inference.
Frankland, S., & Cohen, J. (2020) · eScholarship (California Digital Library) · Cited by 4 · see citing works
Subicular spatial codes arise from predictive mappingPreprint
Bennett, L., de Cothi, W., Muessig, L., Rodrigues, F. R., Cacucci, F., Wills, T. J., Sun, Y., Giocomo, L. M., Lever, C., Poulter, S. L., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.11.06.622306 · Cited by 4 · see citing works
Self-citationHow do ramping dynamics influence computations in the entorhinal cortex?
Nolan, M. F. (2025) · Trends in Neurosciences · doi:10.1016/j.tins.2025.08.005 · Cited by 2 · see citing works
Identifying Transfer Learning in the Reshaping of Inductive Biases
Székely, A., Török, B., Kiss, M. M., Janacsek, K., Németh, D., & Orbán, G. (2024) · Open Mind · doi:10.1162/opmi_a_00158 · Cited by 3 · see citing works
Identifying Transfer Learning in the Reshaping of Inductive BiasesPreprint
Székely, A., Török, B., Kiss, M. M., Janacsek, K., Németh, D., & Orbán, G. (2024) · doi:10.31234/osf.io/jvumf · Cited by 1 · see citing works
Magrans, I., Garrett, M., Ollerenshaw, D. R., Groblewski, P. A., Olsen, S. R., & Mihalas, S. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2019.12.19.883470
Evolution of predictive memory in the hippocampusPreprint
Miller, A. M. P., Jacob, A. D., Ramsaran, A. I., de Snoo, M. L., Josselyn, S. A., & Frankland, P. W. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.09.08.507204
Abstract rule generalization for composing novel meaning recruits the frontoparietal control networkPreprint
Zheng, X., Garvert, M. M., den Ouden, H. E. M., Horstman, L. I., Richter, D., & Cools, R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.30.621101
If Grid Cells are the Answer, What is the Question? A Review of Normative Grid Cell TheoryPreprint
Dorrell, W., & Whittington, J. C. R. (2026) · eLife · doi:10.7554/elife.111058
Self-citationIf Grid Cells are the Answer, What is the Question? A Review of Normative Grid Cell TheoryPreprint
Dorrell, W., & Whittington, J. C. R. (2026) · eLife · doi:10.7554/elife.111058.1
Self-citation
- Authors
- Whittington, J. C. R., Muller, T. H., Mark, S., Barry, C., & Behrens, T. E. J.
- Affiliations
- John Radcliffe Hospital (GB)
- University College London (GB)
- University of Oxford (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 8484-8495
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1805.09042
- OpenAlex
- W2804040390
- Cited by
- 36
- References
- 24
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 6 · 2023: 2 · 2022: 4 · 2021: 4 · 2020: 11 · 2019: 5 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- James S. McDonnell Foundation (JSMF220020372)
- Wellcome Trust (WT104765MA)
- Medical Research Council
- Engineering and Physical Sciences Research Council
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Physical Sciences › Engineering › Automotive Engineering › Spatial Cognition and Navigation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- generalization, structural knowledge, place cells, spatial cognition, artificial neural networks, hierarchical representation, state diagrams, intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
