The Neuroscience of Spatial Navigation and the Relationship to Artificial Intelligence
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Recent advances in artificial intelligence (AI) and neuroscience are impressive. In AI, this includes the development of computer programs that can beat a grandmaster at GO or outperform human radiologists at cancer detection. A great deal of these technological developments are directly related to progress in artificial neural networks-initially inspired by our knowledge about how the brain carries out computation. In parallel, neuroscience has also experienced significant advances in understanding the brain. For example, in the field of spatial navigation, knowledge about the mechanisms and brain regions involved in neural computations of cognitive maps-an internal representation of space-recently received the Nobel Prize in medicine. Much of the recent progress in neuroscience has partly been due to the development of technology used to record from very large populations of neurons in multiple regions of the brain with exquisite temporal and spatial resolution in behaving animals. With the advent of the vast quantities of data that these techniques allow us to collect there has been an increased interest in the intersection between AI and neuroscience, many of these intersections involve using AI as a novel tool to explore and analyze these large data sets. However, given the common initial motivation point-to understand the brain-these disciplines could be more strongly linked. Currently much of this potential synergy is not being realized. We propose that spatial navigation is an excellent area in which these two disciplines can converge to help advance what we know about the brain. In this review, we first summarize progress in the neuroscience of spatial navigation and reinforcement learning. We then turn our attention to discuss how spatial navigation has been modeled using descriptive, mechanistic, and normative approaches and the use of AI in such models. Next, we discuss how AI can advance neuroscience, how neuroscience can advance AI, and the limitations of these approaches. We finally conclude by highlighting promising lines of research in which spatial navigation can be the point of intersection between neuroscience and AI and how this can contribute to the advancement of the understanding of intelligent behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
DeepLabCut: markerless pose estimation of user-defined body parts with deep learning
Mathis, A., Mamidanna, P., Cury, K. M., Abe, T., Murthy, V. N., Mathis, M. W., & Bethge, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0209-y · Cited by 5,187 · cited 1×
“Similarly, DNNs have been used for pose estimation of animal videos (Mathis et al., 2018).”
MethodMicrostructure of a spatial map in the entorhinal cortex
Hafting, T., Fyhn, M., Molden, S., Moser, M.-B., & Moser, E. I. (2005) · Nature · doi:10.1038/nature03721 · Cited by 4,068
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
The organization of recent and remote memories
Frankland, P. W., & Bontempi, B. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1607 · Cited by 2,138
Path integration and the neural basis of the 'cognitive map'
McNaughton, B. L., Battaglia, F. P., Jensen, O., Moser, E. I., & Moser, M.-B. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1932 · Cited by 2,024
Memory, navigation and theta rhythm in the hippocampal-entorhinal system
Buzsáki, G., & Moser, E. I. (2013) · Nature Neuroscience · doi:10.1038/nn.3304 · Cited by 1,847
Taube, J., Muller, R., & Ranck, J. (1990) · The Journal of Neuroscience · doi:10.1523/jneurosci.10-02-00420.1990 · Cited by 1,809 · cited 2×
“, 2019), cells that code for head direction (Taube et al., 1990), cells that code for an animals egocentric orientation with respect to environmental features (Wilber et al.”
BackgroundNeuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557
Geometric determinants of the place fields of hippocampal neurons
O'Keefe, J., & Burgess, N. (1996) · Nature · doi:10.1038/381425a0 · Cited by 1,166
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027 · cited 3×
“For example, in some cases, popular and successful algorithms such as backpropagation are used to train such ANNs, which do not emulate the way in which the brain “learns” (Richards et al., 2019).”
BackgroundMethodThe hippocampus as a predictive map
Stachenfeld, K. L., Botvinick, M. M., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4650 · Cited by 1,000
Organizing conceptual knowledge in humans with a gridlike code
Constantinescu, A. O., O’Reilly, J. X., & Behrens, T. E. J. (2016) · Science · doi:10.1126/science.aaf0941 · Cited by 937 · cited 1×
“…in the parietal and entorhinal cortices have been proposed as a general mechanism implemented across the neocortex to represent spatial relationships between objects and as a general mechanism for many conceptual “spaces” (Constantinescu et al., 2016; Behrens et al., 2018; Hawkins et al., 2019).”
BackgroundAccurate Path Integration in Continuous Attractor Network Models of Grid Cells
Burak, Y., & Fiete, I. R. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000291 · Cited by 779 · cited 1×
“This criticism raises the possibility that even if we can train ANNs that perform spatial navigation, this is not a guarantee that the brain might solve the task in a similar way (Burak and Fiete, 2009; Kanitscheider and Fiete, 2017).”
BackgroundKudrimoti, H. S., Barnes, C. A., & McNaughton, B. L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-10-04090.1999 · Cited by 753
Boundary Vector Cells in the Subiculum of the Hippocampal Formation
Lever, C., Burton, S., Jeewajee, A., O'Keefe, J., & Burgess, N. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1319-09.2009 · Cited by 753
Thelen, E., & Smith, L. B. (2007) · Handbook of Child Psychology · doi:10.1002/9780470147658.chpsy0106 · Cited by 729
Preplay of future place cell sequences by hippocampal cellular assemblies
Dragoi, G., & Tonegawa, S. (2011) · Nature · doi:10.1038/nature09633 · Cited by 716 · cited 1×
“There is also evidence that not only previous experiences but also unexplored possibilities are used to evaluate possible outcomes in navigation tasks in rodents (Dragoi and Tonegawa, 2011).”
BackgroundSpeed cells in the medial entorhinal cortex
Kropff, E., Carmichael, J. E., Moser, M.-B., & Moser, E. I. (2015) · Nature · doi:10.1038/nature14622 · Cited by 668
Reinforcement learning, fast and slow
Botvinick, M., Ritter, S., Wang, J. X., Kurth-Nelson, Z., Blundell, C., & Hassabis, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.02.006 · Cited by 667
Navigating cognition: Spatial codes for human thinking
Bellmund, J. L. S., Gärdenfors, P., Moser, E. I., & Doeller, C. F. (2018) · Science · doi:10.1126/science.aat6766 · Cited by 643 · cited 2×
“The brain structures that are involved in spatial navigation and memory formation are also involved in learning (Bellmund et al., 2018).”
BackgroundFast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep
Euston, D. R., Tatsuno, M., & McNaughton, B. L. (2007) · Science · doi:10.1126/science.1148979 · Cited by 586 · cited 1×
“There are numerous examples of experimental evidence that replays occurs in multiple areas of the brain (Skaggs and McNaughton, 1996; Kudrimoti et al., 1999; Euston et al., 2007; Bermudez Contreras et al., 2013; Wilber et al., 2017).”
BackgroundChen, L. L., Lin, L.-H., Green, E. J., Barnes, C. A., & McNaughton, B. L. (1994) · Experimental Brain Research · doi:10.1007/bf00243212 · Cited by 543
From grid cells to place cells: A mathematical model
Solstad, T., Moser, E. I., & Einevoll, G. T. (2006) · Hippocampus · doi:10.1002/hipo.20244 · Cited by 477
Long-term plasticity in hippocampal place-cell representation of environmental geometry
Lever, C., Wills, T., Cacucci, F., Burgess, N., & O'Keefe, J. (2002) · Nature · doi:10.1038/416090a · Cited by 465
Object-vector coding in the medial entorhinal cortex
Høydal, Ø. A., Skytøen, E. R., Andersson, S. O., Moser, M.-B., & Moser, E. I. (2019) · Nature · doi:10.1038/s41586-019-1077-7 · Cited by 366
Could a neuroscientist understand a microprocessor?
Jonas, E., & Paul Kording, K. (2016) · doi:10.1101/055624 · Cited by 329
Retrosplenial cortex maps the conjunction of internal and external spaces
Alexander, A. S., & Nitz, D. A. (2015) · Nature Neuroscience · doi:10.1038/nn.4058 · Cited by 299 · cited 1×
“In addition, recent work has shown that retrosplenial neurons exhibit HD, position, and spike in the relation to the animals distance between path segments, as well as a conjunctive combination of these firing characteristics (Alexander and Nitz, 2015; Mao et al., 2017, 2018).”
BackgroundThe hippocampal-striatal axis in learning, prediction and goal-directed behavior
Pennartz, C. M. A., Ito, R., Verschure, P. F. M. J., Battaglia, F. P., & Robbins, T. W. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.08.001 · Cited by 287
Egocentric coding of external items in the lateral entorhinal cortex
Wang, C., Chen, X., Lee, H., Deshmukh, S. S., Yoganarasimha, D., Savelli, F., & Knierim, J. J. (2018) · Science · doi:10.1126/science.aau4940 · Cited by 276
Using neuroscience to develop artificial intelligence
Ullman, S. (2019) · Science · doi:10.1126/science.aau6595 · Cited by 231 · cited 1×
“For example, the richness of neuronal types, network topologies or the additional dynamics provided by neuromodulators, the combination of local and long-range synaptic connections might improve the capabilities or reduce the limitations of AI approaches (Ullman, 2019).”
BackgroundAttractor Dynamics of Spatially Correlated Neural Activity in the Limbic System
Knierim, J. J., & Zhang, K. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150351 · Cited by 222
Influence of local objects on hippocampal representations: Landmark vectors and memory
Deshmukh, S. S., & Knierim, J. J. (2013) · Hippocampus · doi:10.1002/hipo.22101 · Cited by 217 · cited 3×
“…and Nadel, 1978 ), grid cells (Hafting et al., 2005; Bonnevie et al., 2013), border cells (Solstad et al., 2008), landmark or object vector cells (Deshmukh and Knierim, 2013; Wilber et al., 2014; Høydal et al., 2019), cells that code for head direction (Taube et al., 1990), cells that code for…”
BackgroundKnierim, J. J., & Hamilton, D. A. (2011) · Physiological Reviews · doi:10.1152/physrev.00021.2010 · Cited by 148 · cited 1×
“Experimental support for this theory is derived from studies that require rodents (and humans) to solve navigational tasks where the goal location is not visible from an animals current location (Knierim and Hamilton, 2011).”
BackgroundEgocentric and allocentric representations of space in the rodent brain
Wang, C., Chen, X., & Knierim, J. J. (2020) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.11.005 · Cited by 141
Efficient cortical coding of 3D posture in freely behaving rats
Mimica, B., Dunn, B. A., Tombaz, T., Bojja, V. P. T. N. C. S., & Whitlock, J. R. (2018) · Science · doi:10.1126/science.aau2013 · Cited by 124
Generalisation of structural knowledge in the hippocampal-entorhinal system
Whittington, J. C. R., Muller, T. H., Mark, S., Barry, C., & Behrens, T. E. J. (2018) · arXiv · doi:10.48550/arxiv.1805.09042 · Cited by 36
Cited by
Predictive maps in rats and humans for spatial navigation
de Cothi, W., Nyberg, N., Griesbauer, E.-M., Ghanamé, C., Zisch, F., Lefort, J. M., Fletcher, L., Newton, C., Renaudineau, S., Bendor, D., et al. (2022) · Current Biology · doi:10.1016/j.cub.2022.06.090 · Cited by 109
Predictive coding and stochastic resonance as fundamental principles of auditory phantom perception.
Schilling, A., Sedley, W., Gerum, R., Metzner, C., Tziridis, K., Maier, A., Schulze, H., Zeng, F.-G., Friston, K. J., & Krauss, P. (2023) · Brain · doi:10.1093/brain/awad255 · Cited by 70
Keith, R. E., Shen, Y., Janzen-Meza, J. A., Abramovitz, J., Antonello, P. C., Hameed, A., Mohana Krishnan, B., & Antoine, M. W. (2025) · Science Advances · doi:10.1126/sciadv.adt0780 · Cited by 8
Brain-inspired spatial intelligence for embodied agents
Ruan, S., Wang, L., Kang, C., Zhu, Q., Liu, S., Wei, X., & Su, H. (2026) · Nature Communications · doi:10.1038/s41467-026-74358-5 · Cited by 1
“…with the real physical world, spatial cognition has emerged as a central theme across disciplines, driving advances in robotics 6 , urban simulation 7 , and planetary-scale modeling 8 , while increasingly recognized as a foundational component of arti fi cial general intelligence (AGI) 3,9,10 .”
Metadata
- Authors
- Bermudez-Contreras, E., Clark, B. J., & Wilber, A.
- Venue
- Frontiers in Computational Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2020-07-28
- Volume
- 14
- Pages
- 63-63
- ISSN
- 1662-5188 (ISSN-L)
- OpenAlex
- W3045753504
- Cited by
- 51
- References
- 38
- FWCI
- 3.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.