Forward and Backward Inference in Spatial Cognition
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
This paper shows that the various computations underlying spatial cognition can be implemented using statistical inference in a single probabilistic model. Inference is implemented using a common set of 'lower-level' computations involving forward and backward inference over time. For example, to estimate where you are in a known environment, forward inference is used to optimally combine location estimates from path integration with those from sensory input. To decide which way to turn to reach a goal, forward inference is used to compute the likelihood of reaching that goal under each option. To work out which environment you are in, forward inference is used to compute the likelihood of sensory observations under the different hypotheses. For reaching sensory goals that require a chaining together of decisions, forward inference can be used to compute a state trajectory that will lead to that goal, and backward inference to refine the route and estimate control signals that produce the required trajectory. We propose that these computations are reflected in recent findings of pattern replay in the mammalian brain. Specifically, that theta sequences reflect decision making, theta flickering reflects model selection, and remote replay reflects route and motor planning. We also propose a mapping of the above computational processes onto lateral and medial entorhinal cortex and hippocampus.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“Given that VB approximates the model evidence using free energy, the resulting scheme would then be broadly consistent with the Free Energy Principle [85].”
MethodCognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Simultaneous localization and mapping: part I
Durrant-Whyte, H., & Bailey, T. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1638022 · Cited by 4,199
Microstructure of a spatial map in the entorhinal cortex
Hafting, T., Fyhn, M., Molden, S., Moser, M.-B., & Moser, E. I. (2005) · Nature · doi:10.1038/nature03721 · Cited by 4,068
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771
Simultaneous localization and mapping (SLAM): part II
Bailey, T., & Durrant-Whyte, H. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1678144 · Cited by 2,554
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Path integration and the neural basis of the 'cognitive map'
McNaughton, B. L., Battaglia, F. P., Jensen, O., Moser, E. I., & Moser, M.-B. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1932 · Cited by 2,024
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727 · cited 2×
“Foster and Wilson [76], for example, recorded from cell ensembles in dorsal CA1 hippocampus in awake behaving rats and detected reverse replays after a rat had run the length of a 1D track.”
BackgroundMethodTwo-stage model of memory trace formation: A role for “noisy” brain states
Buzsáki, G. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90423-5 · Cited by 1,709
Selective suppression of hippocampal ripples impairs spatial memory
Girardeau, G., Benchenane, K., Wiener, S. I., Buzsáki, G., & Zugaro, M. B. (2009) · Nature Neuroscience · doi:10.1038/nn.2384 · Cited by 1,560
Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex
Sargolini, F., Fyhn, M., Hafting, T., McNaughton, B. L., Witter, M. P., Moser, M.-B., & Moser, E. I. (2006) · Science · doi:10.1126/science.1125572 · Cited by 1,485
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · cited 1×
“[72], for example, have shown how populations of cells can represent probability distributions using probabilistic population codes in which simple linear combinations of firing rates can implement Bayesian inference.”
BackgroundCellular networks underlying human spatial navigation
Ekstrom, A. D., Kahana, M. J., Caplan, J. B., Fields, T. A., Isham, E. A., Newman, E. L., & Fried, I. (2003) · Nature · doi:10.1038/nature01964 · Cited by 1,425 · cited 1×
“Place cells have also been found in humans using intracranial unit recordings [55], and neuroimaging of human subjects has implicated the hippocampus in navigation [56] and the representation of spatial location [57].”
BackgroundPatients with hippocampal amnesia cannot imagine new experiences
Hassabis, D., Kumaran, D., Vann, S. D., & Maguire, E. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0610561104 · Cited by 1,414
Knowing Where and Getting There: A Human Navigation Network
Maguire, E. A., Burgess, N., Donnett, J. G., Frackowiak, R. S. J., Frith, C. D., & O'Keefe, J. (1998) · Science · doi:10.1126/science.280.5365.921 · Cited by 1,303 · cited 1×
“Place cells have also been found in humans using intracranial unit recordings [55], and neuroimaging of human subjects has implicated the hippocampus in navigation [56] and the representation of spatial location [57].”
BackgroundSelf-citationMemory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Schemas and Memory Consolidation.
Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., & Morris, R. G. M. (2007) · Science · doi:10.1126/science.1135935 · Cited by 1,244
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
(2006) · doi:10.1093/acprof:oso/9780195100273.001.0001 · Cited by 1,186
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074
The anatomy of memory: an interactive overview of the parahippocampal–hippocampal network
van Strien, N. M., Cappaert, N. L. M., & Witter, M. P. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2614 · Cited by 1,041 · cited 1×
“The anatomical connectivity supporting this architecture is described in Figure 3 of [44].”
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 5×
“We note that the above formulation is slightly different to previous definitions by OKeefe and Nadel [1], Gallistel [2], and Redish [3] which stress the capacity of determining and performing a path from a current position towards a desired location.”
BackgroundMethodInfluentialOn the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929 · cited 1×
“Our use of the terms ‘forward’ and ‘backward’ here relate to time and should not be confused with the direction of message passing in a cortical hierarchy [6].”
MethodAwake hippocampal sharp-wave ripples support spatial memory
Jadhav, S. P., Kemere, C., German, P. W., & Frank, L. M. (2012) · Science · doi:10.1126/science.1217230 · Cited by 924 · cited 2×
“There is also evidence, referred to earlier, that replays during awake ripples are involved in spatial working memory [106].”
BackgroundMethodBenchenane, K., Peyrache, A., Khamassi, M., Tierney, P. L., Gioanni, Y., Battaglia, F. P., & Wiener, S. I. (2010) · Neuron · doi:10.1016/j.neuron.2010.05.013 · Cited by 872 · cited 1×
“The above predictions are consistent with recent findings of changes in theta coherence in hippocampal-prefrontal networks [117].”
ResultEvidence for grid cells in a human memory network
Doeller, C. F., Barry, C., & Burgess, N. (2010) · Nature · doi:10.1038/nature08704 · Cited by 828 · cited 1×
“More recently, an fMRI study has found evidence of grid-cell-like representations in human EC [53].”
BackgroundSelf-citationHippocampal replay of extended experience
Davidson, T. J., Kloosterman, F., & Wilson, M. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.027 · Cited by 806 · cited 3×
“This corresponds to a compression factor of about 15 to 20 relative to the original behaviour [102].”
BackgroundAwake replay of remote experiences in the hippocampus
Karlsson, M. P., & Frank, L. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2344 · Cited by 769 · cited 1×
“In one experiment [105], rats were exposed to two different environments which had the same physical structure (allocentric layout) but differed in their set of visual cues.”
MethodPreplay of future place cell sequences by hippocampal cellular assemblies
Dragoi, G., & Tonegawa, S. (2011) · Nature · doi:10.1038/nature09633 · Cited by 716 · cited 1×
“Finally, Dragoi and Tonegawa [107] have observed ‘preplay’ activity.”
BackgroundThe construction system of the brain
Hassabis, D., & Maguire, E. A. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0296 · Cited by 483 · cited 1×
“The above predictions (and state estimates mn) are then (separately) propagated back down cortical hierarchies, creating egocentric sensory imagery in lower-level regions of scene construction networks [65].”
BackgroundDevelopment of Cue Integration in Human Navigation
Nardini, M., Jones, P., Bedford, R., & Braddick, O. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.021 · Cited by 431
Theta-paced flickering between place-cell maps in the hippocampus
Jezek, K., Henriksen, E. J., Treves, A., Moser, E. I., & Moser, M.-B. (2011) · Nature · doi:10.1038/nature10439 · Cited by 359
Evolution of declarative memory
Manns, J. R., & Eichenbaum, H. (2006) · Hippocampus · doi:10.1002/hipo.20205 · Cited by 345 · cited 1×
“This is consistent with a recent schematic model [48], where it is argued that this functionality is preserved across mammals.”
ResultTraces of experience in the lateral entorhinal cortex
Tsao, A., Moser, M.-B., & Moser, E. I. (2013) · Current Biology · doi:10.1016/j.cub.2013.01.036 · Cited by 290
Pennartz, C. M. A., Lee, E., Verheul, J., Lipa, P., Barnes, C. A., & McNaughton, B. L. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0575-04.2004 · Cited by 282 · cited 1×
“This is consistent with an earlier model [89] and the observation of ripple activity propagating to this region [90].”
ResultGeneral duality between optimal control and estimation
Todorov, E. (2008) · 2008 47th IEEE Conference on Decision and Control · doi:10.1109/cdc.2008.4739438 · Cited by 248
Decoding Neuronal Ensembles in the Human Hippocampus
Hassabis, D., Chu, C., Rees, G., Weiskopf, N., Molyneux, P. D., & Maguire, E. A. (2009) · Current Biology · doi:10.1016/j.cub.2009.02.033 · Cited by 231 · cited 1×
“Place cells have also been found in humans using intracranial unit recordings [55], and neuroimaging of human subjects has implicated the hippocampus in navigation [56] and the representation of spatial location [57].”
BackgroundFrom chemotaxis to the cognitive map: The function of olfaction
Jacobs, L. F. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1201880109 · Cited by 227 · cited 1×
“More realistic environments with multiple olfactory sources and turbulence [26] are beyond the scope of this paper.”
BackgroundDistances between real-world locations are represented in the human hippocampus
Morgan, L. K., MacEvoy, S. P., Aguirre, G. K., & Epstein, R. A. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4667-10.2011 · Cited by 203 · cited 1×
“A representation of spatial distance has also been identified in left hippocampus [58].”
BackgroundPezzulo, G., Rigoli, F., & Chersi, F. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00092 · Cited by 163 · cited 2×
“[19] have embedded both types of decision making systems into a single ‘mixed instrumental controller’.”
Background
Cited by
Active inference: a process theory
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., & Pezzulo, G. (2017) · Neural Computation · doi:10.1162/neco_a_00912 · Cited by 1,156
“However, the scheme does not use conventional forward and backward sweeps (Penny et al., 2013; Pezzulo, Rigoli, & Chersi, 2013), because all future and past states are encoded explicitly.”
BackgroundMethodThe hippocampus as a predictive map
Stachenfeld, K. L., Botvinick, M. M., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4650 · Cited by 1,000
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Active Inference, homeostatic regulation and adaptive behavioural control
Pezzulo, G., Rigoli, F., & Friston, K. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.001 · Cited by 650
“The same idea arises in embodied predictive coding , where perceptual inference minimizes both sensory and proprioceptive error (Pezzulo, 2013).”
InfluentialFriston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Metadata
- Authors
- Penny, W. D., Zeidman, P., & Burgess, N.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-12-12
- Volume
- 9
- Issue
- 12
- Pages
- e1003383
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2117257474
- Cited by
- 68
- References
- 42
- FWCI
- 3.53
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.