Spatial Learning and Action Planning in a Prefrontal Cortical Network Model
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
The interplay between hippocampus and prefrontal cortex (PFC) is fundamental to spatial cognition. Complementing hippocampal place coding, prefrontal representations provide more abstract and hierarchically organized memories suitable for decision making. We model a prefrontal network mediating distributed information processing for spatial learning and action planning. Specific connectivity and synaptic adaptation principles shape the recurrent dynamics of the network arranged in cortical minicolumns. We show how the PFC columnar organization is suitable for learning sparse topological-metrical representations from redundant hippocampal inputs. The recurrent nature of the network supports multilevel spatial processing, allowing structural features of the environment to be encoded. An activation diffusion mechanism spreads the neural activity through the column population leading to trajectory planning. The model provides a functional framework for interpreting the activity of PFC neurons recorded during navigation tasks. We illustrate the link from single unit activity to behavioral responses. The results suggest plausible neural mechanisms subserving the cognitive "insight" capability originally attributed to rodents by Tolman & Honzik. Our time course analysis of neural responses shows how the interaction between hippocampus and PFC can yield the encoding of manifold information pertinent to spatial planning, including prospective coding and distance-to-goal correlates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Microstructure of a spatial map in the entorhinal cortex
Hafting, T., Fyhn, M., Molden, S., Moser, M.-B., & Moser, E. I. (2005) · Nature · doi:10.1038/nature03721 · Cited by 4,068
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
Dynamics of the Hippocampal Ensemble Code for Space
Wilson, M. A., & McNaughton, B. L. (1993) · Science · doi:10.1126/science.8351520 · Cited by 2,350 · cited 1×
“On the other hand, the hippocampal space code is likely to be highly redundant and distributed [18], which does not seem adequate for learning compact topological representations of high-dimensional spatial contexts.”
BackgroundPath integration and the neural basis of the 'cognitive map'
McNaughton, B. L., Battaglia, F. P., Jensen, O., Moser, E. I., & Moser, M.-B. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1932 · Cited by 2,024
DEFICITS IN STRATEGY APPLICATION FOLLOWING FRONTAL LOBE DAMAGE IN MAN
SHALLICE, T., & BURGESS, P. W. (1991) · Brain · doi:10.1093/brain/114.2.727 · Cited by 2,017 · cited 1×
“Among the cortical areas involved in map building and action planning, the prefrontal cortex (PFC) is likely to play a central role, as suggested by anatomical PFC lesion studies showing impaired navigation planning in rats”
BackgroundHabits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697
Selective suppression of hippocampal ripples impairs spatial memory
Girardeau, G., Benchenane, K., Wiener, S. I., Buzsáki, G., & Zugaro, M. B. (2009) · Nature Neuroscience · doi:10.1038/nn.2384 · Cited by 1,560
Self-citationRelative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 2×
“Moreover, the model can merely deal with a single goal at present and can not estimate relative values of different goals [63].”
BackgroundPrefrontal cortex in the rat: Projections to subcortical autonomic, motor, and limbic centers
Gabbott, P. L. A., Warner, T. A., Jays, P. R. L., Salway, P., & Busby, S. J. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20738 · Cited by 1,227 · cited 1×
“Neuroanatomical findings (see [45] for a review; see [46,47] for anatomical data on rat PFC) suggest that columns can be further divided into several minicolumns, each of which consists of a population of interconnected neurons [48].”
BackgroundTheta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task
Jones, M. W., & Wilson, M. A. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030402 · Cited by 1,036 · cited 1×
“) and that the hippocampus and the PFC seem to synchronize at behaviorally relevant places in a maze, such as decision points”
Remembering the past and imagining the future: A neural model of spatial memory and imagery.
Byrne, P., Becker, S., & Burgess, N. (2007) · Psychological Review · doi:10.1037/0033-295x.114.2.340 · Cited by 1,011
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 1×
“In addition, complementing their location selectivity, hippocampal place cells may have extrafield firings, and neural ensembles in the hippocampus may transiently encode paths forward of the animal [112].”
BackgroundCompetition among multiple memory systems: converging evidence from animal and human brain studies
Poldrack, R. A., & Packard, M. G. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00157-4 · Cited by 880 · cited 1×
“processing mediated by a network of brain structures that interact to promote effective spatial behavior [3,9–11].”
BackgroundBenchenane, K., Peyrache, A., Khamassi, M., Tierney, P. L., Gioanni, Y., Battaglia, F. P., & Wiener, S. I. (2010) · Neuron · doi:10.1016/j.neuron.2010.05.013 · Cited by 872 · cited 2×
“Wiener’s laboratory; see detailed methods in [59,60]— extracellular recordings were performed from medial PFC pyramidal cells of Long-Evans rats solving a spatial memory task.”
BackgroundMethodEpisodic Simulation of Future Events: Concepts, Data, and Applications
Schacter, D. L., Addis, D. R., & Buckner, R. L. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.001 · Cited by 840
Replay of rule-learning related neural patterns in the prefrontal cortex during sleep
Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., & Battaglia, F. P. (2009) · Nature Neuroscience · doi:10.1038/nn.2337 · Cited by 767
Self-citationEtienne, A. S., & Jeffery, K. J. (2004) · Hippocampus · doi:10.1002/hipo.10173 · Cited by 726 · cited 1×
“path integration [8]).”
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 1×
“neurons allowed the value of each state to be assessed with respect to its relevance to goal-oriented behavior, consistently with PFC recordings showing reward-dependent activity patterns”
The ‘module-concept’ in cerebral cortex architecture
Szentágothai, J. (1975) · Brain Research · doi:10.1016/0006-8993(75)90122-5 · Cited by 614
Neural Activity in the Primate Prefrontal Cortex during Associative Learning
Asaad, W. F., Rainer, G., & Miller, E. K. (1998) · Neuron · doi:10.1016/s0896-6273(00)80658-3 · Cited by 593
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · cited 1×
“The second limitation of the model is related to the issue of goal representation in the PFC. The model makes decisions based on an appetitive motivational signal only (i.e. the reward at the goal site). Clearly, there are other variables apart from the reward size that influence the planning process. For example, the…”
Vogels, T. P., Rajan, K., & Abbott, L. F. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135637 · Cited by 497 · cited 1×
“stressed that the size, cell composition, synaptic organization, expression of signaling molecules, and function of various types of columns are dramatically different across the cortex, so that the general concept of column should be employed carefully. In our model, we call “column” a local micro-circuit composed by…”
Spatial cognitive maps in animals: New hypotheses on their structure and neural mechanisms.
Poucet, B. (1993) · Psychological Review · doi:10.1037/0033-295x.100.2.163 · Cited by 434 · cited 1×
“In contrast to the qualitative but operational space code provided by topological maps, metrical representations form more precise descriptions of the environment that are available only at specific locations until the environment has been extensively explored [5].”
BackgroundProspective coding for objects in primate prefrontal cortex
Rainer, G., Rao, S. C., & Miller, E. K. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05493.1999 · Cited by 432 · cited 1×
“8B,D, see also [62,65]); and, finally, (iv) neurons q and d, which together encode state-action values, show activity patterns similar to strategy-switching neurons observed by Rich and Shapiro [37].”
MethodA model of hippocampal function
Burgess, N., Recce, M., & O'Keefe, J. (1994) · Neural Networks · doi:10.1016/s0893-6080(05)80159-5 · Cited by 393
The hippocampus as a cognitive graph.
Muller, R. U., Stead, M., & Pach, J. (1996) · The Journal of general physiology · doi:10.1085/jgp.107.6.663 · Cited by 391 · cited 1×
“On the one hand, the hippocampus has been proposed to encode topological-like representations suitable for action sequence learning [16] (see [15] for a review of models).”
BackgroundThoughts, behaviour, and brain dynamics during navigation in the real world
Spiers, H. J., & Maguire, E. A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.037 · Cited by 371 · cited 1×
“Among the cortical areas involved in map building and action planning, the prefrontal cortex (PFC) is likely to play a central role, as suggested by anatomical PFC lesion studies showing impaired navigation planning in rats [24,25] and neuroimaging studies [26,27].”
BackgroundSubjective hierarchies in spatial memory.
McNamara, T. P., Hardy, J. K., & Hirtle, S. C. (1989) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.15.2.211 · Cited by 323
Activity in the lateral prefrontal cortex reflects multiple steps of future events in action plans
Mushiake, H., Saito, N., Sakamoto, K., Itoyama, Y., & Tanji, J. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.045 · Cited by 249 · cited 1×
“[104] showed that activity in the PFC reflects multiple steps of future events in action plans.”
BackgroundPurposive behavior and cognitive mapping: a neural network model
Schmajuk, N. A., & Thieme, A. D. (1992) · Biological Cybernetics · doi:10.1007/bf00201023 · Cited by 91
Mulder, A. B., Nordquist, R. E., Örgüt, O., & Pennartz, C. M. A. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.016 · Cited by 84
Cited by
Key, B. (2016) · Animal Sentience · doi:10.51291/2377-7478.1011 · Cited by 318
Howard, L. R., Javadi, A. H., Yu, Y., Mill, R. D., Morrison, L. C., Knight, R., Loftus, M. M., Staskute, L., & Spiers, H. J. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.001 · Cited by 298
Insects have the capacity for subjective experience
Klein, C., & Barron, A. B. (2016) · Animal Sentience · doi:10.51291/2377-7478.1113 · Cited by 243
The Cognitive Architecture of Spatial Navigation: Hippocampal and Striatal Contributions
Chersi, F., & Burgess, N. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.021 · Cited by 240
Planning and navigation as active inference
Kaplan, R., & Friston, K. J. (2018) · Biological Cybernetics · doi:10.1007/s00422-018-0753-2 · Cited by 203
Metadata
- Authors
- Martinet, L.-E., Sheynikhovich, D., Benchenane, K., & Arleo, A.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-05-19
- Volume
- 7
- Issue
- 5
- Pages
- e1002045
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2089305598
- Cited by
- 82
- References
- 32
- FWCI
- 3.32
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.