A Neurocomputational Model of Goal-Directed Navigation in Insect-Inspired Artificial Agents
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Despite their small size, insect brains are able to produce robust and efficient navigation in complex environments. Specifically in social insects, such as ants and bees, these navigational capabilities are guided by orientation directing vectors generated by a process called path integration. During this process, they integrate compass and odometric cues to estimate their current location as a vector, called the home vector for guiding them back home on a straight path. They further acquire and retrieve path integration-based vector memories globally to the nest or based on visual landmarks. Although existing computational models reproduced similar behaviors, a neurocomputational model of vector navigation including the acquisition of vector representations has not been described before. Here we present a model of neural mechanisms in a modular closed-loop control-enabling vector navigation in artificial agents. The model consists of a path integration mechanism, reward-modulated global learning, random search, and action selection. The path integration mechanism integrates compass and odometric cues to compute a vectorial representation of the agent's current location as neural activity patterns in circular arrays. A reward-modulated learning rule enables the acquisition of vector memories by associating the local food reward with the path integration state. A motor output is computed based on the combination of vector memories and random exploration. In simulation, we show that the neural mechanisms enable robust homing and localization, even in the presence of external sensory noise. The proposed learning rules lead to goal-directed navigation and route formation performed under realistic conditions. Consequently, we provide a novel approach for vector learning and navigation in a simulated, situated agent linking behavioral observations to their possible underlying neural substrates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081 · cited 2×
“Computational modeling has been successful in exploring the link between neural structures and their behavioral function, including learning ( Bienenstock et al., 1982; Oja, 1982), perception (Salinas and Abbott, 1995; Olshausen and Field, 1997), and motor control (Todorov and Jordan, 2002).”
Bienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896
Simplified neuron model as a principal component analyzer
Oja, E. (1982) · Journal of Mathematical Biology · doi:10.1007/bf00275687 · Cited by 2,309
Taube, J., Muller, R., & Ranck, J. (1990) · The Journal of Neuroscience · doi:10.1523/jneurosci.10-02-00420.1990 · Cited by 1,809 · cited 1×
“A similar neural code of orientations has been found in the rat limbic system (Taube et al., 1990).”
Neural correlations, population coding and computation
Averbeck, B. B., Latham, P. E., & Pouget, A. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1888 · Cited by 1,743 · cited 1×
“The distribution of errors follows a two-dimensional Gaussian distribution with mean 0.0 (nest) and width δ r . h i In population coding, neural responses are characterized by correlated or uncorrelated noise (Averbeck et al., 2006, see Figure 5C for examples).”
InfluentialSynaptic reverberation underlying mnemonic persistent activity
Wang, X.-J. (2001) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01868-3 · Cited by 1,059
Accurate Path Integration in Continuous Attractor Network Models of Grid Cells
Burak, Y., & Fiete, I. R. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000291 · Cited by 779 · cited 1×
“As such, any path integration system based on linear integration therefore bounds the natural foraging range of the animal in order to exhibit accurate path integration (Burak and Fiete, 2009).”
Etienne, A. S., & Jeffery, K. J. (2004) · Hippocampus · doi:10.1002/hipo.10173 · Cited by 726
Neural dynamics for landmark orientation and angular path integration
Seelig, J. D., & Jayaraman, V. (2015) · Nature · doi:10.1038/nature14446 · Cited by 718 · cited 9×
“Although this model is based on HD cells and therefore presented as for mammalian navigation, recent findings in Drosophila melanogaster (Seelig and Jayaraman, 2015) demonstrate that similar HD accumulator cells can also be hypothesized for insect navigation.”
InfluentialPath integration in desert ants, Cataglyphis fortis
Müller, M., & Wehner, R. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.14.5287 · Cited by 677
Speed cells in the medial entorhinal cortex
Kropff, E., Carmichael, J. E., Moser, M.-B., & Moser, E. I. (2015) · Nature · doi:10.1038/nature14622 · Cited by 668
The Ant Odometer: Stepping on Stilts and Stumps
Wittlinger, M., Wehner, R., & Wolf, H. (2006) · Science · doi:10.1126/science.1126912 · Cited by 496
Visual place learning in Drosophila melanogaster
Ofstad, T. A., Zuker, C. S., & Reiser, M. B. (2011) · Nature · doi:10.1038/nature10131 · Cited by 399
Heterosynaptic plasticity underlies aversive olfactory learning in Drosophila
Hige, T., Aso, Y., Modi, M. N., Rubin, G. M., & Turner, G. C. (2015) · Neuron · doi:10.1016/j.neuron.2015.11.003 · Cited by 354
Feature detection and orientation tuning in the Drosophila central complex
Seelig, J. D., & Jayaraman, V. (2013) · Nature · doi:10.1038/nature12601 · Cited by 290
Wolff, T., Iyer, N. A., & Rubin, G. M. (2015) · Journal of Comparative Neurology · doi:10.1002/cne.23705 · Cited by 286
Central neural coding of sky polarization in insects
Homberg, U., Heinze, S., Pfeiffer, K., Kinoshita, M., & el Jundi, B. (2011) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2010.0199 · Cited by 238 · cited 1×
“The main sensory cue for PI in social insects is derived from the linear polarization of scattered sunlight (Homberg et al., 2011; Lebhardt et al., 2012; Evangelista et al., 2014).”
Neural coding underlying the cue preference for celestial orientation
el Jundi, B., Warrant, E. J., Byrne, M. J., Khaldy, L., Baird, E., Smolka, J., & Dacke, M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1501272112 · Cited by 203
No Need for a Cognitive Map: Decentralized Memory for Insect Navigation
Cruse, H., & Wehner, R. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002009 · Cited by 162
Mapping the navigational knowledge of individually foraging ants,Myrmecia croslandi
Narendra, A., Gourmaud, S., & Zeil, J. (2013) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2013.0683 · Cited by 137 · cited 1×
“These heading directions are view-based from the visual panorama surrounding the ant (Graham and Cheng, 2009; Narendra et al., 2013), and vector-based with additional information about the path segment length (Collett and Collett, 2009, 2015).”
Optimal cue integration in ants
Wystrach, A., Mangan, M., & Webb, B. (2015) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2015.1484 · Cited by 128
Legge, E. L. G., Wystrach, A., Spetch, M. L., & Cheng, K. (2014) · Journal of Experimental Biology · doi:10.1242/jeb.107862 · Cited by 93
Path integration — a network model
Wittmann, T., & Schwegler, H. (1995) · Biological Cybernetics · doi:10.1007/bf00199549 · Cited by 67 · cited 1×
“…and Wehner, 1988; Hartmann and Wehner, 1995) include behavioral data from navigating animals in order to argue for their proposed PI method, others (Wittmann and Schwegler, 1995; Haferlach et al., 2007; Kim and Lee, 2011) have applied neural network models to investigate possible memory mechanisms…”
Kahsai, L., Carlsson, M. A., Winther, Å. M. E., & Nässel, D. R. (2012) · Neuroscience · doi:10.1016/j.neuroscience.2012.02.007 · Cited by 65
Cited by
Hulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D., Takemura, S.-Y., Wolff, T., Noorman, M., Dreher, M., Dan, C., Parekh, R., et al. (2021) · eLife · doi:10.7554/elife.66039 · Cited by 392
An Anatomically Constrained Model for Path Integration in the Bee Brain
Stone, T., Webb, B., Adden, A., Weddig, N. B., Honkanen, A., Templin, R., Wcislo, W., Scimeca, L., Warrant, E., & Heinze, S. (2017) · Current Biology · doi:10.1016/j.cub.2017.08.052 · Cited by 377
Principles of insect path integration
Heinze, S., Narendra, A., & Cheung, A. (2018) · Current Biology · doi:10.1016/j.cub.2018.04.058 · Cited by 195
Hulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D. B., Takemura, S., Wolff, T., Noorman, M., Dreher, M., Dan, C., Parekh, R., et al. (2020) · doi:10.1101/2020.12.08.413955 · Cited by 392
Metadata
- Authors
- Goldschmidt, D., Manoonpong, P., & Dasgupta, S.
- Venue
- Frontiers in Neurorobotics
- Publisher
- Frontiers Media SA
- Published
- 2017-04-12
- Volume
- 11
- Pages
- 20-20
- ISSN
- 1662-5218 (ISSN-L)
- OpenAlex
- W2606680161
- Cited by
- 37
- References
- 25
- FWCI
- 2.42
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.