CoChat

A unified mechanism for innate and learned visual landmark guidance in the insect central complex

Open access

Published version of a preprint

The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.

Abstract

Insects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can elicit strong innate behaviours (attraction or menotaxis) but can also be used, after learning, as a specific directional cue as part of a navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for the behavioural integration of innate and learned guidance based on the neuroanatomy of the central complex (CX), adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory in the mushroom bodies (MB) that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple world containing a single visual cue, we show how the generated short-term memory can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with the observed effects of unilateral MB lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a mapping of the environment that describes the geometrical attractiveness (or repulsion). We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimal cue integration.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pcbi.1009383

Cites

116 of 116 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Abbreviation of brain structures and neurons, and schematic of the CX model. Indication of the different neuronal pathways used in the model, each pathway is represented by only 1 neuron example showing input and output(s) termination. The left part of the diagram shows the EB compass pathway, the right part shows the steering control pathway. Known pathways are indicated in plain lines while hypothetical pathways are shown with dotted lines.
Fig 1 Abbreviation of brain structures and neurons, and schematic of the CX model. Indication of the different neuronal pathways used in the model, each pathway is represented by only 1 neuron example showing input and output(s) termination. The left part of the diagram shows the EB compass pathway, the right part shows the steering control pathway. Known pathways are indicated in plain lines while hypothetical pathways are shown with dotted lines.CC BY · PubMed Central
Fig 2 Model visual system. A. Map of the 1296 (48x27) elementary units composing the visual system. The visual span is fully panoramic (360°) on the azimuth and 81° upward on the elevation. The red framed visual unit is the one used as example in B. B. Elementary visual unit process. Each unit acts as a orientation-free edge detector. The comparison of the summed intensity of the left vs the right of the unit and of the top vs the bottom gives an index from 0 (no difference ↔ no edge) to 1 (corner edge) for each unit.
Fig 2 Model visual system. A. Map of the 1296 (48x27) elementary units composing the visual system. The visual span is fully panoramic (360°) on the azimuth and 81° upward on the elevation. The red framed visual unit is the one used as example in B. B. Elementary visual unit process. Each unit acts as a orientation-free edge detector. The comparison of the summed intensity of the left vs the right of the unit and of the top vs the bottom gives an index from 0 (no difference ↔ no edge) to 1 (corner edge) for each unit.CC BY · PubMed Central
Fig 3 Ellipsoid body compass model. A. Connectivity diagram between the main neurons of the EB-PB model, EPGs, PEGs and PENs. EPGs have inhibitory connections with each other as indicated, via Delta7 neurons (black lines; one example is shown from the EPG4 in the central part of the diagram). EPGs (light blue) form a recurrent circuit with PEGs (green) while forming connection with neighbouring EPGs through PENs (pink) on each side. B. Connection diagram from the visual circuit to the EPGs. Each angular segment connects in a retinotopic manner to the EPGs. Intrinsically this results in an activity bump forming in the circuit that corresponds to the direction of highest visual contrast. C. Proprioceptive inputs to the PENs. When the agent is engaged in a left turn, PEN1−8 are stimulated, while during a right turn PEN9−16 are stimulated. This will trigger a counter-motion of the bump (posterior view) so that it still indicates the relative direction of the external cue(s). D. Example of the function of the EB model in an arena surrounded by a single cue (here a cylinder represented by the black circle). The blue line shows the path of the agent without any influence of the CX model, i.e. only produced by the steering noise. E. Activity rate of the three neuron types constituting the EB model. On the first line, the activity of EPGs (blue for no activity to yellow for active) shows a perfect following of the cue orientation in the agent’s visual field (red line, scale on the right). Even during a darkness episode (from 1500th to 2500th steps), the model keeps track of the cue position with a relatively low error thanks to the PENs (second line) and PEGs (third line) combined actions.
Fig 3 Ellipsoid body compass model. A. Connectivity diagram between the main neurons of the EB-PB model, EPGs, PEGs and PENs. EPGs have inhibitory connections with each other as indicated, via Delta7 neurons (black lines; one example is shown from the EPG4 in the central part of the diagram). EPGs (light blue) form a recurrent circuit with PEGs (green) while forming connection with neighbouring EPGs through PENs (pink) on each side. B. Connection diagram from the visual circuit to the EPGs. Each angular segment connects in a retinotopic manner to the EPGs. Intrinsically this results in an activity bump forming in the circuit that corresponds to the direction of highest visual contrast. C. Proprioceptive inputs to the PENs. When the agent is engaged in a left turn, PEN1−8 are stimulated, while during a right turn PEN9−16 are stimulated. This will trigger a counter-motion of the bump (posterior view) so that it still indicates the relative direction of the external cue(s). D. Example of the function of the EB model in an arena surrounded by a single cue (here a cylinder represented by the black circle). The blue line shows the path of the agent without any influence of the CX model, i.e. only produced by the steering noise. E. Activity rate of the three neuron types constituting the EB model. On the first line, the activity of EPGs (blue for no activity to yellow for active) shows a perfect following of the cue orientation in the agent’s visual field (red line, scale on the right). Even during a darkness episode (from 1500th to 2500th steps), the model keeps track of the cue position with a relatively low error thanks to the PENs (second line) and PEGs (third line) combined actions.CC BY · PubMed Central
Fig 4 The EPG to PFL3 connectome at the interface between the compass and the steering control. The full connectome is assessed from online Drosophila brain databases (https://v2.virtualflybrain.org, [35–38]). The full list of the synaptic connection between neurons annoted PFL3 and EPGs is given in S1 Table. A. (a) Division of the EB in wedges 15. (b) Quantity of synapses expressed as a function of the EB wedges and the PFL3 columns. B. (a) Relationship between EB wedges and the EPGs modeled here (Fig 3A). (b) The connectome is transformed into EPG-PFL3 synapse weights to create the steering model (see section 2.5). Weights are obtained by summing for each EPG the synapses on the right or on the left part of the PB. The gains are then normalized to fit between 0 and 1.
Fig 4 The EPG to PFL3 connectome at the interface between the compass and the steering control. The full connectome is assessed from online Drosophila brain databases (https://v2.virtualflybrain.org, [35–38]). The full list of the synaptic connection between neurons annoted PFL3 and EPGs is given in S1 Table. A. (a) Division of the EB in wedges 15. (b) Quantity of synapses expressed as a function of the EB wedges and the PFL3 columns. B. (a) Relationship between EB wedges and the EPGs modeled here (Fig 3A). (b) The connectome is transformed into EPG-PFL3 synapse weights to create the steering model (see section 2.5). Weights are obtained by summing for each EPG the synapses on the right or on the left part of the PB. The gains are then normalized to fit between 0 and 1.CC BY · PubMed Central
Fig 5 EPG to PFL3 connectivity scheme. A. Diagram of the EPGs to PFL3s connectivity that drives the steering. Each EPG makes inhibitory connection to two PFL3 neurons, one on each side. The strength of the synapse depends on the index of the EPGi as shown in B. The summed activity rates of the right and left PFL3 neurons are compared to obtain the CX steering signal. Finally, gaussian noise (ν = 0;σ = 10) is added to obtain the final steering command. B. (a) Synapse strength as a function of the index of EPGi, obtained from the connectomic approach (Fig 4B; [30]). Synapses are inhibitory and therefore multiplied by -1. Red lines represent the connection with the subset of PFL3s from the right part of the PB and green from the left part. Synapse weights are presented in a circular representation to show the correspondence with the EPG input geometry. Index 1 corresponds to the synapse between ellipsoid body tile EPG1, connected to the rear right FOV (-157.5°), and PFL31, and so on, through to index 8, the synapse between EPG8, connected to the rear left (157.5°), and PFL38. (b) Heatmap in the arena from 100 simulations in total. The data are normalized to the landmark direction (indicated on the right). (c) Final direction/position of each simulation (n = 100) with the cue placed in different positions around the arena, expressed in the cue reference frames. C. (a) Simulations (n = 100 for each shift condition) where EPG-PFL3 synapse weights were shifted for 1 cell to the right/clockwise (compared to B.). Results show the heatmap relative to the cue (top) of the 100 simulations. (b) Simulations (n = 100 for each shift condition) where EPG-PFL3 synapse weights were shifted for 1 cell to the left/anti-clockwise. Results show the heatmap relative to the cue (top) of the 100 simulations. (c)-(d) Equivalent to (a) and (b), respectively, with a 2 cells shift.
Fig 5 EPG to PFL3 connectivity scheme. A. Diagram of the EPGs to PFL3s connectivity that drives the steering. Each EPG makes inhibitory connection to two PFL3 neurons, one on each side. The strength of the synapse depends on the index of the EPGi as shown in B. The summed activity rates of the right and left PFL3 neurons are compared to obtain the CX steering signal. Finally, gaussian noise (ν = 0;σ = 10) is added to obtain the final steering command. B. (a) Synapse strength as a function of the index of EPGi, obtained from the connectomic approach (Fig 4B; [30]). Synapses are inhibitory and therefore multiplied by -1. Red lines represent the connection with the subset of PFL3s from the right part of the PB and green from the left part. Synapse weights are presented in a circular representation to show the correspondence with the EPG input geometry. Index 1 corresponds to the synapse between ellipsoid body tile EPG1, connected to the rear right FOV (-157.5°), and PFL31, and so on, through to index 8, the synapse between EPG8, connected to the rear left (157.5°), and PFL38. (b) Heatmap in the arena from 100 simulations in total. The data are normalized to the landmark direction (indicated on the right). (c) Final direction/position of each simulation (n = 100) with the cue placed in different positions around the arena, expressed in the cue reference frames. C. (a) Simulations (n = 100 for each shift condition) where EPG-PFL3 synapse weights were shifted for 1 cell to the right/clockwise (compared to B.). Results show the heatmap relative to the cue (top) of the 100 simulations. (b) Simulations (n = 100 for each shift condition) where EPG-PFL3 synapse weights were shifted for 1 cell to the left/anti-clockwise. Results show the heatmap relative to the cue (top) of the 100 simulations. (c)-(d) Equivalent to (a) and (b), respectively, with a 2 cells shift.CC BY · PubMed Central
Fig 6 Steering CX model with external control. The central part of the diagram is similar to the model of EPG to PFL3 connection presented in Fig 5A except the synapse weights are initially set homogeneously (ωi^(EPG−PFL3)=0.5). On each side the model copies the [21] model architecture such that the connection between FBns [red (right FBns) and green (left FBns) cells] and steering neurons (PFL3s, yellow cells) are shifted by one column, in opposite directions on each side. FBns also receive rotatory self-motion information inhibiting inputs [light red (right turns) and green (left turns) lines] for the ipsilateral side, therefore the right FBns are activated during left turns and viceversa. The reward signal (pink) is provided by the sensory pathway indicating goodness-badness of the current sensory input. The modulation of the EPG-PLF3 synapses is under the control of this reward signal and the FBns as shown in the bottom-right inset. The steering command is obtained by comparing the right and left summed activity of the PFL3s after the addition of a gaussian noise (ν = 0;σ = 10) as previously (Fig 5A).
Fig 6 Steering CX model with external control. The central part of the diagram is similar to the model of EPG to PFL3 connection presented in Fig 5A except the synapse weights are initially set homogeneously (ωi^(EPG−PFL3)=0.5). On each side the model copies the [21] model architecture such that the connection between FBns [red (right FBns) and green (left FBns) cells] and steering neurons (PFL3s, yellow cells) are shifted by one column, in opposite directions on each side. FBns also receive rotatory self-motion information inhibiting inputs [light red (right turns) and green (left turns) lines] for the ipsilateral side, therefore the right FBns are activated during left turns and viceversa. The reward signal (pink) is provided by the sensory pathway indicating goodness-badness of the current sensory input. The modulation of the EPG-PLF3 synapses is under the control of this reward signal and the FBns as shown in the bottom-right inset. The steering command is obtained by comparing the right and left summed activity of the PFL3s after the addition of a gaussian noise (ν = 0;σ = 10) as previously (Fig 5A).CC BY · PubMed Central
Fig 7 Innate behaviour under the control of a visual reward signal. Simulations of the FB steering model (Fig 6) using a reward signal provided by the visual processes to modify the EPG-PFL3 synapse weights. We created the visual reward signal to the CX using different masks. Results for each panel include (a) the final path directions (n = 50 simulations), (b) the probability density function of the final direction vector relative to the cue orientation, (c) the averaged EPG-PFL3s synapse weights and (d) examples of 5 simulation paths. See also Fig B in S1 Text for results with continuous masks. A. Visual reward to the FBs is equal to the sum of the visual units signal through a discrete mask equal to 0 outside the 30° frontal area or 1 inside. B. Visual reward to the FBs is equal to the sum of the visual units signal through a discrete mask equal to 0.5 inside the 30° frontal area, -0.5 inside the 30° rear area, or 0 otherwise. C. The mask is shifted by 45° to the left of the visual field. The reward area extends from 30° to 60°. D. The mask is shifted by 45° to the left of the visual field. The reward area extends from -30° to -60°.
Fig 7 Innate behaviour under the control of a visual reward signal. Simulations of the FB steering model (Fig 6) using a reward signal provided by the visual processes to modify the EPG-PFL3 synapse weights. We created the visual reward signal to the CX using different masks. Results for each panel include (a) the final path directions (n = 50 simulations), (b) the probability density function of the final direction vector relative to the cue orientation, (c) the averaged EPG-PFL3s synapse weights and (d) examples of 5 simulation paths. See also Fig B in S1 Text for results with continuous masks. A. Visual reward to the FBs is equal to the sum of the visual units signal through a discrete mask equal to 0 outside the 30° frontal area or 1 inside. B. Visual reward to the FBs is equal to the sum of the visual units signal through a discrete mask equal to 0.5 inside the 30° frontal area, -0.5 inside the 30° rear area, or 0 otherwise. C. The mask is shifted by 45° to the left of the visual field. The reward area extends from 30° to 60°. D. The mask is shifted by 45° to the left of the visual field. The reward area extends from -30° to -60°.CC BY · PubMed Central
Fig 8 Persistence of direction in the absence of the landmark. A. (a) Simulations are done in a static mode, i.e. the agent never leaves the center of the arena and only rotates around its vertical axis. (b) After the 2000th step the cue disappears. B. (a) We tested the model in the same configuration as before, where the landmark is used both as the main cue for the compass and to generate the directed behaviour (Fig 7C). Results are shown in C.a. (b) We tested another configuration where the compass was provided with cues from the absolute orientation in the environment (such as sun position or sky polarization could provide). The attraction behaviour is kept based on the landmark as before. Results are shown in C.b. C. EPG activity rate (blue to yellow) and relative landmark orientation (red line, right scale) during simulation of the cue disappearance paradigm showed in A. (a) The compass and the attraction are both based on the landmark (B.a). The direction can be maintained but slowly drifts as there is no external reference. (b) The compass is based on an absolute orientation perception (potentially from sky cues) while the attraction is based the landmark (B.b). Note this creates a potential offset in the position of the bump and the landmark, but the agent still moves towards the landmark. The heading can be accurately maintained when the landmark disappears.
Fig 8 Persistence of direction in the absence of the landmark. A. (a) Simulations are done in a static mode, i.e. the agent never leaves the center of the arena and only rotates around its vertical axis. (b) After the 2000th step the cue disappears. B. (a) We tested the model in the same configuration as before, where the landmark is used both as the main cue for the compass and to generate the directed behaviour (Fig 7C). Results are shown in C.a. (b) We tested another configuration where the compass was provided with cues from the absolute orientation in the environment (such as sun position or sky polarization could provide). The attraction behaviour is kept based on the landmark as before. Results are shown in C.b. C. EPG activity rate (blue to yellow) and relative landmark orientation (red line, right scale) during simulation of the cue disappearance paradigm showed in A. (a) The compass and the attraction are both based on the landmark (B.a). The direction can be maintained but slowly drifts as there is no external reference. (b) The compass is based on an absolute orientation perception (potentially from sky cues) while the attraction is based the landmark (B.b). Note this creates a potential offset in the position of the bump and the landmark, but the agent still moves towards the landmark. The heading can be accurately maintained when the landmark disappears.CC BY · PubMed Central
Fig 9 Orientation to a goal direction supported by the MB long-term visual memory. A. Mushroom bodies model diagram. The visual Projection Neurons (vPN) correspond to the visual units (Fig 2) extracting edge from the panoramic view. Each KC has a random post-synaptic connection pattern with 2 to 5 vPNs and a pre-synaptic connection to the MB output neuron (MBON). During the learning procedure, the memory reward signal (DAN) is activated and induces the decrease of the synaptic strength between the activated KCs and the MBON. The MBON activity is then used as the reward signal to adapt the CX circuit. B. Schematic of the learning phase before the simulation. The agent faces the feeder during 100 steps from a position in between the feeder and the center of the arena (learning pose), with an orientation error from −15 to 15°. The MB model memory is updated during this phase (DAN active). C. Example paths from the retrieval experiments using the MB model as an input for the CX model. D. Final direction vectors for 50 simulations with the feeder at 0° and the cue oriented at 45°. The red arc shows the median (dot) 95% C.I. obtained by bootstrapping (rep = 10000). E. Averaged right (red) and left (green) EPG-PFL3 synapses weights (shaded area: ±s.d.) obtained from 50 simulations.
Fig 9 Orientation to a goal direction supported by the MB long-term visual memory. A. Mushroom bodies model diagram. The visual Projection Neurons (vPN) correspond to the visual units (Fig 2) extracting edge from the panoramic view. Each KC has a random post-synaptic connection pattern with 2 to 5 vPNs and a pre-synaptic connection to the MB output neuron (MBON). During the learning procedure, the memory reward signal (DAN) is activated and induces the decrease of the synaptic strength between the activated KCs and the MBON. The MBON activity is then used as the reward signal to adapt the CX circuit. B. Schematic of the learning phase before the simulation. The agent faces the feeder during 100 steps from a position in between the feeder and the center of the arena (learning pose), with an orientation error from −15 to 15°. The MB model memory is updated during this phase (DAN active). C. Example paths from the retrieval experiments using the MB model as an input for the CX model. D. Final direction vectors for 50 simulations with the feeder at 0° and the cue oriented at 45°. The red arc shows the median (dot) 95% C.I. obtained by bootstrapping (rep = 10000). E. Averaged right (red) and left (green) EPG-PFL3 synapses weights (shaded area: ±s.d.) obtained from 50 simulations.CC BY · PubMed Central
Fig 10 Replication of unilateral mushroom body lesion experiments from [13]. A. Schematic of the model including both MB and innate visual attraction. Both elements are linearly summed to form a single reward signal, using individual weights (ωVin & ωMB) to modulate the influence of each component. Lesions are indicated by the black scissors and the results are reported in C and D (Left and right lesion respectively). B. Simulation with the combination of innate attraction (ωVin) and the mushroom bodies (ωMB) pathway. The learning procedure is similar as presented in Fig 9B. From top to bottom, final directions (blue arrows, nsim = 100) taken during the simulations [blue arc indicate the median (dot) 95% C.I. obtained by bootstrap (nrep = 10000)], examples of path obtained during simulations, and averaged right (red) and left (green) EPG-PFL3 synapse weights (shaded area: ±s.d.) obtained during 50 simulations. C. Unilateral lesion of the left mushroom body. Final direction vectors and example paths. D. Unilateral lesion of the right mushroom body. Final direction vectors and example paths.
Fig 10 Replication of unilateral mushroom body lesion experiments from [13]. A. Schematic of the model including both MB and innate visual attraction. Both elements are linearly summed to form a single reward signal, using individual weights (ωVin & ωMB) to modulate the influence of each component. Lesions are indicated by the black scissors and the results are reported in C and D (Left and right lesion respectively). B. Simulation with the combination of innate attraction (ωVin) and the mushroom bodies (ωMB) pathway. The learning procedure is similar as presented in Fig 9B. From top to bottom, final directions (blue arrows, nsim = 100) taken during the simulations [blue arc indicate the median (dot) 95% C.I. obtained by bootstrap (nrep = 10000)], examples of path obtained during simulations, and averaged right (red) and left (green) EPG-PFL3 synapse weights (shaded area: ±s.d.) obtained during 50 simulations. C. Unilateral lesion of the left mushroom body. Final direction vectors and example paths. D. Unilateral lesion of the right mushroom body. Final direction vectors and example paths.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 116 references

Cited by

See all 53

Metadata

Authors
Goulard, R., Buehlmann, C., Niven, J. E., Graham, P., & Webb, B.
Affiliations
  • University of Edinburgh (GB)
  • University of Sussex (GB)
Corresponding author
Goulard, Roman
Venue
PLoS Computational Biology
Published
2021-09-23
Volume
17
Issue
9
Pages
e1009383
ISSN
  • 1553-734X (ISSN-L)
  • 1553-7358
OpenAlex
W3200508686
Cited by
51
References
111
Citations by year
2026: 6 · 2025: 9 · 2024: 12 · 2023: 15 · 2022: 4 · 2021: 4
FWCI
4.03
Type
journal article
Language
en
Open access
Locations
  • PLoS Computational Biology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Edinburgh Research Explorer (University of Edinburgh) (acceptedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Biotechnology and Biological Sciences Research Council (BB/R005036/1)
Topics
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurobiology and Insect Physiology Research
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Spatial Cognition and Navigation
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords
insect navigation, central complex, visual landmarks, innate behavior, learned behavior, mushroom body, vector memory, directional memory, reward signals, ants, multisensory integration, cue integration, simulated agents
MeSH terms
Animals, Brain, Computer Simulation, Cues, Insecta, Models, Neurological, Neural Pathways, Reward, Visual Perception, Computational Biology, Mushroom Bodies, Memory, Long-Term, Spatial Memory, Spatial Learning, Spatial Navigation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.