Shallow neural networks trained to detect collisions recover features of visual loom-selective neurons
Open accessPublished version of a preprint
Abstract
Animals have evolved sophisticated visual circuits to solve a vital inference problem: detecting whether or not a visual signal corresponds to an object on a collision course. Such events are detected by specific circuits sensitive to visual looming, or objects increasing in size. Various computational models have been developed for these circuits, but how the collision-detection inference problem itself shapes the computational structures of these circuits remains unknown. Here, inspired by the distinctive structures of LPLC2 neurons in the visual system of Drosophila , we build anatomically-constrained shallow neural network models and train them to identify visual signals that correspond to impending collisions. Surprisingly, the optimization arrives at two distinct, opposing solutions, only one of which matches the actual dendritic weighting of LPLC2 neurons. Both solutions can solve the inference problem with high accuracy when the population size is large enough. The LPLC2-like solutions reproduces experimentally observed LPLC2 neuron responses for many stimuli, and reproduces canonical tuning of loom sensitive neurons, even though the models are never trained on neural data. Thus, LPLC2 neuron properties and tuning are predicted by optimizing an anatomically-constrained neural network to detect impending collisions. More generally, these results illustrate how optimizing inference tasks that are important for an animal’s perceptual goals can reveal and explain computational properties of specific sensory neurons.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Model LPLC2 was driven by large female sizes.
“other model LC units, such as LPLC2, were driven by large female sizes, consistent with its known response to looming stimuli17,24,25,31.”
From Mapping model units to visual neurons reveals population code for social behaviour (2024) · cites this paper as [17]
The Results section (‘Activation patterns of computational solutions resemble biological responses’; page not provided) says the LPLC2-like model encodes the angular size of looming stimuli and that stimulus size influences its response. It does not test female sizes or establish that large females drove the model’s response. (LLM, conf=0.82)
Experimental — accuracy not yet measuredA shortcoming of the DNN approach is that it does not predict how an individual neuron causally contributes to behaviour.
“A shortcoming of this approach is that the DNN does not predict how an individual neuron causally contributes to behaviour, making it difficult to interpret the role of the neuron in the sensorimotor transformation.”
From Mapping model units to visual neurons reveals population code for social behaviour (2024) · cites this paper as [17]
The Results section (“An anatomically constrained mathematical model”; page unavailable) says the network combines model-unit responses to predict collision probability, not behaviour. The Discussion (page unavailable) says individual LPLC2 responses should be interpreted in light of the population response. These passages support a limitation on interpreting individual neurons, but do not establish the specific claim that the DNN cannot predict an individual neuron's causal contribution to behaviour. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Population coding of shape in area V4
Pasupathy, A., & Connor, C. E. (2002) · Nature Neuroscience · doi:10.1038/972 · Cited by 552 · see citing works
Neural circuits underlying visually evoked escapes in larval zebrafish
Dunn, T. W., Gebhardt, C., Naumann, E. A., Riegler, C., Ahrens, M. B., Engert, F., & Del Bene, F. (2016) · Neuron · doi:10.1016/j.neuron.2015.12.021 · Cited by 347 · see citing works
Visually mediated motor planning in the escape response of Drosophila
Card, G., & Dickinson, M. H. (2008) · Current Biology · doi:10.1016/j.cub.2008.07.094 · Cited by 309 · see citing works
Neural Basis for Looming Size and Velocity Encoding in the Drosophila Giant Fiber Escape Pathway
Ache, J. M., Polsky, J., Alghailani, S., Parekh, R., Breads, P., Peek, M. Y., Bock, D. D., von Reyn, C. R., & Card, G. M. (2019) · Current Biology · doi:10.1016/j.cub.2019.01.079 · Cited by 153 · see citing works
The manifold structure of limb coordination in walking Drosophila
DeAngelis, B. D., Zavatone-Veth, J. A., & Clark, D. A. (2019) · eLife · doi:10.7554/elife.46409 · Cited by 104 · see citing works
Nonlinear circuits for naturalistic visual motion estimation
Fitzgerald, J. E., & Clark, D. A. (2015) · eLife · doi:10.7554/elife.09123 · Cited by 52 · see citing works
Self-citationPredicting individual neuron responses with anatomically constrained task optimization
Mano, O., Creamer, M. S., Badwan, B. A., & Clark, D. A. (2021) · Current Biology · doi:10.1016/j.cub.2021.06.090 · Cited by 24 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 65
- Abadi M Barham P Chen J Chen Z Davis A Dean J Devin M Ghemawat S Irving G Isard M 2016 Tensorflow: A system for large-scale machine learning In 12th USENIX symposium on operating systems design and implementation 265 283
- Agrochao M Tanaka R Salazar-Gatzimas E Clark DA 2020 Mechanism for analogous illusory motion perception in flies and humans PNAS 117 23044 23053 10.1073/pnas.2002937117 32839324 PMC7502748 · DOI
- Badwan BA Creamer MS Zavatone-Veth JA Clark DA 2019 Dynamic nonlinearities enable direction opponency in Drosophila elementary motion detectors Nature Neuroscience 22 1318 1326 10.1038/s41593-019-0443-y 31346296 PMC6748873 · DOI
- Ball W Tronick E 1971 Infant responses to impending collision: optical and real Science 171 818 820 10.1126/science.171.3973.818 5541165 · DOI · Paper page
- Bhattacharyya K McLean DL MacIver MA 2017 Visual Threat Assessment and Reticulospinal Encoding of Calibrated Responses in Larval Zebrafish Current Biology 27 2751 2762 10.1016/j.cub.2017.08.012 28889979 PMC5703209 · DOI
- Cafaro J Zylberberg J Field GD 2020 Global Motion Processing by Populations of Direction-Selective Retinal Ganglion Cells The Journal of Neuroscience 40 5807 5819 10.1523/JNEUROSCI.0564-20.2020 32561674 PMC7380974 · DOI
- Chen J Mandel HB Fitzgerald JE Clark DA 2019 Asymmetric ON-OFF processing of visual motion cancels variability induced by the structure of natural scenes eLife 8 e47579 10.7554/eLife.47579 31613221 PMC6884396 · DOI
- Creamer MS Mano O Clark DA 2018 Visual Control of Walking Speed in Drosophila Neuron 100 1460 1473 10.1016/j.neuron.2018.10.028 30415994 PMC6405217 · DOI
- Davis J Goadrich M 2006 The relationship between Precision-Recall and ROC curves Proceedings of the 23rd international conference on Machine learning Pittsburgh Pennsylvania 233 240 10.1145/1143844.1143874 · DOI · Paper page
- de Vries SEJ Clandinin TR 2012 Loom-sensitive neurons link computation to action in the Drosophila visual system Current Biology 22 353 362 10.1016/j.cub.2012.01.007 22305754 PMC3298569 · DOI
- Drews MS Leonhardt A Pirogova N Richter FG Schuetzenberger A Braun L Serbe E Borst A 2020 Dynamic Signal Compression for Robust Motion Vision in Flies Current Biology 30 209 221 10.1016/j.cub.2019.10.035 31928873 · DOI
- Field DJ 1994 What Is the Goal of Sensory Coding? Neural Computation 6 559 601 10.1162/neco.1994.6.4.559 · DOI
- Franke F Fiscella M Sevelev M Roska B Hierlemann A da Silveira RA 2016 Structures of Neural Correlation and How They Favor Coding Neuron 89 409 422 10.1016/j.neuron.2015.12.037 26796692 PMC5424879 · DOI
- Gabbiani F Krapp HG Laurent G 1999 Computation of object approach by a wide-field, motion-sensitive neuron The Journal of Neuroscience 19 1122 1141 9920674 PMC6782150
- Georgopoulos AP Schwartz AB Kettner RE 1986 Neuronal population coding of movement direction Science 233 1416 1419 10.1126/science.3749885 3749885 · DOI
- Gruntman E Romani S Reiser MB 2018 Simple integration of fast excitation and offset, delayed inhibition computes directional selectivity in Drosophila Nature Neuroscience 21 250 257 10.1038/s41593-017-0046-4 29311742 PMC5967973 · DOI · Paper page
- Gruntman E Romani S Reiser MB 2019 The computation of directional selectivity in the Drosophila OFF motion pathway eLife 8 e50706 10.7554/eLife.50706 31825313 PMC6917495 · DOI · Paper page
- Hanley JA McNeil BJ 1982 The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology 143 29 36 10.1148/radiology.143.1.7063747 7063747 · DOI · Paper page
- Hassenstein B Reichardt W 1956 Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus Zeitschrift Für Naturforschung B 11 513 524 10.1515/znb-1956-9-1004 · DOI
- Hervais-Adelman A Legrand LB Zhan M Tamietto M de Gelder B Pegna AJ 2015 Looming sensitive cortical regions without V1 input: evidence from a patient with bilateral cortical blindness Frontiers in Integrative Neuroscience 9 51 10.3389/fnint.2015.00051 26557059 PMC4614319 · DOI
- Kikuchi A Ohashi S Fuse N Ohta T Suzuki M Suzuki Y Fujita T Miyamoto T Aonishi T Miyakawa H Morimoto T 2012 Experience-dependent plasticity of the optomotor response in Drosophila melanogaster Developmental Neuroscience 34 533 542 10.1159/000346266 23406844 · DOI
- King SM Dykeman C Redgrave P Dean P 1992 Use of a distracting task to obtain defensive head movements to looming visual stimuli by human adults in a laboratory setting Perception 21 245 259 10.1068/p210245 1513673 · DOI
- Klapoetke NC Nern A Peek MY Rogers EM Breads P Rubin GM Reiser MB Card GM 2017 Ultra-selective looming detection from radial motion opponency Nature 551 237 241 10.1038/nature24626 29120418 PMC7457385 · DOI · Paper page
- Krapp HG Hengstenberg R 1996 Estimation of self-motion by optic flow processing in single visual interneurons Nature 384 463 466 10.1038/384463a0 8945473 · DOI
- Leonhardt A Ammer G Meier M Serbe E Bahl A Borst A 2016 Asymmetry of Drosophila ON and OFF motion detectors enhances real-world velocity estimation Nature Neuroscience 19 706 715 10.1038/nn.4262 26928063 · DOI
- Liu YJ Wang Q Li B 2011 Neuronal responses to looming objects in the superior colliculus of the cat Brain, Behavior and Evolution 77 193 205 10.1159/000327045 21546772 · DOI
- Maisak MS Haag J Ammer G Serbe E Meier M Leonhardt A Schilling T Bahl A Rubin GM Nern A Dickson BJ Reiff DF Hopp E Borst A 2013 A directional tuning map of Drosophila elementary motion detectors Nature 500 212 216 10.1038/nature12320 23925246 · DOI · Paper page
- Matulis CA Chen J Gonzalez-Suarez AD Behnia R Clark DA 2020 Heterogeneous Temporal Contrast Adaptation in Drosophila Direction-Selective Circuits Current Biology 30 222 236 10.1016/j.cub.2019.11.077 31928874 PMC7003801 · DOI
- Mauss AS Pankova K Arenz A Nern A Rubin GM Borst A 2015 Neural Circuit to Integrate Opposing Motions in the Visual Field Cell 162 351 362 10.1016/j.cell.2015.06.035 26186189 · DOI
- Morgan MG Henrion M Small M 1990 Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis Cambridge University Press 10.1017/CBO9780511840609 · DOI
- Morimoto MM Nern A Zhao A Rogers EM Wong AM Isaacson MD Bock DD Rubin GM Reiser MB 2020 Spatial readout of visual looming in the central brain of Drosophila eLife 9 e57685 10.7554/eLife.57685 33205753 PMC7744102 · DOI
- Muijres FT Elzinga MJ Melis JM Dickinson MH 2014 Flies evade looming targets by executing rapid visually directed banked turns Science 344 172 177 10.1126/science.1248955 24723606 · DOI
- Münch TA da Silveira RA Siegert S Viney TJ Awatramani GB Roska B 2009 Approach sensitivity in the retina processed by a multifunctional neural circuit Nature Neuroscience 12 1308 1316 10.1038/nn.2389 19734895 · DOI
- Oliva D Tomsic D 2014 Computation of object approach by a system of visual motion-sensitive neurons in the crab Neohelice Journal of Neurophysiology 112 1477 1490 10.1152/jn.00921.2013 24899670 · DOI
- Olshausen BA Field DJ 1996 Emergence of simple-cell receptive field properties by learning a sparse code for natural images Nature 381 607 609 10.1038/381607a0 8637596 · DOI · Paper page
- Olshausen BA Field DJ 1997 Sparse coding with an overcomplete basis set: a strategy employed by V1? Vision Research 37 3311 3325 10.1016/s0042-6989(97)00169-7 9425546 · DOI · Paper page
- Peek MY Card GM 2016 Comparative approaches to escape Current Opinion in Neurobiology 41 167 173 10.1016/j.conb.2016.09.012 27710794 · DOI
- Regan D Beverley KI 1978 Looming detectors in the human visual pathway Vision Research 18 415 421 10.1016/0042-6989(78)90051-2 664320 · DOI
- Richards BA Lillicrap TP Beaudoin P Bengio Y Bogacz R Christensen A Clopath C Costa RP de Berker A Ganguli S Gillon CJ Hafner D Kepecs A Kriegeskorte N Latham P Lindsay GW Miller KD Naud R Pack CC Poirazi P Roelfsema P Sacramento J Saxe A Scellier B Schapiro AC Senn W Wayne G Yamins D Zenke F Zylberberg J Therien D Kording KP 2019 A deep learning framework for neuroscience Nature Neuroscience 22 1761 1770 10.1038/s41593-019-0520-2 31659335 PMC7115933 · DOI · Paper page
- Rind FC Bramwell DI 1996 Neural network based on the input organization of an identified neuron signaling impending collision Journal of Neurophysiology 75 967 985 10.1152/jn.1996.75.3.967 8867110 · DOI
- Ruderman DL Bialek W 1994 Statistics of natural images: Scaling in the woods Physical Review Letters 73 814 817 10.1103/PhysRevLett.73.814 10057546 · DOI
- Sabbah S Gemmer JA Bhatia-Lin A Manoff G Castro G Siegel JK Jeffery N Berson DM 2017 A retinal code for motion along the gravitational and body axes Nature 546 492 497 10.1038/nature22818 28607486 PMC5729591 · DOI
- Salay LD Ishiko N Huberman AD 2018 A midline thalamic circuit determines reactions to visual threat Nature 557 183 189 10.1038/s41586-018-0078-2 29720647 PMC8442544 · DOI · Paper page
- Salazar-Gatzimas E Chen J Creamer MS Mano O Mandel HB Matulis CA Pottackal J Clark DA 2016 Direct Measurement of Correlation Responses in Drosophila Elementary Motion Detectors Reveals Fast Timescale Tuning Neuron 92 227 239 10.1016/j.neuron.2016.09.017 27710784 PMC5097865 · DOI
- Santer RD Simmons PJ Rind FC 2005 Gliding behaviour elicited by lateral looming stimuli in flying locusts Journal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology 191 61 73 10.1007/s00359-004-0572-x 15558287 · DOI
- Sato K Yamawaki Y 2014 Role of a looming-sensitive neuron in triggering the defense behavior of the praying mantis Tenodera aridifolia Journal of Neurophysiology 112 671 682 10.1152/jn.00049.2014 24848471 · DOI
- Shang C Liu Z Chen Z Shi Y Wang Q Liu S Li D Cao P 2015 BRAIN CIRCUITS. A parvalbumin-positive excitatory visual pathway to trigger fear responses in mice Science 348 1472 1477 10.1126/science.aaa8694 26113723 · DOI
- Shinomiya K Huang G Lu Z Parag T Xu CS Aniceto R Ansari N Cheatham N Lauchie S Neace E Ogundeyi O Ordish C Peel D Shinomiya A Smith C Takemura S Talebi I Rivlin PK Nern A Scheffer LK Plaza SM Meinertzhagen IA 2019 Comparisons between the ON- and OFF-edge motion pathways in the Drosophila brain eLife 8 e40025 10.7554/eLife.40025 30624205 PMC6338461 · DOI · Paper page
- Stanley KO Clune J Lehman J Miikkulainen R 2019 Designing neural networks through neuroevolution Nature Machine Intelligence 1 24 35 10.1038/s42256-018-0006-z · DOI
- Stavenga DG 2003 Angular and spectral sensitivity of fly photoreceptors. II. Dependence on facet lens F-number and rhabdomere type in Drosophila Journal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology 189 189 202 10.1007/s00359-003-0390-6 12664095 · DOI
- Sun H Frost BJ 1998 Computation of different optical variables of looming objects in pigeon nucleus rotundus neurons Nature Neuroscience 1 296 303 10.1038/1110 10195163 · DOI · Paper page
- Takemura SY Nern A Chklovskii DB Scheffer LK Rubin GM Meinertzhagen IA 2017 The comprehensive connectome of a neural substrate for on motion detection in Drosophila eLife 6 e24394 10.7554/eLife.24394 28432786 PMC5435463 · DOI · Paper page
- Tanouye MA Wyman RJ 1980 Motor outputs of giant nerve fiber in Drosophila Journal of Neurophysiology 44 405 421 10.1152/jn.1980.44.2.405 6774064 · DOI
- Temizer I Donovan JC Baier H Semmelhack JL 2015 A Visual Pathway for Looming-Evoked Escape in Larval Zebrafish Current Biology 25 1823 1834 10.1016/j.cub.2015.06.002 26119746 · DOI · Paper page
- Turner MH Sanchez Giraldo LG Schwartz O Rieke F 2019 Stimulus- and goal-oriented frameworks for understanding natural vision Nature Neuroscience 22 15 24 10.1038/s41593-018-0284-0 30531846 PMC8378293 · DOI
- Virtanen P Gommers R Oliphant TE Haberland M Reddy T Cournapeau D Burovski E Peterson P Weckesser W Bright J van der Walt SJ Brett M Wilson J Millman KJ Mayorov N Nelson ARJ Jones E Kern R Larson E Carey CJ Polat İ Feng Y Moore EW VanderPlas J Laxalde D Perktold J Cimrman R Henriksen I Quintero EA Harris CR Archibald AM Ribeiro AH Pedregosa F van Mulbregt P SciPy 1.0 Contributors 2020 Author Correction: SciPy 1.0: fundamental algorithms for scientific computing in Python Nature Methods 17 261 272 10.1038/s41592-020-0772-5 32015543 PMC7056644 · DOI
- Vogels R 1990 Population coding of stimulus orientation by striate cortical cells Biological Cybernetics 64 25 31 10.1007/BF00203627 2285759 · DOI
- von Reyn CR Breads P Peek MY Zheng GZ Williamson WR Yee AL Leonardo A Card GM 2014 A spike-timing mechanism for action selection Nature Neuroscience 17 962 970 10.1038/nn.3741 24908103 · DOI · Paper page
- von Reyn CR Nern A Williamson WR Breads P Wu M Namiki S Card GM 2017 Feature Integration Drives Probabilistic Behavior in the Drosophila Escape Response Neuron 94 1190 1204 10.1016/j.neuron.2017.05.036 28641115 · DOI · Paper page
- Wu LQ Niu YQ Yang J Wang SR 2005 Tectal neurons signal impending collision of looming objects in the pigeon European Journal of Neuroscience 22 2325 2331 10.1111/j.1460-9568.2005.04397.x 16262670 · DOI
- Wu M Nern A Williamson WR Morimoto MM Reiser MB Card GM Rubin GM 2016 Visual projection neurons in the Drosophila lobula link feature detection to distinct behavioral programs eLife 5 e21022 10.7554/eLife.21022 28029094 PMC5293491 · DOI · Paper page
- Yamins DLK Hong H Cadieu CF Solomon EA Seibert D DiCarlo JJ 2014 Performance-optimized hierarchical models predict neural responses in higher visual cortex PNAS 111 8619 8624 10.1073/pnas.1403112111 24812127 PMC4060707 · DOI · Paper page
- Yamins DLK DiCarlo JJ 2016 Using goal-driven deep learning models to understand sensory cortex Nature Neuroscience 19 356 365 10.1038/nn.4244 26906502 · DOI · Paper page
- Zavatone-Veth JA Badwan BA Clark DA 2020 A minimal synaptic model for direction selective neurons in Drosophila Journal of Vision 20 2 10.1167/jov.20.2.2 32040161 PMC7343402 · DOI
- Zylberberg J Cafaro J Turner MH Shea-Brown E Rieke F 2016 Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code Neuron 89 369 383 10.1016/j.neuron.2015.11.019 26796691 PMC4724064 · DOI
Cited by
Sorted by citations
Mapping model units to visual neurons reveals population code for social behaviour
Cowley, B. R., Calhoun, A. J., Rangarajan, N., Ireland, E., Turner, M. H., Pillow, J. W., & Murthy, M. (2024) · Nature · doi:10.1038/s41586-024-07451-8 · Cited by 45 · see citing works
- Authors
- Zhou, B., Li, Z., Kim, S., Lafferty, J., & Clark, D. A.
- Affiliations
- Yale University (US)
- Corresponding author
- Lafferty, John
- Clark, Damon A
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2022-01-13
- Volume
- 11
- ISSN
- 2050-084X (ISSN-L)
- PMC
- PMC8849349
- OpenAlex
- W4220795574
- Cited by
- 31
- References
- 7
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 7 · 2023: 11 · 2022: 4
- FWCI
- 3.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- eLife (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health (R01EY026555)
- National Science Foundation (CCF-1839308, DMS-1513594)
- Kavli Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurobiology and Insect Physiology Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- visual looming, collision detection, Drosophila, shallow neural networks, neural tuning, computational neuroscience, perceptual inference
- MeSH terms
- Animals, Computer Simulation, Drosophila, Motion Perception, Nerve Net, Photic Stimulation, Sensory Receptor Cells
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review