Cited by 31Visual perception and processing mechanismsNeurobiology and Insect Physiology ResearchNeural dynamics and brain function

Shallow neural networks trained to detect collisions recover features of visual loom-selective neurons

Open access
Zhou, Baohua, Li, Zifan, Kim, Sunnie, Lafferty, John, Clark, Damon A·2022·eLife

Published version of a preprint

Abstract

Animals have evolved sophisticated visual circuits to solve a vital inference problem: detecting whether or not a visual signal corresponds to an object on a collision course. Such events are detected by specific circuits sensitive to visual looming, or objects increasing in size. Various computational models have been developed for these circuits, but how the collision-detection inference problem itself shapes the computational structures of these circuits remains unknown. Here, inspired by the distinctive structures of LPLC2 neurons in the visual system of Drosophila , we build anatomically-constrained shallow neural network models and train them to identify visual signals that correspond to impending collisions. Surprisingly, the optimization arrives at two distinct, opposing solutions, only one of which matches the actual dendritic weighting of LPLC2 neurons. Both solutions can solve the inference problem with high accuracy when the population size is large enough. The LPLC2-like solutions reproduces experimentally observed LPLC2 neuron responses for many stimuli, and reproduces canonical tuning of loom sensitive neurons, even though the models are never trained on neural data. Thus, LPLC2 neuron properties and tuning are predicted by optimizing an anatomically-constrained neural network to detect impending collisions. More generally, these results illustrate how optimizing inference tasks that are important for an animal’s perceptual goals can reveal and explain computational properties of specific sensory neurons.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.7554/elife.72067

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Model LPLC2 was driven by large female sizes.

    “other model LC units, such as LPLC2, were driven by large female sizes, consistent with its known response to looming stimuli17,24,25,31.”

    From Mapping model units to visual neurons reveals population code for social behaviour (2024) · cites this paper as [17]

    The Results section (‘Activation patterns of computational solutions resemble biological responses’; page not provided) says the LPLC2-like model encodes the angular size of looming stimuli and that stimulus size influences its response. It does not test female sizes or establish that large females drove the model’s response. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • A shortcoming of the DNN approach is that it does not predict how an individual neuron causally contributes to behaviour.

    “A shortcoming of this approach is that the DNN does not predict how an individual neuron causally contributes to behaviour, making it difficult to interpret the role of the neuron in the sensorimotor transformation.”

    From Mapping model units to visual neurons reveals population code for social behaviour (2024) · cites this paper as [17]

    The Results section (“An anatomically constrained mathematical model”; page unavailable) says the network combines model-unit responses to predict collision probability, not behaviour. The Discussion (page unavailable) says individual LPLC2 responses should be interpreted in light of the population response. These passages support a limitation on interpreting individual neurons, but do not establish the specific claim that the DNN cannot predict an individual neuron's causal contribution to behaviour. (LLM, conf=0.72)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 65

  1. Abadi M Barham P Chen J Chen Z Davis A Dean J Devin M Ghemawat S Irving G Isard M 2016 Tensorflow: A system for large-scale machine learning In 12th USENIX symposium on operating systems design and implementation 265 283
  2. Agrochao M Tanaka R Salazar-Gatzimas E Clark DA 2020 Mechanism for analogous illusory motion perception in flies and humans PNAS 117 23044 23053 10.1073/pnas.2002937117 32839324 PMC7502748 · DOI
  3. Badwan BA Creamer MS Zavatone-Veth JA Clark DA 2019 Dynamic nonlinearities enable direction opponency in Drosophila elementary motion detectors Nature Neuroscience 22 1318 1326 10.1038/s41593-019-0443-y 31346296 PMC6748873 · DOI
  4. Ball W Tronick E 1971 Infant responses to impending collision: optical and real Science 171 818 820 10.1126/science.171.3973.818 5541165 · DOI · Paper page
  5. Bhattacharyya K McLean DL MacIver MA 2017 Visual Threat Assessment and Reticulospinal Encoding of Calibrated Responses in Larval Zebrafish Current Biology 27 2751 2762 10.1016/j.cub.2017.08.012 28889979 PMC5703209 · DOI
  6. Cafaro J Zylberberg J Field GD 2020 Global Motion Processing by Populations of Direction-Selective Retinal Ganglion Cells The Journal of Neuroscience 40 5807 5819 10.1523/JNEUROSCI.0564-20.2020 32561674 PMC7380974 · DOI
  7. Chen J Mandel HB Fitzgerald JE Clark DA 2019 Asymmetric ON-OFF processing of visual motion cancels variability induced by the structure of natural scenes eLife 8 e47579 10.7554/eLife.47579 31613221 PMC6884396 · DOI
  8. Creamer MS Mano O Clark DA 2018 Visual Control of Walking Speed in Drosophila Neuron 100 1460 1473 10.1016/j.neuron.2018.10.028 30415994 PMC6405217 · DOI
  9. Davis J Goadrich M 2006 The relationship between Precision-Recall and ROC curves Proceedings of the 23rd international conference on Machine learning Pittsburgh Pennsylvania 233 240 10.1145/1143844.1143874 · DOI · Paper page
  10. de Vries SEJ Clandinin TR 2012 Loom-sensitive neurons link computation to action in the Drosophila visual system Current Biology 22 353 362 10.1016/j.cub.2012.01.007 22305754 PMC3298569 · DOI
  11. Drews MS Leonhardt A Pirogova N Richter FG Schuetzenberger A Braun L Serbe E Borst A 2020 Dynamic Signal Compression for Robust Motion Vision in Flies Current Biology 30 209 221 10.1016/j.cub.2019.10.035 31928873 · DOI
  12. Field DJ 1994 What Is the Goal of Sensory Coding? Neural Computation 6 559 601 10.1162/neco.1994.6.4.559 · DOI
  13. Franke F Fiscella M Sevelev M Roska B Hierlemann A da Silveira RA 2016 Structures of Neural Correlation and How They Favor Coding Neuron 89 409 422 10.1016/j.neuron.2015.12.037 26796692 PMC5424879 · DOI
  14. Gabbiani F Krapp HG Laurent G 1999 Computation of object approach by a wide-field, motion-sensitive neuron The Journal of Neuroscience 19 1122 1141 9920674 PMC6782150
  15. Georgopoulos AP Schwartz AB Kettner RE 1986 Neuronal population coding of movement direction Science 233 1416 1419 10.1126/science.3749885 3749885 · DOI
  16. Gruntman E Romani S Reiser MB 2018 Simple integration of fast excitation and offset, delayed inhibition computes directional selectivity in Drosophila Nature Neuroscience 21 250 257 10.1038/s41593-017-0046-4 29311742 PMC5967973 · DOI · Paper page
  17. Gruntman E Romani S Reiser MB 2019 The computation of directional selectivity in the Drosophila OFF motion pathway eLife 8 e50706 10.7554/eLife.50706 31825313 PMC6917495 · DOI · Paper page
  18. Hanley JA McNeil BJ 1982 The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology 143 29 36 10.1148/radiology.143.1.7063747 7063747 · DOI · Paper page
  19. Hassenstein B Reichardt W 1956 Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus Zeitschrift Für Naturforschung B 11 513 524 10.1515/znb-1956-9-1004 · DOI
  20. Hervais-Adelman A Legrand LB Zhan M Tamietto M de Gelder B Pegna AJ 2015 Looming sensitive cortical regions without V1 input: evidence from a patient with bilateral cortical blindness Frontiers in Integrative Neuroscience 9 51 10.3389/fnint.2015.00051 26557059 PMC4614319 · DOI
  21. Kikuchi A Ohashi S Fuse N Ohta T Suzuki M Suzuki Y Fujita T Miyamoto T Aonishi T Miyakawa H Morimoto T 2012 Experience-dependent plasticity of the optomotor response in Drosophila melanogaster Developmental Neuroscience 34 533 542 10.1159/000346266 23406844 · DOI
  22. King SM Dykeman C Redgrave P Dean P 1992 Use of a distracting task to obtain defensive head movements to looming visual stimuli by human adults in a laboratory setting Perception 21 245 259 10.1068/p210245 1513673 · DOI
  23. Klapoetke NC Nern A Peek MY Rogers EM Breads P Rubin GM Reiser MB Card GM 2017 Ultra-selective looming detection from radial motion opponency Nature 551 237 241 10.1038/nature24626 29120418 PMC7457385 · DOI · Paper page
  24. Krapp HG Hengstenberg R 1996 Estimation of self-motion by optic flow processing in single visual interneurons Nature 384 463 466 10.1038/384463a0 8945473 · DOI
  25. Leonhardt A Ammer G Meier M Serbe E Bahl A Borst A 2016 Asymmetry of Drosophila ON and OFF motion detectors enhances real-world velocity estimation Nature Neuroscience 19 706 715 10.1038/nn.4262 26928063 · DOI
  26. Liu YJ Wang Q Li B 2011 Neuronal responses to looming objects in the superior colliculus of the cat Brain, Behavior and Evolution 77 193 205 10.1159/000327045 21546772 · DOI
  27. Maisak MS Haag J Ammer G Serbe E Meier M Leonhardt A Schilling T Bahl A Rubin GM Nern A Dickson BJ Reiff DF Hopp E Borst A 2013 A directional tuning map of Drosophila elementary motion detectors Nature 500 212 216 10.1038/nature12320 23925246 · DOI · Paper page
  28. Matulis CA Chen J Gonzalez-Suarez AD Behnia R Clark DA 2020 Heterogeneous Temporal Contrast Adaptation in Drosophila Direction-Selective Circuits Current Biology 30 222 236 10.1016/j.cub.2019.11.077 31928874 PMC7003801 · DOI
  29. Mauss AS Pankova K Arenz A Nern A Rubin GM Borst A 2015 Neural Circuit to Integrate Opposing Motions in the Visual Field Cell 162 351 362 10.1016/j.cell.2015.06.035 26186189 · DOI
  30. Morgan MG Henrion M Small M 1990 Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis Cambridge University Press 10.1017/CBO9780511840609 · DOI
  31. Morimoto MM Nern A Zhao A Rogers EM Wong AM Isaacson MD Bock DD Rubin GM Reiser MB 2020 Spatial readout of visual looming in the central brain of Drosophila eLife 9 e57685 10.7554/eLife.57685 33205753 PMC7744102 · DOI
  32. Muijres FT Elzinga MJ Melis JM Dickinson MH 2014 Flies evade looming targets by executing rapid visually directed banked turns Science 344 172 177 10.1126/science.1248955 24723606 · DOI
  33. Münch TA da Silveira RA Siegert S Viney TJ Awatramani GB Roska B 2009 Approach sensitivity in the retina processed by a multifunctional neural circuit Nature Neuroscience 12 1308 1316 10.1038/nn.2389 19734895 · DOI
  34. Oliva D Tomsic D 2014 Computation of object approach by a system of visual motion-sensitive neurons in the crab Neohelice Journal of Neurophysiology 112 1477 1490 10.1152/jn.00921.2013 24899670 · DOI
  35. Olshausen BA Field DJ 1996 Emergence of simple-cell receptive field properties by learning a sparse code for natural images Nature 381 607 609 10.1038/381607a0 8637596 · DOI · Paper page
  36. Olshausen BA Field DJ 1997 Sparse coding with an overcomplete basis set: a strategy employed by V1? Vision Research 37 3311 3325 10.1016/s0042-6989(97)00169-7 9425546 · DOI · Paper page
  37. Peek MY Card GM 2016 Comparative approaches to escape Current Opinion in Neurobiology 41 167 173 10.1016/j.conb.2016.09.012 27710794 · DOI
  38. Regan D Beverley KI 1978 Looming detectors in the human visual pathway Vision Research 18 415 421 10.1016/0042-6989(78)90051-2 664320 · DOI
  39. Richards BA Lillicrap TP Beaudoin P Bengio Y Bogacz R Christensen A Clopath C Costa RP de Berker A Ganguli S Gillon CJ Hafner D Kepecs A Kriegeskorte N Latham P Lindsay GW Miller KD Naud R Pack CC Poirazi P Roelfsema P Sacramento J Saxe A Scellier B Schapiro AC Senn W Wayne G Yamins D Zenke F Zylberberg J Therien D Kording KP 2019 A deep learning framework for neuroscience Nature Neuroscience 22 1761 1770 10.1038/s41593-019-0520-2 31659335 PMC7115933 · DOI · Paper page
  40. Rind FC Bramwell DI 1996 Neural network based on the input organization of an identified neuron signaling impending collision Journal of Neurophysiology 75 967 985 10.1152/jn.1996.75.3.967 8867110 · DOI
  41. Ruderman DL Bialek W 1994 Statistics of natural images: Scaling in the woods Physical Review Letters 73 814 817 10.1103/PhysRevLett.73.814 10057546 · DOI
  42. Sabbah S Gemmer JA Bhatia-Lin A Manoff G Castro G Siegel JK Jeffery N Berson DM 2017 A retinal code for motion along the gravitational and body axes Nature 546 492 497 10.1038/nature22818 28607486 PMC5729591 · DOI
  43. Salay LD Ishiko N Huberman AD 2018 A midline thalamic circuit determines reactions to visual threat Nature 557 183 189 10.1038/s41586-018-0078-2 29720647 PMC8442544 · DOI · Paper page
  44. Salazar-Gatzimas E Chen J Creamer MS Mano O Mandel HB Matulis CA Pottackal J Clark DA 2016 Direct Measurement of Correlation Responses in Drosophila Elementary Motion Detectors Reveals Fast Timescale Tuning Neuron 92 227 239 10.1016/j.neuron.2016.09.017 27710784 PMC5097865 · DOI
  45. Santer RD Simmons PJ Rind FC 2005 Gliding behaviour elicited by lateral looming stimuli in flying locusts Journal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology 191 61 73 10.1007/s00359-004-0572-x 15558287 · DOI
  46. Sato K Yamawaki Y 2014 Role of a looming-sensitive neuron in triggering the defense behavior of the praying mantis Tenodera aridifolia Journal of Neurophysiology 112 671 682 10.1152/jn.00049.2014 24848471 · DOI
  47. Shang C Liu Z Chen Z Shi Y Wang Q Liu S Li D Cao P 2015 BRAIN CIRCUITS. A parvalbumin-positive excitatory visual pathway to trigger fear responses in mice Science 348 1472 1477 10.1126/science.aaa8694 26113723 · DOI
  48. Shinomiya K Huang G Lu Z Parag T Xu CS Aniceto R Ansari N Cheatham N Lauchie S Neace E Ogundeyi O Ordish C Peel D Shinomiya A Smith C Takemura S Talebi I Rivlin PK Nern A Scheffer LK Plaza SM Meinertzhagen IA 2019 Comparisons between the ON- and OFF-edge motion pathways in the Drosophila brain eLife 8 e40025 10.7554/eLife.40025 30624205 PMC6338461 · DOI · Paper page
  49. Stanley KO Clune J Lehman J Miikkulainen R 2019 Designing neural networks through neuroevolution Nature Machine Intelligence 1 24 35 10.1038/s42256-018-0006-z · DOI
  50. Stavenga DG 2003 Angular and spectral sensitivity of fly photoreceptors. II. Dependence on facet lens F-number and rhabdomere type in Drosophila Journal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology 189 189 202 10.1007/s00359-003-0390-6 12664095 · DOI
  51. Sun H Frost BJ 1998 Computation of different optical variables of looming objects in pigeon nucleus rotundus neurons Nature Neuroscience 1 296 303 10.1038/1110 10195163 · DOI · Paper page
  52. Takemura SY Nern A Chklovskii DB Scheffer LK Rubin GM Meinertzhagen IA 2017 The comprehensive connectome of a neural substrate for on motion detection in Drosophila eLife 6 e24394 10.7554/eLife.24394 28432786 PMC5435463 · DOI · Paper page
  53. Tanouye MA Wyman RJ 1980 Motor outputs of giant nerve fiber in Drosophila Journal of Neurophysiology 44 405 421 10.1152/jn.1980.44.2.405 6774064 · DOI
  54. Temizer I Donovan JC Baier H Semmelhack JL 2015 A Visual Pathway for Looming-Evoked Escape in Larval Zebrafish Current Biology 25 1823 1834 10.1016/j.cub.2015.06.002 26119746 · DOI · Paper page
  55. Turner MH Sanchez Giraldo LG Schwartz O Rieke F 2019 Stimulus- and goal-oriented frameworks for understanding natural vision Nature Neuroscience 22 15 24 10.1038/s41593-018-0284-0 30531846 PMC8378293 · DOI
  56. Virtanen P Gommers R Oliphant TE Haberland M Reddy T Cournapeau D Burovski E Peterson P Weckesser W Bright J van der Walt SJ Brett M Wilson J Millman KJ Mayorov N Nelson ARJ Jones E Kern R Larson E Carey CJ Polat İ Feng Y Moore EW VanderPlas J Laxalde D Perktold J Cimrman R Henriksen I Quintero EA Harris CR Archibald AM Ribeiro AH Pedregosa F van Mulbregt P SciPy 1.0 Contributors 2020 Author Correction: SciPy 1.0: fundamental algorithms for scientific computing in Python Nature Methods 17 261 272 10.1038/s41592-020-0772-5 32015543 PMC7056644 · DOI
  57. Vogels R 1990 Population coding of stimulus orientation by striate cortical cells Biological Cybernetics 64 25 31 10.1007/BF00203627 2285759 · DOI
  58. von Reyn CR Breads P Peek MY Zheng GZ Williamson WR Yee AL Leonardo A Card GM 2014 A spike-timing mechanism for action selection Nature Neuroscience 17 962 970 10.1038/nn.3741 24908103 · DOI · Paper page
  59. von Reyn CR Nern A Williamson WR Breads P Wu M Namiki S Card GM 2017 Feature Integration Drives Probabilistic Behavior in the Drosophila Escape Response Neuron 94 1190 1204 10.1016/j.neuron.2017.05.036 28641115 · DOI · Paper page
  60. Wu LQ Niu YQ Yang J Wang SR 2005 Tectal neurons signal impending collision of looming objects in the pigeon European Journal of Neuroscience 22 2325 2331 10.1111/j.1460-9568.2005.04397.x 16262670 · DOI
  61. Wu M Nern A Williamson WR Morimoto MM Reiser MB Card GM Rubin GM 2016 Visual projection neurons in the Drosophila lobula link feature detection to distinct behavioral programs eLife 5 e21022 10.7554/eLife.21022 28029094 PMC5293491 · DOI · Paper page
  62. Yamins DLK Hong H Cadieu CF Solomon EA Seibert D DiCarlo JJ 2014 Performance-optimized hierarchical models predict neural responses in higher visual cortex PNAS 111 8619 8624 10.1073/pnas.1403112111 24812127 PMC4060707 · DOI · Paper page
  63. Yamins DLK DiCarlo JJ 2016 Using goal-driven deep learning models to understand sensory cortex Nature Neuroscience 19 356 365 10.1038/nn.4244 26906502 · DOI · Paper page
  64. Zavatone-Veth JA Badwan BA Clark DA 2020 A minimal synaptic model for direction selective neurons in Drosophila Journal of Vision 20 2 10.1167/jov.20.2.2 32040161 PMC7343402 · DOI
  65. Zylberberg J Cafaro J Turner MH Shea-Brown E Rieke F 2016 Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code Neuron 89 369 383 10.1016/j.neuron.2015.11.019 26796691 PMC4724064 · DOI

Cited by

Sorted by citations

Authors
Zhou, B., Li, Z., Kim, S., Lafferty, J., & Clark, D. A.
Affiliations
Yale University (US)
Corresponding author
  • Lafferty, John
  • Clark, Damon A
Venue
eLife
Published
2022-01-13
Volume
11
ISSN
2050-084X (ISSN-L)
OpenAlex
W4220795574
Cited by
31
References
7
Citations by year
2026: 4 · 2025: 5 · 2024: 7 · 2023: 11 · 2022: 4
FWCI
3.48
Type
journal article
Language
en
Open access
Locations
  • eLife (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Institutes of Health (R01EY026555)
  • National Science Foundation (CCF-1839308, DMS-1513594)
  • Kavli Foundation
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurobiology and Insect Physiology Research
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
Keywords
visual looming, collision detection, Drosophila, shallow neural networks, neural tuning, computational neuroscience, perceptual inference
MeSH terms
Animals, Computer Simulation, Drosophila, Motion Perception, Nerve Net, Photic Stimulation, Sensory Receptor Cells

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review