Evolving images for visual neurons using a deep generative network reveals coding principles and neuronal preferences

Ponce, Carlos R., Xiao, Will, Schade, Peter F., Hartmann, Till S., Kreiman, Gabriel, Livingstone, Margaret S.·2019·Cell
DOI 10.1016/j.cell.2019.04.005

Cited by (245)

Items 101–200 of 245

  1. A distinct population of heterogeneously color-tuned neurons in macaque visual cortex
    Sunny Nigam, Sorin Pojoga, Valentin Dragoi · 2021 · Science Advances
  2. Exploring the Origins and Prevalence of Texture Bias in Convolutional Neural Networks.
    Katherine L. Hermann, Simon Kornblith · 2019 · arXiv (Cornell University)
  3. Distinct neural bases of visual art- and music-induced aesthetic experiences
    Youjing Luo, Qianqian Yu, Shuyi Wu, Yuejia Luo · 2024 · NeuroImage
  4. Energy Guided Diffusion for Generating Neurally Exciting Images
    Paweł A. Pierzchlewicz, Konstantin Willeke, Arne Nix, Pavithra Elumalai, Kelli Restivo, Tori Shinn, Cate Nealley, Gabrielle Rodriguez, Saumil Surendra Patel, Katrin Franke et al. · 2023 · neural information processing systems
  5. The feature landscape of visual cortex
    Rudi Tong, Ronan V. da Silva, Dongyan Lin, Arna Ghosh, James Wilsenach, Erica Cianfarano, Pouya Bashivan, Blake A. Richards, Stuart Trenholm · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  6. Distinct visual processing networks for foveal and peripheral visual fields
    Jie Zhang, Huihui Zhou, Shuo Wang · 2024 · Communications Biology
  7. Distinct attentional characteristics of neurons with visual feature coding in the primate brain
    Jie Zhang, Runnan Cao, Xiaocang Zhu, Huihui Zhou, Shuo Wang · 2025 · Science Advances
  8. Human brain responses are modulated when exposed to optimized natural images or synthetically generated images
    Zijin Gu, Keith Wakefield Jamison, Mert Rory Sabuncu, Amy F. Kuceyeski · 2023 · Communications Biology
  9. Color Tuning of Face-Selective Neurons in Macaque Inferior Temporal Cortex
    Marianne Duyck, Audrey L. Y. Chang, Tessa J. Gruen, Lawrence Y. Tello, Serena Eastman, Joshua Fuller-Deets, Bevil R. Conway · 2021 · eNeuro
  10. Higher visual areas act like domain-general filters with strong selectivity and functional specialization
    Meenakshi Khosla, Leila Wehbe · 2026 · Nature Communications
  11. One-to-one mapping between deep network units and real neurons uncovers a visual population code for social behavior
    Benjamin R. Cowley, Adam J. Calhoun, Nivedita Rangarajan, Maxwell H. Turner, J. Pillow, M. Murthy · 2023 · bioRxiv
  12. Scalable Gaussian process inference of neural responses to natural images
    Matías A. Goldin, Samuele Virgili, M. Chalk · 2023 · bioRxiv
  13. Feature-based encoding of face identity by single neurons in the human amygdala and hippocampus
    Runnan Cao, Jinge Wang, Chujun Lin, Emanuela De Falco, Alina Peter, Hernan Gonzalo Rey, Peter Brunner, Jon Timothy Willie, James J. DiCarlo, Alexander T. Todorov et al. · 2025 · Nature Human Behaviour
  14. Face cells encode object parts more than facial configuration of illusory faces
    Saloni Sharma, Kasper Vinken, Akshay V. Jagadeesh, Margaret S. Livingstone · 2024 · Nature Communications
  15. An Annotated Journey through Modern Visual Neuroscience
    Stuart Trenholm, Arjun Krishnaswamy · 2020 · Journal of Neuroscience
  16. Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse
    Liwei Huang, Zhengyu Ma, Liutao Yu, Huihui Zhou, Yonghong Tian · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
  17. How well do models of visual cortex generalize to out of distribution samples?
    Yifei Ren, Pouya Bashivan · 2024 · PLoS Computational Biology
  18. Intracortical recordings reveal the neuronal selectivity for bodies and body parts in the human visual cortex
    Jesus Garcia Ramirez, Michaël Vanhoyland, N. Apurva Ratan Murty, Thomas Decramer, Wim Van Paesschen, Stefania Bracci, Hans Op de Beeck, Nancy Kanwisher, Peter Janssen, Tom Theys · 2024 · Proceedings of the National Academy of Sciences
  19. A neural computational framework for face processing in the human temporal lobe
    Runnan Cao, Jie Zhang, Jie Zheng, Yue Wang, Peter Brunner, Jon Timothy Willie, Shuo Wang · 2025 · Current Biology
  20. Mapping macaque to human cortex with natural scene responses
    Kasper Vinken, Saloni Sharma, Margaret S. Livingstone · 2025 · Proceedings of the National Academy of Sciences
  21. Bodies in motion: Unraveling the distinct roles of motion and shape in dynamic body responses in the temporal cortex
    Rajani Raman, Anna Bognár, Ghazaleh Ghamkhari Nejad, Nick Taubert, Martin A. Giese, Rufin Vogels · 2023 · Cell Reports
  22. Topological structure of population activity in mouse visual cortex encodes densely sampled stimulus rotations
    Kosio Beshkov, Marianne Fyhn, Torkel Hafting, Gaute T. Einevoll · 2024 · iScience
  23. The Portilla-Simoncelli Texture Model: towards Understanding the Early Visual Cortex
    Jonathan Vacher, Thibaud Briand · 2021 · Image Processing On Line
  24. Parallel development of object recognition in newborn chicks and deep neural networks
    Lalit Pandey, Donsuk Lee, Samantha M. W. Wood, Justin N. Wood · 2024 · PLoS Computational Biology
  25. Do Topographic Deep ANN Models of the Primate Ventral Stream Predict the Perceptual Effects of Direct IT Cortical Interventions?
    Martin Schrimpf, Paul McGrath, Eshed Margalit, James J. DiCarlo · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  26. Understanding How Cells Probe the World: A Preliminary Step towards Modeling Cell Behavior?
    Pierre Bongrand · 2023 · International Journal of Molecular Sciences
  27. High-performance evolutionary algorithms for online neuron control
    Binxu Wang, Carlos R. Ponce · 2022 · Genetic and Evolutionary Computation Conference (GECCO)
  28. Using compositionality to understand parts in whole objects
    Sripati P. Arun · 2022 · European Journal of Neuroscience
  29. Emergent selectivity for scenes, object properties, and contour statistics in feedforward models of scene-preferring cortex
    Donald Shi Pui Li, Michael Bonner · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  30. A human single-neuron dataset for object recognition
    Runnan Cao, Peter Brunner, Nicholas James Brandmeir, Jon Timothy Willie, Shuo Wang · 2025 · Scientific Data
  31. Hue tuning curves in V4 change with visual context
    Ari S. Benjamin, Pavan Ramkumar, Hugo L. Fernandes, Matthew Smith, Konrad Paul Kording · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
  32. Roadmap on advances in visual and physiological optics
    Jesús Emmanuel Gómez-Correa, Brian Vohnsen, Barbara Krystyna Pierscionek, S. Chávez Cerda, Sabine Kling, Jos J Rozema, Raymond A. Applegate, Giuliano Scarcelli, J. Bradley Randleman, Alexander V. Goncharov et al. · 2025 · Journal of Optics
  33. A software platform for real-time and adaptive neuroscience experiments
    Anne Draelos, Matthew D. Loring, Maxim Nikitchenko, Chaichontat Sriworarat, Pranjal Gupta, Daniel Sprague, Eftychios A. Pnevmatikakis, Andrea Giovannucci, Tyler Benster, Karl A. Deisseroth et al. · 2025 · Nature Communications
  34. Task Modulation of Single-Neuron Activity in the Human Amygdala and Hippocampus
    Runnan Cao, Alexander Todorov, Nicholas James Brandmeir, Shuo Wang · 2021 · eNeuro
  35. Heterogeneous orientation tuning in the primary visual cortex of mice diverges from Gabor-like receptive fields in primates
    Jiakun Fu, Paweł A. Pierzchlewicz, Konstantin F. Willeke, Mohammad Bashiri, Taliah Muhammad, Maria Diamantaki, Emmanouil Froudarakis, Kelli Restivo, Kayla Ponder, George H. Denfield et al. · 2024 · Cell Reports
  36. Face pareidolia minimally engages macaque face selective neurons
    Kenji W. Koyano, Jessica Taubert, William Robison, Elena N. Waidmann, David A. Leopold · 2025 · Progress in Neurobiology
  37. High-contrast "gaudy" images improve the training of deep neural network models of visual cortex
    Benjamin R. Cowley, Jonathan W. Pillow · 2020 · arXiv (Cornell University)
  38. Real-Time fMRI in the Treatment of Mental Health Disorders
    Vincent Taschereau‐Dumouchel, Cody A. Cushing, Hakwan C. Lau · 2022
  39. Color and Spatial Frequency Provide Functional Signatures of Retinotopic Visual Areas
    Spencer R. Loggia, Stuart J. Duffield, Kurt Braunlich, Bevil R. Conway · 2024 · Journal of Neuroscience
  40. Retinal processing of natural scenes: challenges ahead
    Samuele Virgili, Olivier Marre · 2026 · Vision Research
  41. Functional bipartite invariance in mouse primary visual cortex receptive fields
    Zhiwei Ding, Dat T. Tran, Kayla Ponder, Zhuokun Ding, Rachel Froebe, Lydia Ntanavara, Paul G. Fahey, Erick Cobos, Luca Baroni, Maria Diamantaki et al. · 2026 · Nature Neuroscience
  42. Neuronal tuning aligns dynamically with object and texture manifolds across the visual hierarchy
    Binxu Wang, Carlos R. Ponce · 2026 · Nature Neuroscience
  43. Generalizing biological surround suppression based on center surround similarity via deep neural network models
    Xu Pan, Annie DeForge, Odelia Schwartz · 2023 · PLoS Computational Biology
  44. Encoding of visual objects in the human medial temporal lobe
    Yue Wang, Runnan Cao, Shuo Wang · 2024 · Journal of Neuroscience
  45. Diverse coactive neurons encode stimulus-driven and stimulus-independent variables
    Jì Xià, Tyler D. Marks, Michael J. Goard, Ralf Weßel · 2020 · Journal of Neurophysiology
  46. Learning Realistic Patterns from Visually Unrealistic Stimuli: Generalization and Data Anonymization
    Konstantinos Nikolaidis, Stein Kristiansen, Thomas Plagemann, Vera Goebel, Knut Liestøl, Mohan Kankanhalli, Gunn Marit Traaen, Britt Øverland, Harriet Akre, Lars Aakerøy et al. · 2021 · Journal of Artificial Intelligence Research
  47. Predicting Single Neuron Responses of the Primary Visual Cortex with Deep Learning Model
    Kaiwen Deng, Peter S. Schwendeman, Yuanfang Guan · 2024 · Advanced Science
  48. Text-related functionality and dynamics of visual human pre-frontal activations revealed through neural network convergence
    Adva Shoham, Rotem Broday-Dvir, Itay Yaron, Galit Yovel, Rafael Malach · 2025 · Communications Biology
  49. PATHFINDER: Designing Stimulus for Neuromodulation Through Data-Driven Inverse Estimation of Non-Linear Functions
    Chaitanya Goswami, Pulkit Grover · 2023 · IEEE Transactions on Biomedical Engineering
  50. If deep learning is the answer, then what is the question?
    Andrew Saxe, Stephanie Nelli, Christopher Summerfield · 2020 · arXiv (Cornell University)
  51. Noise-robust recognition of objects by humans and deep neural networks
    Hojin Jang, Devin R. McCormack, Frank Tong · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
  52. Context-dependent selectivity to natural scenes in the retina
    Matías A. Goldin, Baptiste Lefebvre, Samuele Virgili, Alexander S. Ecker, Thierry Mora, Ulisse Ferrari, Olivier Marre · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  53. In silico discovery of representational relationships across visual cortex
    Alessandro T. Gifford, Maya A. Jastrzębowska, Johannes Singer, Radoslaw Martin Cichy · 2025 · Nature Human Behaviour
  54. Should Artificial Intelligence Play a Durable Role in Biomedical Research and Practice?
    Pierre Bongrand · 2024 · International Journal of Molecular Sciences
  55. Computational single-neuron mechanisms of visual object coding in the human temporal lobe
    Runnan Cao, Jie Zhang, Jie Zheng, Yue Wang, Peter Brunner, Jon Timothy Willie, Shuo Wang · 2026 · Nature Communications
  56. Canary Vocal Sensorimotor Model with RNN Decoder and Low-dimensional GAN Generator
    Silvia Pagliarini, Arthur Leblois, Xavier Hinaut · 2021 · IEEE International Conference on Development and Learning (ICDL)
  57. Inverting Adversarially Robust Networks for Image Synthesis
    Renán A. Rojas-Gómez, Raymond A. Yeh, Minh N. Do, Anh Nguyen · 2023 · Lecture notes in computer science
  58. Brain Decoding of Multiple Subjects for Estimating Visual Information Based on a Probabilistic Generative Model
    Takaaki Higashi, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama · 2022 · Sensors
  59. Modulating human brain responses via optimal natural image selection and synthetic image generation
    Zijin Gu, Jamison, Keith, Mert Rory Sabuncu, Amy F. Kuceyeski · 2023 · PubMed
  60. Deep generative networks reveal the tuning of neurons in IT and predict their influence on visual perception
    Paolo Papale, Daniela De Luca, Pieter R. Roelfsema · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  61. Hierarchical Optimization predicts Plasticity in the Macaque Inferior Temporal Cortex following Object Training
    Lynn K. A. Sörensen, James J. DiCarlo, Kohitij Kar · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  62. On Human-like Biases in Convolutional Neural Networks for the Perception of Slant from Texture
    Yuanhao Wang, Qian Zhang, Celine Aubuchon, Jovan T. Kemp, Fulvio Domini A, James Tompkin · 2023 · ACM Transactions on Applied Perception
  63. Fast gradient-free activation maximization for neurons in spiking neural networks
    Nikita Pospelov, Andrei Chertkov, Maxim Beketov, Ivan Valer'evich Oseledets, K. V. Anokhin · 2024 · Neurocomputing
  64. Visualizing and Controlling Cortical Responses Using Voxel-Weighted Activation Maximization
    Matthew W. Shinkle, Mark D. Lescroart · 2025 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  65. Investigating the effect of attention mechanisms on deep neural network engineering performance and brain-like properties
    Denghui Bai, Tingting Zhang, Qiuzhu Zhang, Junjun Zhang, Zhenlan Jin, Ling Li · 2025 · Neurocomputing
  66. Generic fitting models learn edge representations from prenatal retinal waves
    Lalit Pandey, Samantha M. W. Wood, Benjamin Cappell, Justin N. Wood · 2026 · Cognition
  67. Macaques recognize features in synthetic images derived from ventral stream neurons
    Katherine N. Mueller, Mary C. Carter, Jeevun A. Kansupada, Carlos R. Ponce · 2023 · Proceedings of the National Academy of Sciences
  68. BRACTIVE: A Brain Activation Approach to Human Visual Brain Learning
    Xuan-Bac Nguyen, Hojin Jang, Xin Li, Samee U. Khan, Pawan Sinha, Khoa Luu · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
  69. Characterizing the Performance of Deep Neural Networks for Eye-Tracking
    Arnab Biswas, Kamran Binaee, Kaylie Jacleen Capurro, Mark D. Lescroart · 2021 · ACM Symposium on Eye Tracking Research and Applications (ETRA)
  70. Neurophysiology: The Three-Dimensional Building Blocks of Object Vision
    David A. Leopold, Arash Afraz · 2021 · Current Biology
  71. improv : A software platform for real-time and adaptive neuroscience experiments
    Anne Draelos, Matthew D. Loring, Maxim Nikitchenko, Chaichontat Sriworarat, Pranjal Gupta, Daniel Sprague, Eftychios A. Pnevmatikakis, Andrea Giovannucci, Tyler Benster, Karl A. Deisseroth et al. · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  72. Interpretability of artificial neural network models in artificial Intelligence vs. neuroscience
    Kohitij Kar, Simon Kornblith, Evelina G. Fedorenko · 2022 · arXiv (Cornell University)
  73. Upgrading Voxel-wise Encoding Model via Integrated Integration over Features and Brain Networks
    Yuanning Li, Huzheng Yang, Shi Gu · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
  74. Topological Structure of Population Activity in Mouse Visual Cortex Encodes Visual Scene Rotations
    Kosio Beshkov, Gaute T. Einevoll · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  75. Space perception
    Frank Bremmer · 2023 · Elsevier eBooks
  76. Modeling Sensorimotor Processing with Physics-Informed Neural Networks
    Adriana Perez Rotondo, Alessandro Marin Vargas, Michael D. Dimitriou, Alexander Mathis · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  77. Diverse Perceptual Representations Across Visual Pathways Emerge from A Single Objective
    Yingtian Tang, Abdülkadir Gökce, Khaled Jedoui, Daniel L. K. Yamins, Martin Schrimpf · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
  78. Deep learning-driven characterization of single cell tuning in primate visual area V4 supports topological organization
    Konstantin F. Willeke, Kelli Restivo, Katrin Franke, Arne Nix, Santiago A. Cadena, Tori Shinn, Cate Nealley, Gabrielle Rodriguez, Saumil Surendra Patel, Alexander S. Ecker et al. · 2026 · eLife
  79. Neural prediction decorrelation reveals that adversarial robustness substantially improves DNN prediction accuracy across the entire human auditory cortex
    David Skrill, Jenelle Feather, Sam Norman-Haignere · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
  80. Neural Encoding and Decoding
    Behtash Babadi · 2023 · Handbook of Neuroengineering
  81. Probabilistic neural transfer function estimation with Bayesian system identification
    Nan Wu, Isabel Valera, Fabian H. Sinz, Alexander S. Ecker, Thomas Euler, Yongrong Qiu · 2024 · PLoS Computational Biology
  82. Advancements in neural closed-loop manipulations in awake, behaving animals
    Wenxuan Fang, Afsoon G. Mombeini, Manu Sasidharan Madhav · 2025 · Current Opinion in Behavioral Sciences
  83. Understanding the Brain as a Mentalizing Machine with a Symbol Grounding Function
    Takaaki Kaneko, Taihei Ninomiya, Masaki Isoda · 2026 · Journal of Neuroscience
  84. Making models disagree to learn how brains compute
    Tal Golan, Heiko H. Schütt, Nikolaus Kriegeskorte · 2026 · Nature reviews. Neuroscience
  85. What do neurons really want? The role of semantics in cortical representations
    Gabriel Kreiman · 2019 · The Psychology of learning and motivation/The psychology of learning and motivation
  86. Machine learning and neuroimaging: Understanding the human brain in health and disease
    Zijin Gu, Keith Wakefield Jamison, Mert Rory Sabuncu, Amy F. Kuceyeski · 2024 · Elsevier eBooks
  87. Brain feature maps reveal progressive animal-feature representations in the ventral stream
    Zhanqi Zhang, Till S. Hartmann, Richard T. Born, Margaret S. Livingstone, Carlos R. Ponce · 2025 · Science Advances
  88. Neural Encoding and Decoding
    Behtash Babadi · 2021 · Handbook of Neuroengineering
  89. Maximal Dependence Capturing as a Principle of Sensory Processing
    Rishabh Raj, Dar Dahlen, Kyle Duyck, C. Ron Yu · 2022 · Frontiers in Computational Neuroscience
  90. Face identity selectivity in the deep neural network and human brain
    Jinge Wang, Runnan Cao, Nicholas James Brandmeir, Xin Li, Shuo Wang · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  91. The Dynamic Sensorium competition for predicting large-scale mouse visual cortex activity from videos.
    Polina Turishcheva, Paul G. Fahey, Michaela Vystrčilová, Laura Hansel, Rachel Froebe, Kayla Ponder, Yongrong Qiu, Konstantin F. Willeke, Mohammad Bashiri, Eric Y. Wang et al. · 2024 · PubMed
  92. Distinct attentional profile and functional connectivity of neurons with visual feature coding in the primate brain
    Jie Zhang, Runnan Cao, Xiaocang Zhu, Huihui Zhou, Shuo Wang · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  93. Diffusion-based stimulus optimization reveals functional organization across higher visual cortex
    Margaret M. Henderson, Andrew F. Luo, Sungjoon Park, Michael J. Tarr, Leila Wehbe · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
  94. Vision: Dialogues between Deep Networks and the Brain
    Charles E. Connor · 2019 · Current Biology
  95. Contrast invariant tuning in human perception of image content
    Ingo Fruend, Jaykishan Y. Patel, Elee D Stalker · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
  96. A Deep Dive to Illuminate V4 Neurons
    Aaron P. Batista, Konrad Paul Kording · 2019 · Trends in Neurosciences
  97. Discrimination Assessment for Saliency Maps
    Ruiyi Li, Yangzhou Du, Zhongchao Shi, Yang Zhang, Zhiqiang He · 2019 · Lecture notes in computer science
  98. Color tuning of neurons in face patches of macaque inferior temporal cortex
    Marianne Duyck, Tessa J. Gruen, Lawrence Y. Tello, Serena Eastman, Joshua Fuller-Deets, Bevil R. Conway · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
  99. Selective and invariant features of neural response surfaces measured with principal curvature
    James R. Golden, Kedarnath P. Vilankar, David J. Field · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
  100. Learning Realistic Patterns from Unrealistic Stimuli: Generalization and Data Anonymization
    Konstantinos Nikolaidis, Stein Kristiansen, Thomas Plagemann, Vera Goebel, Knut Liestøl, Mohan Kankanhalli, Gunn Marit Traaen, Britt Øverland, Harriet Akre, Lars Aakerøy et al. · 2020 · arXiv (Cornell University)