The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Neural population control via deep image synthesis
Open accessPublished version of a preprint
Abstract
Predicting behavior of visual neurons: To what extent are predictive deep learning models of neural responses useful for generating experimental hypotheses? Bashivan et al. took an artificial neural network built to model the behavior of the target visual system and used it to construct images predicted to either broadly activate large populations of neurons or selectively activate one population while keeping the others unchanged. They then analyzed the effectiveness of these images in producing the desired effects in the macaque visual cortex. The manipulations showed very strong effects and achieved considerable and highly selective influence over the neuronal populations. Using novel and non-naturalistic images, the neural network was shown to reproduce the overall behavior of the animals' neural responses. Science , this issue p. eaav9436
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Receptive fields and functional architecture of monkey striate cortex
Hubel, D. H., & Wiesel, T. N. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008455 · Cited by 6,568
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Self-citationUsing goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Self-citationStimulus-selective properties of inferior temporal neurons in the macaque
Desimone, R., Albright, T., Gross, C., & Bruce, C. (1984) · The Journal of Neuroscience · doi:10.1523/jneurosci.04-08-02051.1984 · Cited by 1,423
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
A Cortical Region Consisting Entirely of Face-Selective Cells
Tsao, D. Y., Freiwald, W. A., Tootell, R. B. H., & Livingstone, M. S. (2006) · Science · doi:10.1126/science.1119983 · Cited by 1,141
Kobatake, E., & Tanaka, K. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.71.3.856 · Cited by 807
Research works printed but not linked: 6
- D. L. K. Yamins H. Hong C. Cadieu J. J. DiCarlo in Advances in Neural Information Processing Systems 26 C. J. C. Burges et al . Eds. (Neural Information Processing Systems Foundation 2013); https://papers.nips.cc/paper/4991-hierarchical-modular-optimization-of-convolutional-networks-achieves-representations-similar-to-macaque-it-and-human-ventral-stream.
- A. Krizhevsky I. Sutskever G. E. Hinton in Advances in Neural Information Processing Systems 25 F. Pereira et al . Eds. (Neural Information Processing Systems Foundation 2012); https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.
- D. Klindt A. S. Ecker T. Euler M. Bethge in Advances in Neural Information Processing Systems 31 I. Guyon et al . Eds. (Neural Information Processing Systems Foundation 2017); https://papers.nips.cc/paper/6942-neural-system-identification-for-large-populations-separating-what-and-where.pdf.
- D. Erhan Y. Bengio A. Courville P. Vincent Visualizing higher-layer features of a deep network (Departement d’Informatique et Recherche Opérationnelle Université de Montréal 2009); https://pdfs.semanticscholar.org/65d9/94fb778a8d9e0f632659fb33a082949a50d3.pdf.
- I. J. Goodfellow J. Shlens C. Szegedy Explaining and harnessing adversarial examples. arXiv 1412.6572 [stat.ML] (20 March 2015). · arXiv
- J. Deng W. Dong R. Socher L.-J. Li K. Li L. Fei-Fei in 2009 IEEE Conference on Computer Vision and Pattern Recognition (IEEE 2009) pp. 248–255; www.image-net.org/papers/imagenet_cvpr09.pdf.
Cited by
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027
Computation Through Neural Population Dynamics
Vyas, S., Golub, M. D., Sussillo, D., & Shenoy, K. V. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092619-094115 · Cited by 671
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
Lindsay, G. W. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01544 · Cited by 557
Quo vadis artificial intelligence?
Jiang, Y., Li, X., Luo, H., Yin, S., & Kaynak, O. (2022) · Discover Artificial Intelligence · doi:10.1007/s44163-022-00022-8 · Cited by 544
The neural architecture of language: Integrative modeling converges on predictive processing
Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105646118 · Cited by 517
Deep Neural Networks as Scientific Models
Cichy, R. M., & Kaiser, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.009 · Cited by 454
If deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397
“One approach, illustrated schematically here, uses ‘closed loop’ experimental designs to test the predictive power of deep networks 57,58,149 .”
BackgroundMethodArtificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X.-J. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 376
Unsupervised neural network models of the ventral visual stream
Zhuang, C., Yan, S., Nayebi, A., Schrimpf, M., Frank, M. C., DiCarlo, J. J., & Yamins, D. L. K. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2014196118 · Cited by 337
Self-citationDeep Learning: The Good, the Bad, and the Ugly
Serre, T. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014951 · Cited by 267
Ponce, C. R., Xiao, W., Schade, P. F., Hartmann, T. S., Kreiman, G., & Livingstone, M. S. (2019) · Cell · doi:10.1016/j.cell.2019.04.005 · Cited by 245
Integrative benchmarking to advance neurally mechanistic models of human intelligence
Schrimpf, M., Kubilius, J., Lee, M. J., Ratan Murty, N. A., Ajemian, R., & DiCarlo, J. J. (2020) · Neuron · doi:10.1016/j.neuron.2020.07.040 · Cited by 233
Self-citationThe neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
Higgins, I., Chang, L., Langston, V., Hassabis, D., Summerfield, C., Tsao, D., & Botvinick, M. (2021) · Nature Communications · doi:10.1038/s41467-021-26751-5 · Cited by 162
Conwell, C., Prince, J. S., Kay, K. N., Alvarez, G. A., & Konkle, T. (2022) · doi:10.1101/2022.03.28.485868 · Cited by 160
Performance vs. competence in human–machine comparisons
Firestone, C. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905334117 · Cited by 150
Individual differences among deep neural network models
Mehrer, J., Spoerer, C. J., Kriegeskorte, N., & Kietzmann, T. C. (2020) · Nature Communications · doi:10.1038/s41467-020-19632-w · Cited by 133
The neural architecture of language: Integrative modeling converges on predictive processing
(2020) · doi:10.1101/2020.06.26.174482 · Cited by 129
Anterior Cingulate Cortex and the Control of Dynamic Behavior in Primates
Monosov, I. E., Haber, S. N., Leuthardt, E. C., & Jezzini, A. (2020) · Current Biology · doi:10.1016/j.cub.2020.10.009 · Cited by 118
“Hierarchical models that assign cognitive functions to relatively localized pools of neurons in the cerebral cortex have been a crucial tool in systems neuroscience, greatly increasing our mechanistic understanding of perceptual decision-making, visual categorization, and economic choice [1–6] and have extended our kn…”
BackgroundA goal-driven modular neural network predicts parietofrontal neural dynamics during grasping
Michaels, J. A., Schaffelhofer, S., Agudelo-Toro, A., & Scherberger, H. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2005087117 · Cited by 103
Conwell, C., Prince, J. S., Kay, K. N., Alvarez, G. A., & Konkle, T. (2024) · Nature Communications · doi:10.1038/s41467-024-53147-y · Cited by 100
State-dependent pupil dilation rapidly shifts visual feature selectivity
Franke, K., Willeke, K. F., Ponder, K., Galdamez, M., Zhou, N., Muhammad, T., Patel, S., Froudarakis, E., Reimer, J., Sinz, F. H., et al. (2022) · Nature · doi:10.1038/s41586-022-05270-3 · Cited by 85
(2021) · doi:10.1162/jocn_a_01755 · Cited by 85
Unveiling functions of the visual cortex using task-specific deep neural networks
Dwivedi, K., Bonner, M. F., Cichy, R. M., & Roig, G. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009267 · Cited by 52
Mapping model units to visual neurons reveals population code for social behaviour
Cowley, B. R., Calhoun, A. J., Rangarajan, N., Ireland, E., Turner, M. H., Pillow, J. W., & Murthy, M. (2024) · Nature · doi:10.1038/s41586-024-07451-8 · Cited by 55
“These maximizing stimulus sequences represent predictions of the 1-to-1 network that can be tested in future experiments to see if they truly elicit large responses from LC neurons, much like recent work has identified images to drive visual cortical neurons of macaque monkey 64–67 .”
BackgroundEmergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks
Mohsenzadeh, Y., Mullin, C., Lahner, B., & Oliva, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-61409-0 · Cited by 31
Advances in neuroscience, not devices, will determine the effectiveness of visual prostheses
Abbasi, B., & Rizzo, J. F. (2021) · Seminars in Ophthalmology · doi:10.1080/08820538.2021.1887902 · Cited by 19
Golan, T., Taylor, J., Schütt, H., Peters, B., Sommers, R. P., Seeliger, K., Doerig, A., Linton, P., Konkle, T., van Gerven, M., et al. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23001553 · Cited by 12
Khosla, M., & Wehbe, L. (2022) · doi:10.1101/2022.03.16.484578 · Cited by 11
Better artificial intelligence does not mean better models of biology
Linsley, D., Feng, P., & Serre, T. (2026) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.11.016 · Cited by 7
Deep Learning–Based Control of Electrically Evoked Activity in Human Visual Cortex
Moure, P., Granley, J., Grani, F., Soo, L., Lozano, A., López-Peco, R., Villamarin-Ortiz, A., Soto-Sanchez, C., Liu, S.-C., Beyeler, M., et al. (2025) · bioRxiv · doi:10.1101/2025.09.24.678361
“Using image neural networks predictive of primate and human V1 could be one solution [39, 50], but our perception decoders might offer another solution.”
Metadata
- Authors
- Bashivan, P., Kar, K., & DiCarlo, J. J.
- Venue
- Science
- Published
- 2019-05-03
- Volume
- 364
- Issue
- 6439
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2898929289
- Cited by
- 434
- References
- 32
- FWCI
- 27.99
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Office of Naval Research (MURI-114407)
- National Eye Institute (R01-EY014970)
- Intelligence Advanced Research Projects Activity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.