The DOI matches its Crossref record; 138 of the 138 references it cites were found in a registry or an index.
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
Open accessAbstract
Convolutional neural networks (CNNs) were inspired by early findings in the study of biological vision. They have since become successful tools in computer vision and state-of-the-art models of both neural activity and behavior on visual tasks. This review highlights what, in the context of CNNs, it means to be a good model in computational neuroscience and the various ways models can provide insight. Specifically, it covers the origins of CNNs and the methods by which we validate them as models of biological vision. It then goes on to elaborate on what we can learn about biological vision by understanding and experimenting on CNNs and discusses emerging opportunities for the use of CNNs in vision research beyond basic object recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“artificial vision models such as deep convolutional neural networks (DCNNs), are already both highly successful and often claimed to be good models of human vision (Kietzmann et al. 2019, Lindsay 2021, Mehrer et al. 2021, Zhuang et al. 2021).”
From Consciousness in Artificial Intelligence: Insights from the Science of Consciousness (2023) · cites this paper as Lindsay 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503 · cited 2×
“The CNN as we know it today comes from the field of computer vision, yet the inspiration from the work of Hubel and Wiesel is clearly visible in it (Figure 1; Rawat & Wang, 2017).”
BackgroundMethodRepresentational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Recurrent Models of Visual Attention
Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 2,568
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
Proceedings of IEEE International Conference on Computer Vision
(1995) · doi:10.1109/iccv.1995 · Cited by 2,280
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
Frankle, J., & Carbin, M. (2018) · arXiv · doi:10.48550/arxiv.1803.03635 · Cited by 1,529
Deep learning and the information bottleneck principle
Tishby, N., & Zaslavsky, N. (2015) · 2015 IEEE Information Theory Workshop (ITW) · doi:10.1109/itw.2015.7133169 · Cited by 1,409
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Proceedings of the 35th Annual Meeting of the Cognitive Science Society
Culbertson, J., & Wilson, C. (2013) · Cited by 1,139
Kriegeskorte, N. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035447 · Cited by 1,093
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027
Self-citationGuclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
Untangling invariant object recognition
DiCarlo, J. J., & Cox, D. D. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.06.010 · Cited by 959
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
Saxe, A., McClelland, J. L., & Ganguli, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6120 · Cited by 931
Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition
Cao, Y., Chen, Y., & Khosla, D. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0788-3 · Cited by 917
Olah, C., Mordvintsev, A., & Schubert, L. (2017) · Distill · doi:10.23915/distill.00007 · Cited by 880
Predicting Parameters in Deep Learning
Denil, M., Shakibi, B., Dinh, L., Ranzato, M., & de Freitas, N. (2013) · arXiv · doi:10.48550/arxiv.1306.0543 · Cited by 853
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks.Preprint
Frankle, J., & Carbin, M. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 838
Similarity of Neural Network Representations Revisited
Kornblith, S., Norouzi, M., Lee, H., & Hinton, G. (2019) · arXiv · doi:10.48550/arxiv.1905.00414 · Cited by 724
Understanding deep convolutional networks
Mallat, S. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2015.0203 · Cited by 688
Towards Explainable Artificial Intelligence
Samek, W., & Müller, K.-R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_1 · Cited by 580
Opening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks
Sussillo, D., & Barak, O. (2013) · Neural Computation · doi:10.1162/neco_a_00409 · Cited by 575
Kell, A. J. E., Yamins, D. L. K., Shook, E. N., Norman-Haignere, S. V., & McDermott, J. H. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.044 · Cited by 544
Neural network models and deep learning
Kriegeskorte, N., & Golan, T. (2019) · Current Biology · doi:10.1016/j.cub.2019.02.034 · Cited by 543
Why is Real-World Visual Object Recognition Hard?
Pinto, N., Cox, D. D., & DiCarlo, J. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040027 · Cited by 537
Kar, K., Kubilius, J., Schmidt, K., Issa, E. B., & DiCarlo, J. J. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0392-5 · Cited by 496 · cited 1×
“These connections can also help make the CNN representations a better match to neural data, particularly for challenging images and at later time points in the response (Kar et al., 2019; Kubilius et al., 2019; Rajaei, Mohsenzadeh, Ebrahimpour, & KhalighRazavi, 2019; Shi, Wen, Zhang, Han, & Liu, 2018; McIntosh, Mahesw…”
BackgroundBrain-Score: Which Artificial Neural Network for Object Recognition is most Brain-Like?
Schrimpf, M., Kubilius, J., Hong, H., Majaj, N. J., Rajalingham, R., Issa, E. B., Kar, K., Bashivan, P., Prescott-Roy, J., Geiger, F., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/407007 · Cited by 458
Learning Deep Generative Models
Salakhutdinov, R. (2015) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020120 · Cited by 436
Neural population control via deep image synthesis
Bashivan, P., Kar, K., & DiCarlo, J. J. (2019) · Science · doi:10.1126/science.aav9436 · Cited by 434
Theories of Error Back-Propagation in the Brain
Whittington, J. C. R., & Bogacz, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.005 · Cited by 420
Local Aggregation for Unsupervised Learning of Visual Embeddings
Zhuang, C., Zhai, A., & Yamins, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00610 · Cited by 417
(2020) · The MIT Press eBooks · doi:10.7551/mitpress/11442.001.0001 · Cited by 405
Generalisation in humans and deep neural networks
Geirhos, R., Temme, C. R. M., Rauber, J., Schütt, H. H., Bethge, M., & Wichmann, F. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.08750 · Cited by 399
Direct Fit to Nature: An Evolutionary Perspective on Biological and Artificial Neural Networks
Hasson, U., Nastase, S. A., & Goldstein, A. (2020) · Neuron · doi:10.1016/j.neuron.2019.12.002 · Cited by 387
Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning
Lotter, W. E., Kreiman, G., & Cox, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08104 · Cited by 368
Rajalingham, R., Issa, E. B., Bashivan, P., Kar, K., Schmidt, K., & DiCarlo, J. J. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0388-18.2018 · Cited by 358
de Vries, S. E. J., Lecoq, J. A., Buice, M. A., Groblewski, P. A., Ocker, G. K., Oliver, M., Feng, D., Cain, N., Ledochowitsch, P., Millman, D., et al. (2020) · Nature Neuroscience · doi:10.1038/s41593-019-0550-9 · Cited by 353
Deep convolutional models improve predictions of macaque V1 responses to natural images
Cadena, S. A., Denfield, G. H., Walker, E. Y., Gatys, L. A., Tolias, A. S., Bethge, M., & Ecker, A. S. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006897 · Cited by 347
Deep convolutional networks do not classify based on global object shape
Baker, N., Lu, H., Erlikhman, G., & Kellman, P. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006613 · Cited by 345
Seeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338
Explicit information for category-orthogonal object properties increases along the ventral stream
Hong, H., Yamins, D. L. K., Majaj, N. J., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4247 · Cited by 337
Rubin, D. B., Van Hooser, S. D., & Miller, K. D. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.026 · Cited by 331
Deep image reconstruction from human brain activity
Shen, G., Horikawa, T., Majima, K., & Kamitani, Y. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006633 · Cited by 315
On the importance of single directions for generalization
Morcos, A. S., Barrett, D. G. T., Rabinowitz, N. C., & Botvinick, M. (2018) · arXiv · doi:10.48550/arxiv.1803.06959 · Cited by 305
Deep Neural Networks as a Computational Model for Human Shape Sensitivity
Kubilius, J., Bracci, S., & Op de Beeck, H. P. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004896 · Cited by 295
Perceptual learning rules based on reinforcers and attention
Roelfsema, P. R., van Ooyen, A., & Watanabe, T. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.005 · Cited by 281
Comparing deep neural networks against humans: object recognition when the signal gets weakerPreprint
Geirhos, R., Janssen, D., Schütt, H. H., Rauber, J., Bethge, M., & Wichmann, F. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06969 · Cited by 272
Deep Learning: The Good, the Bad, and the Ugly
Serre, T. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014951 · Cited by 267
Reinforcement and Imitation Learning for Diverse Visuomotor Skills
Zhu, Y., Wang, Z., Merel, J., Rusu, A., Erez, T., Cabi, S., Tunyasuvunakool, S., Kramár, J., Hadsell, R., de Freitas, N., et al. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.009 · Cited by 260
Proceedings of the 37th Annual Conference of the Cognitive Science Society
Kehler, A., & Rohde, H. (2015) · Cited by 245
Recurrent neural networks as versatile tools of neuroscience research
Barak, O. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.06.003 · Cited by 244
A Model of V4 Shape Selectivity and Invariance
Cadieu, C., Kouh, M., Pasupathy, A., Connor, C. E., Riesenhuber, M., & Poggio, T. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01265.2006 · Cited by 226
Classification and Geometry of General Perceptual Manifolds
Chung, S., Lee, D. D., & Sompolinsky, H. (2018) · Physical Review X · doi:10.1103/physrevx.8.031003 · Cited by 223
A quantitative theory of immediate visual recognition
Serre, T., Kreiman, G., Kouh, M., Cadieu, C., Knoblich, U., & Poggio, T. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)65004-8 · Cited by 219
Recurrent computations for visual pattern completion
Tang, H., Schrimpf, M., Lotter, W., Moerman, C., Paredes, A., Ortega Caro, J., Hardesty, W., Cox, D., & Kreiman, G. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1719397115 · Cited by 213
Recurrent Convolutional Neural Networks: A Better Model of Biological Object Recognition
Spoerer, C. J., McClure, P., & Kriegeskorte, N. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01551 · Cited by 211
Effects of Degradations on Deep Neural Network ArchitecturesPreprint
Roy, P., Ghosh, S., Bhattacharya, S., & Pal, U. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.10108 · Cited by 201
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and ArchitecturesPreprint
Bartunov, S., Santoro, A., Richards, B. A., Marris, L., Hinton, G. E., & Lillicrap, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.04587 · Cited by 199
Deep Networks Can Resemble Human Feed-forward Vision in Invariant Object Recognition
Kheradpisheh, S. R., Ghodrati, M., Ganjtabesh, M., & Masquelier, T. (2016) · Scientific Reports · doi:10.1038/srep32672 · Cited by 197
Separability and geometry of object manifolds in deep neural networks
Cohen, U., Chung, S., Lee, D. D., & Sompolinsky, H. (2020) · Nature Communications · doi:10.1038/s41467-020-14578-5 · Cited by 188
Deep neural networks in computational neuroscience
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2019) · Oxford Research Encyclopedia of Neuroscience · doi:10.1093/acrefore/9780190264086.013.46 · Cited by 186
Understanding Neural Networks via Feature Visualization: A Survey
Nguyen, A., Yosinski, J., & Clune, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_4 · Cited by 180
Martin Cichy, R., Khosla, A., Pantazis, D., & Oliva, A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.03.063 · Cited by 178
Weight Agnostic Neural Networks
Gaier, A., & Ha, D. (2019) · Unpublished · doi:10.13140/rg.2.2.16025.88169 · Cited by 161
Jozwik, K. M., Kriegeskorte, N., Storrs, K. R., & Mur, M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01726 · Cited by 161
BOLD5000, a public fMRI dataset while viewing 5000 visual images
Chang, N., Pyles, J. A., Marcus, A., Gupta, A., Tarr, M. J., & Aminoff, E. M. (2019) · Scientific Data · doi:10.1038/s41597-019-0052-3 · Cited by 159
Early recurrent feedback facilitates visual object recognition under challenging conditions
Wyatte, D., Jilk, D. J., & O’Reilly, R. C. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00674 · Cited by 152
Evaluating (and Improving) the Correspondence Between Deep Neural Networks and Human Representations
Peterson, J. C., Abbott, J. T., & Griffiths, T. L. (2018) · Cognitive Science · doi:10.1111/cogs.12670 · Cited by 151
Seeliger, K., Fritsche, M., Güçlü, U., Schoenmakers, S., Schoffelen, J., Bosch, S., & van Gerven, M. A. J. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.018 · Cited by 149
Controversial stimuli: Pitting neural networks against each other as models of human cognition
Golan, T., Raju, P. C., & Kriegeskorte, N. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912334117 · Cited by 146
Beyond core object recognition: Recurrent processes account for object recognition under occlusion
Rajaei, K., Mohsenzadeh, Y., Ebrahimpour, R., & Khaligh‐Razavi, S. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007001 · Cited by 138
BOLD5000, a public fMRI dataset while viewing 5000 visual images
Chang, N., Pyles, J. A., Marcus, A., Gupta, A., Tarr, M., & Aminoff, E. (2019) · Figshare · doi:10.1184/r1/8097584 · Cited by 132
Revisiting the Importance of Individual Units in CNNs via AblationPreprint
Zhou, B., Sun, Y., Bau, D., & Torralba, A. B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02891 · Cited by 129
Analyzing biological and artificial neural networks: challenges with opportunities for synergy?
Barrett, D. G. T., Morcos, A. S., & Macke, J. H. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.01.007 · Cited by 127
Jacob, G., Pramod, R. T., Katti, H., & Arun, S. P. (2021) · Nature Communications · doi:10.1038/s41467-021-22078-3 · Cited by 126
Using human brain activity to guide machine learning
Fong, R., Scheirer, W. J., & Cox, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-23618-6 · Cited by 124
Devereux, B. J., Clarke, A., & TYLER, L. K. (2018) · Scientific Reports · doi:10.1038/s41598-018-28865-1 · Cited by 112
The spatiotemporal neural dynamics underlying perceived similarity for real-world objects
Cichy, R. M., Kriegeskorte, N., Jozwik, K. M., van den Bosch, J. J. F., & Charest, I. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.03.031 · Cited by 106
Bracci, S., Ritchie, J. B., Kalfas, I., & de Beeck, H. O. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.1714-18.2019 · Cited by 106
Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction
Watanabe, E., Kitaoka, A., Sakamoto, K., Yasugi, M., & Tanaka, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00345 · Cited by 101 · cited 1×
“In addition, a model trained based on the concept of predictive coding [68] was able to predict object movement and replicate motion illusions [69].”
BackgroundHierarchical visuomotor control of humanoidsPreprint
Merel, J., Ahuja, A., Pham, V., Tunyasuvunakool, S., Liu, S., Tirumala, D., Heess, N., & Wayne, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09656 · Cited by 101
Principles for models of neural information processing
Kay, K., & Weiner, K. S. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.016 · Cited by 101
Lindsey, J. W., Ocko, S. A., Ganguli, S., & Deny, S. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/511535 · Cited by 99
Stimulus- and goal-oriented frameworks for understanding natural vision
Turner, M. H., Giraldo, L. G. S., Schwartz, O., & Rieke, F. M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0284-0 · Cited by 97
Computational mechanisms underlying cortical responses to the affordance properties of visual scenes
Bonner, M. F., & Epstein, R. A. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006111 · Cited by 94
How biological attention mechanisms improve task performance in a large-scale visual system model
Lindsay, G. W., & Miller, K. D. (2018) · eLife · doi:10.7554/elife.38105 · Cited by 91
Self-citationWen, H., Shi, J., Chen, W., & Liu, Z. (2018) · Scientific Reports · doi:10.1038/s41598-018-22160-9 · Cited by 89
Population response magnitude variation in inferotemporal cortex predicts image memorability
Jaegle, A., Mehrpour, V., Mohsenzadeh, Y., Meyer, T., Oliva, A., & Rust, N. C. (2019) · eLife · doi:10.7554/elife.47596 · Cited by 86
King, M. L., Groen, I. I. A., Steel, A., Kravitz, D. J., & Baker, C. I. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.079 · Cited by 84
Deep Neural Networks for Modeling Visual Perceptual Learning
Wenliang, L. K., & Seitz, A. R. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.1620-17.2018 · Cited by 83 · cited 1×
“Finally, CNNs were also able to recapitulate several behavioral and neural effects of fine-grain perceptual learning [104].”
BackgroundZeman, A. A., Ritchie, J. B., Bracci, S., & de Beeck, H. O. (2020) · Scientific Reports · doi:10.1038/s41598-020-59175-0 · Cited by 81
Deep Learning for Cognitive Neuroscience
Storrs, K. R., & Kriegeskorte, N. (2020) · The MIT Press eBooks · doi:10.7551/mitpress/11442.003.0077 · Cited by 78
Using deep learning to probe the neural code for images in primary visual cortex
Kindel, W., Christensen, E., & Zylberberg, J. (2019) · Journal of Vision · doi:10.1167/19.4.29 · Cited by 73
What does it mean to understand a neural network?Preprint
Lillicrap, T., & Kording, K. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06374 · Cited by 61
Learning divisive normalization in primary visual cortex
Burg, M. F., Cadena, S. A., Denfield, G. H., Walker, E. Y., Tolias, A. S., Bethge, M., & Ecker, A. S. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009028 · Cited by 61
Deep neural networks predict category typicality ratings for images
Lake, B. M., Zaremba, W., Fergus, R., & Gureckis, T. M. (2015) · Cited by 59
Limited translation invariance of human visual pattern recognition
Dill, M., & Fahle, M. W. (1998) · Perception & Psychophysics · doi:10.3758/bf03211918 · Cited by 58
Feedforward object-vision models only tolerate small image variations compared to human
Ghodrati, M., Farzmahdi, A., Rajaei, K., Ebrahimpour, R., & Khaligh‐Razavi, S. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00074 · Cited by 57
Attentional Neural Network: Feature Selection Using Cognitive FeedbackPreprint
Wang, Q., Zhang, J., Song, S., & Zhang, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.5140 · Cited by 55
Computational Models of Object Recognition in Cortex: A Review
Riesenhuber, M., & Poggio, T. (2000) · Defense Technical Information Center (DTIC) · doi:10.21236/ada458109 · Cited by 54
Fleming, R. W., & Storrs, K. R. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.07.004 · Cited by 54
Nonlinear processing of shape information in rat lateral extrastriate cortex
Matteucci, G., Marotti, R. B., Riggi, M., Rosselli, F. B., & Zoccolan, D. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.1938-18.2018 · Cited by 53
Disentangling neural mechanisms for perceptual grouping
Kim, J., Linsley, D. A., Thakkar, K., & Serre, T. (2019) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2019.1130-0 · Cited by 46
Stimulus domain transfer in recurrent models for large scale cortical population prediction on videoPreprint
Sinz, F. H., Ecker, A. S., Fahey, P. G., Walker, E. Y., Cobos, E., Froudarakis, E., Yatsenko, D., Pitkow, Z., Reimer, J., & Tolias, A. S. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/452672 · Cited by 43
Deep recurrent neural network reveals a hierarchy of process memory during dynamic natural vision
Shi, J., Wen, H., Zhang, Y., Han, K., & Liu, Z. (2018) · Human Brain Mapping · doi:10.1002/hbm.24006 · Cited by 41
Visual pathways from the perspective of cost functions and multi-task deep neural networks
Scholte, H. S., Losch, M., Ramakrishnan, K., de Haan, E. H. F., & Bohté, S. M. (2017) · Cortex · doi:10.1016/j.cortex.2017.09.019 · Cited by 30
Input Switched Affine Networks: An RNN Architecture Designed for InterpretabilityPreprint
Foerster, J., Gilmer, J., Chorowski, J., Sohl-Dickstein, J., & Sussillo, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09434 · Cited by 29
Totally Looks Like - How Humans Compare, Compared to Machines
Rosenfeld, A., Solbach, M. D., & Tsotsos, J. K. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00262 · Cited by 27
Diverse Feature Visualizations Reveal Invariances in Early Layers of Deep Neural Networks
Cadena, S. A., Weis, M. A., Gatys, L. A., Bethge, M., & Ecker, A. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_14 · Cited by 25
Do Neural Networks Show Gestalt Phenomena? An Exploration of the Law of Closure.
Kim, B., Reif, E., WATTENBERG, M. P., & Samy Bengio, A. (2019) · Cited by 25
One-Shot High-Fidelity Imitation: Training Large-Scale Deep Nets with RLPreprint
Paine, T. L., Colmenarejo, S. G., Wang, Z., Reed, S., Aytar, Y., Pfaff, T., Hoffman, M. W., Barth-Maron, G., Cabi, S., Budden, D., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05017 · Cited by 25
A Connectome Based Hexagonal Lattice Convolutional Network Model of the Drosophila Visual System
Tschopp, F. D., Reiser, M. B., & Turaga, S. C. (2018) · arXiv · doi:10.48550/arxiv.1806.04793 · Cited by 24
How well do deep neural networks trained on object recognition characterize the mouse visual system
Cadena, S. A., Sinz, F. H., Muhammad, T., Froudarakis, E., Cobos, E., Walker, E. Y., Reimer, J., Bethge, M., Tolias, A. S., & Ecker, A. S. (2019) · GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) · Cited by 23
Methods and measurements to compare men against machines
Wichmann, F. A., Janssen, D., Geirhos, R., Aguilar, G., Schütt, H. H., Maertens, M., & Bethge, M. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.14.hvei-113 · Cited by 22
Invariant recognition drives neural representations of action sequences
Tacchetti, A., Işık, L., & Poggio, T. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005859 · Cited by 21
Tripp, B. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966303 · Cited by 20
A Balanced Comparison of Object Invariances in Monkey IT Neurons
Murty, N. A. R., & Arun, S. P. (2017) · eNeuro · doi:10.1523/eneuro.0333-16.2017 · Cited by 16
Multiplicative mixing of object identity and image attributes in single inferior temporal neurons
Ratan Murty, N. A., & Arun, S. P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1714287115 · Cited by 15
Neural dynamics of real-world object vision that guide behaviourPreprint
Cichy, R. M., Kriegeskorte, N., Jozwik, K. M., van den Bosch, J. J. F., & Charest, I. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/147298 · Cited by 15
Spoerer, C. J., Kietzmann, T. C., & Kriegeskorte, N. (2019) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2019.1068-0 · Cited by 14
Surround Modulation: A Bio-inspired Connectivity Structure for Convolutional Neural Networks
Hasani, H., Soleymani, M., & Aghajan, H. K. (2019) · neural information processing systems · Cited by 14
Nonlinear processing of shape information in rat lateral extrastriate cortexPreprint
Matteucci, G., Marotti, R. B., Riggi, M., Rosselli, F. B., & Zoccolan, D. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/341792 · Cited by 13
How can deep learning advance computational modeling of sensory information processing?Preprint
Thompson, J. A. F., Bengio, Y., Formisano, E., & Schönwiesner, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08651 · Cited by 13
Dobs, K., Kell, A. J. E., Palmer, I., Cohen, M. A., & Kanwisher, N. (2019) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2019.1405-0 · Cited by 9
KerCNNs: biologically inspired lateral connections for classification of corrupted imagesPreprint
Montobbio, N., Bonnasse‐Gahot, L., Citti, G., & Sarti, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08336 · Cited by 9
Incorporating Feedback in Convolutional Neural Networks
Jarvers, C., & Heiko Neumann, B. (2019) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2019.1191-0 · Cited by 7
Totally Looks Like - How Humans Compare, Compared to Machines
Rosenfeld, A., Solbach, M. D., & Tsotsos, J. K. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20887-5_18 · Cited by 6
Task-specific vision models explain task-specific areas of visual cortexPreprint
Dwivedi, K., & Roig, G. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/402735 · Cited by 3
Research works printed but not linked: 10
- Geirhos, 2018, ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness, arXiv preprint arXiv:1811.12231 · arXiv
- Jacob, 2019, Do deep neural networks see the way we do?, bioRxiv, 860759
- Kubilius, 2019, Brain-like object recognition with high-performing shallow recurrent ANNs, arXiv preprint arXiv:1909.06161 · arXiv
- Lindsay, 2019, A simple circuit model of visual cortex explains neural and behavioral aspects of attention, bioRxiv, 875534
- Love, 2017, Deep networks as models of human and animal categorization, 1457
- Maheswaranathan, 2018, Deep learning models reveal internal structure and diverse computations in the retina under natural scenes, bioRxiv, 340943
- McIntosh, 2016, Deep learning models of the retinal response to natural scenes, 1361
- Sacramento, 2018, Dendritic cortical microcircuits approximate the backpropagation algorithm, 8735
- Thorat, 2019, The functional role of cue-driven feature-based feedback in object recognition, arXiv preprint arXiv:1903.10446 · arXiv
- Zhuang, 2019, Self-supervised neural network models of higher visual cortex development, 566, 10.32470/CCN.2019.1393-0 · doi:10.32470/ccn.2019.1393-0
Cited by
If deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397
Attention in Psychology, Neuroscience, and Machine Learning
Lindsay, G. W. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00029 · Cited by 309
Self-citationThe neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
Self-citationConsciousness in Artificial Intelligence: Insights from the Science of Consciousness
Butlin, P., Long, R., Elmoznino, E., Bengio, Y., Birch, J., Constant, A., Deane, G., Fleming, S. M., Frith, C., Ji, X., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.08708 · Cited by 196
Self-citationHiggins, I., Chang, L., Langston, V., Hassabis, D., Summerfield, C., Tsao, D., & Botvinick, M. (2021) · Nature Communications · doi:10.1038/s41467-021-26751-5 · Cited by 162
Metadata
- Authors
- Lindsay, G. W.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2021-09-01
- Volume
- 33
- Issue
- 10
- Pages
- 2017-2031
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W3004895274
- Cited by
- 557
- References
- 138
- FWCI
- 28.13
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.