Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence
Open accessThe DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
The complex multi-stage architecture of cortical visual pathways provides the neural basis for efficient visual object recognition in humans. However, the stage-wise computations therein remain poorly understood. Here, we compared temporal (magnetoencephalography) and spatial (functional MRI) visual brain representations with representations in an artificial deep neural network (DNN) tuned to the statistics of real-world visual recognition. We showed that the DNN captured the stages of human visual processing in both time and space from early visual areas towards the dorsal and ventral streams. Further investigation of crucial DNN parameters revealed that while model architecture was important, training on real-world categorization was necessary to enforce spatio-temporal hierarchical relationships with the brain. Together our results provide an algorithmically informed view on the spatio-temporal dynamics of visual object recognition in the human visual brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Using this approach, known as neuroconnectionism, numerous studies have identified shared representational structure across brains and ANN models, as well as factors influencing this alignment [5–11]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationLearning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
Research works printed but not linked: 1
- Ungerleider, L. G. & Mishkin, M. In Analysis of Visual Behavior 549–586 (MIT Press, 1982).
Cited by
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027
Magnetoencephalography for Brain Electrophysiology and Imaging
Baillet, S. (2017) · Nature Neuroscience · doi:10.1038/nn.4504 · Cited by 992
Training Spiking Neural Networks Using Lessons From Deep Learning
Eshraghian, J. K., Ward, M., Neftci, E. O., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D. S., & Lu, W. D. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3308088 · Cited by 782
STDP-based spiking deep convolutional neural networks for object recognition
Kheradpisheh, S. R., Ganjtabesh, M., Thorpe, S. J., & Masquelier, T. (2018) · Neural Networks · doi:10.1016/j.neunet.2017.12.005 · Cited by 768
Neural network models and deep learning
Kriegeskorte, N., & Golan, T. (2019) · Current Biology · doi:10.1016/j.cub.2019.02.034 · Cited by 543
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535
Kell, A. J. E., Yamins, D. L. K., Shook, E. N., Norman-Haignere, S. V., & McDermott, J. H. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.044 · Cited by 544
The neural architecture of language: Integrative modeling converges on predictive processing
Schrimpf, M., Blank, I. A., Tuckute, G., Kauf, C., Hosseini, E. A., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105646118 · Cited by 517
Brain-Score: Which Artificial Neural Network for Object Recognition is most Brain-Like?
Schrimpf, M., Kubilius, J., Hong, H., Majaj, N. J., Rajalingham, R., Issa, E. B., Kar, K., Bashivan, P., Prescott-Roy, J., Geiger, F., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/407007 · Cited by 458
Deep Neural Networks as Scientific Models
Cichy, R. M., & Kaiser, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.009 · Cited by 454
Self-citationNeural population control via deep image synthesis
Bashivan, P., Kar, K., & DiCarlo, J. J. (2019) · Science · doi:10.1126/science.aav9436 · Cited by 434
Deep learning-based landslide susceptibility mapping
Azarafza, M., Azarafza, M., Akgün, H., Atkinson, P. M., & Derakhshani, R. (2021) · Scientific Reports · doi:10.1038/s41598-021-03585-1 · Cited by 412
If deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397
Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.002 · Cited by 394
Rajalingham, R., Issa, E. B., Bashivan, P., Kar, K., Schmidt, K., & DiCarlo, J. J. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0388-18.2018 · Cited by 358
Deep convolutional models improve predictions of macaque V1 responses to natural images
Cadena, S. A., Denfield, G. H., Walker, E. Y., Gatys, L. A., Tolias, A. S., Bethge, M., & Ecker, A. S. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006897 · Cited by 347
Deep convolutional networks do not classify based on global object shape
Baker, N., Lu, H., Erlikhman, G., & Kellman, P. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006613 · Cited by 345
Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision
Wen, H., Shi, J., Zhang, Y., Lu, K.-H., Cao, J., & Liu, Z. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhx268 · Cited by 303
A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers
Zhang, X., Yao, L., Wang, X., Monaghan, J., McAlpine, D., & Zhang, Y. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abc902 · Cited by 296
THINGS: A database of 1,854 object concepts and more than 26,000 naturalistic object images
Hebart, M. N., Dickter, A. H., Kidder, A., Kwok, W. Y., Corriveau, A., Van Wicklin, C., & Baker, C. I. (2019) · PLOS ONE · doi:10.1371/journal.pone.0223792 · Cited by 281
Deep Learning: The Good, the Bad, and the Ugly
Serre, T. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014951 · Cited by 267
Integrative benchmarking to advance neurally mechanistic models of human intelligence
Schrimpf, M., Kubilius, J., Lee, M. J., Ratan Murty, N. A., Ajemian, R., & DiCarlo, J. J. (2020) · Neuron · doi:10.1016/j.neuron.2020.07.040 · Cited by 233
Overview: Computer Vision and Machine Learning for Microstructural Characterization and Analysis
Holm, E. A., Cohn, R., Gao, N., Kitahara, A. R., Matson, T. P., Lei, B., & Yarasi, S. R. (2020) · Metallurgical and Materials Transactions A · doi:10.1007/s11661-020-06008-4 · Cited by 249
Survey on Deep Neural Networks in Speech and Vision Systems
Alam, M., Samad, M. D., Vidyaratne, L., Glandon, A., & Iftekharuddin, K. M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.053 · Cited by 252
The neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
How face perception unfolds over time
Dobs, K., Isik, L., Pantazis, D., & Kanwisher, N. (2019) · Nature Communications · doi:10.1038/s41467-019-09239-1 · Cited by 231
Self-citationComputational approaches to fMRI analysis
Cohen, J. D., Daw, N., Engelhardt, B., Hasson, U., Li, K., Niv, Y., Norman, K. A., Pillow, J., Ramadge, P. J., Turk-Browne, N. B., et al. (2017) · Nature Neuroscience · doi:10.1038/nn.4499 · Cited by 226
Recurrent Convolutional Neural Networks: A Better Model of Biological Object Recognition
Spoerer, C. J., McClure, P., & Kriegeskorte, N. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01551 · Cited by 211
Deep problems with neural network models of human vision
Bowers, J. S., Malhotra, G., Dujmović, M., Llera Montero, M., Tsvetkov, C., Biscione, V., Puebla, G., Adolfi, F., Hummel, J. E., Heaton, R. F., et al. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002813 · Cited by 204
Overview: Computer Vision and Machine Learning for Microstructural Characterization and Analysis
Holm, E. A., Cohn, R., Gao, N., Kitahara, A. R., Matson, T. P., Lei, B., & Yarasi, S. R. (2020) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 196
Han, K., Wen, H., Shi, J., Lu, K.-H., Zhang, Y., Fu, D., & Liu, Z. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.05.039 · Cited by 186
Multivariate pattern analysis for MEG: A comparison of dissimilarity measures
Guggenmos, M., Sterzer, P., & Cichy, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.02.044 · Cited by 182
Self-citationDecoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features
Palazzo, S., Spampinato, C., Kavasidis, I., Giordano, D., Schmidt, J., & Shah, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2995909 · Cited by 175
Spatio-Temporal Saliency Networks for Dynamic Saliency Prediction
Bak, C., Kocak, A., Erdem, E., & Erdem, A. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2777665 · Cited by 176
Biological constraints on neural network models of cognitive function
Pulvermüller, F., Tomasello, R., Henningsen-Schomers, M. R., & Wennekers, T. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-021-00473-5 · Cited by 173
Yadav, S. P., Zaidi, S., Mishra, A., & Yadav, V. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09647-x · Cited by 169
Groen, I. I., Greene, M. R., Baldassano, C., Fei-Fei, L., Beck, D. M., & Baker, C. I. (2018) · eLife · doi:10.7554/elife.32962 · Cited by 169
End-to-End Deep Image Reconstruction From Human Brain Activity
Shen, G., Dwivedi, K., Majima, K., Horikawa, T., & Kamitani, Y. (2019) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2019.00021 · Cited by 163
BOLD5000, a public fMRI dataset while viewing 5000 visual images
Chang, N., Pyles, J. A., Marcus, A., Gupta, A., Tarr, M. J., & Aminoff, E. M. (2019) · Scientific Data · doi:10.1038/s41597-019-0052-3 · Cited by 159
Conwell, C., Prince, J. S., Kay, K. N., Alvarez, G. A., & Konkle, T. (2022) · doi:10.1101/2022.03.28.485868 · Cited by 160
Xu, Y., & Vaziri-Pashkam, M. (2021) · Nature Communications · doi:10.1038/s41467-021-22244-7 · Cited by 184
Performance vs. competence in human–machine comparisons
Firestone, C. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905334117 · Cited by 150
The Rhetoric and Reality of Anthropomorphism in Artificial Intelligence
Watson, D. (2019) · Minds and Machines · doi:10.1007/s11023-019-09506-6 · Cited by 148
A Guide to Representational Similarity Analysis for Social Neuroscience
Popal, H. S., Wang, Y., & Olson, I. R. (2019) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsz099 · Cited by 179
Cichy, R. M., & Pantazis, D. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.023 · Cited by 180
Self-citationMaking Sense of Real-World Scenes
Malcolm, G. L., Groen, I. I. A., & Baker, C. I. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.09.003 · Cited by 179
A large and rich EEG dataset for modeling human visual object recognition
Gifford, A. T., Dwivedi, K., Roig, G., & Cichy, R. M. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119754 · Cited by 275
Self-citationVisual Imagery and Perception Share Neural Representations in the Alpha Frequency Band
Xie, S., Kaiser, D., & Cichy, R. M. (2020) · Current Biology · doi:10.1016/j.cub.2020.04.074 · Cited by 139
Self-citationThe Scene Perception & Event Comprehension Theory (SPECT) Applied to Visual Narratives
Loschky, L. C., Larson, A. M., Smith, T. J., & Magliano, J. P. (2019) · Topics in Cognitive Science · doi:10.1111/tops.12455 · Cited by 215
The Origins and Prevalence of Texture Bias in Convolutional Neural NetworksPreprint
Hermann, K. L., Chen, T., & Kornblith, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09071 · Cited by 349
Using transfer learning to detect galaxy mergers
Ackermann, S., Schawinski, K., Zhang, C., Weigel, A. K., & Turp, M. D. (2018) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sty1398 · Cited by 137
Contini, E. W., Wardle, S. G., & Carlson, T. A. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.02.013 · Cited by 152
Jozwik, K. M., Kriegeskorte, N., Storrs, K. R., & Mur, M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01726 · Cited by 161
A self-supervised domain-general learning framework for human ventral stream representation
Konkle, T., & Alvarez, G. A. (2022) · Nature Communications · doi:10.1038/s41467-022-28091-4 · Cited by 186
Akbar, S., Hayat, M., Tahir, M., Khan, S. A., & Alarfaj, F. K. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102349 · Cited by 133
The neural architecture of language: Integrative modeling converges on predictive processing
(2020) · doi:10.1101/2020.06.26.174482 · Cited by 129
Task-Driven Convolutional Recurrent Models of the Visual SystemPreprint
Nayebi, A., Bear, D. M., Kubilius, J., Kar, K., Ganguli, S., Sussillo, D., DiCarlo, J. J., & Yamins, D. L. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00053 · Cited by 144
Category selectivity in human visual cortex: Beyond visual object recognition
Peelen, M. V., & Downing, P. E. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.03.033 · Cited by 145
Seeliger, K., Fritsche, M., Güçlü, U., Schoenmakers, S., Schoffelen, J., Bosch, S., & van Gerven, M. A. J. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.018 · Cited by 149
Mandal, P. K., Banerjee, A., Tripathi, M., & Sharma, A. (2018) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2018.00060 · Cited by 140
Grossman, S., Gaziv, G., Yeagle, E. M., Harel, M., Mégevand, P., Groppe, D. M., Khuvis, S., Herrero, J. L., Irani, M., Mehta, A. D., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-12623-6 · Cited by 131
Jacob, G., Pramod, R. T., Katti, H., & Arun, S. P. (2021) · Nature Communications · doi:10.1038/s41467-021-22078-3 · Cited by 126
Beyond core object recognition: Recurrent processes account for object recognition under occlusion
Rajaei, K., Mohsenzadeh, Y., Ebrahimpour, R., & Khaligh‐Razavi, S. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007001 · Cited by 138
Dual-Stream Interactive Networks for No-Reference Stereoscopic Image Quality Assessment
Zhou, W., Chen, Z., & Li, W. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2902831 · Cited by 117
Raza, A., Uddin, J., Almuhaimeed, A., Akbar, S., Zou, Q., & Ahmad, A. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01563 · Cited by 119
Computational models of category-selective brain regions enable high-throughput tests of selectivity
Murty, N. A. R., Bashivan, P., Abate, A., DiCarlo, J. J., & Kanwisher, N. (2021) · Nature Communications · doi:10.1038/s41467-021-25409-6 · Cited by 146
Fleming, R. W. (2017) · Annual Review of Vision Science · doi:10.1146/annurev-vision-102016-061429 · Cited by 117
Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction
Watanabe, E., Kitaoka, A., Sakamoto, K., Yasugi, M., & Tanaka, K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00345 · Cited by 101
Devereux, B. J., Clarke, A., & TYLER, L. K. (2018) · Scientific Reports · doi:10.1038/s41598-018-28865-1 · Cited by 112
Controversial stimuli: Pitting neural networks against each other as models of human cognition
Golan, T., Raju, P. C., & Kriegeskorte, N. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912334117 · Cited by 146
Kuzovkin, I., Vicente, R., Petton, M., Lachaux, J.-P., Baciu, M., Kahane, P., Rheims, S., Vidal, J. R., & Aru, J. (2018) · Communications Biology · doi:10.1038/s42003-018-0110-y · Cited by 104
Bangla Handwritten Character Recognition using Convolutional Neural Network with Data Augmentation
Chowdhury, R. R., Hossain, M. S., Islam, R. U., Andersson, K., & Hossain, S. (2019) · International Conference on Informatics, Electronics & Vision (ICIEV) · doi:10.1109/iciev.2019.8858545 · Cited by 113
Feature-space selection with banded ridge regression
la Tour, T. D., Eickenberg, M., Núñez-Elizalde, A. O., & Gallant, J. L. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119728 · Cited by 164
Ahmad, A., Akbar, S., Khan, S. A., Hayat, M., Ali, F., Ahmed, A., & Tahir, M. (2020) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2020.104214 · Cited by 105
Turay, T., & Vladimirova, T. (2022) · IEEE Access · doi:10.1109/access.2022.3147495 · Cited by 131
Mohsenzadeh, Y., Qin, S., Cichy, R. M., & Pantazis, D. (2018) · eLife · doi:10.7554/elife.36329 · Cited by 113
Self-citationRepresentation Similarity Analysis for Efficient Task Taxonomy & Transfer Learning
Dwivedi, K., & Roig, G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01267 · Cited by 179
Using human brain activity to guide machine learning
Fong, R., Scheirer, W. J., & Cox, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-23618-6 · Cited by 124
Deep neural network models of sensory systems: windows onto the role of task constraints
Kell, A. J. E., & McDermott, J. H. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.02.003 · Cited by 119
Conwell, C., Prince, J. S., Kay, K. N., Alvarez, G. A., & Konkle, T. (2024) · Nature Communications · doi:10.1038/s41467-024-53147-y · Cited by 100
Deep Nets: What have They Ever Done for Vision?
Yuille, A. L., & Liu, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01405-z · Cited by 98
Reconstructing Perceived Images From Human Brain Activities With Bayesian Deep Multiview Learning
Du, C., Du, C., Huang, L., & He, H. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2882456 · Cited by 101
Norman-Haignere, S., & McDermott, J. H. (2018) · PLoS Biology · doi:10.1371/journal.pbio.2005127 · Cited by 109
Deep Neural Networks for Modeling Visual Perceptual Learning
Wenliang, L. K., & Seitz, A. R. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.1620-17.2018 · Cited by 83
Computational mechanisms underlying cortical responses to the affordance properties of visual scenes
Bonner, M. F., & Epstein, R. A. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006111 · Cited by 94
Francl, A. F., & McDermott, J. H. (2022) · Nature Human Behaviour · doi:10.1038/s41562-021-01244-z · Cited by 132
The spatiotemporal neural dynamics underlying perceived similarity for real-world objects
Cichy, R. M., Kriegeskorte, N., Jozwik, K. M., van den Bosch, J. J. F., & Charest, I. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.03.031 · Cited by 106
Self-citationPrinciples for models of neural information processing
Kay, K., & Weiner, K. S. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.016 · Cited by 101
Brain hierarchy score: Which deep neural networks are hierarchically brain-like?
Nonaka, S., Majima, K., Aoki, S., & Kamitani, Y. (2021) · iScience · doi:10.1016/j.isci.2021.103013 · Cited by 95
Stimulus- and goal-oriented frameworks for understanding natural vision
Turner, M. H., Giraldo, L. G. S., Schwartz, O., & Rieke, F. M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0284-0 · Cited by 97
Baker, N., Lu, H., Erlikhman, G., & Kellman, P. J. (2020) · Vision Research · doi:10.1016/j.visres.2020.04.003 · Cited by 95
Does the brain's ventral visual pathway compute object shape?
Ayzenberg, V., & Behrmann, M. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.09.019 · Cited by 110
(2021) · doi:10.1162/jocn_a_01755 · Cited by 85
Humans can decipher adversarial images
Zhou, Z., & Firestone, C. (2019) · RePEc: Research Papers in Economics · Cited by 87
Perception science in the age of deep neural networks.
VanRullen, R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00142 · Cited by 82
Bankson, B., Hebart, M. N., Groen, I. I. A., & Baker, C. I. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.05.037 · Cited by 98
How deep is the brain? The shallow brain hypothesis
Suzuki, M., Pennartz, C. M. A., & Aru, J. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00756-z · Cited by 79
Reconstructing Natural Scenes from fMRI Patterns using BigBiGAN
Mozafari, M., Reddy, L., & VanRullen, R. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206960 · Cited by 82
Александрович, М. В., Евгеньевна, Р. А., Zhuravlev, M. О., Makarov, V. V., Nedaivozov, V. O., Grubov, V., Pchelintceva, S. V., Hramov, A. E., & Pisarchik, A. N. (2017) · PLoS ONE · doi:10.1371/journal.pone.0188700 · Cited by 79
Embracing New Techniques in Deep Learning for Estimating Image Memorability
Needell, C. D., & Bainbridge, W. A. (2022) · Computational Brain & Behavior · doi:10.1007/s42113-022-00126-5 · Cited by 96
Metadata
- Authors
- Cichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- McGovern Institute for Brain Research (US)
- Corresponding author
- Cichy, Radoslaw Martin
- Venue
- Scientific Reports
- Published
- 2016-06-10
- Volume
- 6
- Issue
- 1
- Pages
- 27755-27755
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC4901271
- OpenAlex
- W2412480261
- Cited by
- 716
- References
- 57
- Citations by year
- 2026: 34 · 2025: 77 · 2024: 90 · 2023: 84 · 2022: 81 · 2021: 77 · 2020: 81 · 2019: 75 · 2018: 65 · 2017: 46 · 2016: 5
- FWCI
- 40.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- Refubium (Universitätsbibliothek der Freien Universität Berlin) (submittedVersion, cc-by)
- Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver (cc-by)
- Funders
- National Science Foundation (1532591)
- Alexander von Humboldt-Stiftung
- Massachusetts Institute of Technology
- Deutsche Forschungsgemeinschaft (CI241/1‐1)
- McGovern Institute for Brain Research, Massachusetts Institute of Technology
- National Eye Institute (R01EY020484)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- visual object recognition, deep neural network, spatiotemporal dynamics, dorsal stream, ventral stream, hierarchical visual processing, magnetoencephalography, functional MRI
- MeSH terms
- Adult, Brain, Brain Mapping, Female, Humans, Magnetic Resonance Imaging, Male, Task Performance and Analysis, Time Factors, Visual Cortex, Visual Pathways, Visual Perception, Magnetoencephalography, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.