The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision
Open accessAbstract
Convolutional neural network (CNN) driven by image recognition has been shown to be able to explain cortical responses to static pictures at ventral-stream areas. Here, we further showed that such CNN could reliably predict and decode functional magnetic resonance imaging data from humans watching natural movies, despite its lack of any mechanism to account for temporal dynamics or feedback processing. Using separate data, encoding and decoding models were developed and evaluated for describing the bi-directional relationships between the CNN and the brain. Through the encoding models, the CNN-predicted areas covered not only the ventral stream, but also the dorsal stream, albeit to a lesser degree; single-voxel response was visualized as the specific pixel pattern that drove the response, revealing the distinct representation of individual cortical location; cortical activation was synthesized from natural images with high-throughput to map category representation, contrast, and selectivity. Through the decoding models, fMRI signals were directly decoded to estimate the feature representations in both visual and semantic spaces, for direct visual reconstruction and semantic categorization, respectively. These results corroborate, generalize, and extend previous findings, and highlight the value of using deep learning, as an all-in-one model of the visual cortex, to understand and decode natural vision.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2014) · Cited by 33,419
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Neural Mechanisms of Selective Visual Attention
Desimone, R., & Duncan, J. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.001205 · Cited by 8,388 · cited 6×
“Therefore, in addition to bottom-up salience, there are other selection mechanisms, likely top-down attention (Desimone and Duncan 1995 ) that shape the fMRI responses during movie viewing.”
BackgroundInfluentialThe free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“Other plausible models are generative in nature (Dayan et al. 1995; Kingma and Welling 2013), in line with the free-energy theory — a likely principle of the brain (Friston and Kiebel 2009; Friston 2010).”
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 14×
“It offers intuitive insights into the distinct functions of different locations, for example, the complementary representations at FFA and PPA.”
BackgroundInfluentialSeparate visual pathways for perception and action
Goodale, M. A., & Milner, A. D. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90344-8 · Cited by 6,519
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
The minimal preprocessing pipelines for the Human Connectome Project
Glasser, M. F., Sotiropoulos, S. N., Wilson, J. A., Coalson, T. S., Fischl, B., Andersson, J. L., Xu, J., Jbabdi, S., Webster, M., Polimeni, J. R., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.127 · Cited by 5,253
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
A multi-modal parcellation of human cerebral cortex
Glasser, M. F., Coalson, T. S., Robinson, E. C., Hacker, C. D., Harwell, J., Yacoub, E., Ugurbil, K., Andersson, J., Beckmann, C. F., Jenkinson, M., et al. (2016) · Nature · doi:10.1038/nature18933 · Cited by 5,111
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733 · cited 4×
“This intriguing finding is likely attributable to the effects from both bottom-up salience (Itti and Koch 2001) and top-down attention (Desimone and Duncan 1995).”
BackgroundInfluentialCNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Daugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 2×
“…dynamic natural vision involves feedforward, recurrent, and feedback connections (Callaway 2004), the CNN only models feedforward processing and operates on instantaneous input, without any account for recurrent or feedback network interactions (Bastos et al. 2012; Polack and Contreras 2012).”
BackgroundBeyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Intersubject synchronization of cortical activity during natural vision
Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., & Malach, R. (2004) · Science · doi:10.1126/science.1089506 · Cited by 1,839 · cited 8×
“To address this question, we fi rst mapped the cortical activation with natural vision by evaluating the intra-subject reproducibility of fMRI activity when the subjects watched the training movie for the fi rst versus second time (Hasson et al. 2004; Lu et al. 2016).”
BackgroundMethodResultInfluentialDecoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829 · cited 4×
“These questions, concerning neural encoding and decoding (Naselaris et al. 2011), have been mostly addressed with static or arti fi cial stimuli (Kamitani and Tong 2005; Haynes and Rees 2006).”
BackgroundMethodInfluentialUnderstanding deep image representations by inverting them
Mahendran, A., & Vedaldi, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299155 · Cited by 1,827
Decoding mental states from brain activity in humans
Haynes, J.-D., & Rees, G. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1931 · Cited by 1,817
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Predictive coding under the free-energy principle
Friston, K., & Kiebel, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0300 · Cited by 1,579
Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2599174 · Cited by 1,547
Natural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504 · cited 4×
“Since deep-learning models are already available for speech recognitions (Hinton et al. 2012) and language processing (Collobert and Weston 2008), decoding of brain measures in response to natural hearing, speech, and language are realistically attainable goals (Huth et al. 2016a).”
BackgroundMethodResultInfluentialMatching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey
Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K., & Bandettini, P. A. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.043 · Cited by 1,344
Identifying natural images from human brain activity
Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,286
Visual field maps in human cortex.
Wandell, B. A., Dumoulin, S. O., & Brewer, A. A. (2007) · Neuron · doi:10.1016/j.neuron.2007.10.012 · Cited by 1,231 · cited 3×
“The human visual cortex may use a deeper hierarchy, than the 8-layer CNN in this study, spanning >20 visual areas (Wandell et al. 2007), and thus it may be better explained by deeper CNNs (Simonyan and Ziserman”
MethodResultDayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Object Detectors Emerge in Deep Scene CNNs
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2014) · arXiv · doi:10.48550/arxiv.1412.6856 · Cited by 971
Johnson, M. H. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1766 · Cited by 969
Long-term Recurrent Convolutional Networks for Visual Recognition and Description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Saenko, K., & Darrell, T. (2014) · doi:10.21236/ada623249 · Cited by 968
Guclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies
Nishimoto, S., Vu, A. T., Naselaris, T., Benjamini, Y., Yu, B., & Gallant, J. L. (2011) · Current Biology · doi:10.1016/j.cub.2011.08.031 · Cited by 933
A feedforward architecture accounts for rapid categorization
Serre, T., Oliva, A., & Poggio, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700622104 · Cited by 918
Naselaris, T., Kay, K. N., Nishimoto, S., & Gallant, J. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.073 · Cited by 905
Huth, A. G., Nishimoto, S., Vu, A. T., & Gallant, J. L. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.014 · Cited by 896
Cichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A. (2016) · Scientific Reports · doi:10.1038/srep27755 · Cited by 716
Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M.-A., Morito, Y., Tanabe, H. C., Sadato, N., & Kamitani, Y. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.004 · Cited by 543 · cited 9×
“Miyawaki et al. previously used a similar computational strategy for direct reconstruction of simple pixel patterns, for example, letters and shapes, with binary-valued local image bases ( Miyawaki et al. 2008).”
BackgroundMethodInfluentialObject Detectors Emerge in Deep Scene CNNsPreprint
Zhou, B., Khosla, A., Lapedriza, À., Oliva, A., & Torralba, A. B. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 523
Generic decoding of seen and imagined objects using hierarchical visual features
Horikawa, T., & Kamitani, Y. (2017) · Nature Communications · doi:10.1038/ncomms15037 · Cited by 516
Bayesian Reconstruction of Natural Images from Human Brain Activity
Naselaris, T., Prenger, R. J., Kay, K. N., Oliver, M., & Gallant, J. L. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.006 · Cited by 511
Neural decoding of visual imagery during sleep
Horikawa, T., Tamaki, M., Miyawaki, Y., & Kamitani, Y. (2013) · Science · doi:10.1126/science.1234330 · Cited by 498
Neural Systems Shared by Visual Imagery and Visual Perception: A Positron Emission Tomography Study
Kosslyn, S. M., Thompson, W. L., & Alpert, N. M. (1997) · NeuroImage · doi:10.1006/nimg.1997.0295 · Cited by 386
Natural Image Statistics: A Probabilistic Approach to Early Computational Vision.
Hyvrinen, A., Hurri, J., & Hoyer, P. O. (2009) · Medical Entomology and Zoology · Cited by 374
Inverse retinotopy: Inferring the visual content of images from brain activation patterns
Thirion, B., Duchesnay, E., Hubbard, E., Dubois, J., Poline, J.-B., Lebihan, D., & Dehaene, S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.06.062 · Cited by 363
Seeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338 · cited 20×
“…were previously explored with low-level visual features (Kay et al. 2008; Nishimoto et al. 2011) or high-level semantic features (Huth et al. 2012, 2016a), and more recently with hierarchical features extracted by the CNN from static pictures (Güçlü and van Gerven 2015a; Eickenberg et al. 2016).”
BackgroundMethodResultInfluentialCOMPLETE FUNCTIONAL CHARACTERIZATION OF SENSORY NEURONS BY SYSTEM IDENTIFICATION
Wu, M. C.-K., David, S. V., & Gallant, J. L. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113024 · Cited by 338
Do we have independent visual streams for perception and action?
Schenk, T., & McIntosh, R. D. (2010) · Cognitive Neuroscience · doi:10.1080/17588920903388950 · Cited by 315
Deep Neural Networks as a Computational Model for Human Shape Sensitivity
Kubilius, J., Bracci, S., & Op de Beeck, H. P. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004896 · Cited by 295
‘What’ Is Happening in the Dorsal Visual Pathway
Freud, E., Plaut, D. C., & Behrmann, M. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.08.003 · Cited by 286
Separate Visual Pathways for Perception and Action
Goodale, M. A., & Milner, A. D. (2003) · Essential Sources in the Scientific Study of Consciousness · doi:10.7551/mitpress/2834.003.0016 · Cited by 276
Patterns of Activity in the Categorical Representations of Objects
Carlson, T. A., Schrater, P., & He, S. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903322307429 · Cited by 273
Rossion, B., Hanseeuw, B., & Dricot, L. (2012) · Brain and Cognition · doi:10.1016/j.bandc.2012.01.001 · Cited by 269
Two neural pathways of face processing: A critical evaluation of current models
Bernstein, M., & Yovel, G. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.06.010 · Cited by 218
Feedforward, feedback and inhibitory connections in primate visual cortex
Callaway, E. M. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.04.004 · Cited by 165
Decoding the Semantic Content of Natural Movies from Human Brain Activity
Huth, A. G., Lee, T., Nishimoto, S., Bilenko, N. Y., Vu, A. T., & Gallant, J. L. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00081 · Cited by 163
On the usefulness of ‘what’ and ‘where’ pathways in vision
de Haan, E. H. F., & Cowey, A. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.08.005 · Cited by 159
Güçlü, U., & van Gerven, M. A. J. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.12.036 · Cited by 148
Correspondences between retinotopic areas and myelin maps in human visual cortex
Abdollahi, R. O., Kolster, H., Glasser, M. F., Robinson, E. C., Coalson, T. S., Dierker, D., Jenkinson, M., Van Essen, D. C., & Orban, G. A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.042 · Cited by 126
Using human brain activity to guide machine learning
Fong, R., Scheirer, W. J., & Cox, D. (2018) · Scientific Reports · doi:10.1038/s41598-018-23618-6 · Cited by 124
Functional MRI mapping of dynamic visual features during natural viewing in the macaque
Russ, B. E., & Leopold, D. A. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.01.012 · Cited by 107
Khaligh‐Razavi, S., Henriksson, L., Kay, K., & Kriegeskorte, N. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.10.007 · Cited by 84
Cortical representation of animate and inanimate objects in complex natural scenes
Naselaris, T., Stansbury, D. E., & Gallant, J. L. (2012) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2012.02.001 · Cited by 77
Long-Range Parallel Processing and Local Recurrent Activity in the Visual Cortex of the Mouse
Polack, P., & Contreras, D. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.6304-11.2012 · Cited by 73
Mur, M., Ruff, D. A., Bodurka, J., Weerd, P. D., Bandettini, P. A., & Kriegeskorte, N. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.2334-11.2012 · Cited by 58
Visual Interpretation of Kernel‐Based Prediction Models
Hansen, K., Baehrens, D., Schroeter, T. S., Rupp, M., & Müller, K. (2011) · Molecular Informatics · doi:10.1002/minf.201100059 · Cited by 55
How to Explain Individual Classification Decisions
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859912 · Cited by 54 · cited 3×
“This optimization included 2 steps, combining the visualization methods based on masking (Zhou et al. 2014; Li 2016) and gradient (Baehrens et al. 2010; Hansen et al. 2011; Simonyan et al. 2013; Springenberg et al. 2014).”
BackgroundMethodCichy, R. M., Khosla, A., Pantazis, D., Torralba, A. B., & Oliva, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.02970 · Cited by 50
Lu, K., Hung, S.-C., Wen, H., Lynch, L. K., & Liu, Z. (2016) · PLoS ONE · doi:10.1371/journal.pone.0161797 · Cited by 46
Self-citationFeedforward and feedback processes in vision
Kafalıgönül, H., Breitmeyer, B. G., & Öğmen, H. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00279 · Cited by 44
Adolf, D., Weston, S., Baecke, S., Luchtmann, M., Bernarding, J., & Kropf, S. (2014) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2014.00072 · Cited by 24
Hsieh, P., & Tse, P. U. (2010) · Human Brain Mapping · doi:10.1002/hbm.20946 · Cited by 21
Visual attention with deep neural networks
Canziani, A., & Culurciello, E. (2015) · Conference on Information Sciences and Systems · doi:10.1109/ciss.2015.7086900 · Cited by 4
Visualization of Deep Convolutional Neural Networks
Li, D. (2015) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7bk19nt · Cited by 1
Cited by
Neural network models and deep learning
Kriegeskorte, N., & Golan, T. (2019) · Current Biology · doi:10.1016/j.cub.2019.02.034 · Cited by 543
Rajalingham, R., Issa, E. B., Bashivan, P., Kar, K., Schmidt, K., & DiCarlo, J. J. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0388-18.2018 · Cited by 358
Deep image reconstruction from human brain activity
Shen, G., Horikawa, T., Majima, K., & Kamitani, Y. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006633 · Cited by 315
High-resolution image reconstruction with latent diffusion models from human brain activity
Takagi, Y., & Nishimoto, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01389 · Cited by 297
The neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
Metadata
- Authors
- Wen, H., Shi, J., Zhang, Y., Lu, K.-H., Cao, J., & Liu, Z.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-10-20
- Volume
- 28
- Issue
- 12
- Pages
- 4136-4160
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2507706845
- Cited by
- 303
- References
- 93
- FWCI
- 14.60
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.