Eight open questions in the computational modeling of higher sensory cortex
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Propelled by advances in biologically inspired computer vision and artificial intelligence, the past five years have seen significant progress in using deep neural networks to model response patterns of neurons in visual cortex. In this paper, we briefly review this progress and then discuss eight key 'open questions' that we believe will drive research in computational models of sensory systems over the next five years, both in visual cortex and beyond.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
A Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Self-citationHow does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
Self-citationDeep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Categorical Representation of Visual Stimuli in the Primate Prefrontal Cortex
Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2001) · Science · doi:10.1126/science.291.5502.312 · Cited by 1,123
Signal timing across the macaque visual system
Schmolesky, M. T., Wang, Y., Hanes, D. P., Thompson, K. G., Leutgeb, S., Schall, J. D., & Leventhal, A. G. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.6.3272 · Cited by 1,032
Guclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
Spatial summation in the receptive fields of simple cells in the cat's striate cortex.
Movshon, J. A., Thompson, I. D., & Tolhurst, D. J. (1978) · The Journal of Physiology · doi:10.1113/jphysiol.1978.sp012488 · Cited by 890 · cited 1×
“Early visual areas, such as V1 cortex, capture low-level features such as edges and center-surround patterns [6 ,7].”
BackgroundFast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
Self-citationCadieu, C. F., Hong, H., Yamins, D. L. K., Pinto, N., Ardila, D., Solomon, E. A., Majaj, N. J., & DiCarlo, J. J. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003963 · Cited by 824 · cited 1×
“Intriguingly, even though these networks are not directly optimized to fit neural data, their top hidden layers are nonetheless highly predictive of single-site neural responses as well population-level representations in IT cortex both in electrophysiological [23 ,28], and fMRI data [29 ,30].”
BackgroundSelf-citationFreiwald, W. A., & Tsao, D. Y. (2010) · Science · doi:10.1126/science.1194908 · Cited by 678
Metamers of the ventral stream
Freeman, J., & Simoncelli, E. P. (2011) · Nature Neuroscience · doi:10.1038/nn.2889 · Cited by 667
The topography of high-order human object areas
Malach, R., Levy, I., & Hasson, U. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(02)01870-3 · Cited by 459
Microstimulation of inferotemporal cortex influences face categorization
Afraz, S.-R., Kiani, R., & Esteky, H. (2006) · Nature · doi:10.1038/nature04982 · Cited by 363 · cited 1×
“Over the next 2–5 years, it should be possible to combine computational models with cutting-edge optical techniques in non-human primates [45,46] to help design highly targeted real-time neural perturbation studies.”
Background
Cited by
Kar, K., Kubilius, J., Schmidt, K., Issa, E. B., & DiCarlo, J. J. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0392-5 · Cited by 496
Self-citationThe Organization and Operation of Inferior Temporal Cortex
Conway, B. R. (2018) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091517-034202 · Cited by 255
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119
Metadata
- Authors
- Yamins, D. L., & DiCarlo, J. J.
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2016-04
- Volume
- 37
- Pages
- 114-120
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W2294365934
- Cited by
- 43
- References
- 15
- FWCI
- 0.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.