Principles for models of neural information processing
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
The goal of cognitive neuroscience is to understand how mental operations are performed by the brain. Given the complexity of the brain, this is a challenging endeavor that requires the development of formal models. Here, we provide a perspective on models of neural information processing in cognitive neuroscience. We define what these models are, explain why they are useful, and specify criteria for evaluating models. We also highlight the difference between functional and mechanistic models, and call attention to the value that neuroanatomy has for understanding brain function. Based on the principles we propose, we proceed to evaluate the merit of recently touted deep neural network models. We contend that these models are promising, but substantial work is necessary to (i) clarify what type of explanation these models provide, (ii) determine what specific effects they accurately explain, and (iii) improve our understanding of how they work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Ultrastructural Characterization of the Lower Motor System in a Mouse Model of Krabbe Disease
Cappello, V., Marchetti, L., Parlanti, P., Landi, S., Tonazzini, I., Cecchini, M., Piazza, V., & Gemmi, M. (2016) · Scientific Reports · doi:10.1038/s41598-016-0001-8 · Cited by 13,097
The organization of the human cerebral cortex estimated by intrinsic functional connectivity
Thomas Yeo, B. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., Roffman, J. L., Smoller, J. W., Zöllei, L., Polimeni, J. R., et al. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00338.2011 · Cited by 9,182
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759 · cited 1×
“These networks, inspired by properties of biological visual systems (Fukushima, 1980; Serre et al., 2007), consist of multiple layers of processing, where each layer is composed of units that perform relatively simple linear and nonlinear operations on the outputs of previous layers.”
BackgroundA multi-modal parcellation of human cerebral cortex
Glasser, M. F., Coalson, T. S., Robinson, E. C., Hacker, C. D., Harwell, J., Yacoub, E., Ugurbil, K., Andersson, J., Beckmann, C. F., Jenkinson, M., et al. (2016) · Nature · doi:10.1038/nature18933 · Cited by 5,111
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906
Neural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex
Luck, S. J., Chelazzi, L., Hillyard, S. A., & Desimone, R. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.1.24 · Cited by 1,615
Natural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504 · cited 1×
“An increasing number of researchers are developing quantitative models of where distinct regions and networks are located within the brain (Haxby et al., 2011; Huth et al., 2016; Nelson et al., 2010; Yeo et al., 2011).”
BackgroundGeneration and evaluation of a cortical area parcellation from resting-state correlations
Gordon, E. M., Laumann, T. O., Adeyemo, B., Huckins, J. F., Kelley, W. M., & Petersen, S. E. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhu239 · Cited by 1,463 · cited 1×
“…accurately identified the relevant brain regions in a given observer, which can be a challenging endeavor (Benson et al., 2012; Frost and Goebel, 2012; Glasser et al., 2016; Gordon et al., 2016; Sabuncu et al., 2010; D. Wang et al., 2015; L. Wang et al., 2014; Weiner and Grill-Spector, 2012).”
BackgroundDecoding reveals the contents of visual working memory in early visual areas
Harrison, S. A., & Tong, F. (2009) · Nature · doi:10.1038/nature07832 · Cited by 1,347
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Regulation of clock and NPAS2 DNA binding by the redox state of NAD cofactors
Rutter, J., Reick, M., Wu, L. C., & McKnight, S. L. (2001) · Science · doi:10.1126/science.1060698 · Cited by 1,059
Guclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
Cortical microstimulation influences perceptual judgements of motion direction
Salzman, C. D., Britten, K. H., & Newsome, W. T. (1990) · Nature · doi:10.1038/346174a0 · Cited by 881 · cited 1×
“…made in specific brain areas (Gallant et al., 2000), surgical removal of entire brain areas (Weiner et al., 2016b), the effects of enhancement (Salzman et al., 1990) or disruption (Pascual-Leone and Walsh, 2001) of neural activity, or the effects of psychoactive drugs (Rokem and Silver,…”
BackgroundCadieu, C. F., Hong, H., Yamins, D. L. K., Pinto, N., Ardila, D., Solomon, E. A., Majaj, N. J., & DiCarlo, J. J. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003963 · Cited by 824 · cited 1×
“…units in deep neural networks correlate strongly with experimentally measured responses in the primate visual system (e.g., (Agrawal et al., 2014; Cadieu et al., 2014; Eickenberg et al., 2016; Güçlü and van Gerven, 2015a; Khaligh-Razavi and Kriegeskorte, 2014; Kubilius et al., 2016; Yamins et…”
BackgroundFast Backprojections from the Motion to the Primary Visual Area Necessary for Visual Awareness
Pascual-Leone, A., & Walsh, V. (2001) · Science · doi:10.1126/science.1057099 · Cited by 761 · cited 1×
“…made in specific brain areas (Gallant et al., 2000), surgical removal of entire brain areas (Weiner et al., 2016b), the effects of enhancement (Salzman et al., 1990) or disruption (Pascual-Leone and Walsh, 2001) of neural activity, or the effects of psychoactive drugs (Rokem and Silver, 2010).”
BackgroundCichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A. (2016) · Scientific Reports · doi:10.1038/srep27755 · Cited by 716 · cited 1×
“…responses to controlled stimuli (Eickenberg et al., 2016)), we can manipulate the models (e.g., perturb parameters and examine the consequences (Cichy et al., 2016)), and we can model the models (e.g., perform simulated experiments ‘in silico’ and derive simpler models that achieve the same…”
MethodParcellating cortical functional networks in individuals
Wang, D., Buckner, R. L., Fox, M. D., Holt, D. J., Holmes, A. J., Stoecklein, S., Langs, G., Pan, R., Qian, T., Li, K., et al. (2015) · Nature Neuroscience · doi:10.1038/nn.4164 · Cited by 527
Electrical Stimulation of Human Fusiform Face-Selective Regions Distorts Face Perception
Parvizi, J., Jacques, C., Foster, B. L., Withoft, N., Rangarajan, V., Weiner, K. S., & Grill-Spector, K. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2609-12.2012 · Cited by 352
Self-citationSeeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338 · cited 3×
“We can observe the models (e.g., inspect responses to controlled stimuli (Eickenberg et al., 2016)), we can manipulate the models (e.g., perturb parameters and examine the consequences (Cichy et al., 2016)), and we can model the models (e.g., perform simulated experiments ‘in silico’ and derive…”
BackgroundMethodAttention modulates spatial priority maps in the human occipital, parietal and frontal cortices
Sprague, T. C., & Serences, J. T. (2013) · Nature Neuroscience · doi:10.1038/nn.3574 · Cited by 266
Pinto, N., Doukhan, D., DiCarlo, J. J., & Cox, D. D. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000579 · Cited by 248 · cited 1×
“The computational capabilities of DNNs depend critically on the specific parameters used in the models (Coates et al., 2011; Pinto et al., 2009).”
MethodThe Retinotopic Organization of Striate Cortex Is Well Predicted by Surface Topology
Benson, N. C., Butt, O. H., Datta, R., Radoeva, P. D., Brainard, D. H., & Aguirre, G. K. (2012) · Current Biology · doi:10.1016/j.cub.2012.09.014 · Cited by 227 · cited 2×
“This approach assumes we have already accurately identified the relevant brain regions in a given observer, which can be a challenging endeavor (Benson et al., 2012; Frost and Goebel, 2012; Glasser et al., 2016; Gordon et al., 2016; Sabuncu et al., 2010; D. Wang et al., 2015; L. Wang et al., 2014;…”
BackgroundMethodRangarajan, V., Hermes, D., Foster, B. L., Weiner, K. S., Jacques, C., Grill-Spector, K., & Parvizi, J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0527-14.2014 · Cited by 226
Self-citationAttention Modulates the Responses of Simple Cells in Monkey Primary Visual Cortex
McAdams, C. J., & Reid, R. C. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2904-05.2005 · Cited by 203 · cited 1×
“…using naturalistic visual scenes to deliver luminance stimulation (David et al., 2004), manipulating the internal cognitive state of the observer (McAdams and Reid, 2005), or allowing visual stimulation to occur simultaneously with motor responses—and still found that the same model (with…”
A cross-validated cytoarchitectonic atlas of the human ventral visual stream
Rosenke, M., Weiner, K. S., Barnett, M. A., Zilles, K., Amunts, K., Goebel, R., & Grill-Spector, K. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.02.040 · Cited by 97
Self-citation
Cited by
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
Lindsay, G. W. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01544 · Cited by 557
Deep Neural Networks as Scientific Models
Cichy, R. M., & Kaiser, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.009 · Cited by 454
Novikov, D. S., Kiselev, V. G., & Jespersen, S. N. (2018) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27101 · Cited by 366
Deep neural networks in computational neuroscience
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2019) · Oxford Research Encyclopedia of Neuroscience · doi:10.1093/acrefore/9780190264086.013.46 · Cited by 186
Conwell, C., Prince, J. S., Kay, K. N., Alvarez, G. A., & Konkle, T. (2022) · doi:10.1101/2022.03.28.485868 · Cited by 160
Self-citation
Metadata
- Authors
- Kay, K. N.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 180
- Issue
- Pt A
- Pages
- 101-109
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2952237357
- Cited by
- 88
- References
- 29
- FWCI
- 4.58
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.