The DOI matches its Crossref record; 102 of the 104 references it cites were found in a registry or an index.
A deep learning framework for neuroscience
Open accessAbstract
Systems neuroscience seeks explanations for how the brain implements a wide variety of perceptual, cognitive and motor tasks. Conversely, artificial intelligence attempts to design computational systems based on the tasks they will have to solve. In artificial neural networks, the three components specified by design are the objective functions, the learning rules and the architectures. With the growing success of deep learning, which utilizes brain-inspired architectures, these three designed components have increasingly become central to how we model, engineer and optimize complex artificial learning systems. Here we argue that a greater focus on these components would also benefit systems neuroscience. We give examples of how this optimization-based framework can drive theoretical and experimental progress in neuroscience. We contend that this principled perspective on systems neuroscience will help to generate more rapid progress.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Self-citationNo free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Self-citationInformation theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
DeepLabCut: markerless pose estimation of user-defined body parts with deep learning
Mathis, A., Mamidanna, P., Cury, K. M., Abe, T., Murthy, V. N., Mathis, M. W., & Bethge, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0209-y · Cited by 5,187
Prototypical Networks for Few-shot Learning
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 4,755 · cited 1×
“However, it is worth noting that (1) many species, especially humans, develop slowly with large quantities of experiential data and (2) that deep networks can work well in low data regimes if they have good inductive biases 46 .”
BackgroundConvolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
Self-citation
Research works printed but not linked: 3
- Sacramento, J., Costa, R. P., Bengio, Y. & Senn, W. Dendritic cortical microcircuits approximate the backpropagation algorithm. Adv. Neural Inf. Proc. Sys. 31, 8735–8746 (2018).
- Neyshabur, B., Tomioka, R. & Srebro, N. In search of the real inductive bias: on the role of implicit regularization in deep learning. Preprint at arXiv https://arxiv.org/abs/1412.6614 (2014). · arXiv
- Bellec, G., Salaj, D., Subramoney, A., Legenstein, R. & Maass, W. Long short-term memory and learning-to-learn in networks of spiking neurons. Adv. Neural Inf. Proc. Sys. 31, 787–797 (2018).
Cited by
Training Spiking Neural Networks Using Lessons From Deep Learning
Eshraghian, J. K., Ward, M., Neftci, E. O., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D. S., & Lu, W. D. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3308088 · Cited by 782
“While it is unlikely that our brains use something as explicit as a cross-entropy loss function, it is fair to say that humans and animals have baseline objectives [121].”
BackgroundEmbedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 652
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
Lindsay, G. W. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01544 · Cited by 557
“For this reason, an alternative way to describe the network that is compact without relying on simple statements about computations has been proposed (Lillicrap & Kording, 2019; Richards et al., 2019); this viewpoint focuses on describing the architec-”
MethodSelf-citationShared computational principles for language processing in humans and deep language models
Goldstein, A., Zada, Z., Buchnik, E., Schain, M., Price, A., Aubrey, B., Nastase, S. A., Feder, A., Emanuel, D., Cohen, A., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01026-4 · Cited by 447
“To the extent that the brain relies on a next-word prediction objective to learn how to use language in context, it likely uses a different implementation 54 .”
BackgroundArtificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X.-J. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 376
Metadata
- Authors
- Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., Gillon, C. J., Hafner, D., Kepecs, A., Kriegeskorte, N., Latham, P., Lindsay, G. W., Miller, K. D., Naud, R., Pack, C. C., Poirazi, P., Roelfsema, P., Sacramento, J., Saxe, A., Scellier, B., Schapiro, A. C., Senn, W., Wayne, G., Yamins, D., Zenke, F., Zylberberg, J., Therien, D., & Kording, K. P.
- Affiliations
- Canadian Institute for Advanced Research (CA)
- Google DeepMind (United Kingdom) (GB)
- Stanford University (US)
- University of Bern (CH)
- Google (United States) (US)
- University of Toronto (CA)
- Mortimer B. Zuckerman Mind Brain Behavior Institute (US)
- Gatsby Computational Neuroscience Unit (GB)
- University of Ottawa (CA)
- McGill University (CA)
- FORTH Institute of Molecular Biology and Biotechnology (GR)
- Netherlands Institute for Neuroscience (NL)
- University of Zurich (CH)
- University of Oxford (GB)
- Mila - Quebec Artificial Intelligence Institute (CA)
- University of Pennsylvania (US)
- Corresponding author
- Richards, Blake A.
- ORCID
- Richards, Blake A.
- Lillicrap, Timothy P.
- Bengio, Yoshua
- Christensen, Amelia
- Clopath, Claudia
- Costa, Rui Ponte
- Ganguli, Surya
- Gillon, Colleen J.
- Hafner, Danijar
- Kriegeskorte, Nikolaus
- Latham, Peter
- Lindsay, Grace W.
- Miller, Kenneth D.
- Naud, Richard
- Pack, Christopher C.
- Poirazi, Panayiota
- Roelfsema, Pieter
- Sacramento, João
- Saxe, Andrew
- Scellier, Benjamin
- Schapiro, Anna C.
- Senn, Walter
- Yamins, Daniel
- Zenke, Friedemann
- Zylberberg, Joel
- Therien, Denis
- Kording, Konrad P.
- Venue
- Nature Neuroscience
- Published
- 2019-10-28
- Volume
- 22
- Issue
- 11
- Pages
- 1761-1770
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC7115933
- OpenAlex
- W2978368159
- Cited by
- 1,027
- References
- 104
- Citations by year
- 2026: 104 · 2025: 158 · 2024: 187 · 2023: 148 · 2022: 150 · 2021: 170 · 2020: 102 · 2019: 8
- FWCI
- 7.06
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- KNAW research portal (Royal Academy of Art and Sciences (KNAW)) (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion, other-oa)
- PubMed Central (acceptedVersion)
- Cold Spring Harbor Laboratory Institutional Repository (Cold Spring Harbor Laboratory) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- BORIS (University Library Bern) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Explore Bristol Research (submittedVersion, other-oa)
- Spiral (Imperial College London) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- McGill University
- Medical Research Council (MC_UU_12024/5)
- Biotechnology and Biological Sciences Research Council (BB/P018785/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- systems neuroscience, deep learning, artificial neural networks, objective function, learning rules, neural network architecture, brain-inspired architecture, computational neuroscience
- MeSH terms
- Deep Learning, Animals, Artificial Intelligence, Brain, Humans, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A deep learning framework for neuroscience. https://app.cochat.ai/papers/10.1038/s41593-019-0520-2
- The paper
- Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., Gillon, C. J., Hafner, D., Kepecs, A., Kriegeskorte, N., Latham, P., Lindsay, G. W., Miller, K. D., Naud, R., Pack, C. C., . . . Kording, K. P. (2019). A deep learning framework for neuroscience. Nature Neuroscience. https://doi.org/10.1038/s41593-019-0520-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.