Dendritic solutions to the credit assignment problem
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Guaranteeing that synaptic plasticity leads to effective learning requires a means for assigning credit to each neuron for its contribution to behavior. The 'credit assignment problem' refers to the fact that credit assignment is non-trivial in hierarchical networks with multiple stages of processing. One difficulty is that if credit signals are integrated with other inputs, then it is hard for synaptic plasticity rules to distinguish credit-related activity from non-credit-related activity. A potential solution is to use the spatial layout and non-linear properties of dendrites to distinguish credit signals from other inputs. In cortical pyramidal neurons, evidence hints that top-down feedback signals are integrated in the distal apical dendrites and have a distinct impact on spike-firing and synaptic plasticity. This suggests that the distal apical dendrites of pyramidal neurons help the brain to solve the credit assignment problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
No free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
Neuronal Oscillations in Cortical Networks
Buzsáki, G., & Draguhn, A. (2004) · Science · doi:10.1126/science.1099745 · Cited by 6,576
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 1×
“Indeed, at the neural level, it is possible to reduce a loss function without there being any direct neural correlate of said loss function to find [51,52].”
BackgroundControl of mental activities by internal models in the cerebellum
Ito, M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2332 · Cited by 1,356 · cited 3×
“Thus, this can be modeled as a three-factor learning rule, where pre and/or postsynaptic activities interact with a credit assignment factor provided by the climbing fibers [70,85].”
BackgroundA new cellular mechanism for coupling inputs arriving at different cortical layers
Larkum, M. E., Zhu, J. J., & Sakmann, B. (1999) · Nature · doi:10.1038/18686 · Cited by 1,180 · cited 3×
“Specifically, the apical dendrites of pyramidal neurons have a region that is rich in voltage-gated calcium channels [31,33,100,101,43,36], which can induce ‘plateau potentials’ when the apical dendrites are sufficiently depolarized, or if there is coincident activation of distal apical inputs and somatic spiking (Fig…”
BackgroundThe "Wake-Sleep" Algorithm for Unsupervised Neural Networks
Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995) · Science · doi:10.1126/science.7761831 · Cited by 1,070
Markram, H., Lübke, J., Frotscher, M., Roth, A., & Sakmann, B. (1997) · The Journal of Physiology · doi:10.1113/jphysiol.1997.sp022031 · Cited by 960 · cited 1×
“Second, distal apical dendrites are electrotonically distant from the soma and the basal and oblique dendrites [34,37,87,88], which receive much of the local feedforward and recurrent inputs to pyramidal neurons [22,23].”
BackgroundMegı́as, M., Emri, Z., Freund, T. F., & Gulyás, A. I. (2001) · Neuroscience · doi:10.1016/s0306-4522(00)00496-6 · Cited by 950
Cited by
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027
Self-citationLillicrap, T. P., Santoro, A., Marris, L., Akerman, C. J., & Hinton, G. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0277-3 · Cited by 908
Self-citationTang, J., Yuan, F., Shen, X., Wang, Z., Rao, M., He, Y., Sun, Y., Li, X., Zhang, W., Li, Y., et al. (2019) · Advanced Materials · doi:10.1002/adma.201902761 · Cited by 834
Synaptic Plasticity Forms and Functions
Magee, J. C., & Grienberger, C. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-090919-022842 · Cited by 806
Theories of Error Back-Propagation in the Brain
Whittington, J. C. R., & Bogacz, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.005 · Cited by 420
“A solution to this inconsistency has been proposed in several models in which the error is represented in dendrites of the corresponding neuron [44 – 46].”
MethodBurst-dependent synaptic plasticity can coordinate learning in hierarchical circuits
Payeur, A., Guerguiev, J., Zenke, F., Richards, B. A., & Naud, R. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00857-x · Cited by 292
Self-citationThe neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
Self-citationSaka, A. B., Oyedele, L. O., Akanbi, L. A., Ganiyu, S. A., Chan, D. W. M., & Bello, S. A. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101869 · Cited by 161
Bidirectional synaptic plasticity rapidly modifies hippocampal representations
Milstein, A. D., Li, Y., Bittner, K. C., Grienberger, C., Soltesz, I., Magee, J. C., & Romani, S. (2021) · eLife · doi:10.7554/elife.73046 · Cited by 151
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation
Song, Y., Millidge, B., Salvatori, T., Lukasiewicz, T., Xu, Z., & Bogacz, R. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01514-1 · Cited by 85
How deep is the brain? The shallow brain hypothesis
Suzuki, M., Pennartz, C. M. A., & Aru, J. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00756-z · Cited by 79
Rudroff, T., Rainio, O., & Klén, R. (2024) · Brain Sciences · doi:10.3390/brainsci14111111 · Cited by 11
Metadata
- Authors
- Richards, B. A., & Lillicrap, T. P.
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 54
- Pages
- 28-36
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W2891772748
- Cited by
- 150
- References
- 30
- FWCI
- 1.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.