The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Distinct Eligibility Traces for LTP and LTD in Cortical Synapses
Open accessAbstract
In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called “distal reward problem” has been the notion of activity-generated ‘synaptic eligibility traces’, silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction/transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Spike Timing–Dependent Plasticity: A Hebbian Learning Rule
Caporale, N., & Dan, Y. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125639 · Cited by 1,997 · cited 7×
“Although bidirectional synaptic plasticity induced by coincident activity is well established, particularly in the form of spike-timing-dependent plasticity (STDP) (Caporale and Dan, 2008; Richards et al., 2010), the existence of eligibility traces for long-term potentiation (LTP) has been reported in only two studies…”
InfluentialRidderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407
Zhao, S., Ting, J. T., Atallah, H. E., Qiu, L., Tan, J., Gloss, B., Augustine, G. J., Deisseroth, K., Luo, M., Graybiel, A. M., et al. (2011) · Nature Methods · doi:10.1038/nmeth.1668 · Cited by 653
A critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Urakubo, H., Ishii, S., & Kasai, H. (2014) · Science · doi:10.1126/science.1255514 · Cited by 614
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity
Seol, G. H., Ziburkus, J., Huang, S., Song, L., Kim, I. T., Takamiya, K., Huganir, R. L., Lee, H.-K., & Kirkwood, A. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.013 · Cited by 429
Self-citationOtmakhova, N. A., & Lisman, J. E. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-23-07478.1996 · Cited by 377
Rewards evoke learning of unconsciously processed visual stimuli in adult humans
Seitz, A. R., Kim, D., & Watanabe, T. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.016 · Cited by 337
Modulation of long-term synaptic depression in visual cortex by acetylcholine and norepinephrine
Kirkwood, A., Rozas, C., Kirkwood, J., Perez, F., & Bear, M. F. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01599.1999 · Cited by 315
Self-citationWeber (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00036 · Cited by 205
Wörgötter, F., & Porr, B. (2005) · Neural Computation · doi:10.1162/0899766053011555 · Cited by 203
Cited by
Synaptic Plasticity Forms and Functions
Magee, J. C., & Grienberger, C. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-090919-022842 · Cited by 806
Dawson, J., Liu, C. Y., Francisco, G. E., Cramer, S. C., Wolf, S. L., Dixit, A., Alexander, J., Ali, R., Brown, B. L., Feng, W., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00475-x · Cited by 518
Hulsey, D. R., Riley, J. R., Loerwald, K. W., Rennaker, R. L., Kilgard, M. P., & Hays, S. A. (2017) · Experimental Neurology · doi:10.1016/j.expneurol.2016.12.005 · Cited by 313
Gerstner, W., Lehmann, M., Liakoni, V., Corneil, D., & Brea, J. (2018) · Frontiers in Neural Circuits · doi:10.3389/fncir.2018.00053 · Cited by 290
Activity patterns of serotonin neurons underlying cognitive flexibility
Matias, S., Lottem, E., Dugué, G. P., & Mainen, Z. F. (2017) · eLife · doi:10.7554/elife.20552 · Cited by 239
Metadata
- Authors
- He, K., Huertas, M., Hong, S. Z., Tie, X., Hell, J. W., Shouval, H., & Kirkwood, A.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2015-11
- Volume
- 88
- Issue
- 3
- Pages
- 528-538
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2176033094
- Cited by
- 217
- References
- 12
- FWCI
- 6.73
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.