A silent eligibility trace enables dopamine‐dependent synaptic plasticity for reinforcement learning in the mouse striatum
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Dopamine‐dependent synaptic plasticity is a candidate mechanism for reinforcement learning. A silent eligibility trace – initiated by synaptic activity and transformed into synaptic strengthening by later action of dopamine – has been hypothesized to explain the retroactive effect of dopamine in reinforcing past behaviour. We tested this hypothesis by measuring time‐dependent modulation of synaptic plasticity by dopamine in adult mouse striatum, using whole‐cell recordings. Presynaptic activity followed by postsynaptic action potentials (pre–post) caused spike‐timing‐dependent long‐term depression in D1‐expressing neurons, but not in D2 neurons, and not if postsynaptic activity followed presynaptic activity. Subsequent experiments focused on D1 neurons. Applying a dopamine D1 receptor agonist during induction of pre–post plasticity caused long‐term potentiation. This long‐term potentiation was hidden by long‐term depression occurring concurrently and was unmasked when long‐term depression blocked an L‐type calcium channel antagonist. Long‐term potentiation was blocked by a Ca 2+ ‐permeable AMPA receptor antagonist but not by an NMDA antagonist or an L‐type calcium channel antagonist. Pre–post stimulation caused transient elevation of rectification – a marker for expression of Ca 2+ ‐permeable AMPA receptors – for 2–4‐s after stimulation. To test for an eligibility trace, dopamine was uncaged at specific time points before and after pre‐ and postsynaptic conjunction of activity. Dopamine caused potentiation selectively at synapses that were active 2‐s before dopamine release, but not at earlier or later times. Our results provide direct evidence for a silent eligibility trace in the synapses of striatal neurons. This dopamine‐timing‐dependent plasticity may play a central role in reinforcement learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A gene expression atlas of the central nervous system based on bacterial artificial chromosomes
Gong, S., Zheng, C., Doughty, M. L., Losos, K., Didkovsky, N., Schambra, U. B., Nowak, N. J., Joyner, A., Leblanc, G., Hatten, M. E., et al. (2003) · Nature · doi:10.1038/nature02033 · Cited by 2,108 · cited 7×
“In the current experiment, we definitively identified MSNs as D1 or D2 by their expression of EGFP.”
BackgroundMethodInfluentialDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
Synaptic tagging and long-term potentiation
Frey, U., & Morris, R. G. M. (1997) · Nature · doi:10.1038/385533a0 · Cited by 1,736 · cited 1×
“These include consolidation of alreadyexpressed synaptic plasticity based on synaptic tagging mechanisms that convert shorter forms of LTP into longer term, protein synthesis-dependent forms (Frey & Morris, 1997).”
BackgroundA cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879
Self-citationA critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Urakubo, H., Ishii, S., & Kasai, H. (2014) · Science · doi:10.1126/science.1255514 · Cited by 614
Lacey, M. G., Mercuri, N. B., & North, R. A. (1987) · The Journal of Physiology · doi:10.1113/jphysiol.1987.sp016787 · Cited by 614
Explicit neural signals reflecting reward uncertainty
Schultz, W., Preuschoff, K., Camerer, C., Hsu, M., Fiorillo, C. D., Tobler, P. N., & Bossaerts, P. (2008) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2008.0152 · Cited by 239 · cited 1×
“Dopamine – a neuromodulator released by positive reinforcement (Fiorillo et al., 2003; Cheer et al., 2007; Schultz et al., 2008) – plays a key role in the underlying neural mechanisms.”
BackgroundMemory, plasticity and sleep - A role for calcium permeable AMPA receptors?
Shepherd, J. D. (2012) · Frontiers in Molecular Neuroscience · doi:10.3389/fnmol.2012.00049 · Cited by 49
Cited by
Synaptic Plasticity Forms and Functions
Magee, J. C., & Grienberger, C. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-090919-022842 · Cited by 806
Gerstner, W., Lehmann, M., Liakoni, V., Corneil, D., & Brea, J. (2018) · Frontiers in Neural Circuits · doi:10.3389/fncir.2018.00053 · Cited by 290
Neuromodulation of hippocampal long-term synaptic plasticity
Palacios-Filardo, J., & Mellor, J. R. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.08.009 · Cited by 184
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150
Reward magnitude determines reinforcement learning efficiency
Gong, S., Martell, A., Dudman, J. T., & Coddington, L. T. (2026) · Science · doi:10.1126/science.aeb0813 · Cited by 2
Metadata
- Authors
- Shindou, T., Shindou, M., Watanabe, S., & Wickens, J.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2018-04-14
- Volume
- 49
- Issue
- 5
- Pages
- 726-736
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2794747207
- Cited by
- 94
- References
- 8
- FWCI
- 3.60
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A silent eligibility trace enables dopamine‐dependent synaptic plasticity for reinforcement learning in the mouse striatum. https://app.cochat.ai/papers/10.1111/ejn.13921
- The paper
- Shindou, T., Shindou, M., Watanabe, S., & Wickens, J. (2019). A silent eligibility trace enables dopamine‐dependent synaptic plasticity for reinforcement learning in the mouse striatum. European Journal of Neuroscience. https://doi.org/10.1111/ejn.13921
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.