Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Spike timing-dependent plasticity (STDP) is under neuromodulatory control, which is correlated with distinct behavioral states. Previously, we reported that dopamine, a reward signal, broadens the time window for synaptic potentiation and modulates the outcome of hippocampal STDP even when applied after the plasticity induction protocol (Brzosko et al., 2015). Here, we demonstrate that sequential neuromodulation of STDP by acetylcholine and dopamine offers an efficacious model of reward-based navigation. Specifically, our experimental data in mouse hippocampal slices show that acetylcholine biases STDP toward synaptic depression, whilst subsequent application of dopamine converts this depression into potentiation. Incorporating this bidirectional neuromodulation-enabled correlational synaptic learning rule into a computational model yields effective navigation toward changing reward locations, as in natural foraging behavior. Thus, temporally sequenced neuromodulation of STDP enables associations to be made between actions and outcomes and also provides a possible mechanism for aligning the time scales of cellular and behavioral learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Optimal foraging, the marginal value theorem
Charnov, E. L. (1976) · Theoretical Population Biology · doi:10.1016/0040-5809(76)90040-x · Cited by 5,374
Bi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744
Morris, R. G. M., Anderson, E., Lynch, G. S., & Baudry, M. (1986) · Nature · doi:10.1038/319774a0 · Cited by 3,640 · cited 2×
“Hippocampal synaptic plasticity (Bliss and Lomo, 1973; Bliss and Collingridge, 1993), including STDP (Bi and Poo, 1998; Debanne et al., 1998; Kwag and Paulsen, 2009; Andrade-Talavera et al., 2016), is believed to mediate the encoding of spatial memories (Morris et al., 1986; Tsien et al., 1996).”
BackgroundThe essential role of hippocampal CA1 NMDA receptor-dependent synaptic plasticity in spatial memory.
Tsien, J. Z., Huerta, P. T., & Tonegawa, S. (1996) · Cell · doi:10.1016/s0092-8674(00)81827-9 · Cited by 1,782 · cited 2×
“Hippocampal synaptic plasticity (Bliss and Lomo, 1973; Bliss and Collingridge, 1993), including STDP (Bi and Poo, 1998; Debanne et al., 1998; Kwag and Paulsen, 2009; Andrade-Talavera et al., 2016), is believed to mediate the encoding of spatial memories (Morris et al., 1986; Tsien et al., 1996).”
BackgroundUncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“Several computational functions have been previously suggested for acetylcholine (Doya, 2002; Yu & Dayan, 2005; Hasselmo, 1999).”
BackgroundNeuronal Dynamics: From Single Neurons to Networks and Models of Cognition
Gerstner, W., Kistler, W. M., Naud, R., & Paninski, L. (2014) · doi:10.1017/cbo9781107447615 · Cited by 1,515 · cited 1×
“Firstly, in contrast to many forms of behavioral learning, conventional STDP is unsupervised, that is, the resulting plasticity is not informed by the outcome of the activity (Hertz et al., 1991; Gerstner et al., 2014).”
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450
Cellular networks underlying human spatial navigation
Ekstrom, A. D., Kahana, M. J., Caplan, J. B., Fields, T. A., Isham, E. A., Newman, E. L., & Fried, I. (2003) · Nature · doi:10.1038/nature01964 · Cited by 1,425 · cited 1×
“A wealth of experimental data has implicated the hippocampus with its constituent place cells (O’Keefe and Dostrovsky, 1971; O’Keefe and Nadel, 1978) in spatial learning and memory in non-human animals (Morris et al., 1982) as well as humans (Ekstrom et al., 2003).”
BackgroundNeuromodulation: acetylcholine and memory consolidation
Hasselmo, M. E. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01365-0 · Cited by 809 · cited 1×
“Several computational functions have been previously suggested for acetylcholine (Doya, 2002; Yu & Dayan, 2005; Hasselmo, 1999).”
BackgroundMetalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Marrosu, F., Portas, C., Mascia, M. S., Casu, M. A., Fà, M., Giagheddu, M., Imperato, A., & Gessa, G. L. (1995) · Brain Research · doi:10.1016/0006-8993(94)01399-3 · Cited by 480 · cited 3×
“DOI: 10.7554/eLife.27756 8 of 18 1990; Marrosu et al., 1995; Thiel et al., 1998).”
BackgroundInfluentialNeuromodulators control the polarity of spike-timing-dependent synaptic plasticity
Seol, G. H., Ziburkus, J., Huang, S., Song, L., Kim, I. T., Takamiya, K., Huganir, R. L., Lee, H.-K., & Kirkwood, A. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.013 · Cited by 429 · cited 3×
“Our findings are consistent with previous reports using STDP induction protocols, showing that cholinergic receptor activation enables t-LTD in the visual cortex (Seol et al., 2007) and facilitates t-LTD in the dorsal cochlear nucleus (Zhao and Tzounopoulos, 2011), but appear to contrast with results from studies in t…”
BackgroundResultPan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429
Cited by
Synaptic Plasticity Forms and Functions
Magee, J. C., & Grienberger, C. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-090919-022842 · Cited by 806
Gerstner, W., Lehmann, M., Liakoni, V., Corneil, D., & Brea, J. (2018) · Frontiers in Neural Circuits · doi:10.3389/fncir.2018.00053 · Cited by 290
Specific basal forebrain-cortical cholinergic circuits coordinate cognitive operations
Záborszky, L., Gombkoto, P., Varsanyi, P., Gielow, M. R., Poe, G., Role, L. W., Ananth, M., Rajebhosale, P., Talmage, D. A., Hasselmo, M. E., et al. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.1676-18.2018 · Cited by 202
Neuromodulation of hippocampal long-term synaptic plasticity
Palacios-Filardo, J., & Mellor, J. R. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.08.009 · Cited by 184
Bidirectional synaptic plasticity rapidly modifies hippocampal representations
Milstein, A. D., Li, Y., Bittner, K. C., Grienberger, C., Soltesz, I., Magee, J. C., & Romani, S. (2021) · eLife · doi:10.7554/elife.73046 · Cited by 151
Metadata
- Authors
- Brzosko, Z., Zannone, S., Schultz, W., Clopath, C., & Paulsen, O.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2017-07-10
- Volume
- 6
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W2726920196
- Cited by
- 97
- References
- 13
- FWCI
- 4.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.