The DOI matches its Crossref record; 182 of the 182 references it cites were found in a registry or an index.
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules
Open accessAbstract
Classical Hebbian learning puts the emphasis on joint pre- and postsynaptic activity, but neglects the potential role of neuromodulators. Since neuromodulators convey information about novelty or reward, the influence of neuromodulators on synaptic plasticity is useful not just for action learning in classical conditioning, but also to decide "when" to create new memories in response to a flow of sensory stimuli. In this review, we focus on timing requirements for pre- and postsynaptic activity in conjunction with one or several phasic neuromodulatory signals. While the emphasis of the text is on conceptual models and mathematical theories, we also discuss some experimental evidence for neuromodulation of Spike-Timing-Dependent Plasticity. We highlight the importance of synaptic mechanisms in bridging the temporal gap between sensory stimulation and neuromodulatory signals, and develop a framework for a class of neo-Hebbian three-factor learning rules that depend on presynaptic activity, postsynaptic variables as well as the influence of neuromodulators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
A synaptic model of memory: long-term potentiation in the hippocampus
Bliss, T. V. P., & Collingridge, G. L. (1993) · Nature · doi:10.1038/361031a0 · Cited by 11,566 · cited 2×
“Behavioral learning and memory is thought to be linked to long-lasting synaptic changes (Hebb, 1949; Barnes, 1979; Morris et al., 1986; Bliss and Collingridge, 1993; Martin et al., 2000) that can be experimentally induced by protocols for longterm potentiation (LTP) (Lømo, 1964; Bliss and Lømo,…”
BackgroundMethodHebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Kohonen, T. (1990) · Proceedings of the IEEE · doi:10.1109/5.58325 · Cited by 8,414
Bliss, T. V. P., & Gardner‐Medwin, A. R. (1973) · The Journal of Physiology · doi:10.1113/jphysiol.1973.sp010274 · Cited by 7,437
indicated, N. A. (1950) · Journal of Consulting Psychology · doi:10.1037/h0049612 · Cited by 6,923
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
The hippocampus as a cognitive map
Passingham, R. E. (1979) · Neuroscience · doi:10.1016/0306-4522(79)90015-0 · Cited by 5,128
Cited by
Tang, J., Yuan, F., Shen, X., Wang, Z., Rao, M., He, Y., Sun, Y., Li, X., Zhang, W., Li, Y., et al. (2019) · Advanced Materials · doi:10.1002/adma.201902761 · Cited by 834
Synaptic Plasticity Forms and Functions
Magee, J. C., & Grienberger, C. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-090919-022842 · Cited by 806
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks
Fang, W., Yu, Z., Chen, Y., Masquelier, T., Huang, T., & Tian, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00266 · Cited by 605
SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks
Zenke, F., & Ganguli, S. (2018) · Neural Computation · doi:10.1162/neco_a_01086 · Cited by 515
A solution to the learning dilemma for recurrent networks of spiking neurons
Bellec, G., Scherr, F., Subramoney, A., Hajek, E., Salaj, D., Legenstein, R., & Maass, W. (2020) · Nature Communications · doi:10.1038/s41467-020-17236-y · Cited by 506
John, R. A., Liu, F., Chien, N. A., Kulkarni, M. R., Zhu, C., Fu, Q., Basu, A., Liu, Z., & Mathews, N. (2018) · Advanced Materials · doi:10.1002/adma.201800220 · Cited by 361
Neural ensemble dynamics underlying a long-term associative memory
Grewe, B. F., Gründemann, J., Kitch, L. J., Lecoq, J. A., Parker, J. G., Marshall, J. D., Larkin, M. C., Jercog, P. E., Grenier, F., Li, J. Z., et al. (2017) · Nature · doi:10.1038/nature21682 · Cited by 351
Ling, H., Koutsouras, D. A., Kazemzadeh, S., van de Burgt, Y., Yan, F., & Gkoupidenis, P. (2020) · Applied Physics Reviews · doi:10.1063/1.5122249 · Cited by 294
Gerstner, W., Lehmann, M., Liakoni, V., Corneil, D., & Brea, J. (2018) · Frontiers in Neural Circuits · doi:10.3389/fncir.2018.00053 · Cited by 290
Self-citationExploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware
Rathi, N., Chakraborty, I., Kosta, A., Sengupta, A., Ankit, A., Panda, P., & Roy, K. (2023) · ACM Computing Surveys · doi:10.1145/3571155 · Cited by 267
The temporal paradox of Hebbian learning and homeostatic plasticity
Zenke, F., Gerstner, W., & Ganguli, S. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.03.015 · Cited by 201
Self-citationNeuromodulation of hippocampal long-term synaptic plasticity
Palacios-Filardo, J., & Mellor, J. R. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.08.009 · Cited by 184
Single-cell transcriptomic evidence for dense intracortical neuropeptide networks
Smith, S. J., Sümbül, U., Graybuck, L. T., Collman, F., Seshamani, S., Gala, R., Gliko, O., Elabbady, L., Miller, J. A., Bakken, T. E., et al. (2019) · eLife · doi:10.7554/elife.47889 · Cited by 156
“As one case in point, the broad class of synaptic learning rules that neuroscientists call “spike-timing-dependent plasticity” (STDP) [98,99] has already attracted a great deal of attention by computer scientists as a possible element of more efficient credit assignment and ANN parameter adjustment algorithms, particu…”
BackgroundMotor primitives in space and time via targeted gain modulation in cortical networks
Stroud, J. P., Porter, M. A., Hennequin, G., & Vogels, T. P. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0276-0 · Cited by 119
Jang, H., Simeone, O., Gardner, B., & Gruning, A. (2019) · IEEE Signal Processing Magazine · doi:10.1109/msp.2019.2935234 · Cited by 101
“Three-factor rule While the details differ for each learning rule and task, a general form of the learning rule for the synaptic weights follows the three-factor rule [21], [22].”
BackgroundDopamine promotes head direction plasticity during orienting movements
Fisher, Y. E., Marquis, M., D’Alessandro, I., & Wilson, R. I. (2022) · Nature · doi:10.1038/s41586-022-05485-4 · Cited by 67
Balancing new against old information: the role of puzzlement surprise in learning
Faraji, M., Preuschoff, K., & Gerstner, W. (2018) · Neural Computation · doi:10.1162/neco_a_01025 · Cited by 68
“…the activity of a single neuromodulator, or a combination of several neuromodulators, conveys the amount of puzzlement surprise to many areas of the brain, where it regulates the learning rate of those synapses that have been involved in representing the recent stimuli (Frémaux & Gerstner, 2016).”
BackgroundP300 amplitude variations, prior probabilities, and likelihoods: a Bayesian ERP study
Kopp, B., Seer, C., Lange, F., Kluytmans, A., Kolossa, A., Fingscheidt, T., & Hoijtink, H. (2016) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-016-0442-3 · Cited by 60
Véronneau-Veilleux, F., Robaey, P., Ursino, M., & Nekka, F. (2022) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2022.849323 · Cited by 32
Serotonergic neuromodulation of synaptic plasticity
Higa, G. S. V., Viana, F. J. C., Francis-Oliveira, J., Cruvinel, E., Franchin, T. S., Marcourakis, T., Ulrich, H., & De Pasquale, R. (2024) · Neuropharmacology · doi:10.1016/j.neuropharm.2024.110036 · Cited by 29
New light on cortical neuropeptides and synaptic network plasticity
Smith, S. J., Hawrylycz, M., Rossier, J., & Sümbül, U. (2020) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2020.04.002 · Cited by 26
The Functions of Dopamine in Operant Conditioned Reflexes
Maiorov, V. I. (2019) · Neuroscience and Behavioral Physiology · doi:10.1007/s11055-019-00815-y · Cited by 10
“…a modulating factor in synaptic plasticity [Pawlak et al., 2010; Lisman et al., 2011; Nakano et al., 2013; Yagashita et al., 20145; He et al., 2015] Frémaux and Gerstner, 2016] and in particular as the third factor required for induction of long-term potentiation of synaptic transmission (the…”
Metadata
- Authors
- Frémaux, N., & Gerstner, W.
- Venue
- Frontiers in Neural Circuits
- Publisher
- Frontiers Media SA
- Published
- 2016-01-19
- Volume
- 9
- Pages
- 85-85
- ISSN
- 1662-5110 (ISSN-L)
- OpenAlex
- W2271476098
- Cited by
- 413
- References
- 182
- FWCI
- 16.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.