The DOI matches its Crossref record; 145 of the 145 references it cites were found in a registry or an index.
Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules
Open accessAbstract
Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Hodgkin, A. L., & Huxley, A. F. (1952) · The Journal of Physiology · doi:10.1113/jphysiol.1952.sp004764 · Cited by 23,191
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
A synaptic model of memory: long-term potentiation in the hippocampus
Bliss, T. V. P., & Collingridge, G. L. (1993) · Nature · doi:10.1038/361031a0 · Cited by 11,566
Hebb, D. O. (2005) · doi:10.4324/9781410612403 · Cited by 9,825
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“…gain during active exploration (Storck et al., 1995; Schmidhuber, 2006; Sun et al., 2011; Little and Sommer, 2013; Friston et al., 2016), and via formal definitions of surprise (Shannon, 1948; Storck et al., 1995; Itti and Baldi, 2009; Friston, 2010; Schmidhuber, 2010; Faraji et al., 2018).”
BackgroundAsynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025
Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs
Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997) · Science · doi:10.1126/science.275.5297.213 · Cited by 3,832
Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Bienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896 · cited 1×
“In the Bienenstock-Cooper Munro (BCM) model of developmental cortical plasticity (Bienenstock et al., 1982) the presynaptic factor xj is the firing rate of the presynaptic neuron and g(yi) = (yi − θ) yi is a quadratic function with yi the postsynaptic firing rate and θ a threshold rate.”
BackgroundSynaptic Plasticity and Memory: An Evaluation of the Hypothesis
Martin, S. J., Grimwood, P. D., & Morris, R. G. M. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.649 · Cited by 2,794 · cited 1×
“Memory formation and behavioral learning is linked to changes of synaptic connections (Martin et al., 2000).”
BackgroundCompetitive Hebbian learning through spike-timing-dependent synaptic plasticity
Song, S., Miller, K. D., & Abbott, L. F. (2000) · Nature Neuroscience · doi:10.1038/78829 · Cited by 2,729
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
Simplified neuron model as a principal component analyzer
Oja, E. (1982) · Journal of Mathematical Biology · doi:10.1007/bf00275687 · Cited by 2,309
Basal ganglia and cerebellar loops: motor and cognitive circuits
Middleton, F. (2000) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00040-5 · Cited by 1,940
Matsuzaki, M., Ellis-Davies, G. C. R., Nemoto, T., Miyashita, Y., Iino, M., & Kasai, H. (2001) · Nature Neuroscience · doi:10.1038/nn736 · Cited by 1,802 · cited 2×
“The strength of an excitatory synaptic contact can be defined by the amplitude of the postsynaptic potential which is closely related to the spine volume and the number of AMPA receptors (Matsuzaki et al., 2001).”
BackgroundMethodUncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“Indeed, theories of surprise as well as hierarchical Bayesian models predict a faster change of model parameters for surprising stimuli than for known ones (Yu and Dayan, 2005; Nassar et al., 2010; Mathys et al., 2011, 2014; Faraji et al., 2018) similar to, but more general than, the well-known Kalman filters (Kalman,…”
ResultSynaptic tagging and long-term potentiation
Frey, U., & Morris, R. G. M. (1997) · Nature · doi:10.1038/385533a0 · Cited by 1,736 · cited 5×
“could be related to synaptic consolidation (Frey and Morris, 1997; Reymann and Frey, 2007; Redondo andMorris, 2011; Lisman, 2017) rather than eligibility traces in reinforcement learning where shorter time constants are needed (Izhikevich, 2007; Legenstein et al.”
BackgroundMethodInfluentialThe role of acetylcholine in learning and memory
Hasselmo, M. E. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.09.002 · Cited by 1,693
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · cited 3×
“…1998) but in some of the early studies it remained unclear whether eligibility traces can be set by presynaptic activity alone (Klopf, 1972; Sutton and Barto, 1981) or only by Hebbian co-activation of pre- and postsynaptic neurons (Barto et al., 1983; Barto, 1985; Williams, 1992; Schultz,…”
BackgroundMethodNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Synaptic theory of working memory
Mongillo, G., Barak, O., & Tsodyks, M. (2008) · Science · doi:10.1126/science.1150769 · Cited by 1,253
Bayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity
Sjöström, P. J., Turrigiano, G. G., & Nelson, S. B. (2001) · Neuron · doi:10.1016/s0896-6273(01)00542-6 · Cited by 1,174
A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory.
Lisman, J. (1989) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.86.23.9574 · Cited by 1,127
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126
A neuronal learning rule for sub-millisecond temporal coding
Gerstner, W., Kempter, R., van Hemmen, J. L., & Wagner, H. (1996) · Nature · doi:10.1038/383076a0 · Cited by 1,110
Self-citationGenerating Coherent Patterns of Activity from Chaotic Neural Networks
Sussillo, D., & Abbott, L. F. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.018 · Cited by 1,092
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Non-Holographic Associative Memory
WILLSHAW, D. J., BUNEMAN, O. P., & LONGUET-HIGGINS, H. C. (1969) · Nature · doi:10.1038/222960a0 · Cited by 979 · cited 1×
“, 2005), memory formation and memory recall (Willshaw et al., 1969; Hopfield, 1982).”
BackgroundAMPARs and Synaptic Plasticity: The Last 25 Years
Huganir, R. L., & Nicoll, R. A. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.025 · Cited by 968
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964
Reinforcement Learning in Continuous Time and Space
Doya, K. (2000) · Neural Computation · doi:10.1162/089976600300015961 · Cited by 960
State-dependent computations: spatiotemporal processing in cortical networks
Buonomano, D. V., & Maass, W. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2558 · Cited by 926
A critical window for cooperation and competition among developing retinotectal synapses
Zhang, L. I., Tao, H. W., Holt, C. E., Harris, W. A., & Poo, M.-M. (1998) · Nature · doi:10.1038/25665 · Cited by 908
Pupil Size as Related to Interest Value of Visual Stimuli
Hess, E. H., & Polt, J. M. (1960) · Science · doi:10.1126/science.132.3423.349 · Cited by 888
Practising orientation identification improves orientation coding in V1 neurons
Schoups, A., Vogels, R., Qian, N., & Orban, G. (2001) · Nature · doi:10.1038/35087601 · Cited by 856
Locus coeruleus and dopaminergic consolidation of everyday memory
Takeuchi, T., Duszkiewicz, A. J., Sonneborn, A., Spooner, P. A., Yamasaki, M., Watanabe, M., Smith, C. C., Fernández, G., Deisseroth, K., Greene, R. W., et al. (2016) · Nature · doi:10.1038/nature19325 · Cited by 827
Random synaptic feedback weights support error backpropagation for deep learning
Lillicrap, T. P., Cownden, D., Tweed, D. B., & Akerman, C. J. (2016) · Nature Communications · doi:10.1038/ncomms13276 · Cited by 812
Spike-timing-dependent synaptic modification induced by natural spike trains
Froemke, R. C., & Dan, Y. (2002) · Nature · doi:10.1038/416433a · Cited by 803
Artola, A., & Singer, W. (1993) · Trends in Neurosciences · doi:10.1016/0166-2236(93)90081-v · Cited by 795
Making memories last: the synaptic tagging and capture hypothesis
Redondo, R. L., & Morris, R. G. M. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn2963 · Cited by 792 · cited 6×
“Neuromodulators such as dopamine have been identified as the necessary third factor for consolidation (Bailey et al., 2000; Reymann and Frey, 2007; Redondo and Morris, 2011; Lisman, 2017).”
BackgroundInfluentialLevy, W. B., & Steward, O. (1983) · Neuroscience · doi:10.1016/0306-4522(83)90010-6 · Cited by 766
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762
Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2056368 · Cited by 747
Stable Hebbian Learning from Spike Timing-Dependent Plasticity
van Rossum, M. C. W., Bi, G. Q., & Turrigiano, G. G. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-23-08812.2000 · Cited by 723
The Effect of Stimulus Sequence on the Waveform of the Cortical Event-Related Potential
Squires, K. C., Wickens, C., Squires, N. K., & Donchin, E. (1976) · Science · doi:10.1126/science.959831 · Cited by 709
Behavioral time scale synaptic plasticity underlies CA1 place fields
Bittner, K. C., Milstein, A. D., Grienberger, C., Romani, S., & Magee, J. C. (2017) · Science · doi:10.1126/science.aan3846 · Cited by 707
Selection of Intrinsic Horizontal Connections in the Visual Cortex by Correlated Neuronal Activity
Löwel, S., & Singer, W. (1992) · Science · doi:10.1126/science.1372754 · Cited by 707
Haber, S. N., Kim, K.-S., Mailly, P., & Calzavara, R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0271-06.2006 · Cited by 686
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., ODoherty, J., & Pezzulo, G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.022 · Cited by 674
Hebbian learning and spiking neurons
Kempter, R., Gerstner, W., & van Hemmen, J. L. (1999) · Physical Review E · doi:10.1103/physreve.59.4498 · Cited by 664
Self-citationSolving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling
Izhikevich, E. M. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl152 · Cited by 657
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
Reward Timing in the Primary Visual Cortex
Shuler, M. G., & Bear, M. F. (2006) · Science · doi:10.1126/science.1123513 · Cited by 648
Structural and Molecular Remodeling of Dendritic Spine Substructures during Long-Term Potentiation
Bosch, M., Castro, J., Saneyoshi, T., Matsuno, H., Sur, M., & Hayashi, Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.03.021 · Cited by 637
A critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., Hayashi-Takagi, A., Ellis-Davies, G. C. R., Urakubo, H., Ishii, S., & Kasai, H. (2014) · Science · doi:10.1126/science.1255514 · Cited by 614
Connectivity reflects coding: a model of voltage-based STDP with homeostasis
Clopath, C., Büsing, L., Vasilaki, E., & Gerstner, W. (2010) · Nature Neuroscience · doi:10.1038/nn.2479 · Cited by 607
Self-citationA unified model of NMDA receptor-dependent bidirectional synaptic plasticity
Shouval, H. Z., Bear, M. F., & Cooper, L. N. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.152343099 · Cited by 607
Reinforcement learning with replacing eligibility traces
Singh, S. P., & Sutton, R. S. (1996) · Machine Learning · doi:10.1007/bf00114726 · Cited by 575
Cascade Models of Synaptically Stored Memories
Fusi, S., Drew, P. J., & Abbott, L. F. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.001 · Cited by 569
Nassar, M. R., Wilson, R. C., Heasly, B., & Gold, J. I. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0822-10.2010 · Cited by 560
Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons
Bittner, K. C., Grienberger, C., Vaidya, S. P., Milstein, A. D., Macklin, J. J., Suh, J., Tonegawa, S., & Magee, J. C. (2015) · Nature Neuroscience · doi:10.1038/nn.4062 · Cited by 540
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 535
Neuromodulatory transmitter systems in the cortex and their role in cortical plasticity
Gu, Q. (2002) · Neuroscience · doi:10.1016/s0306-4522(02)00026-x · Cited by 518
Lisman, J. E. (1985) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.82.9.3055 · Cited by 475
A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP
Lisman, J., Grace, A. A., & Duzel, E. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.07.006 · Cited by 465
Uncertainty in perception and the Hierarchical Gaussian Filter
Mathys, C. D., Lomakina, E. I., Daunizeau, J., Iglesias, S., Brodersen, K. H., Friston, K. J., & Stephan, K. E. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00825 · Cited by 465
Shatz, C. J. (1992) · Scientific American · doi:10.1038/scientificamerican0992-60 · Cited by 462
The Role of Constraints in Hebbian Learning
Miller, K. D., & MacKay, D. J. C. (1994) · Neural Computation · doi:10.1162/neco.1994.6.1.100 · Cited by 448
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules
Frémaux, N., & Gerstner, W. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2015.00085 · Cited by 413
Self-citationLearning Enhances Sensory and Multiple Non-sensory Representations in Primary Visual Cortex
Poort, J., Khan, A. G., Pachitariu, M., Nemri, A., Orsolic, I., Krupic, J., Bauza, M., Sahani, M., Keller, G. B., Mrsic-Flogel, T. D., et al. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.037 · Cited by 403
Neurobiology: Memory and molecular turnover
Crick, F. (1984) · Nature · doi:10.1038/312101a0 · Cited by 392
Is Heterosynaptic modulation essential for stabilizing hebbian plasiticity and memory
Bailey, C. H., Giustetto, M., Huang, Y.-Y., Hawkins, R. D., & Kandel, E. R. (2000) · Nature Reviews Neuroscience · doi:10.1038/35036191 · Cited by 382 · cited 4×
“2009; Fr´emaux et al., 2013; Fr ´emaux and Gerstner, 2016). Three-factor rules have also been called ’neoHebbian’ (Lisman et al., 2011; Lisman, 2017) or ’heterosynaptic (modulatory-input dependent)’ (Bailey et al., 2000) and can be traced back to the 1960s (Crow, 1968), if not earlier. To our knowledge the wording ’th…”
BackgroundInfluentialDissecting the diversity of midbrain dopamine neurons
Roeper, J. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2013.03.003 · Cited by 373
Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics
Brader, J. M., Senn, W., & Fusi, S. (2007) · Neural Computation · doi:10.1162/neco.2007.19.11.2881 · Cited by 371
Towards deep learning with segregated dendrites
Guerguiev, J., Lillicrap, T. P., & Richards, B. A. (2017) · eLife · doi:10.7554/elife.22901 · Cited by 371
Moncada, D., & Viola, H. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1083-07.2007 · Cited by 370
Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity
Florian, R. V. (2007) · Neural Computation · doi:10.1162/neco.2007.19.6.1468 · Cited by 358
Reymann, K. G., & Frey, J. U. (2007) · Neuropharmacology · doi:10.1016/j.neuropharm.2006.07.026 · Cited by 331
Izhikevich, E. M., & Desai, N. S. (2003) · Neural Computation · doi:10.1162/089976603321891783 · Cited by 317
Equilibrium Properties of Temporally Asymmetric Hebbian Plasticity
Rubin, J., Lee, D. D., & Sompolinsky, H. (2001) · Physical Review Letters · doi:10.1103/physrevlett.86.364 · Cited by 301
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294
A model of hippocampally dependent navigation, using the temporal difference learning rule
Foster, D. J., Morris, R. G. M., & Dayan, P. (2000) · Hippocampus · doi:10.1002/(sici)1098-1063(2000)10:1<1::aid-hipo1>3.0.co;2-1 · Cited by 290
Perceptual learning rules based on reinforcers and attention
Roelfsema, P. R., van Ooyen, A., & Watanabe, T. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.005 · Cited by 281
Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity
Arleo, A., & Gerstner, W. (2000) · Biological Cybernetics · doi:10.1007/s004220000171 · Cited by 270
Self-citationDevelopmental robotics, optimal artificial curiosity, creativity, music, and the fine arts
Schmidhuber, J. (2006) · Connection Science · doi:10.1080/09540090600768658 · Cited by 268
Legenstein, R., Pecevski, D., & Maass, W. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000180 · Cited by 267
Menegas, W., Babayan, B. M., Uchida, N., & Watabe-Uchida, M. (2017) · eLife · doi:10.7554/elife.21886 · Cited by 265
Attention-Gated Reinforcement Learning of Internal Representations for Classification
Roelfsema, P. R., & Ooyen, A. V. (2005) · Neural Computation · doi:10.1162/0899766054615699 · Cited by 260
Timing is not everything: neuromodulation opens the STDP gate
Pawlak, V. (2010) · Frontiers in Synaptic Neuroscience · doi:10.3389/fnsyn.2010.00146 · Cited by 255
Control of synaptic plasticity in deep cortical networks
Roelfsema, P. R., & Holtmaat, A. (2018) · Nature Reviews Neuroscience · doi:10.1038/nrn.2018.6 · Cited by 246
Optimal Spike-Timing-Dependent Plasticity for Precise Action Potential Firing in Supervised Learning
Pfister, J.-P., Toyoizumi, T., Barber, D., & Gerstner, W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.6.1318 · Cited by 245
Self-citationLong-term potentiation: outstanding questions and attempted synthesis
Lisman, J. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1242 · Cited by 240
Computational principles of synaptic memory consolidation
Benna, M. K., & Fusi, S. (2016) · Nature Neuroscience · doi:10.1038/nn.4401 · Cited by 238
Zhang, J.-C., Lau, P.-M., & Bi, G.-Q. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0900546106 · Cited by 231
Learning by the Dendritic Prediction of Somatic Spiking
Urbanczik, R., & Senn, W. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.030 · Cited by 230 · cited 3×
“, 2010), a Hebbian two-factor rule if used in unsupervised learning (Urbanczik and Senn, 2014), but the same rule must be seen as a three-factor rule with a neuron-specific (non-global) third factor in the supervised setting.”
BackgroundMethodInfluentialSenn, W., Markram, H., & Tsodyks, M. (2001) · Neural Computation · doi:10.1162/089976601300014628 · Cited by 219
Distinct Eligibility Traces for LTP and LTD in Cortical Synapses
He, K., Huertas, M., Hong, S. Z., Tie, X., Hell, J. W., Shouval, H., & Kirkwood, A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.037 · Cited by 217
Conditional modulation of spike-timing-dependent plasticity for olfactory learning
Cassenaer, S., & Laurent, G. (2012) · Nature · doi:10.1038/nature10776 · Cited by 216
Gjorgjieva, J., Clopath, C., Audet, J., & Pfister, J.-P. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1105933108 · Cited by 213
Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons
Frémaux, N., Sprekeler, H., & Gerstner, W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003024 · Cited by 209
Self-citationCalcium Time Course as a Signal for Spike-Timing–Dependent Plasticity
Rubin, J. E., Gerkin, R. C., Bi, G.-Q., & Chow, C. C. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00803.2004 · Cited by 186
Learning by statistical cooperation of self-interested neuron-like computing elements.
Barto, A. (1985) · PubMed · Cited by 182
Lisman, J. (2017) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0260 · Cited by 169
STDP in a Bistable Synapse Model Based on CaMKII and Associated Signaling Pathways
Graupner, M., & Brunel, N. (2005) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030221 · Cited by 164
Action Selection and Action Value in Frontal-Striatal Circuits
Seo, M., Lee, E., & Averbeck, B. B. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.037 · Cited by 161
Cortical Synapses and Reinforcement: a Hypothesis
CROW, T. J. (1968) · Nature · doi:10.1038/219736a0 · Cited by 159
Learning in neural networks by reinforcement of irregular spiking
Xie, X. S., & Seung, H. S. (2004) · Physical Review E · doi:10.1103/physreve.69.041909 · Cited by 157
Retroactive modulation of spike timing-dependent plasticity by dopamine
Brzosko, Z., Schultz, W., & Paulsen, O. (2015) · eLife · doi:10.7554/elife.09685 · Cited by 157
Human Inferences about Sequences: A Minimal Transition Probability Model
Meyniel, F., Maheu, M., & Dehaene, S. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005260 · Cited by 157
Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity
Frémaux, N., Sprekeler, H., & Wulfram Gerstner, B. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.6249-09.2010 · Cited by 148
Tag-Trigger-Consolidation: A Model of Early and Late Long-Term-Potentiation and Depression
Clopath, C., Ziegler, L., Vasilaki, E., Buesing, L., & Wulfram Gerstner, B. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000248 · Cited by 147
Ngezahayo, A., Schachner, M., & Artola, A. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-07-02451.2000 · Cited by 143
Planning to be surprised: optimal bayesian exploration in dynamic environments
Sun, Y., Gomez, F., & Schmidhuber, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22887-2_5 · Cited by 134 · cited 1×
“Theoreticians have studied these ideas in the context of curiosity (Schmidhuber, 2010), information gain during active exploration (Storck et al., 1995; Schmidhuber, 2006; Sun et al., 2011; Little and Sommer, 2013; Friston et al., 2016), and via formal definitions of surprise (Shannon, 1948; Storck et al.”
BackgroundA computational analysis of the neural bases of Bayesian inference
Kolossa, A., Kopp, B., & Fingscheidt, T. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.11.007 · Cited by 133
Matching Recall and Storage in Sequence Learning with Spiking Neural Networks
Brea, J. M., Senn, W., & Pfister, J.-P. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.4098-12.2013 · Cited by 132
Self-citationVasilaki, E., Frémaux, N., Urbanczik, R., Senn, W., & Wulfram Gerstner, B. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000586 · Cited by 130
Loewenstein, Y., & Seung, H. S. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0505220103 · Cited by 113
Learning and exploration in action-perception loops
Little, D. Y.-J., & Sommer, F. T. (2013) · Frontiers in Neural Circuits · doi:10.3389/fncir.2013.00037 · Cited by 112
Brown, M. A., Sr., & Sharp, P. E. (1995) · Hippocampus · doi:10.1002/hipo.450050304 · Cited by 108
Shindou, T., Shindou, M., Watanabe, S., & Wickens, J. R. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.13921 · Cited by 104
Brain structure and dynamics across scales: in search of rules
Wang, X., & Kennedy, H. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.12.010 · Cited by 103
Brzosko, Z., Zannone, S., Schultz, W., Clopath, C., & Paulsen, O. (2017) · eLife · doi:10.7554/elife.27756 · Cited by 102
Diversity and Homogeneity in Responses of Midbrain Dopamine Neurons
Fiorillo, C. D., Yun, S. R., & Song, M. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3886-12.2013 · Cited by 99
Reinforcement learning in populations of spiking neuronsPreprint
Urbanczik, R., & Senn, W. (2008) · Nature Precedings · doi:10.1038/nn.2264 · Cited by 94
State Based Model of Long-Term Potentiation and Synaptic Tagging and Capture
Barrett, A. B., Billings, G. O., Morris, R., & van Rossum, M. C. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000259 · Cited by 89
Fauth, M. J., Wörgötter, F., & Tetzlaff, C. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004031 · Cited by 82
Stochastic variational learning in recurrent spiking networks
Rezende, D. J., & Wulfram Gerstner, B. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00038 · Cited by 78
A Model-Based Approach to Trial-By-Trial P300 Amplitude Fluctuations
Kolossa, A., Fingscheidt, T., Wessel, K., & Kopp, B. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00359 · Cited by 70
Balancing new against old information: the role of puzzlement surprise in learning
Faraji, M., Preuschoff, K., & Gerstner, W. (2018) · Neural Computation · doi:10.1162/neco_a_01025 · Cited by 68
How Attention Can Create Synaptic Tags for the Learning of Working Memories in Sequential Tasks
Rombouts, J. O., Bohté, S. M., & Roelfsema, P. R. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004060 · Cited by 67
Synaptic Consolidation: From Synapses to Behavioral Modeling
Ziegler, L., Zenke, F., Kastner, D. B., & Wulfram Gerstner, B. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3989-14.2015 · Cited by 65
Prospective Coding by Spiking Neurons
Brea, J., Gaál, A. T., Urbanczik, R., & Senn, W. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005003 · Cited by 55
Self-citationStructural plasticity controlled by calcium based correlation detection
Helias, M., Rotter, S., Gewaltig, M.-O., & Diesmann, M. (2008) · Frontiers in Computational Neuroscience · doi:10.3389/neuro.10.007.2008 · Cited by 51
Deger, M., Helias, M., Rotter, S., & Diesmann, M. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002689 · Cited by 49
Reinforcement delay of one second severely impairs acquisition of brain self-stimulation
Black, J., Belluzzi, J. D., & Stein, L. (1985) · Brain Research · doi:10.1016/0006-8993(85)91418-0 · Cited by 44
Multicontact Co-operativity in Spike-Timing–Dependent Structural Plasticity Stabilizes Networks
Deger, M., Seeholzer, A., & Wulfram Gerstner, B. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx339 · Cited by 28
Cited by
Synaptic Plasticity Forms and Functions
Magee, J. C., & Grienberger, C. (2020) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-090919-022842 · Cited by 806
A solution to the learning dilemma for recurrent networks of spiking neurons
Bellec, G., Scherr, F., Subramoney, A., Hajek, E., Salaj, D., Legenstein, R., & Maass, W. (2020) · Nature Communications · doi:10.1038/s41467-020-17236-y · Cited by 506
Burst-dependent synaptic plasticity can coordinate learning in hierarchical circuits
Payeur, A., Guerguiev, J., Zenke, F., Richards, B. A., & Naud, R. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00857-x · Cited by 292
Reconfigurable halide perovskite nanocrystal memristors for neuromorphic computing
John, R. A., Demirağ, Y., Shynkarenko, Y., Berezovska, Y., Ohannessian, N., Payvand, M., Zeng, P., Bodnarchuk, M. I., Krumeich, F., Kara, G., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-29727-1 · Cited by 292
Sensorimotor processing in the rodent barrel cortex
Petersen, C. C. H. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0200-y · Cited by 271
Metadata
- Authors
- Gerstner, W., Lehmann, M., Liakoni, V., Corneil, D., & Brea, J.
- Venue
- Frontiers in Neural Circuits
- Publisher
- Frontiers Media SA
- Published
- 2018-07-31
- Volume
- 12
- Pages
- 53-53
- ISSN
- 1662-5110 (ISSN-L)
- OpenAlex
- W2782973718
- Cited by
- 290
- References
- 145
- FWCI
- 6.49
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.