Learning in spiking neural networks by reinforcement of stochastic synaptic transmission

Learning representations by back-propagating errors

Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · see citing works

Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning

Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 7,936 · see citing works

Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type

Bi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744 · see citing works

Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs

Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997) · Science · doi:10.1126/science.275.5297.213 · Cited by 3,832 · see citing works

Neuronlike adaptive elements that can solve difficult learning control problems

Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,238 · see citing works

Long-Term Potentiation--A Decade of Progress?

Malenka, R. C., & Nicoll, A. R. A. (1999) · Science · doi:10.1126/science.285.5435.1870 · Cited by 2,729 · see citing works

Getting formal with dopamine and reward

Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works

Reliability of spike timing in neocortical neurons

Mainen, Z. F., & Sejnowski, T. J. (1995) · Science · doi:10.1126/science.7770778 · Cited by 1,950 · see citing works

Steps toward Artificial Intelligence

Minsky, M. (1961) · Proceedings of the IRE · doi:10.1109/jrproc.1961.287775 · Cited by 1,706 · see citing works

Learning Automata: An Introduction

Narendra, K. S., & Thathachar, M. A. L. (1989) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,556 · see citing works

Connectionist learning procedures

Hinton, G. E. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90049-0 · Cited by 1,487 · see citing works

Stochastic Approximation Methods for Constrained and Unconstrained Systems

Kushner, H. J., & Clark, D. S. (1978) · Applied mathematical sciences · doi:10.1007/978-1-4684-9352-8 · Cited by 1,446 · see citing works

A Synaptically Controlled, Associative Signal for Hebbian Plasticity in Hippocampal Neurons

Magee, J. C., & Johnston, D. (1997) · Science · doi:10.1126/science.275.5297.209 · Cited by 1,303 · see citing works

Neural Networks with Dynamic Synapses

Tsodyks, M. V., Pawelzik, K. R., & Markram, H. (1998) · Neural Computation · doi:10.1162/089976698300017502 · Cited by 950 · see citing works

Redistribution of synaptic efficacy between neocortical pyramidal neurons

Markram, H., & Tsodyks, M. V. (1996) · Nature · doi:10.1038/382807a0 · Cited by 856 · see citing works

Cerebellar Long-Term Depression: Characterization, Signal Transduction, and Functional Roles

Ito, M. (2001) · Physiological Reviews · doi:10.1152/physrev.2001.81.3.1143 · Cited by 832 · see citing works

Practical issues in temporal difference learning

Tesauro, G. J. (1992) · Machine Learning · doi:10.1007/bf00992697 · Cited by 798 · see citing works

Temporal credit assignment in reinforcement learning

Sutton, R. S. (1984) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 769 · see citing works

Chaotic Balanced State in a Model of Cortical Circuits

van Vreeswijk, C., & Sompolinsky, H. (1998) · Neural Computation · doi:10.1162/089976698300017214 · Cited by 711 · see citing works

Proceedings of the 1988 Connectionist Models Summer School

Touretzsky, D., Hinton, G. E., & B, T. J. S. A. (1989) · Morgan Kaufmann eBooks · Cited by 611 · see citing works

Society of mind

Minsky, M. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90036-j · Cited by 555 · see citing works

Infinite-Horizon Policy-Gradient Estimation

Baxter, J., & Bartlett, P. L. (2001) · Cited by 525 · see citing works

Searching for the Memory Trace in a Mini-Brain, the HoneybeePreprint

Menzel, R. (2001) · Learning & Memory · doi:10.1101/lm.38801 · Cited by 518 · see citing works

Synaptic Depression and the Temporal Response Characteristics of V1 Cells

Chance, F. S., Nelson, S. B., & Abbott, L. F. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-12-04785.1998 · Cited by 403 · see citing works

Changes in reliability of synaptic function as a mechanism for plasticity

Stevens, C., & Wang, Y.-Y. (1994) · Nature · doi:10.1038/371704a0 · Cited by 399 · see citing works

Facilitation, augmentation and potentiation at central synapses

Thomson, A. M. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01580-0 · Cited by 387 · see citing works

Regulation of hippocampal transmitter release during development and long-term potentiation.

Bolshakov, V. Y., & Siegelbaum, S. (1995) · Science · doi:10.1126/science.7569903 · Cited by 385 · see citing works

Infinite-Horizon Policy-Gradient Estimation

Baxter, J., & Bartlett, P. L. (2001) · Journal of Artificial Intelligence Research · doi:10.1613/jair.806 · Cited by 343 · see citing works

Learning internal representations by back-propagating errors

Rumelhart, D. E. (1986) · Medical Entomology and Zoology · Cited by 337 · see citing works

Coding of temporal information by activity-dependent synapses.

Fuhrmann, G., Segev, I., Markram, H., & Tsodyks, M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00258.2001 · Cited by 267 · see citing works

Weight perturbation: an optimal architecture and learning technique for analog VLSI feedforward and recurrent multilayer networks

Jabri, M. A., & Flower, B. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.105429 · Cited by 231 · see citing works

A more biologically plausible learning rule for neural networks.

Mazzoni, P., Andersen, R. A., & Jordan, M. I. (1991) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.88.10.4433 · Cited by 227 · see citing works

Quantal release of neurotransmitter and long-term potentiation.

Stevens, C. (1993) · Cell · doi:10.1016/s0092-8674(05)80028-5 · Cited by 222 · see citing works

Neural Learning Rules for the Vestibulo-Ocular Reflex

Raymond, J. L., & Lisberger, S. G. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-21-09112.1998 · Cited by 213 · see citing works

A Fast Stochastic Error-Descent Algorithm for Supervised Learning and Optimization

Cauwenberghs, G. (1992) · CaltechAUTHORS (California Institute of Technology) · Cited by 146 · see citing works

Theory of neural-analog reinforcement systems and its application to the brain-model problem

Minsky, M. (1954) · Cited by 130 · see citing works

Kushner, H. J./Clark, D. S., Stochastic Approximation Methods for Constrained and Unconstrained Systems. (Applied Mathematical Sciences 26). Berlin‐Heidelberg‐New York, Springer‐Verlag 1978. X, 261 S., 4 Abb., DM 26,40. US $ 13.20

Nollau, V. (1980) · ZAMM ‐ Journal of Applied Mathematics and Mechanics / Zeitschrift für Angewandte Mathematik und Mechanik · doi:10.1002/zamm.19800600133 · Cited by 120 · see citing works

Long-Term Facilitation in Aplysia Involves Increase in Transmitter Release

Dale, N., Schacher, S., & Kandel, E. R. (1988) · Science · doi:10.1126/science.2892269 · Cited by 115 · see citing works

Alopex: A Correlation-Based Learning Algorithm for Feedforward and Recurrent Neural Networks

Unnikrishnan, K. P., & Venugopal, K. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.3.469 · Cited by 113 · see citing works

Learning Curves for Stochastic Gradient Descent in Linear Feedforward Networks

Werfel, J., Xie, X. S., & Seung, H. S. (2005) · Neural Computation · doi:10.1162/089976605774320539 · Cited by 112 · see citing works

The matching law

Davison, M. (1987) · Cited by 77 · see citing works

Foraging for brain stimulation: toward a neurobiology of computation

Gallistel, C. R. (1994) · Cognition · doi:10.1016/0010-0277(94)90026-4 · Cited by 73 · see citing works

Melioration: A Theory of Distributed Choice

Herrnstein, R., & Prélec, D. (1991) · The Journal of Economic Perspectives · doi:10.1257/jep.5.3.137 · Cited by 72 · see citing works

Quantifying song bout production during zebra finch sensory-motor learning suggests a sensitive period for vocal practice

Johnson, F., Soderstrom, K., & Whitney, O. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00374-6 · Cited by 61 · see citing works

Reinforcement Learning by Stochastic Hill Climbing on Discounted Reward

Kimura, H., Yamamura, M., & Kobayashi, S. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50044-x · Cited by 58 · see citing works

Correspondence

Ito, M. (1996) · Trends in Neurosciences · doi:10.1016/0166-2236(96)81860-1 · Cited by 50 · see citing works

Spike-Based Synaptic Plasticity and the Emergence of Direction Selective Simple Cells: Simulation Results

Buchs, N. J., & Senn, W. (2002) · Journal of Computational Neuroscience · doi:10.1023/a:1020210230751 · Cited by 49 · see citing works

Toward a Model of Intelligence as an Economy of Agents

Baum, E. B. (1999) · Machine Learning · doi:10.1023/a:1007593124513 · Cited by 41 · see citing works

Deep learning in neural networks: an overview

Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · see citing works

Neural syntax: cell assemblies, synapsembles, and readers

Buzsáki, G. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.023 · Cited by 1,289 · see citing works

Decision Making in Recurrent Neuronal Circuits

Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works

Theories of Error Back-Propagation in the Brain

Whittington, J. C. R., & Bogacz, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.005 · Cited by 420 · see citing works

A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales

Fusi, S., Asaad, W. F., Miller, E. K., & Wang, X.-J. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.017 · Cited by 199 · see citing works

Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances

Fiete, I. R., Fee, M. S., & Seung, H. S. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01311.2006 · Cited by 167 · see citing works

An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals

Iigaya, K., Fonseca, M. S., Murakami, M., Mainen, Z. F., & Dayan, P. (2018) · Nature Communications · doi:10.1038/s41467-018-04840-2 · Cited by 120 · see citing works

Toward an integration of deep learning and neuroscience

Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119 · see citing works

Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs

Millidge, B., Tschantz, A., & Buckley, C. L. (2022) · Neural Computation · doi:10.1162/neco_a_01497 · Cited by 95 · see citing works

Striatal action-value neurons reconsidered

Elber-Dorozko, L., & Loewenstein, Y. (2018) · eLife · doi:10.7554/elife.34248 · Cited by 53 · see citing works

Learning probabilistic neural representations with randomly connected circuits

Maoz, O., Tkačik, G., Esteki, M. S., Kiani, R., & Schneidman, E. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912804117 · Cited by 44 · see citing works

Use-Dependent Decline of Paired-Pulse Facilitation atAplysiaSensory Neuron Synapses Suggests a Distinct Vesicle Pool or Release Mechanism

Jiang, X., & Abrams, T. W. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10310.1998 · Cited by 49 · see citing works

The Role of CaV2.1 Channel Facilitation in Synaptic Facilitation

Weyrer, C., Turecek, J., Niday, Z., Liu, P. W., Nanou, E., Catterall, W. A., Bean, B. P., & Regehr, W. G. (2019) · Cell Reports · doi:10.1016/j.celrep.2019.01.114 · Cited by 17 · see citing works

Long-Term Synaptic Facilitation in the Absence of Short-Term Facilitation in Aplysia Neurons

Emptage, N. J., & Carew, T. J. (1993) · Science · doi:10.1126/science.8211146 · Cited by 193 · see citing works

Is synaptic facilitation caused by presynaptic spike broadening?

Zucker, R. S., & LARA-ESTRELLA, L. O. (1979) · Nature · doi:10.1038/278057a0 · Cited by 27 · see citing works

Role of Transforming Growth Factor-β in Long-Term Synaptic Facilitation in Aplysia

Zhang, F., Endo, S., Cleary, L. J., Eskin, A., & Byrne, J. H. (1997) · Science · doi:10.1126/science.275.5304.1318 · Cited by 180 · see citing works