The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Spiking Neural Networks and online learning: An overview and perspectives
Open accessAbstract
Applications that generate huge amounts of data in the form of fast streams are becoming increasingly prevalent, being therefore necessary to learn in an online manner. These conditions usually impose memory and processing time restrictions, and they often turn into evolving environments where a change may affect the input data distribution. Such a change causes that predictive models trained over these stream data become obsolete and do not adapt suitably to new distributions. Specially in these non-stationary scenarios, there is a pressing need for new algorithms that adapt to these changes as fast as possible, while maintaining good performance scores. Unfortunately, most off-the-shelf classification models need to be retrained if they are used in changing environments, and fail to scale properly. Spiking Neural Networks have revealed themselves as one of the most successful approaches to model the behavior and learning potential of the brain, and exploit them to undertake practical online learning tasks. Besides, some specific flavors of Spiking Neural Networks can overcome the necessity of retraining after a drift occurs. This work intends to merge both fields by serving as a comprehensive overview, motivating further developments that embrace Spiking Neural Networks for online learning scenarios, and being a friendly entry point for non-experts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Hodgkin, A. L., & Huxley, A. F. (1952) · The Journal of Physiology · doi:10.1113/jphysiol.1952.sp004764 · Cited by 23,191
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Dementia prevention, intervention, and care
Livingston, G., Sommerlad, A., Orgeta, V., Costafreda, S. G., Huntley, J., Ames, D., Ballard, C., Banerjee, S., Burns, A., Cohen-Mansfield, J., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31363-6 · Cited by 6,072
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting
Izhikevich, E. M. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/2526.001.0001 · Cited by 3,765
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
Self-citationNetworks of spiking neurons: The third generation of neural network models
Maass, W. (1997) · Neural Networks · doi:10.1016/s0893-6080(97)00011-7 · Cited by 3,481
Apache Spark: A unified engine for big data processing
Zaharia, M., Xin, R. S., Wendell, P., Das, T., Armbrust, M., Dave, A., Meng, X., Rosen, J., Venkataraman, S., Franklin, M. J., et al. (2016) · Communications of the ACM · doi:10.1145/2934664 · Cited by 2,757
Spiking Neuron Models: Single Neurons, Populations, Plasticity
Wulfram Gerstner, B., & Kistler, W. M. (2002) · Cited by 2,028
Learning under Concept Drift: A Review
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2876857 · Cited by 1,603
Synaptic Modification by Correlated Activity: Hebb's Postulate Revisited
Bi, G.-Q., & Poo, M.-M. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.139 · Cited by 1,489
Furber, S. B., Galluppi, F., Temple, S., & Plana, L. A. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2304638 · Cited by 1,350
Explainable artificial intelligence: A survey
Dosilovic, F. K., Brcic, M., & Hlupic, N. (2018) · 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) · doi:10.23919/mipro.2018.8400040 · Cited by 1,147
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, S. M., Kok, J. N., & La Poutré, H. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00658-0 · Cited by 1,021
Carnevale, N. T., & Hines, M. L. (2006) · Cited by 874
The tempotron: a neuron that learns spike timing–based decisions
Gütig, R., & Sompolinsky, H. (2006) · Nature Neuroscience · doi:10.1038/nn1643 · Cited by 815
Spike-based strategies for rapid processing
Thorpe, S., Delorme, A., & Van Rullen, R. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00083-1 · Cited by 731
Spike Timing-Dependent Plasticity: From Synapse to Perception
Dan, Y., & Poo, M.-M. (2006) · Physiological Reviews · doi:10.1152/physrev.00030.2005 · Cited by 675
Diez-Olivan, A., Del Ser, J., Galar, D., & Sierra, B. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.10.005 · Cited by 633
Spatiotemporal firing patterns in the frontal cortex of behaving monkeys
Abeles, M., Bergman, H., Margalit, E., & Vaadia, E. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.4.1629 · Cited by 598
Bio-inspired computation: Where we stand and what's next
Del Ser, J., Osaba, E., Molina, D., Yang, X.-S., Salcedo-Sanz, S., Camacho, D., Das, S., Suganthan, P. N., Coello Coello, C. A., & Herrera, F. (2019) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2019.04.008 · Cited by 593
Self-citationA Survey on Ensemble Learning for Data Stream Classification
Gomes, H. M., Barddal, J. P., Enembreck, F., & Bifet, A. (2018) · ACM Computing Surveys · doi:10.1145/3054925 · Cited by 579
Self-citationWebb, G. I., Hyde, R., Cao, H., Nguyen, H. L., & Petitjean, F. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-015-0448-4 · Cited by 536
Brian: a simulator for spiking neural networks in Python
Goodman, D. (2008) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.005.2008 · Cited by 518
A survey on data preprocessing for data stream mining: Current status and future directions
Ramírez-Gallego, S., Krawczyk, B., García, S., Woźniak, M., & Herrera, F. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.078 · Cited by 502
Chen, Z., & Liu, B. (2018) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01581-6 · Cited by 466
Kasabov, N. K. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.01.006 · Cited by 454
Self-citationIncremental on-line learning: A review and comparison of state of the art algorithms
Losing, V., Hammer, B., & Wersing, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.06.084 · Cited by 382
An Overview of Concept Drift Applications
Žliobaitė, I., Pechenizkiy, M., & Gama, J. (2016) · Studies in Big Data · doi:10.1007/978-3-319-26989-4_4 · Cited by 379
Introduction to spiking neural networks: Information processing, learning and applications
Ponulak, 2., & Kasinski, A. (2011) · Acta Neurobiologiae Experimentalis · doi:10.55782/ane-2011-1862 · Cited by 368
A Systematic Study of Online Class Imbalance Learning With Concept Drift
Wang, S., Minku, L. L., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2771290 · Cited by 331
Markram, H. (2012) · Scientific American · doi:10.1038/scientificamerican0612-50 · Cited by 322
Samza: Stateful scalable stream processing at LinkedIn
Noghabi, S. A., Paramasivam, K., Pan, Y., Ramesh, N., Bringhurst, J., Gupta, I., & Campbell, R. H. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137765.3137770 · Cited by 276
Scikit-Multiflow: A Multi-output Streaming Framework
Montiel, J., Read, J., Bifet, A., & Abdessalem, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.04662 · Cited by 271
Self-citationCanevelli, M., Grande, G., Lacorte, E., Quarchioni, E., Cesari, M., Mariani, C., Bruno, G., & Vanacore, N. (2016) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2016.06.020 · Cited by 226
Discussion and review on evolving data streams and concept drift adapting
Khamassi, I., Sayed-Mouchaweh, M., Hammami, M., & Ghédira, K. (2018) · Evolving Systems · doi:10.1007/s12530-016-9168-2 · Cited by 223
Deep learning for segmentation of brain tumors: Impact of cross‐institutional training and testing
AlBadawy, E. A., Saha, A., & Mazurowski, M. A. (2018) · Medical Physics · doi:10.1002/mp.12752 · Cited by 208
What Can a Neuron Learn with Spike-Timing-Dependent Plasticity?
Legenstein, R., Naeger, C., & Maass, W. (2005) · Neural Computation · doi:10.1162/0899766054796888 · Cited by 207
The chronotron: a neuron that learns to fire temporally-precise spike patterns
Florian, R. (2010) · Nature Precedings · doi:10.1038/npre.2010.5190.1 · Cited by 204
A Survey of Robotics Control Based on Learning-Inspired Spiking Neural Networks
Bing, Z., Meschede, C., Röhrbein, F., Huang, K., & Knoll, A. C. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00035 · Cited by 187
Machine Learning for Data Streams: With Practical Examples in Moa
Bifet, A., Gavaldà, R., Holmes, G., & Pfahringer, B. (2018) · Project Muse (Johns Hopkins University) · Cited by 175
Self-citationTo spike or not to spike: A probabilistic spiking neuron model
Kasabov, N. K. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.08.010 · Cited by 174
Self-citationBig Data Analysis: Apache Storm Perspective
SZABIST, Hussain Iqbal, M., & Rahim Soomro, T. (2015) · International Journal of Computer Trends and Technology · doi:10.14445/22312803/ijctt-v19p103 · Cited by 169
A large-scale comparison of concept drift detectors
Barros, R. S. M., & Santos, S. G. T. C. (2018) · Information Sciences · doi:10.1016/j.ins.2018.04.014 · Cited by 164
Evolving spiking neural network—a survey
Schliebs, S., & Kasabov, N. (2013) · Evolving Systems · doi:10.1007/s12530-013-9074-9 · Cited by 159
Self-citationvan Albada, S. J., Rowley, A. G. D., Senk, J., Hopkins, M., Schmidt, M., Stokes, A. B., Lester, D., Diesmann, M., & Furber, S. B. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00291 · Cited by 158
Chen, Z., & Liu, B. (2018) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.2200/s00737ed1v01y201610aim033 · Cited by 154
SAMOA: scalable advanced massive online analysis
Morales, G. D. F., & Bifet, A. (2015) · Cited by 148
Self-citationComparison of supervised learning methods for spike time coding in spiking neural networks
Kasiński, A., & Ponulak, F. (2006) · Digital library of Zielona Gora (University of Zielona Góra) · Cited by 140
ANNarchy: a code generation approach to neural simulations on parallel hardware
Vitay, J., Dinkelbach, H. Ü., & Hamker, F. H. (2015) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2015.00019 · Cited by 116
A spiking neural model of adaptive arm control
DeWolf, T., Stewart, T. C., Slotine, J.-J. E., & Eliasmith, C. (2016) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.2134 · Cited by 109
PCSIM: A Parallel Simulation Environment for Neural Circuits Fully Integrated with Python
Pecevski, D., Natschläger, T., & Schuch, K. (2009) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.011.2009 · Cited by 103
Evolving Spiking Neural Networks for online learning over drifting data streams
Lobo, J. L., Laña, I., Ser, J. D., Bilbao, M. N., & Kasabov, N. K. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.014 · Cited by 87
Self-citationKNOWLEDGE EXTRACTION FROM EVOLVING SPIKING NEURAL NETWORKS WITH RANK ORDER POPULATION CODING
Soltic, S., & Kasabov, N. K. (2010) · International Journal of Neural Systems · doi:10.1142/s012906571000253x · Cited by 69
Self-citationWang, J., Belatreche, A., Maguire, L., et al. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2501322 · Cited by 56
Lobo, J. L., Ser, J. D., Bilbao, M. N., Perfecto, C., & Salcedo‐Sanz, S. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.10.004 · Cited by 27
Self-citationOnline Machine Learning in Big Data StreamsPreprint
Benczúr, A. A., Kocsis, L., & Pálovics, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05872 · Cited by 23
Drift Detection over Non-stationary Data Streams Using Evolving Spiking Neural Networks
Lobo, J. L., Ser, J. D., Laña, I., Bilbao, M. N., & Kasabov, N. K. (2018) · Studies in computational intelligence · doi:10.1007/978-3-319-99626-4_8 · Cited by 18
Self-citation
Cited by
From concept drift to model degradation: An overview on performance-aware drift detectors
Bayram, F., Ahmed, B. S., & Kassler, A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108632 · Cited by 407
Supervised learning in spiking neural networks: A review of algorithms and evaluations
Wang, X., Lin, X., & Dang, X. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.02.011 · Cited by 277
Quantitative phase imaging based on holography: trends and new perspectives
Huang, Z., & Cao, L. (2024) · Light: Science & Applications · doi:10.1038/s41377-024-01453-x · Cited by 277
Almulla, M. A., & Al-Rahmi, W. M. (2023) · Sustainability · doi:10.3390/su15053978 · Cited by 130
Metadata
- Authors
- Lobo, J. L., Del Ser, J., Bifet, A., & Kasabov, N.
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 121
- Pages
- 88-100
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W2969231383
- Cited by
- 304
- References
- 64
- FWCI
- 10.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.