The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks
Abstract
In this paper, we develop an online sequential learning algorithm for single hidden layer feedforward networks (SLFNs) with additive or radial basis function (RBF) hidden nodes in a unified framework. The algorithm is referred to as online sequential extreme learning machine (OS-ELM) and can learn data one-by-one or chunk-by-chunk (a block of data) with fixed or varying chunk size. The activation functions for additive nodes in OS-ELM can be any bounded nonconstant piecewise continuous functions and the activation functions for RBF nodes can be any integrable piecewise continuous functions. In OS-ELM, the parameters of hidden nodes (the input weights and biases of additive nodes or the centers and impact factors of RBF nodes) are randomly selected and the output weights are analytically determined based on the sequentially arriving data. The algorithm uses the ideas of ELM of Huang et al. developed for batch learning which has been shown to be extremely fast with generalization performance better than other batch training methods. Apart from selecting the number of hidden nodes, no other control parameters have to be manually chosen. Detailed performance comparison of OS-ELM is done with other popular sequential learning algorithms on benchmark problems drawn from the regression, classification and time series prediction areas. The results show that the OS-ELM is faster than the other sequential algorithms and produces better generalization performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
Self-citationUCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Golub, G. H., & Loan, C. F. V. (1996) · Johns Hopkins University Press eBooks · Cited by 6,027
Oscillation and Chaos in Physiological Control Systems
Mackey, M. C., & Glass, L. (1977) · Science · doi:10.1126/science.267326 · Cited by 4,135
Universal Approximation Using Radial-Basis-Function Networks
Park, J., & Sandberg, I. W. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.246 · Cited by 4,112
Extreme learning machine: a new learning scheme of feedforward neural networks
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2005) · 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541) · doi:10.1109/ijcnn.2004.1380068 · Cited by 4,084
Self-citationLearning internal representations by error propagation
RUMELHART, D. E., HINTON, G. E., & WILLIAMS, R. J. (1988) · Readings in Cognitive Science · doi:10.1016/b978-1-4832-1446-7.50035-2 · Cited by 3,002
Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes
Huang, G.-B., Chen, L., & Siew, C.-K. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.875977 · Cited by 2,614
Self-citationGeneralized Inverse of Matrices and Its Applications
Banerjee, K. S. (1973) · Technometrics · doi:10.1080/00401706.1973.10489026 · Cited by 2,310
Cited by
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,550
Self-citationExtreme learning machines: a survey
Huang, G.-B., Wang, D. H., & Lan, Y. (2011) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-011-0019-y · Cited by 1,914
Self-citationTrends in extreme learning machines: A review
Huang, G., Huang, G.-B., Song, S., & You, K. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.001 · Cited by 1,732
Self-citationDeep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
Extreme Learning Machine for Multilayer Perceptron
Tang, J., Deng, C., & Huang, G.-B. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2424995 · Cited by 1,451
Self-citationBig data deep learning: Challenges and perspectives
Chen, X.-W., & Lin, X. (2014) · IEEE Access · doi:10.1109/access.2014.2325029 · Cited by 1,255
Convex incremental extreme learning machine
Huang, G.-B., & Chen, L. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.02.009 · Cited by 1,139
Self-citationEnhanced random search based incremental extreme learning machine
Huang, G.-B., & Chen, L. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.10.008 · Cited by 891
Self-citationOptimization method based extreme learning machine for classification
Huang, G.-B., Ding, X., & Zhou, H. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.02.019 · Cited by 869
Self-citationSemi-Supervised and Unsupervised Extreme Learning Machines
Huang, G., Song, S., Gupta, J. N. D., & Wu, C. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2307349 · Cited by 797
Self-citationOnline learning: A comprehensive survey
Hoi, S. C. H., Sahoo, D., Lu, J., & Zhao, P. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.112 · Cited by 746
Extreme Learning Machines [Trends & Controversies]
Cambria, E., Huang, G.-B., Kasun, L. L. C., Zhou, H., Vong, C. M., Lin, J., Yin, J., Cai, Z., Liu, Q., Li, K., et al. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.140 · Cited by 710
Self-citationError Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning
Feng, G., Huang, G.-B., Lin, Q., & Gay, R. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2024147 · Cited by 654
Self-citationExtreme learning machine: algorithm, theory and applications
Ding, S., Zhao, H., Zhang, Y., Xu, X., & Nie, R. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-013-9405-z · Cited by 593
Artificial Intelligence and COVID-19: Deep Learning Approaches for Diagnosis and Treatment
Jamshidi, M., Lalbakhsh, A., Talla, J., Peroutka, Z., Hadjilooei, F., Lalbakhsh, P., Jamshidi, M., Spada, L. L., Mirmozafari, M., Dehghani, M., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3001973 · Cited by 551
Khan, A. A., Chaudhari, O., & Chandra, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122778 · Cited by 530
Regularized Extreme Learning Machine
Deng, W., Zheng, Q., & Chen, L. (2009) · 2009 IEEE Symposium on Computational Intelligence and Data Mining · doi:10.1109/cidm.2009.4938676 · Cited by 454
Tang, J., Deng, C., Huang, G.-B., & Zhao, B. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2335751 · Cited by 407
Self-citationFrom concept drift to model degradation: An overview on performance-aware drift detectors
Bayram, F., Ahmed, B. S., & Kassler, A. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108632 · Cited by 407
Incremental on-line learning: A review and comparison of state of the art algorithms
Losing, V., Hammer, B., & Wersing, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.06.084 · Cited by 382
Machine learning and integrative analysis of biomedical big data
Mirza, B., Wang, W., Wang, J., Choi, H., Chung, N. C., & Ping, P. (2019) · Genes · doi:10.3390/genes10020087 · Cited by 380
Review of soft sensor methods for regression applications
Souza, F. A. A., Araújo, R., & Mendes, J. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2015.12.011 · Cited by 345
Power Utility Nontechnical Loss Analysis With Extreme Learning Machine Method
Nizar, A. H., Dong, Z. Y., & Wang, Y. (2008) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2008.926431 · Cited by 342
Ensemble of online sequential extreme learning machine
Lan, Y., Soh, Y. C., & Huang, G.-B. (2009) · Neurocomputing · doi:10.1016/j.neucom.2009.02.013 · Cited by 334
Self-citationA Systematic Study of Online Class Imbalance Learning With Concept Drift
Wang, S., Minku, L. L., & Yao, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2771290 · Cited by 331
Deterministic wind energy forecasting: A review of intelligent predictors and auxiliary methods
Liu, H., Chen, C., Lv, X., Wu, X., & Liu, M. (2019) · Energy Conversion and Management · doi:10.1016/j.enconman.2019.05.020 · Cited by 294
Direct Quantile Regression for Nonparametric Probabilistic Forecasting of Wind Power Generation
Wan, C., Lin, J., Wang, J., Song, Y., & Dong, Z. Y. (2017) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2016.2625101 · Cited by 289
Self-Adaptive Evolutionary Extreme Learning Machine
Cao, J., Lin, Z., & Huang, G.-B. (2012) · Neural Processing Letters · doi:10.1007/s11063-012-9236-y · Cited by 286
Self-citationHigh-Performance Extreme Learning Machines: A Complete Toolbox for Big Data Applications
Akusok, A., Bjork, K.-M., Miche, Y., & Lendasse, A. (2015) · IEEE Access · doi:10.1109/access.2015.2450498 · Cited by 269
Singh, R., Kumar, H., & Singla, R. K. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.07.015 · Cited by 262
Recent advances in neuro-fuzzy system: A survey
Shihabudheen, K. V., & Pillai, G. N. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.04.014 · Cited by 261
Non-iterative and Fast Deep Learning: Multilayer Extreme Learning Machines
Zhang, J., Li, Y., Xiao, W., & Zhang, Z. (2020) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2020.04.033 · Cited by 179
A State-of-the-Art Review of EEG-Based Imagined Speech Decoding
Lopez-Bernal, D., Balderas, D., Ponce, P., & Molina, A. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.867281 · Cited by 107
“…(Riaz et al., 2014; Bakhshali et al., 2020; Agarwal and Kumar, 2021; Rao, 2021; Dash et al., 2022), Naive Bayes (Dash et al., 2020a; Agarwal and Kumar, 2021; Iliopoulos and Papasotiriou, 2021; Lee et al., 2021b), and Relevance Vector Machines (RVM) (Liang et al., 2006; Matsumoto and Hori, 2014).”
BackgroundParallel online sequential extreme learning machine based on MapReduce
Wang, B., Huang, S., Qiu, J., Liu, Y., & Wang, G. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.03.076 · Cited by 102
Voice Pathology Detection and Classification by Adopting Online Sequential Extreme Learning Machine
Al-Dhief, F. T., Baki, M. M., Latiff, N. M. A., Malik, N. N. N. A., Salim, N. S., Albader, M. A. A., Mahyuddin, N. M., & Mohammed, M. A. (2021) · IEEE Access · doi:10.1109/access.2021.3082565 · Cited by 102
Novel Online Sequential Learning-Based Adaptive Routing for Edge Software-Defined Vehicular Networks
Zhao, L., Zhao, W., Hawbani, A., Al-Dubai, A. Y., Min, G., Zomaya, A. Y., & Gong, C. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3046275 · Cited by 95
Deo, R. C., Yaseen, Z. M., Al-Ansari, N., Nguyen-Huy, T., Langlands, T. A. M., & Galligan, L. (2020) · IEEE Access · doi:10.1109/access.2020.3010938 · Cited by 89
Online human activity recognition using low-power wearable devices
Bhat, G., Deb, R., Chaurasia, V. V., Shill, H., & Ogras, U. Y. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3240833 · Cited by 82
A Neural Network-Based On-device Learning Anomaly Detector for Edge Devices
Tsukada, M., Kondo, M., & Matsutani, H. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2973631 · Cited by 81
Janakiraman, V. M., Nguyen, X., & Assanis, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.11.024 · Cited by 53
Frances-Villora, J. V., Rosado-Muñoz, A., Martínez-Villena, J. M., Bataller-Mompean, M., Guerrero, J. F., & Wegrzyn, M. (2016) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2016.02.007 · Cited by 49
Tian, S., & Xu, K. (2017) · Metals · doi:10.3390/met7080311 · Cited by 48
Human activity recognition in cognitive environments using sequential ELM
Chandan Kumar, R., Bharadwaj, S. S., Sumukha, B. N., & George, K. (2016) · 2016 Second International Conference on Cognitive Computing and Information Processing (CCIP) · doi:10.1109/ccip.2016.7802880 · Cited by 8
“Evidently, the training time is much faster than BPA as the requirement for iterations is completely eliminated.”
BackgroundMethod
Metadata
- Authors
- Liang, N.-Y., Huang, G.-B., Saratchandran, P., & Sundararajan, N.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2006-11
- Volume
- 17
- Issue
- 6
- Pages
- 1411-1423
- ISSN
- 1045-9227 (ISSN-L)
- 1941-0093
- OpenAlex
- W2158054309
- Cited by
- 1,965
- References
- 35
- FWCI
- 18.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.