The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes
Abstract
According to conventional neural network theories, single-hidden-layer feedforward networks (SLFNs) with additive or radial basis function (RBF) hidden nodes are universal approximators when all the parameters of the networks are allowed adjustable. However, as observed in most neural network implementations, tuning all the parameters of the networks may cause learning complicated and inefficient, and it may be difficult to train networks with nondifferential activation functions such as threshold networks. Unlike conventional neural network theories, this paper proves in an incremental constructive method that in order to let SLFNs work as universal approximators, one may simply randomly choose hidden nodes and then only need to adjust the output weights linking the hidden layer and the output layer. In such SLFNs implementations, the activation functions for additive nodes can be any bounded nonconstant piecewise continuous functions g : R --> R and the activation functions for RBF nodes can be any integrable piecewise continuous functions g : R --> R and integral of R g(x)dx not equal to 0. The proposed incremental method is efficient not only for SFLNs with continuous (including nondifferentiable) activation functions but also for SLFNs with piecewise continuous (such as threshold) activation functions. Compared to other popular methods such a new network is fully automatic and users need not intervene the learning process by manually tuning control parameters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
Self-citationUCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
A comparison of methods for multiclass support vector machines
Hsu, C.-W., & Lin, C.-J. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991427 · Cited by 6,838
Cited by
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
Self-citationThe graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,550
Self-citationA Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks
Liang, N.-Y., Huang, G.-B., Saratchandran, P., & Sundararajan, N. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.880583 · Cited by 1,965
Self-citationExtreme learning machines: a survey
Huang, G.-B., Wang, D. H., & Lan, Y. (2011) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-011-0019-y · Cited by 1,914
Self-citationTrends in extreme learning machines: A review
Huang, G., Huang, G.-B., Song, S., & You, K. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.001 · Cited by 1,732
Self-citationExtreme Learning Machine for Multilayer Perceptron
Tang, J., Deng, C., & Huang, G.-B. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2424995 · Cited by 1,451
Self-citationBenchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
Convex incremental extreme learning machine
Huang, G.-B., & Chen, L. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.02.009 · Cited by 1,139
Self-citationAn Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels
Huang, G.-B. (2014) · Cognitive Computation · doi:10.1007/s12559-014-9255-2 · Cited by 957
Self-citationNeural Networks and Deep Learning
Theodoridis, S. (2015) · Machine Learning · doi:10.1016/b978-0-12-801522-3.00018-5 · Cited by 900
Enhanced random search based incremental extreme learning machine
Huang, G.-B., & Chen, L. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.10.008 · Cited by 891
Self-citationOptimization method based extreme learning machine for classification
Huang, G.-B., Ding, X., & Zhou, H. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.02.019 · Cited by 869
Self-citationSemi-Supervised and Unsupervised Extreme Learning Machines
Huang, G., Song, S., Gupta, J. N. D., & Wu, C. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2307349 · Cited by 797
Self-citationOP-ELM: Optimally Pruned Extreme Learning Machine
Miche, Y., Sorjamaa, A., Bas, P., Simula, O., Jutten, C., & Lendasse, A. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2036259 · Cited by 765
Weighted extreme learning machine for imbalance learning
Zong, W., Huang, G.-B., & Chen, Y. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.08.010 · Cited by 743
Self-citationExtreme Learning Machines [Trends & Controversies]
Cambria, E., Huang, G.-B., Kasun, L. L. C., Zhou, H., Vong, C. M., Lin, J., Yin, J., Cai, Z., Liu, Q., Li, K., et al. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.140 · Cited by 710
Self-citationError Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning
Feng, G., Huang, G.-B., Lin, Q., & Gay, R. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2024147 · Cited by 654
Self-citationMetaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V. K., Abraham, A., & Snášel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 606
A review on extreme learning machine
Wang, J., Lu, S., Wang, S.-H., & Zhang, Y.-D. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11007-7 · Cited by 572
Huang, G.-B. (2015) · Cognitive Computation · doi:10.1007/s12559-015-9333-0 · Cited by 471
Self-citationA review on neural networks with random weights
Cao, W., Wang, X., Ming, Z., & Gao, J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.040 · Cited by 466
Predicting compressive strength of lightweight foamed concrete using extreme learning machine model
Yaseen, Z. M., Deo, R. C., Hilal, A., Abd, A. M., Bueno, L. C., Salcedo-Sanz, S., & Nehdi, M. L. (2018) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2017.09.004 · Cited by 434
Sales forecasting using extreme learning machine with applications in fashion retailing
Sun, Z.-L., Choi, T.-M., Au, K.-F., & Yu, Y. (2008) · Decision Support Systems · doi:10.1016/j.dss.2008.07.009 · Cited by 426
Neural networks: An overview of early research, current frameworks and new challenges
Prieto, A., Prieto, B., Ortigosa, E. M., Ros, E., Pelayo, F., Ortega, J., & Rojas, I. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.014 · Cited by 391
Domain Adaptation Extreme Learning Machines for Drift Compensation in E-Nose Systems
Zhang, L., & Zhang, D. (2015) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2014.2367775 · Cited by 368
A fast pruned-extreme learning machine for classification problem
Rong, H.-J., Ong, Y.-S., Tan, A.-H., & Zhu, Z. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.01.005 · Cited by 358
Voting based extreme learning machine
Cao, J., Lin, Z., Huang, G.-B., & Liu, N. (2012) · Information Sciences · doi:10.1016/j.ins.2011.09.015 · Cited by 356
Self-citationLocal Receptive Fields Based Extreme Learning Machine
Huang, G.-B., Bai, Z., Kasun, L. L. C., & Vong, C. M. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2405316 · Cited by 350
Self-citationSentic patterns: Dependency-based rules for concept-level sentiment analysis
Poria, S., Cambria, E., Winterstein, G., & Huang, G.-B. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.05.005 · Cited by 345
Self-citationDeep Learning for Medical Image-Based Cancer Diagnosis
Jiang, X., Hu, Z., Wang, S., & Zhang, Y. (2023) · Cancers · doi:10.3390/cancers15143608 · Cited by 345
Power Utility Nontechnical Loss Analysis With Extreme Learning Machine Method
Nizar, A. H., Dong, Z. Y., & Wang, Y. (2008) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2008.926431 · Cited by 342
Ensemble of online sequential extreme learning machine
Lan, Y., Soh, Y. C., & Huang, G.-B. (2009) · Neurocomputing · doi:10.1016/j.neucom.2009.02.013 · Cited by 334
Self-citationStream-flow forecasting using extreme learning machines: A case study in a semi-arid region in Iraq
Yaseen, Z. M., Jaafar, O., Deo, R. C., Kisi, O., Adamowski, J., Quilty, J., & El-Shafie, A. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2016.09.035 · Cited by 329
Taormina, R., & Chau, K.-W. (2015) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.08.022 · Cited by 329
Yao, L., & Ge, Z. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2733448 · Cited by 289
Self-Adaptive Evolutionary Extreme Learning Machine
Cao, J., Lin, Z., & Huang, G.-B. (2012) · Neural Processing Letters · doi:10.1007/s11063-012-9236-y · Cited by 286
Self-citationAn Efficient Method for Traffic Sign Recognition Based on Extreme Learning Machine
Huang, Z., Yu, Y., Gu, J., & Liu, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2533424 · Cited by 281
A Review of Machine Learning for Near-Infrared Spectroscopy
Zhang, W., Kasun, L. C., Wang, Q. J., Zheng, Y., & Lin, Z. (2022) · Sensors · doi:10.3390/s22249764 · Cited by 280
Dwivedi, V., & Srinivasan, B. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.12.099 · Cited by 278
Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping
Chen, X., Dong, Z. Y., Meng, K., Xu, Y., Wong, K. P., & Ngan, H. W. (2012) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2012.2190627 · Cited by 272
High-Performance Extreme Learning Machines: A Complete Toolbox for Big Data Applications
Akusok, A., Bjork, K.-M., Miche, Y., & Lendasse, A. (2015) · IEEE Access · doi:10.1109/access.2015.2450498 · Cited by 269
A study on effectiveness of extreme learning machine
Wang, Y., Cao, F., & Yuan, Y. (2011) · Neurocomputing · doi:10.1016/j.neucom.2010.11.030 · Cited by 269
Recent advances in neuro-fuzzy system: A survey
Shihabudheen, K. V., & Pillai, G. N. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.04.014 · Cited by 261
Incremental extreme learning machine with fully complex hidden nodes
Huang, G.-B., Li, M.-B., Chen, L., & Siew, C.-K. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.07.025 · Cited by 259
Self-citationA new intelligent method based on combination of VMD and ELM for short term wind power forecasting
Abdoos, A. A. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.03.054 · Cited by 259
A hybrid deep learning CNN–ELM for age and gender classification
Duan, M., Li, K., Yang, C., & Li, K. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.062 · Cited by 258
Chen, H.-L., Wang, G., Ma, C., Cai, Z.-N., Liu, W.-B., & Wang, S.-J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.138 · Cited by 256
Multi-kernel extreme learning machine for EEG classification in brain-computer interfaces
Zhang, Y., Wang, Y., Zhou, G., Jin, J., Wang, B., Wang, X., & Cichocki, A. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.12.015 · Cited by 255
Ensemble Based Extreme Learning Machine
Liu, N., & Wang, H. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2053356 · Cited by 254
Real-Time Learning Capability of Neural Networks
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.875974 · Cited by 253
Self-citationSong, Y., Crowcroft, J., & Zhang, J. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.07.003 · Cited by 252
Bridging the divide in financial market forecasting: machine learners vs. financial economists
Hsu, M.-W., Lessmann, S., Sung, M.-C., Ma, T., & Johnson, J. E. V. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.05.033 · Cited by 195
Non-iterative and Fast Deep Learning: Multilayer Extreme Learning Machines
Zhang, J., Li, Y., Xiao, W., & Zhang, Z. (2020) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2020.04.033 · Cited by 179
Clinical Human Gait Classification: Extreme Learning Machine Approach
Patil, P., Kumar, K. S., Gaud, N., & Semwal, V. B. (2019) · 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT) · doi:10.1109/icasert.2019.8934463 · Cited by 97
“As on today, due to its inherent complexities, bipedal robots are not efficient to work outside laboratory environment i.e. unstructured environments designed for humans and are controlled as fully-actuated system, which is not energy efficient [9].”
BackgroundDeo, R. C., Yaseen, Z. M., Al-Ansari, N., Nguyen-Huy, T., Langlands, T. A. M., & Galligan, L. (2020) · IEEE Access · doi:10.1109/access.2020.3010938 · Cited by 89
Distributed Routing Strategy Based on Machine Learning for LEO Satellite Network
Na, Z., Pan, Z., Liu, X., Deng, Z., Gao, Z., & Guo, Q. (2018) · Wireless Communications and Mobile Computing · doi:10.1155/2018/3026405 · Cited by 60
Lopez-Fandino, J., Quesada-Barriuso, P., Heras, D. B., & Arguello, F. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2384133 · Cited by 57
“[4] and [35] have proved that once they are randomly generated, the hidden node parameters (ai, bi) can remain fixed and training an SLFN is equivalent to finding a least-squares solution β̂ of the linear system Hβ = T, i.”
BackgroundExploring ELM-based spatial–spectral classification of hyperspectral images
Heras, D. B., Argüello, F., & Quesada-Barriuso, P. (2014) · International Journal of Remote Sensing · doi:10.1080/01431161.2013.869633 · Cited by 54
Tian, S., & Xu, K. (2017) · Metals · doi:10.3390/met7080311 · Cited by 48
Argüello, F., & Heras, D. B. (2015) · International Journal of Remote Sensing · doi:10.1080/01431161.2014.999882 · Cited by 27
Weighted extreme learning machine for P300 detection with application to brain computer interface
Kong, W., Guo, S., Long, Y., Peng, Y., Zeng, H., Zhang, X., & Zhang, J. (2023) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-018-0840-1 · Cited by 22
Online Learning of Oil Leak Anomalies in Wind Turbines with Block-Based Binary Reservoir
Cardoni, M., Pau, D. P., Falaschetti, L., Turchetti, C., & Lattuada, M. (2021) · Electronics · doi:10.3390/electronics10222836 · Cited by 17
Metadata
- Authors
- Huang, G.-B., Chen, L., & Siew, C.-K.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2006-07
- Volume
- 17
- Issue
- 4
- Pages
- 879-892
- ISSN
- 1045-9227 (ISSN-L)
- 1941-0093
- OpenAlex
- W2141695047
- Cited by
- 2,614
- References
- 48
- FWCI
- 39.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.