The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Extreme Learning Machine for Regression and Multiclass Classification
Abstract
Due to the simplicity of their implementations, least square support vector machine (LS-SVM) and proximal support vector machine (PSVM) have been widely used in binary classification applications. The conventional LS-SVM and PSVM cannot be used in regression and multiclass classification applications directly, although variants of LS-SVM and PSVM have been proposed to handle such cases. This paper shows that both LS-SVM and PSVM can be simplified further and a unified learning framework of LS-SVM, PSVM, and other regularization algorithms referred to extreme learning machine (ELM) can be built. ELM works for the "generalized" single-hidden-layer feedforward networks (SLFNs), but the hidden layer (or called feature mapping) in ELM need not be tuned. Such SLFNs include but are not limited to SVM, polynomial network, and the conventional feedforward neural networks. This paper shows the following: 1) ELM provides a unified learning platform with a widespread type of feature mappings and can be applied in regression and multiclass classification applications directly; 2) from the optimization method point of view, ELM has milder optimization constraints compared to LS-SVM and PSVM; 3) in theory, compared to ELM, LS-SVM and PSVM achieve suboptimal solutions and require higher computational complexity; and 4) in theory, ELM can approximate any target continuous function and classify any disjoint regions. As verified by the simulation results, ELM tends to have better scalability and achieve similar (for regression and binary class cases) or much better (for multiclass cases) generalization performance at much faster learning speed (up to thousands times) than traditional SVM and LS-SVM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
Self-citationGolub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., et al. (1999) · Science · doi:10.1126/science.286.5439.531 · Cited by 11,516
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
A comparison of methods for multiclass support vector machines
Hsu, C.-W., & Lin, C.-J. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991427 · Cited by 6,838
Support Vector Regression Machines
Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. N. (1996) · Cited by 4,658
Extreme learning machine: a new learning scheme of feedforward neural networks
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2005) · 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541) · doi:10.1109/ijcnn.2004.1380068 · Cited by 4,084
Self-citationNeural Information Processing Systems
(2018) · The Deep Learning Revolution · doi:10.7551/mitpress/11474.003.0014 · Cited by 3,730
Least Squares Support Vector Machines
Suykens, J. A. K., Van Gestel, T., De Brabanter, J., De Moor, B., & Vandewalle, J. (2002) · WORLD SCIENTIFIC eBooks · doi:10.1142/5089 · Cited by 3,642
Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes
Huang, G.-B., Chen, L., & Siew, C.-K. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.875977 · Cited by 2,614
Self-citationGeneralized Inverse of Matrices and Its Applications
Banerjee, K. S. (1973) · Technometrics · doi:10.1080/00401706.1973.10489026 · Cited by 2,310
A database for handwritten text recognition research
Hull, J. J. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.291440 · Cited by 2,244
A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks
Liang, N.-Y., Huang, G.-B., Saratchandran, P., & Sundararajan, N. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.880583 · Cited by 1,965
Self-citationRidge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.2307/1267351 · Cited by 1,955
Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms
White, B. W., & Rosenblatt, F. (1963) · The American Journal of Psychology · doi:10.2307/1419730 · Cited by 1,792
Generalized Inverse of Matrices and its Applications
Mayne, A. J. (1972) · Journal of the Operational Research Society · doi:10.1057/jors.1972.96 · Cited by 1,212
Bartlett, P. L. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.661502 · Cited by 1,166
Least Squares Support Vector Machines
Suykens, J. A. K., Gestel, T. V., Brabanter, J. D., Moor, B. D., & Vandewalle, J. P. L. (2002) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789812776655 · Cited by 1,166
Convex incremental extreme learning machine
Huang, G.-B., & Chen, L. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.02.009 · Cited by 1,139
Self-citationEnhanced random search based incremental extreme learning machine
Huang, G.-B., & Chen, L. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.10.008 · Cited by 891
Self-citationOptimization method based extreme learning machine for classification
Huang, G.-B., Ding, X., & Zhou, H. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.02.019 · Cited by 869
Self-citationProximal support vector machine classifiers
Fung, G., & Mangasarian, O. L. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502527 · Cited by 842
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
OP-ELM: Optimally Pruned Extreme Learning Machine
Miche, Y., Sorjamaa, A., Bas, P., Simula, O., Jutten, C., & Lendasse, A. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2036259 · Cited by 765
Practical Methods of Optimization. Volume 1: Unconstrained Optimization
Williams, T. (1980) · Cited by 697
Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning
Feng, G., Huang, G.-B., Lin, Q., & Gay, R. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2024147 · Cited by 654
Self-citationMatrices: theory and applications
(2003) · Choice Reviews Online · doi:10.5860/choice.40-4658 · Cited by 648
RSVM: Reduced Support Vector Machines
Lee, Y.-J., & Mangasarian, O. L. (2001) · Proceedings of the 2001 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972719.13 · Cited by 647
Fast Kernel Classifiers With Online And Active Learning
Bordes, A., Ertekin, Ş., Weston, J., & Bottou, L. (2005) · Cited by 616
Principles of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms.
Orbach, J. (1962) · Archives of General Psychiatry · doi:10.1001/archpsyc.1962.01720030064010 · Cited by 512
Regularized Extreme Learning Machine
Deng, W., Zheng, Q., & Chen, L. (2009) · 2009 IEEE Symposium on Computational Intelligence and Data Mining · doi:10.1109/cidm.2009.4938676 · Cited by 454
A Parallel Mixture of SVMs for Very Large Scale Problems
Collobert, R., Bengio, S., & Bengio, Y. (2002) · Neural Computation · doi:10.1162/089976602753633402 · Cited by 359
Can threshold networks be trained directly?
Huang, G.-B., Zhu, Q.-Y., Mao, K. Z., Siew, C.-K., Saratchandran, P., & Sundararajan, N. (2006) · IEEE Transactions on Circuits and Systems II: Express Briefs · doi:10.1109/tcsii.2005.857540 · Cited by 266
Self-citationClassification ability of single hidden layer feedforward neural networks
Huang, G.-B., Chen, Y.-Q., & Babri, H. A. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.846750 · Cited by 261
Self-citationIncremental extreme learning machine with fully complex hidden nodes
Huang, G.-B., Li, M.-B., Chen, L., & Siew, C.-K. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.07.025 · Cited by 259
Self-citationAutomated star/galaxy discrimination with neural networks
Odewahn, S. C., Stockwell, E. B., Pennington, R. L., Humphreys, R. M., & Zumach, W. A. (1992) · The Astronomical Journal · doi:10.1086/116063 · Cited by 196
Espinoza, M., Suykens, J. A. K., Belmans, R. J. M., & Moor, B. D. (2007) · IEEE Control Systems · doi:10.1109/mcs.2007.904656 · Cited by 164
Multiclass least squares support vector machines
Suykens, J. A. K., & Vandewalle, J. (2003) · IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339) · doi:10.1109/ijcnn.1999.831072 · Cited by 158
Benchmarking a reduced multivariate polynomial pattern classifier
Toh, K., Tran, Q.-L., & Srinivasan, D. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.3 · Cited by 129
Extreme Support Vector Machine Classifier
Liu, Q., He, Q., & Shi, Z. (2008) · Springer eBooks · doi:10.1007/978-3-540-68125-0_21 · Cited by 127
Automated Star/Galaxy Discrimination with Neural Networks
Odewahn, S. C., Stockwell, E. B., Pennington, R. L., Humphreys, R. M., & Zumach, W. (1992) · Astrophysics and space science library · doi:10.1007/978-94-011-2472-0_28 · Cited by 127
Optimized fixed-size kernel models for large data sets
Brabanter, K. D., Brabanter, J. D., Suykens, J. A. K., & Moor, B. D. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.01.024 · Cited by 103
Espinoza, M., Suykens, J. A. K., & Moor, B. D. (2006) · Computational Management Science · doi:10.1007/s10287-005-0003-7 · Cited by 101
Deterministic Neural Classification
Toh, K. (2008) · Neural Computation · doi:10.1162/neco.2007.04-07-508 · Cited by 100
Partial Lanczos extreme learning machine for single-output regression problems
Tang, X., & Han, M. (2009) · Neurocomputing · doi:10.1016/j.neucom.2009.03.016 · Cited by 58
Fast Modular Network Implementation for Support Vector Machines
Huang, G.-B., Mao, K., Siew, C. K., & Huang, D. S. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.857952 · Cited by 54
Self-citationMulticlass LS-SVMs: Moderated Outputs and Coding-Decoding Schemes
Gestel, T. V., Suykens, J. A. K., Lanckriet, G. R. G., Lambrechts, A., Moor, B. D., & Vandewalle, J. P. L. (2002) · Neural Processing Letters · doi:10.1023/a:1013815310229 · Cited by 43
Multiclass Proximal Support Vector Machines
Tang, Y., & Zhang, H. H. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x113647 · Cited by 23
Sparse conjugate directions pursuit with application to fixed-size kernel models
Karsmakers, P., Kristiaan Pelckmans, A., Brabanter, K. D., hamme, H. V., & Suykens, J. A. K. (2011) · Machine Learning · doi:10.1007/s10994-011-5253-8 · Cited by 19
Cited by
Trends in extreme learning machines: A review
Huang, G., Huang, G.-B., Song, S., & You, K. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.001 · Cited by 1,732
Self-citationGraph-based approach for airborne light detection and ranging segmentation
Vilariño, D. L., Cabaleiro, J. C., Martínez, J., Rivera, F. F., & Pena, T. F. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.015020 · Cited by 1,721
Extreme Learning Machine for Multilayer Perceptron
Tang, J., Deng, C., & Huang, G.-B. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2424995 · Cited by 1,451
Self-citationBenchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
Digital twin driven prognostics and health management for complex equipment
Tao, F., Zhang, M., Liu, Y., & Nee, A. Y. C. (2018) · CIRP Annals · doi:10.1016/j.cirp.2018.04.055 · Cited by 1,000
Metadata
- Authors
- Huang, G.-B., Zhou, H., Ding, X., & Zhang, R.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Published
- 2012-04
- Volume
- 42
- Issue
- 2
- Pages
- 513-529
- ISSN
- 1083-4419 (ISSN-L)
- 1941-0492
- OpenAlex
- W2026131661
- Cited by
- 5,550
- References
- 54
- FWCI
- 153.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.