The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Semi-Supervised and Unsupervised Extreme Learning Machines
Abstract
Extreme learning machines (ELMs) have proven to be efficient and effective learning mechanisms for pattern classification and regression. However, ELMs are primarily applied to supervised learning problems. Only a few existing research papers have used ELMs to explore unlabeled data. In this paper, we extend ELMs for both semi-supervised and unsupervised tasks based on the manifold regularization, thus greatly expanding the applicability of ELMs. The key advantages of the proposed algorithms are as follows: 1) both the semi-supervised ELM (SS-ELM) and the unsupervised ELM (US-ELM) exhibit learning capability and computational efficiency of ELMs; 2) both algorithms naturally handle multiclass classification or multicluster clustering; and 3) both algorithms are inductive and can handle unseen data at test time directly. Moreover, it is shown in this paper that all the supervised, semi-supervised, and unsupervised ELMs can actually be put into a unified framework. This provides new perspectives for understanding the mechanism of random feature mapping, which is the key concept in ELM theory. Empirical study on a wide range of data sets demonstrates that the proposed algorithms are competitive with the state-of-the-art semi-supervised or unsupervised learning algorithms in terms of accuracy and efficiency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
Self-citationThe Nature of Statistical Learning Theory
Vapnik, V. N. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3264-1 · Cited by 10,696
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
On Spectral Clustering: Analysis and an algorithm
Ng, A. Y., Jordan, M. I., & Weiss, Y. (2001) · Cited by 8,159
Training feedforward networks with the Marquardt algorithm
Hagan, M. T., & Menhaj, M. B. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329697 · Cited by 7,701
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,621
Combinatorial Optimization: Algorithms and Complexity.
Johnson, D. S., Papadimitriou, C. H., & Steiglitz, K. (1984) · The American Mathematical Monthly · doi:10.2307/2322374 · Cited by 5,942
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,550
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Semi-Supervised Learning Literature Survey
Zhu, X. (2005) · Minds at UW (University of Wisconsin) · Cited by 4,506
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
Extreme learning machine: a new learning scheme of feedforward neural networks
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2005) · 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541) · doi:10.1109/ijcnn.2004.1380068 · Cited by 4,084
Self-citation(2006) · Cited by 3,624
Orthogonal least squares learning algorithm for radial basis function networks
Chen, S., Cowan, C. F. N., & Grant, P. M. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80341 · Cited by 3,362
Transductive Inference for Text Classification using Support Vector Machines
Joachims, T. (1999) · Cited by 2,723
Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes
Huang, G.-B., Chen, L., & Siew, C.-K. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.875977 · Cited by 2,614
Self-citationParameterisation of a stochastic model for human face identification
Samaria, F. S., & Harter, A. C. (2002) · Proceedings of 1994 IEEE Workshop on Applications of Computer Vision · doi:10.1109/acv.1994.341300 · Cited by 2,593
Acquiring linear subspaces for face recognition under variable lighting
Lee, K.-C., Ho, J., & Kriegman, D. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.92 · Cited by 2,391
A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks
Liang, N.-Y., Huang, G.-B., Saratchandran, P., & Sundararajan, N. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.880583 · Cited by 1,965
Self-citationTraining with Noise is Equivalent to Tikhonov Regularization
Bishop, C. M. (1995) · Neural Computation · doi:10.1162/neco.1995.7.1.108 · Cited by 1,325
Lütkepohl, H. (1996) · Cited by 923
Weighted extreme learning machine for imbalance learning
Zong, W., Huang, G.-B., & Chen, Y. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.08.010 · Cited by 743
Self-citationA simple procedure for pruning back-propagation trained neural networks
Karnin, E. D. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80236 · Cited by 670
Wavelet Support Vector Machine
Zhang, L., Zhou, W., & Jiao, L. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.811113 · Cited by 510
Beyond the point cloud: from transductive to semi-supervised learning
Sindhwani, V., Niyogi, P., & Belkin, M. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102455 · Cited by 439
Optimization Techniques for Semi-Supervised Support Vector Machines
Chapelle, O., Sindhwani, V., & Keerthi, S. S. (2008) · MPG.PuRe (Max Planck Society) · doi:10.5555/1390681.1390688 · Cited by 401
Deep learning via semi-supervised embedding
Weston, J., Ratle, F., & Collobert, R. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390303 · Cited by 380
Semisupervised Neural Networks for Efficient Hyperspectral Image Classification
Ratle, F., Camps-Valls, G., & Weston, J. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2037898 · Cited by 316
Laplacian Support Vector Machines Trained in the Primal
Melacci, S., & Belkin, M. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0909.5422 · Cited by 311
A study on effectiveness of extreme learning machine
Wang, Y., Cao, F., & Yuan, Y. (2011) · Neurocomputing · doi:10.1016/j.neucom.2010.11.030 · Cited by 269
Classification ability of single hidden layer feedforward neural networks
Huang, G.-B., Chen, Y.-Q., & Babri, H. A. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.846750 · Cited by 261
Self-citationA fast nonlinear model identification method
Li, K., Peng, J.-X., & Irwin, G. W. (2005) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.852557 · Cited by 226
An RKHS for multi-view learning and manifold co-regularization
Sindhwani, V., & Rosenberg, D. S. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390279 · Cited by 221
Universal Approximation of Extreme Learning Machine With Adaptive Growth of Hidden Nodes
Zhang, R., Lan, Y., Huang, G.-B., & Xu, Z.-B. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2011.2178124 · Cited by 216
Self-citationLaplacian Support Vector Machines Trained in the Primal
MelacciStefano, & BelkinMikhail (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021038 · Cited by 216
Online sequential extreme learning machine with forgetting mechanism
Zhao, J., Wang, Z., & Park, D. S. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.02.003 · Cited by 180
Robust extreme learning machine
Horata, P., Chiewchanwattana, S., & Sunat, K. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.12.045 · Cited by 155
A comparative analysis of support vector machines and extreme learning machines
Liu, X., Gao, C., & Li, P. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.04.002 · Cited by 151
Extreme Support Vector Machine Classifier
Liu, Q., He, Q., & Shi, Z. (2008) · Springer eBooks · doi:10.1007/978-3-540-68125-0_21 · Cited by 131
(2013) · Cited by 131
Fast orthogonal least squares algorithm for efficient subset model selection
Chen, S., & Wigger, J. (1995) · IEEE Transactions on Signal Processing · doi:10.1109/78.398734 · Cited by 131
EEG-based vigilance estimation using extreme learning machines
Shi, L.-C., & Lu, B. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.02.041 · Cited by 129
Regularized extreme learning machine for regression with missing data
Yu, Q., Miché, Y., Eirola, E., van Heeswijk, M., Séverin, É., & Lendasse, A. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.02.040 · Cited by 128
A One-Layer Recurrent Neural Network for Support Vector Machine Learning
Xia, Y., & Wang, J. (2004) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2003.822955 · Cited by 99
Efficient Digital Implementation of Extreme Learning Machines for Classification
Decherchi, S., Gastaldo, P., Leoncini, A., & Zunino, R. (2012) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2012.2204112 · Cited by 92
Wang, X., Qing-yan, S., Miao, Q., & Zhai, J. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.12.053 · Cited by 90
SELM: Semi-supervised ELM with application in sparse calibrated location estimation
Liu, J., Chen, Y., Liu, M., et al. (2011) · Neurocomputing · doi:10.1016/j.neucom.2010.12.043 · Cited by 87
Robust Support Vector Regression for Uncertain Input and Output Data
Huang, G. M., Song, S., Wu, C., & You, K. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2212456 · Cited by 54
Self-citationOrthogonal Least Squares Algorithm for Training Cascade Neural Networks
Huang, G. M., Song, S., & Wu, C. (2012) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2012.2189060 · Cited by 43
Self-citationRobust Single-Hidden Layer Feedforward Network-Based Pattern Classifier
Man, Z., Lee, K., Wang, D., Cao, Z., & Khoo, S. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2218616 · Cited by 42
Cross-Domain Semi-Supervised Learning Using Feature Formulation
Xingquan Zhu, A. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2157999 · Cited by 26
Solution Path for Manifold Regularized Semisupervised Classification
Wang, G., Wang, F., Chen, T., Yeung, D., & Lochovsky, F. H. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168205 · Cited by 20
Cited by
Trends in extreme learning machines: A review
Huang, G., Huang, G.-B., Song, S., & You, K. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.001 · Cited by 1,732
Self-citationExtreme Learning Machine for Multilayer Perceptron
Tang, J., Deng, C., & Huang, G.-B. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2424995 · Cited by 1,451
Self-citationAn Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels
Huang, G.-B. (2014) · Cognitive Computation · doi:10.1007/s12559-014-9255-2 · Cited by 957
Self-citationA Systematic Review on Supervised and Unsupervised Machine Learning Algorithms for Data Science
Alloghani, M., Al-Jumeily, D., Mustafina, J., Hussain, A., & Aljaaf, A. J. (2020) · Unsupervised and Semi-Supervised Learning · doi:10.1007/978-3-030-22475-2_1 · Cited by 702
Huang, G.-B. (2015) · Cognitive Computation · doi:10.1007/s12559-015-9333-0 · Cited by 471
Self-citation
Metadata
- Authors
- Huang, G., Song, S., Gupta, J. N. D., & Wu, C.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2014-12
- Volume
- 44
- Issue
- 12
- Pages
- 2405-2417
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2042184006
- Cited by
- 797
- References
- 57
- FWCI
- 78.23
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.