The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Local Receptive Fields Based Extreme Learning Machine
Abstract
Extreme learning machine (ELM), which was originally proposed for "generalized" single-hidden layer feedforward neural networks (SLFNs), provides efficient unified learning solutions for the applications of feature learning, clustering, regression and classification. Different from the common understanding and tenet that hidden neurons of neural networks need to be iteratively adjusted during training stage, ELM theories show that hidden neurons are important but need not be iteratively tuned. In fact, all the parameters of hidden nodes can be independent of training samples and randomly generated according to any continuous probability distribution. And the obtained ELM networks satisfy universal approximation and classification capability. The fully connected ELM architecture has been extensively studied. However, ELM with local connections has not attracted much research attention yet. This paper studies the general architecture of locally connected ELM, showing that: 1) ELM theories are naturally valid for local connections, thus introducing local receptive fields to the input layer; 2) each hidden node in ELM can be a combination of several hidden nodes (a subnetwork), which is also consistent with ELM theories. ELM theories may shed a light on the research of different local receptive fields including true biological receptive fields of which the exact shapes and formula may be unknown to human beings. As a specific example of such general architectures, random convolutional nodes and a pooling structure are implemented in this paper. Experimental results on the NORB dataset, a benchmark for object recognition, show that compared with conventional deep learning solutions, the proposed local receptive fields based ELM (ELM-LRF) reduces the error rate from 6.5% to 2.7% and increases the learning speed up to 200 times.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Extreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Receptive fields and functional architecture of monkey striate cortex
Hubel, D. H., & Wiesel, T. N. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008455 · Cited by 6,568
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,550
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
An analysis of single-layer networks in unsupervised feature learning
Coates, A., Ng, A. Y., & Lee, H. (2011) · International Conference on Artificial Intelligence and Statistics · Cited by 4,675
Extreme learning machine: a new learning scheme of feedforward neural networks
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2005) · 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541) · doi:10.1109/ijcnn.2004.1380068 · Cited by 4,084
Self-citationFace recognition: a convolutional neural-network approach
Lawrence, S., Giles, C. L., Tsoi, A. C., & Back, A. D. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554195 · Cited by 3,092
Data-intensive applications, challenges, techniques and technologies: A survey on Big Data
Philip Chen, C. L., & Zhang, C.-Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.015 · Cited by 3,047
Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes
Huang, G.-B., Chen, L., & Siew, C.-K. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.875977 · Cited by 2,614
Self-citationLee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Adaptive pattern recognition and neural networks
(1989) · Choice Reviews Online · doi:10.5860/choice.26-6311 · Cited by 2,313
Generalized Inverse of Matrices and Its Applications
Banerjee, K. S. (1973) · Technometrics · doi:10.1080/00401706.1973.10489026 · Cited by 2,310
Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear Estimation
Marquardt, D. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488699 · Cited by 2,276
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153 · cited 2×
“Inspired by convolutional neural networks (CNNs) [22], one of such local receptive fields can be implemented by randomly generating convolutional hidden nodes and the universal approximation capability of such ELM can still be preserved.”
BackgroundMethodTrends in extreme learning machines: A review
Huang, G., Huang, G.-B., Song, S., & You, K. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.001 · Cited by 1,732
Self-citationEvaluation of Pooling Operations in Convolutional Architectures for Object Recognition
Scherer, D., Müller, A., & Behnke, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15825-4_10 · Cited by 1,503
Learning methods for generic object recognition with invariance to pose and lighting
LeCun, Y., Huang, F. J., & Bottou, L. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315150 · Cited by 1,324
Generalized Inverse of Matrices and its Applications
Mayne, A. J. (1972) · Journal of the Operational Research Society · doi:10.1057/jors.1972.96 · Cited by 1,212
Bartlett, P. L. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.661502 · Cited by 1,166
Convex incremental extreme learning machine
Huang, G.-B., & Chen, L. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.02.009 · Cited by 1,139
Self-citationLearning and generalization characteristics of the random vector functional-link net
Pao, Y.-H., Park, G.-H., & Sobajic, D. J. (1994) · Neurocomputing · doi:10.1016/0925-2312(94)90053-1 · Cited by 1,138
Efficient Learning of Sparse Representations with an Energy-Based Model
Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0147 · Cited by 1,106
Hawkins, J., & Blakeslee, S. (2004) · Cited by 1,012
An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels
Huang, G.-B. (2014) · Cognitive Computation · doi:10.1007/s12559-014-9255-2 · Cited by 957
Self-citationStochastic choice of basis functions in adaptive function approximation and the functional-link net
Igelnik, B., & Pao, Y.-H. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.471375 · Cited by 955
Enhanced random search based incremental extreme learning machine
Huang, G.-B., & Chen, L. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.10.008 · Cited by 891
Self-citationOptimization method based extreme learning machine for classification
Huang, G.-B., Ding, X., & Zhou, H. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.02.019 · Cited by 869
Self-citationSemi-Supervised and Unsupervised Extreme Learning Machines
Huang, G., Song, S., Gupta, J. N. D., & Wu, C. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2307349 · Cited by 797
Self-citationExtreme Learning Machines [Trends & Controversies]
Cambria, E., Huang, G.-B., Kasun, L. L. C., Zhou, H., Vong, C. M., Lin, J., Yin, J., Cai, Z., Liu, Q., Li, K., et al. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.140 · Cited by 710
Self-citationFeedforward neural networks with random weights
Schmidt, W. F., Kraaijveld, M. A., & Duin, R. P. W. (2003) · Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems · doi:10.1109/icpr.1992.201708 · Cited by 540
Testing for neglected nonlinearity in time series models
Lee, T.-H., White, H., & Granger, C. W. J. (1993) · Journal of Econometrics · doi:10.1016/0304-4076(93)90122-l · Cited by 498
Distinct representations of olfactory information in different cortical centres
Sosulski, D. L., Bloom, M. L., Cutforth, T., Axel, R., & Datta, S. R. (2011) · Nature · doi:10.1038/nature09868 · Cited by 479
Tiled convolutional neural networks
Ngiam, J., Chen, Z., Chia, D., Koh, P. W., Le, Q. V., & Ng, A. Y. (2010) · neural information processing systems · Cited by 361
3D Object Recognition with Deep Belief Nets
Nair, V. B., & Hinton, G. E. (2009) · neural information processing systems · Cited by 356
On Random Weights and Unsupervised Feature Learning
Saxe, A., Koh, P. W., Chen, Z., Bhand, M., Suresh, B., & Ng, A. Y. (2011) · Cited by 352
Power Utility Nontechnical Loss Analysis With Extreme Learning Machine Method
Nizar, A. H., Dong, Z. Y., & Wang, Y. (2008) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2008.926431 · Cited by 342
CONSISTENT SPECIFICATION TESTING WITH NUISANCE PARAMETERS PRESENT ONLY UNDER THE ALTERNATIVE
Stinchcombe, M. B., & White, H. (1998) · Econometric Theory · doi:10.1017/s0266466698143013 · Cited by 336
You, Z.-H., Lei, Y.-K., Zhu, L., Xia, J., & Wang, B. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-s8-s10 · Cited by 304
Zhou, Z.-H., Chawla, N. V., Jin, Y., & Williams, G. J. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2350953 · Cited by 275
Can threshold networks be trained directly?
Huang, G.-B., Zhu, Q.-Y., Mao, K. Z., Siew, C.-K., Saratchandran, P., & Sundararajan, N. (2006) · IEEE Transactions on Circuits and Systems II: Express Briefs · doi:10.1109/tcsii.2005.857540 · Cited by 266
Self-citationThe Emerging "Big Dimensionality"
Zhai, Y., Ong, Y.-S., & Tsang, I. W. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2326099 · Cited by 257
Song, Y., Crowcroft, J., & Zhang, J. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.07.003 · Cited by 252
Sparse Extreme Learning Machine for Classification
Bai, Z., Huang, G.-B., Wang, D., Wang, H., & Westover, M. B. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2298235 · Cited by 238
Self-citationUniform approximation of functions with random bases
Rahimi, A., & Recht, B. (2008) · 2008 46th Annual Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2008.4797607 · Cited by 238
Chen, C. L. P., & Wan, J. Z. (1999) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.740166 · Cited by 230
The Sparseness of Mixed Selectivity Neurons Controls the Generalization–Discrimination Trade-Off
Barak, O., Rigotti, M., & Fusi, S. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2753-12.2013 · Cited by 207
Kernel-based extreme learning machine for remote-sensing image classification
Pal, M., Maxwell, A. E., & Warner, T. A. (2013) · Remote Sensing Letters · doi:10.1080/2150704x.2013.805279 · Cited by 200
Beyond simple features: A large-scale feature search approach to unconstrained face recognition
Cox, D., & Pinto, N. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771385 · Cited by 197
Extreme Learning Machine With Composite Kernels for Hyperspectral Image Classification
Zhou, Y., Peng, J., & Chen, C. L. P. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2359965 · Cited by 181
Reservoir computing and extreme learning machines for non-linear time-series data analysis
Butcher, J. B., Verstraeten, D., Schrauwen, B., Day, C. R., & Haycock, P. W. (2013) · Neural Networks · doi:10.1016/j.neunet.2012.11.011 · Cited by 169
A rapid supervised learning neural network for function interpolation and approximation
Chen, C. L. P. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536316 · Cited by 169
The No-Prop algorithm: A new learning algorithm for multilayer neural networks
Widrow, B., Greenblatt, A., Kim, Y., & Park, D. (2013) · Neural Networks · doi:10.1016/j.neunet.2012.09.020 · Cited by 168
Yan, Z., & Wang, J. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2275948 · Cited by 158
Incremental Learning in Human Action Recognition Based on Snippets
Minhas, R., Mohammed, A. A., & Wu, Q. M. J. (2011) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2011.2177182 · Cited by 88
Text categorization based on regularization extreme learning machine
Zheng, W., Qian, Y., & Lu, H. (2012) · Neural Computing and Applications · doi:10.1007/s00521-011-0808-y · Cited by 83
Efficacy of Retinal Spikes in Driving Cortical Responses
Kara, P., & Reid, R. C. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-24-08547.2003 · Cited by 63
Steinwart, I., Hush, D. R., & Scovel, C. (2009) · University of North Texas Digital Library (University of North Texas) · Cited by 55
Chen, C. L. P., LeClair, S. R., & Pao, Y. (1998) · Neurocomputing · doi:10.1016/s0925-2312(97)00062-3 · Cited by 54
Bilateral amblyopia after a short period of reverse occlusion in kittens
Murphy, K. M., & Mitchell, D. E. (1986) · Nature · doi:10.1038/323536a0 · Cited by 51
Bring Your Own Learner: A Cloud-Based, Data-Parallel Commons for Machine Learning
Arnaldo, I., Veeramachaneni, K. K., Song, A. H., & O’Reilly, U.-M. (2015) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2369892 · Cited by 21
Cited by
Gumaei, A., Hassan, M. M., Hassan, M. R., Alelaiwi, A., & Fortino, G. (2019) · IEEE Access · doi:10.1109/access.2019.2904145 · Cited by 484
Huang, G.-B. (2015) · Cognitive Computation · doi:10.1007/s12559-015-9333-0 · Cited by 471
Self-citationA review on neural networks with random weights
Cao, W., Wang, X., Ming, Z., & Gao, J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.040 · Cited by 466
A review on weight initialization strategies for neural networks
Narkhede, M. V., Bartakke, P. P., & Sutaone, M. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10033-z · Cited by 311
An Efficient Method for Traffic Sign Recognition Based on Extreme Learning Machine
Huang, Z., Yu, Y., Gu, J., & Liu, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2533424 · Cited by 281
Metadata
- Authors
- Huang, G.-B., Bai, Z., Kasun, L. L. C., & Vong, C. M.
- Venue
- IEEE Computational Intelligence Magazine
- Published
- 2015-05
- Volume
- 10
- Issue
- 2
- Pages
- 18-29
- ISSN
- 1556-603X (ISSN-L)
- OpenAlex
- W2031878488
- Cited by
- 350
- References
- 64
- FWCI
- 54.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.