Fast Learning in Networks of Locally-Tuned Processing Units
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
We propose a network architecture which uses a single internal layer of locally-tuned processing units to learn both classification tasks and real-valued function approximations (Moody and Darken 1988). We consider training such networks in a completely supervised manner, but abandon this approach in favor of a more computationally efficient hybrid learning method which combines self-organized and supervised learning. Our networks learn faster than backpropagation for two reasons: the local representations ensure that only a few units respond to any given input, thus reducing computational overhead, and the hybrid learning rules are linear rather than nonlinear, thus leading to faster convergence. Unlike many existing methods for data analysis, our network architecture and learning rules are truly adaptive and are thus appropriate for real-time use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1967) · Cited by 23,719
Least squares quantization in PCM
Lloyd, S. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056489 · Cited by 15,836
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
Networks for approximation and learning
Poggio, T., & Girosi, F. (1990) · Proceedings of the IEEE · doi:10.1109/5.58326 · Cited by 3,252
Predicting chaotic time series
Farmer, J. D., & Sidorowich, J. J. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.845 · Cited by 1,929
Self-organization and associative memory: 3rd edition
Kohonen, T. (1989) · Springer eBooks · Cited by 1,223
Radial basis functions for multivariable interpolation: a review
Powell, M. J. D. (1987) · Clarendon Press eBooks · Cited by 1,197
Networks and the best approximation property
Girosi, F., & Poggio, T. (1990) · Biological Cybernetics · doi:10.1007/bf00195855 · Cited by 888
Decision theoretic generalizations of the PAC model for neural net and other learning applications
Haussler, D. (1992) · Information and Computation · doi:10.1016/0890-5401(92)90010-d · Cited by 843
Layered Neural Networks with Gaussian Hidden Units as Universal Approximations
Hartman, E. J., Keeler, J. D., & Kowalski, J. M. (1990) · Neural Computation · doi:10.1162/neco.1990.2.2.210 · Cited by 782
Cited by
ANFIS: adaptive-network-based fuzzy inference system
Jang, J.-S. R. (1993) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.256541 · Cited by 16,254
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
A general regression neural network
Specht, D. F. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.97934 · Cited by 4,492
An introduction to kernel-based learning algorithms
Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., & Scholkopf, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914517 · Cited by 3,473
Orthogonal least squares learning algorithm for radial basis function networks
Chen, S., Cowan, C. F. N., & Grant, P. M. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80341 · Cited by 3,362
Networks for approximation and learning
Poggio, T., & Girosi, F. (1990) · Proceedings of the IEEE · doi:10.1109/5.58326 · Cited by 3,252
Clustering of the self-organizing map
Vesanto, J., & Alhoniemi, E. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.846731 · Cited by 2,680
Fuzzy logic systems for engineering: a tutorial
Mendel, J. M. (1995) · Proceedings of the IEEE · doi:10.1109/5.364485 · Cited by 2,110
Neural networks for control systems—A survey
Hunt, K. J., Sbarbaro, D., Żbikowski, R., & Gawthrop, P. J. (1992) · Automatica · doi:10.1016/0005-1098(92)90053-i · Cited by 1,864
EXPERT SYSTEMS WITH APPLICATIONS
(2005) · Expert Systems with Applications · doi:10.1016/j.eswa.2004.10.010 · Cited by 1,656
Neural-network-based fuzzy logic control and decision system
Lin, C.-T., & Lee, C. S. G. (1991) · IEEE Transactions on Computers · doi:10.1109/12.106218 · Cited by 1,480
Survey on data-driven industrial process monitoring and diagnosis
Qin, S. J. (2012) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2012.09.004 · Cited by 1,470
'Neural-gas' network for vector quantization and its application to time-series prediction
Martinetz, T. M., Berkovich, S. G., & Schulten, K. J. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.238311 · Cited by 1,431
A Resource-Allocating Network for Function Interpolation
Platt, J. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.213 · Cited by 1,354
Regularization Theory and Neural Networks Architectures
Girosi, F., Jones, M., & Poggio, T. (1995) · Neural Computation · doi:10.1162/neco.1995.7.2.219 · Cited by 1,349
Rätsch, G., Onoda, T., & Müller, K.-R. (2001) · Machine Learning · doi:10.1023/a:1007618119488 · Cited by 1,299
Kasabov, N. K., & Song, Q. (2002) · IEEE Transactions on Fuzzy Systems · doi:10.1109/91.995117 · Cited by 1,264
LeCun, Y. A., Bottou, L., Orr, G. B., & Müller, K.-R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_3 · Cited by 1,264
Progress in supervised neural networks
Hush, D. R., & Horne, B. G. (1993) · IEEE Signal Processing Magazine · doi:10.1109/79.180705 · Cited by 1,247
Talukdar, S., Singha, P., Mahato, S., Shahfahad, Pal, S., Liou, Y.-A., & Rahman, A. (2020) · Remote Sensing · doi:10.3390/rs12071135 · Cited by 1,212
Managerial Applications of Neural Networks: The Case of Bank Failure Predictions
Tam, K. Y., & Kiang, M. Y. (1992) · Management Science · doi:10.1287/mnsc.38.7.926 · Cited by 1,118
Bankruptcy prediction in banks and firms via statistical and intelligent techniques – A review
Ravi Kumar, P., & Ravi, V. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.08.043 · Cited by 1,074
Neural Networks: A Review from a Statistical Perspective
Cheng, B., & Titterington, D. M. (1994) · Statistical Science · doi:10.1214/ss/1177010638 · Cited by 1,048
Neural network credit scoring models
West, D. (2000) · Computers & Operations Research · doi:10.1016/s0305-0548(99)00149-5 · Cited by 1,033
“The RBF network [25] is also quite di!erent in that the hidden layer is restricted to radially symmetric functions, which produce a local response to the input data.”
BackgroundRegularization Algorithms for Learning That Are Equivalent to Multilayer Networks
Poggio, T., & Girosi, F. (1990) · Science · doi:10.1126/science.247.4945.978 · Cited by 1,026
Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery
Yang, X., Wang, Y., Byrne, R., Schneider, G., & Yang, S. (2019) · Chemical Reviews · doi:10.1021/acs.chemrev.8b00728 · Cited by 1,022
Support vector machine with adaptive parameters in financial time series forecasting
Cao, L. J., & Tay, F. E. H. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820556 · Cited by 1,008
Predicting time series with support vector machines
Müller, K. R., Smola, A. J., Rätsch, G., Schölkopf, B., Kohlmorgen, J., & Vapnik, V. (1997) · Lecture Notes in Computer Science · doi:10.1007/bfb0020283 · Cited by 981
Learning and tuning fuzzy logic controllers through reinforcements
Berenji, H. R., & Khedkar, P. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.159061 · Cited by 942
Neural networks and their applications
Bishop, C. M. (1994) · Review of Scientific Instruments · doi:10.1063/1.1144830 · Cited by 926
LeCun, Y., Bottou, L., Orr, G. B., & Müller, K. R. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8_2 · Cited by 919
Networks and the best approximation property
Girosi, F., & Poggio, T. (1990) · Biological Cybernetics · doi:10.1007/bf00195855 · Cited by 888
Neural Networks in Civil Engineering: 1989–2000
Adeli, H. (2001) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/0885-9507.00219 · Cited by 884
Davey, H. M., & Kell, D. B. (1996) · Microbiological Reviews · doi:10.1128/mr.60.4.641-696.1996 · Cited by 879
Rose, K. (1998) · Proceedings of the IEEE · doi:10.1109/5.726788 · Cited by 876
A new evolutionary system for evolving artificial neural networks
Yao, X., & Liu, Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572107 · Cited by 874
Decision theoretic generalizations of the PAC model for neural net and other learning applications
Haussler, D. (1992) · Information and Computation · doi:10.1016/0890-5401(92)90010-d · Cited by 843
Foundations of neural networks, fuzzy systems, and knowledge engineering
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0330 · Cited by 821
Pattern classification using neural networks
Lippmann, R. P. (1989) · IEEE Communications Magazine · doi:10.1109/35.41401 · Cited by 811
Chen, S., Mulgrew, B., & Grant, P. M. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.238312 · Cited by 797
An Empirical Comparison of Machine Learning Models for Time Series Forecasting
Ahmed, N. K., Atiya, A. F., Gayar, N. E., & El-Shishiny, H. (2010) · Econometric Reviews · doi:10.1080/07474938.2010.481556 · Cited by 789
Layered Neural Networks with Gaussian Hidden Units as Universal Approximations
Hartman, E. J., Keeler, J. D., & Kowalski, J. M. (1990) · Neural Computation · doi:10.1162/neco.1990.2.2.210 · Cited by 782
Designing fuzzy inference systems from data: An interpretability-oriented review
Guillaume, S. (2001) · IEEE Transactions on Fuzzy Systems · doi:10.1109/91.928739 · Cited by 752
Ben Taieb, S., Bontempi, G., Atiya, A. F., & Sorjamaa, A. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.039 · Cited by 734
Neural networks for nonlinear dynamic system modelling and identification
CHEN, S., & BILLINGS, S. A. (1992) · International Journal of Control · doi:10.1080/00207179208934317 · Cited by 720
A Nonparametric Approach to Pricing and Hedging Derivative Securities Via Learning Networks
HUTCHINSON, J. M., LO, A. W., & POGGIO, T. (1994) · The Journal of Finance · doi:10.1111/j.1540-6261.1994.tb00081.x · Cited by 717
Wavelet neural networks for function learning
Zhang, J., Walter, G. G., Miao, Y., & Lee, W. N. W. (1995) · IEEE Transactions on Signal Processing · doi:10.1109/78.388860 · Cited by 716
Machine learning and radiology
Wang, S., & Summers, R. M. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.02.005 · Cited by 697
A Survey of Face Recognition Techniques
Jafri, R., & Arabnia, H. R. (2009) · Journal of Information Processing Systems · doi:10.3745/jips.2009.5.2.041 · Cited by 677
Perspectives and problems in motor learning
Wolpert, D. M., Ghahramani, Z., & Flanagan, J. R. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01773-3 · Cited by 667
Face recognition with radial basis function (RBF) neural networks
Er, M. J., Wu, S., Lu, J., & Toh, H. L. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.1000134 · Cited by 664
Neural Networks and Related Methods for Classification
Ripley, B. D. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01990.x · Cited by 627
The application of artificial neural networks to the analysis of remotely sensed data
Mas, J. F., & Flores, J. J. (2008) · International Journal of Remote Sensing · doi:10.1080/01431160701352154 · Cited by 616
Introduction to neural networks
Cross, S. S., Harrison, R. F., & Kennedy, R. L. (1995) · The Lancet · doi:10.1016/s0140-6736(95)91746-2 · Cited by 615
Rival penalized competitive learning for clustering analysis, RBF net, and curve detection
Xu, L., Krzyzak, A., & Oja, E. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.238318 · Cited by 613
Characterising Virtual Eigensignatures for General Purpose Face Recognition
Graham, D. B., & Allinson, N. M. (1998) · Face Recognition · doi:10.1007/978-3-642-72201-1_25 · Cited by 607
Modeling chemical processes using prior knowledge and neural networks'
Thompson, M. L., & Kramer, M. A. (1994) · AIChE Journal · doi:10.1002/aic.690400806 · Cited by 596
Pattern analysis for machine olfaction: a review
Gutierrez-Osuna, R. (2002) · IEEE Sensors Journal · doi:10.1109/jsen.2002.800688 · Cited by 578
On the training of radial basis function classifiers
Musavi, M. T., Ahmed, W., Chan, K. H., Faris, K. B., & Hummels, D. M. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80038-3 · Cited by 569
Bottou, L., & Vapnik, V. (1992) · Neural Computation · doi:10.1162/neco.1992.4.6.888 · Cited by 542
“To evaluate the output yGl&,al(x) of the complete system for an input pattern x, we merge these weighted averages according to the values of the X kernels on x. (3.4) This is a radial basis functions (RBF) network (Broomhead and Lowe 1988; Moody and Darken 1989).”
MethodInfluentialSuperparamagnetic Clustering of Data
Blatt, M., Wiseman, S., & Domany, E. (1996) · Physical Review Letters · doi:10.1103/physrevlett.76.3251 · Cited by 537
Saad, E. W., Prokhorov, D. V., & Wunsch, D. C. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.728395 · Cited by 537
Three learning phases for radial-basis-function networks
Schwenker, F., Kestler, H. A., & Palm, G. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00027-2 · Cited by 533
Yingwei, L., Sundararajan, N., & Saratchandran, P. (1997) · Neural Computation · doi:10.1162/neco.1997.9.2.461 · Cited by 507
An Equivalence Between Sparse Approximation and Support Vector Machines
Girosi, F. (1998) · Neural Computation · doi:10.1162/089976698300017269 · Cited by 506
Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning
Kasabov, N. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.969494 · Cited by 482
Advances in Modeling and Simulation of Grinding Processes
Brinksmeier, E., Aurich, J. C., Govekar, E., Heinzel, C., Hoffmeister, H.-W., Klocke, F., Peters, J., Rentsch, R., Stephenson, D. J., Uhlmann, E., et al. (2006) · CIRP Annals · doi:10.1016/j.cirp.2006.10.003 · Cited by 463
Yingwei, L., Sundararajan, N., & Saratchandran, P. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.661125 · Cited by 449
Advantages of Radial Basis Function Networks for Dynamic System Design
Yu, H., Xie, T., Paszczynski, S., & Wilamowski, B. M. (2011) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2011.2164773 · Cited by 445
Spatial Transformations in the Parietal Cortex Using Basis Functions
Pouget, A., & Sejnowski, T. J. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.2.222 · Cited by 425
RADIAL BASIS PROBABILISTIC NEURAL NETWORKS: MODEL AND APPLICATION
HUANG, D.-S. (1999) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001499000604 · Cited by 423
A data‐driven algorithm for constructing artificial neural network rainfall‐runoff models
Sudheer, K. P., Gosain, A. K., & Ramasastri, K. S. (2002) · Hydrological Processes · doi:10.1002/hyp.554 · Cited by 418
Vernon, D., Metta, G., & Sandini, G. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890274 · Cited by 414
A review of neural networks in plant disease detection using hyperspectral data
Golhani, K., Balasundram, S. K., Vadamalai, G., & Pradhan, B. (2018) · Information Processing in Agriculture · doi:10.1016/j.inpa.2018.05.002 · Cited by 402
The Mathematics of Learning: Dealing With Data
Smale, S. (2005) · 2005 International Conference on Neural Networks and Brain · doi:10.1109/icnnb.2005.1614860 · Cited by 398
Chen, T., & Chen, H. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.392252 · Cited by 394
Goodacre, R., Timmins, É. M., Burton, R., Kaderbhai, N., Woodward, A. M., Kell, D. B., & Rooney, P. J. (1998) · Microbiology · doi:10.1099/00221287-144-5-1157 · Cited by 388
Approaches to Multisensor Data Fusion in Target Tracking: A Survey
Smith, D., & Singh, S. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.183 · Cited by 379
Fuzzy EMG classification for prosthesis control
Chan, F. H. Y., Yang, Y.-S., Lam, F. K., Zhang, Y.-T., & Parker, P. A. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.867872 · Cited by 376
Series in Machine Perception and Artificial Intelligence
(2012) · Series in machine perception and artificial intelligence · doi:10.1142/smpai · Cited by 365
Constructing NARMAX models using ARMAX models
JOHANSEN, T. A., & FOSS, B. (1993) · International Journal of Control · doi:10.1080/00207179308923046 · Cited by 363
Computational approaches to sensorimotor transformations
Pouget, A., & Snyder, L. H. (2000) · Nature Neuroscience · doi:10.1038/81469 · Cited by 357
Regularization in the Selection of Radial Basis Function Centers
Orr, M. J. L. (1995) · Neural Computation · doi:10.1162/neco.1995.7.3.606 · Cited by 357
HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems
Kim, J., & Kasabov, N. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00067-2 · Cited by 351
Neural network adaptive wavelets for signal representation and classification
Szu, H. H. (1992) · Optical Engineering · doi:10.1117/12.59918 · Cited by 349
Recursive hybrid algorithm for non-linear system identification using radial basis function networks
CHEN, S., BILLINGS, S. A., & GRANT, P. M. (1992) · International Journal of Control · doi:10.1080/00207179208934272 · Cited by 343
Adaptive boosting for SAR automatic target recognition
Sun, Y., Liu, Z., Todorovic, S., & Li, J. (2007) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2007.357120 · Cited by 343
Least mean square error reconstruction principle for self-organizing neural-nets
Xu, L. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80107-8 · Cited by 341
Radial basis function networks for classifying process faults
(1991) · IEEE Control Systems · doi:10.1109/37.75576 · Cited by 329
Clustering: A neural network approach
Du, K.-L. (2010) · Neural Networks · doi:10.1016/j.neunet.2009.08.007 · Cited by 325
Variable Resolution Discretization in Optimal Control
Munos, R., & Moore, A. (2002) · Machine Learning · doi:10.1023/a:1017992615625 · Cited by 321
Neural Networks for Optimal Approximation of Smooth and Analytic Functions
Mhaskar, H. N. (1996) · Neural Computation · doi:10.1162/neco.1996.8.1.164 · Cited by 321
Mitaim, S., & Kosko, B. (1998) · Proceedings of the IEEE · doi:10.1109/5.726785 · Cited by 315
A recurrent self-organizing neural fuzzy inference network
Juang, C.-F., & Lin, C.-T. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.774232 · Cited by 315
Incorporating prior information in machine learning by creating virtual examples
Niyogi, P., Girosi, F., & Poggio, T. (1998) · Proceedings of the IEEE · doi:10.1109/5.726787 · Cited by 313
Fu, X., & Wang, L. (2003) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.810911 · Cited by 312
The 2017 IEEE International Conference on Fuzzy Systems
(2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2016.2545826 · Cited by 308
Karayiannis, N. B., & Mi, G. W. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.641471 · Cited by 307
Goodacre, R., Shann, B., Gilbert, R. J., Timmins, É. M., McGovern, A. C., Alsberg, B. K., Kell, D. B., & Logan, N. A. (2000) · Analytical Chemistry · doi:10.1021/ac990661i · Cited by 305
Metadata
- Authors
- Moody, J., & Darken, C. J.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 1989-06
- Volume
- 1
- Issue
- 2
- Pages
- 281-294
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2171277043
- Cited by
- 4,194
- References
- 20
- FWCI
- 47.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.