The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Progress in supervised neural networks
Abstract
Theoretical results concerning the capabilities and limitations of various neural network models are summarized, and some of their extensions are discussed. The network models considered are divided into two basic categories: static networks and dynamic networks. Unlike static networks, dynamic networks have memory. They fall into three groups: networks with feedforward dynamics, networks with output feedback, and networks with state feedback, which are emphasized in this work. Most of the networks discussed are trained using supervised learning.>
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1979) · Cited by 43,841
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Identification and control of dynamical systems using neural networks
Narendra, K. S., & Parthasarathy, K. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80202 · Cited by 8,014
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
Hopfield, J. J. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.10.3088 · Cited by 6,918
Algorithms for clustering data
Flury, B. (1989) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(89)90033-5 · Cited by 6,432
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
A universal algorithm for sequential data compression
Ziv, J., & Lempel, A. (1977) · IEEE Transactions on Information Theory · doi:10.1109/tit.1977.1055714 · Cited by 5,456
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369
Fast Learning in Networks of Locally-Tuned Processing Units
Moody, J., & Darken, C. J. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.281 · Cited by 4,194
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Specht, D. F. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90049-q · Cited by 3,762
Orthogonal least squares learning algorithm for radial basis function networks
Chen, S., Cowan, C. F. N., & Grant, P. M. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80341 · Cited by 3,362
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (2015) · Measures of Complexity · doi:10.1007/978-3-319-21852-6_3 · Cited by 3,105
Bellanger, M. (1987) · Signal Processing · doi:10.1016/0165-1684(87)90147-2 · Cited by 2,961
Advances in Neural Information Processing Systems 37
(2024) · doi:10.52202/079017 · Cited by 2,791
Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
Phoneme recognition using time-delay neural networks
Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., & Lang, K. J. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.21701 · Cited by 2,643
Computation: Finite and Infinite Machines.
Clarke, D. A., & Minsky, M. L. (1968) · The American Mathematical Monthly · doi:10.2307/2313471 · Cited by 2,583
Gordon, A. D., & Hartigan, J. A. (1976) · Journal of the American Statistical Association · doi:10.2307/2286880 · Cited by 2,569
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (1971) · Theory of Probability & Its Applications · doi:10.1137/1116025 · Cited by 2,448
Neural networks and fuzzy systems: a dynamical systems approach to machine intelligence
(1991) · Choice Reviews Online · doi:10.5860/choice.29-2151 · Cited by 2,314
Adaptive pattern recognition and neural networks
(1989) · Choice Reviews Online · doi:10.5860/choice.26-6311 · Cited by 2,313
Friedman, J. H., & Stuetzle, W. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477729 · Cited by 2,216
Mallows, C. L. (1995) · Technometrics · doi:10.1080/00401706.1995.10484370 · Cited by 2,083
Introduction to artificial neural systems
Nelson, D., & Wang, J. (1992) · Neurocomputing · doi:10.1016/0925-2312(92)90018-k · Cited by 1,999
Mallows, C. L. (1973) · Technometrics · doi:10.2307/1267380 · Cited by 1,975
Advances in Neural Information Processing Systems 5
Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896
Increased rates of convergence through learning rate adaptation
Jacobs, R. A. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90003-2 · Cited by 1,806
The condensed nearest neighbor rule (Corresp.)
Hart, P. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054155 · Cited by 1,733
Polynomial Theory of Complex Systems
Ivakhnenko, A. G. (1971) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1971.4308320 · Cited by 1,684
Neural computing: theory and practice
(1989) · Choice Reviews Online · doi:10.5860/choice.27-1569 · Cited by 1,663
A Projection Pursuit Algorithm for Exploratory Data Analysis
Friedman, J. H., & Tukey, J. W. (1974) · IEEE Transactions on Computers · doi:10.1109/t-c.1974.224051 · Cited by 1,652
Mark, J. W. (1975) · Proceedings of the IEEE · doi:10.1109/proc.1975.9993 · Cited by 1,565
What Size Net Gives Valid Generalization?
Baum, E. B., & Haussler, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.1.151 · Cited by 1,541
Connectionist learning procedures
Hinton, G. E. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90049-0 · Cited by 1,430
An introduction to neural computing
Kohonen, T. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90020-2 · Cited by 1,202
Aihara, K., Takabe, T., & Toyoda, M. (1990) · Physics Letters A · doi:10.1016/0375-9601(90)90136-c · Cited by 1,175
Pattern Recognition Principles
Kavzoglu, T., Tso, B., & Mather, P. M. (2024) · Classification Methods for Remotely Sensed Data · doi:10.1201/9781003439172-2 · Cited by 1,053
Pattern Classification and Scene Analysis.
Grenander, U., Duda, R. O., & Hart, P. E. (1974) · Journal of the American Statistical Association · doi:10.2307/2286028 · Cited by 1,006
Neural Network Classifiers Estimate Bayesian a posteriori Probabilities
Richard, M. D., & Lippmann, R. P. (1991) · Neural Computation · doi:10.1162/neco.1991.3.4.461 · Cited by 986
(2009) · Encyclopedia of Neuroscience · doi:10.1007/978-3-540-29678-2_965 · Cited by 926
Stochastic Complexity and Modeling
Rissanen, J. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350051 · Cited by 922
Learning in Artificial Neural Networks: A Statistical Perspective
White, H. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.425 · Cited by 922
The capacity of the Hopfield associative memory
McEliece, R., Posner, E., Rodemich, E., & Venkatesh, S. (1987) · IEEE Transactions on Information Theory · doi:10.1109/tit.1987.1057328 · Cited by 910
Networks and the best approximation property
Girosi, F., & Poggio, T. (1990) · Biological Cybernetics · doi:10.1007/bf00195855 · Cited by 888
Neural Information Processing Systems
Anderson, D. Z. (1988) · neural information processing systems · Cited by 784
Layered Neural Networks with Gaussian Hidden Units as Universal Approximations
Hartman, E. J., Keeler, J. D., & Kowalski, J. M. (1990) · Neural Computation · doi:10.1162/neco.1990.2.2.210 · Cited by 782
Complexity of automaton identification from given data
Gold, E. M. (1978) · Information and Control · doi:10.1016/s0019-9958(78)90562-4 · Cited by 771
NETtalk: a parallel network that learns to read aloud
B, T. J. S. A., & Rosenberg, C. (1988) · The MIT Press eBooks · Cited by 670
Learning State Space Trajectories in Recurrent Neural Networks
Pearlmutter, B. A. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.263 · Cited by 656
Gradient methods for the optimization of dynamical systems containing neural networks
Narendra, K. S., & Parthasarathy, K. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80336 · Cited by 641
Threshold logic and its applications
室賀, 三. (1971) · Wiley-Interscience eBooks · Cited by 620
A time-delay neural network architecture for isolated word recognition
Lang, K. J., Waibel, A. H., & Hinton, G. E. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90044-l · Cited by 596
Simplifying Neural Networks by Soft Weight-Sharing
Nowlan, S. J., & Hinton, G. E. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.473 · Cited by 595
On the training of radial basis function classifiers
Musavi, M. T., Ahmed, W., Chan, K. H., Faris, K. B., & Hummels, D. M. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80038-3 · Cited by 569
Neural networks for signal processing
Kosko, B. (1992) · CERN Document Server (European Organization for Nuclear Research) · Cited by 538
Pfeifer, R., Soulié, F. F., Steels, L., & Schreter, Z. (1989) · Elsevier eBooks · Cited by 514
Introduction to statistical pattern recognition
Davis, J. C. (1996) · Computers & Geosciences · doi:10.1016/0098-3004(96)00017-9 · Cited by 463
Learning and Extracting Finite State Automata with Second-Order Recurrent Neural Networks
Giles, C. L., Miller, C. B., Chen, D., Chen, H. H., Sun, G. Z., & Lee, Y. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.393 · Cited by 392
Model of biological pattern recognition with spatially chaotic dynamics
Yao, Y., & Freeman, W. J. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90086-z · Cited by 344
Links between Markov models and multilayer perceptrons
Bourlard, H., & Wellekens, C. J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.62605 · Cited by 340
Improving the convergence of back-propagation learning with second-order methods
Becker, S., & LeCun, Y. (1989) · Cited by 331
Bounds on the number of hidden neurons in multilayer perceptrons
Huang, S.-C., & Huang, Y.-F. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80290 · Cited by 328
A Gaussian potential function network with hierarchically self-organizing learning
Lee, S., & Kil, R. M. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90005-p · Cited by 325
Experiments on Learning by Back Propagation.
Plaut, D. C., Nowlan, S. J., & Hinton, G. E. (1986) · Cited by 323
Grammatical Inference: Introduction and Survey - Part I
Fu, K.-S., & Booth, T. L. (1975) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1975.5409159 · Cited by 270
Information capacity of the Hopfield model
Abu-Mostafa, Y., & St. Jacques, J. (1985) · IEEE Transactions on Information Theory · doi:10.1109/tit.1985.1057069 · Cited by 267
Machine Learning: A Theoretical Approach
NATARAJAN, B. K. (1992) · CERN Document Server (European Organization for Nuclear Research) · Cited by 253
On the complexity of minimum inference of regular sets
Angluin, D. (1978) · Information and Control · doi:10.1016/s0019-9958(78)90683-6 · Cited by 251
Large Automatic Learning, Rule Extraction, and Generalization.
Denker, J. S., Schwartz, D., Wittner, B. S., Solla, S. A., Howard, R. E., Jackel, L. D., & Hopfield, J. J. (1987) · Complex Systems · Cited by 248
Neural Network Design and the Complexity of Learning
Judd, J. S. (1990) · The MIT Press eBooks · doi:10.7551/mitpress/4932.001.0001 · Cited by 210
Neural Networks and Speech Processing
Morgan, D. P., & Scofield, C. L. (1991) · Springer eBooks · doi:10.1007/978-1-4615-3950-6 · Cited by 189
Dynamics and architecture for neural computation
Pineda, F. J. (1988) · Journal of Complexity · doi:10.1016/0885-064x(88)90021-0 · Cited by 184
BACK-PROPAGATION, WEIGHT-ELIMINATION AND TIME SERIES PREDICTION
Weigend, A. S., Rumelhart, D. E., & Huberman, B. A. (1991) · Connectionist Models · doi:10.1016/b978-1-4832-1448-1.50016-0 · Cited by 174
A probabilistic approach to the understanding and training of neural network classifiers
Gish, H. (2002) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1990.115636 · Cited by 174
Induction of Finite-State Languages Using Second-Order Recurrent Networks
Watrous, R. L., & Kuhn, G. M. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.406 · Cited by 151
Mechanisms of planning and problem solving in the brain
Albus, J. S. (1979) · Mathematical Biosciences · doi:10.1016/0025-5564(79)90063-4 · Cited by 143
Classification with neural networks: a performance analysis
Hush (1989) · IEEE International Conference on Systems Engineering · doi:10.1109/icsyse.1989.48672 · Cited by 141
Note on generalization, regularization and architecture selection in nonlinear learning systems
Moody, J. E. (2002) · Machine learning for signal processing ... · doi:10.1109/nnsp.1991.239541 · Cited by 138
A generalized convergence theorem for neural networks
Bruck, J., & Goodman, J. W. (1988) · IEEE Transactions on Information Theory · doi:10.1109/18.21239 · Cited by 134
A synthesis procedure for Hopfield's continuous-time associative memory
Farrell, J. A., & MICHEL, A. N. (1990) · IEEE Transactions on Circuits and Systems · doi:10.1109/31.55063 · Cited by 115
Efficient simulation of finite automata by neural nets
Alon, N., Dewdney, A. K., & Ott, T. J. (1991) · Journal of the ACM · doi:10.1145/103516.103523 · Cited by 93
A new error criterion for posterior probability estimation with neural nets
El-Jaroudi, A., & Makhoul, J. (1990) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1990.137843 · Cited by 81
Statistical properties of artificial neural networks
Barron, A. R. (2003) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.1989.70117 · Cited by 77
Linear and logarithmic capacities in associative neural networks
Venkatesh, S. S., & Psaltis, D. (1989) · IEEE Transactions on Information Theory · doi:10.1109/18.30977 · Cited by 70
Information capacity of associative memories
Kuh, A., & Dickinson, B. (1989) · IEEE Transactions on Information Theory · doi:10.1109/18.42177 · Cited by 70
Error surfaces for multilayer perceptrons
Hush, D. R., Horne, B. G., & Salas, J. M. (1992) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.179853 · Cited by 58
Self-citationDynamic behavior of nonlinear networks
Choi, M. Y., & Huberman, B. A. (1983) · Physical Review A · doi:10.1103/physreva.28.1204 · Cited by 57
Formation of disconnected decision regions with a single hidden layer
Makhoul, El-Jaroudi, & Schwartz (1989) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1989.118619 · Cited by 54
Sigmoids Distinguish More Efficiently Than Heavisides
Sontag, E. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.470 · Cited by 27
Turing equivalence of neural networks with second order connection weights
Sun, G.-Z., Chen, H.-H., & Lee, Y.-C. (2002) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1991.155360 · Cited by 24
Generalization capabilities of minimal kernel-based networks
Kraaijveld, M. A., & Duin, R. P. W. (2002) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1991.155288 · Cited by 12
Cited by
Forecasting with artificial neural networks:
Zhang, G., Eddy Patuwo, B., & Y. Hu, M. (1998) · International Journal of Forecasting · doi:10.1016/s0169-2070(97)00044-7 · Cited by 4,229
Evolving artificial neural networks
Yao, X. (1999) · Proceedings of the IEEE · doi:10.1109/5.784219 · Cited by 2,981
An introduction to multisensor data fusion
Hall, D. L., & Llinas, J. (1997) · Proceedings of the IEEE · doi:10.1109/5.554205 · Cited by 2,629
Bebis, G., & Georgiopoulos, M. (1994) · IEEE Potentials · doi:10.1109/45.329294 · Cited by 746
Speech recognition in noisy environments: A survey
Gong, Y. (1995) · Speech Communication · doi:10.1016/0167-6393(94)00059-j · Cited by 635
Metadata
- Authors
- Hush, D. R., & Horne, B. G.
- Venue
- IEEE Signal Processing Magazine
- Published
- 1993-01
- Volume
- 10
- Issue
- 1
- Pages
- 8-39
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2078376347
- Cited by
- 1,247
- References
- 101
- FWCI
- 79.99
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.