The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
30 years of adaptive neural networks: perceptron, Madaline, and backpropagation
Abstract
Fundamental developments in feedforward artificial neural networks from the past thirty years are reviewed. The history, origination, operating characteristics, and basic theory of several supervised neural-network training algorithms (including the perceptron rule, the least-mean-square algorithm, three Madaline rules, and the backpropagation technique) are described. The concept underlying these iterative adaptation algorithms is the minimal disturbance principle, which suggests that during training it is advisable to inject new information into a network in a manner that disturbs stored information to the smallest extent possible. The two principal kinds of online rules that have developed for altering the weights of a network are examined for both single-threshold elements and multielement networks. They are error-correction rules, which alter the weights of a network to correct error in the output response to the present input pattern, and gradient rules, which alter the weights of a network during each pattern presentation by gradient descent with the objective of reducing mean-square error (averaged over all training patterns).>
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Self-organized formation of topologically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · doi:10.1007/bf00337288 · Cited by 9,529
Self-Organization and Associative Memory
Kohonen, T. (1989) · Springer Series in Information Sciences · doi:10.1007/978-3-642-88163-3 · Cited by 8,740
Identification and control of dynamical systems using neural networks
Narendra, K. S., & Parthasarathy, K. (1990) · IEEE Transactions on Neural Networks · doi:10.1109/72.80202 · Cited by 8,014
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
indicated, N. A. (1950) · Journal of Consulting Psychology · doi:10.1037/h0049612 · Cited by 6,923
Hopfield, J. J. (1984) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.81.10.3088 · Cited by 6,918
Cited by
Artificial neural networks: fundamentals, computing, design, and application
Basheer, I. A., & Hajmeer, M. (2000) · Journal of Microbiological Methods · doi:10.1016/s0167-7012(00)00201-3 · Cited by 3,231
Rokach, L. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-009-9124-7 · Cited by 2,657
Neuro-fuzzy modeling and control
Jang, J.-S. R., & Sun, C.-T. (1995) · Proceedings of the IEEE · doi:10.1109/5.364486 · Cited by 2,328
Godara, L. C. (1997) · Proceedings of the IEEE · doi:10.1109/5.622504 · Cited by 2,073
Causability and explainability of artificial intelligence in medicine
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885
“…not part of the input or output come to represent important features of the task domain, and the regularities in the task are captured by the interactions of these units (refer to the original paper of Rumelhart, Hinton, and Williams (1986) and the review by Widrow and Lehr (1990) for an overview).”
BackgroundNeural networks for control systems—A survey
Hunt, K. J., Sbarbaro, D., Żbikowski, R., & Gawthrop, P. J. (1992) · Automatica · doi:10.1016/0005-1098(92)90053-i · Cited by 1,864
Prokhorov, D. V., & Wunsch, D. C. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623201 · Cited by 1,186
Neural networks and their applications
Bishop, C. M. (1994) · Review of Scientific Instruments · doi:10.1063/1.1144830 · Cited by 926
Gao, S., Zhou, M., Wang, Y., Cheng, J., Yachi, H., & Wang, J. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2846646 · Cited by 698
On the problem of local minima in backpropagation
Gori, M., & Tesi, A. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.107014 · Cited by 650
What do we need to build explainable AI systems for the medical domain?
Holzinger, A., Biemann, C., Pattichis, C. S., & Kell, D. B. (2017) · arXiv · doi:10.48550/arxiv.1712.09923 · Cited by 636
Electronic synapses made of layered two-dimensional materials
Shi, Y., Liang, X., Yuan, B., Chen, V., Li, H., Hui, F., Yu, Z., Yuan, F., Pop, E., Wong, H.-S. P., et al. (2018) · Nature Electronics · doi:10.1038/s41928-018-0118-9 · Cited by 636
Metaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V. K., Abraham, A., & Snášel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 606
Scarselli, F., & Chung Tsoi, A. (1998) · Neural Networks · doi:10.1016/s0893-6080(97)00097-x · Cited by 571
A survey on modern trainable activation functions
Apicella, A., Donnarumma, F., Isgrò, F., & Prevete, R. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.01.026 · Cited by 571
Statistical aspects of neural networks
Ripley, B. D. (1993) · Networks and Chaos — Statistical and Probabilistic Aspects · doi:10.1007/978-1-4899-3099-6_2 · Cited by 504
Neural networks: applications in industry, business and science
Widrow, B., Rumelhart, D. E., & Lehr, M. A. (1994) · Communications of the ACM · doi:10.1145/175247.175257 · Cited by 494
Self-citationA neural network component for an intrusion detection system
Debar, H., Becker, M., & Siboni, D. (2003) · Proceedings 1992 IEEE Computer Society Symposium on Research in Security and Privacy · doi:10.1109/risp.1992.213257 · Cited by 461
Kasabov, N. K. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.01.006 · Cited by 454
A review of deep learning with special emphasis on architectures, applications and recent trends
Sengupta, S., Basak, S., Saikia, P., Paul, S., Tsalavoutis, V., Atiah, F., Ravi, V., & Peters, A. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105596 · Cited by 454
PAOLA, J. D., & SCHOWENGERDT, R. A. (1995) · International Journal of Remote Sensing · doi:10.1080/01431169508954607 · Cited by 439
Concrete compressive strength using artificial neural networks
Asteris, P. G., & Mokos, V. G. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04663-2 · Cited by 435
Sahiner, B., Chan, H.-P., Petrick, N., Wei, D., Helvie, M. A., Adler, D. D., & Goodsitt, M. M. (1996) · IEEE Transactions on Medical Imaging · doi:10.1109/42.538937 · Cited by 420
Bouwmans, T., Javed, S., Sultana, M., & Jung, S. K. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.024 · Cited by 396
Theory and applications of neural networks for industrial control systems
Fukuda, T., & Shibata, T. (1992) · IEEE Transactions on Industrial Electronics · doi:10.1109/41.170966 · Cited by 391
Azlan Hussain, M. (1999) · Artificial Intelligence in Engineering · doi:10.1016/s0954-1810(98)00011-9 · Cited by 381
A neural network short term load forecasting model for the Greek power system
Bakirtzls, A. G., Petridls, V., Klartzis, S. J., Alexladls, M. C., & Malssls, A. H. (1996) · IEEE Transactions on Power Systems · doi:10.1109/59.496166 · Cited by 373
Machine learning for interatomic potential models
Mueller, T., Hernandez, A., & Wang, C. (2020) · The Journal of Chemical Physics · doi:10.1063/1.5126336 · Cited by 363
Randomness in neural networks: an overview
Scardapane, S., & Wang, D. (2017) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1200 · Cited by 352
HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems
Kim, J., & Kasabov, N. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00067-2 · Cited by 351
Predicting phishing websites based on self-structuring neural network
Mohammad, R. M., Thabtah, F., & McCluskey, L. (2014) · Neural Computing and Applications · doi:10.1007/s00521-013-1490-z · Cited by 350
Bhattacharya, A., & Chakraborty, C. (2011) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2010.2070770 · Cited by 335
Neural Network Potential Energy Surfaces for Small Molecules and Reactions
Manzhos, S., & Carrington, T. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00665 · Cited by 329
Kumar, S., Gopi, T., Harikeerthana, N., Gupta, M. K., Gaur, V., Krolczyk, G. M., & Wu, C. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-02029-5 · Cited by 328
Review of neural network applications in medical imaging and signal processing
Miller, A. S., Blott, B. H., & hames, T. K. (1992) · Medical & Biological Engineering & Computing · doi:10.1007/bf02457822 · Cited by 328
A review of automatic differentiation and its efficient implementation
Margossian, C. C. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1305 · Cited by 321
On the complex backpropagation algorithm
Benvenuto, N., & Piazza, F. (1992) · IEEE Transactions on Signal Processing · doi:10.1109/78.127967 · Cited by 317
Shin, Y., & Ghosh, J. (2002) · IJCNN-91-Seattle International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.155142 · Cited by 299
Nonlinear internal model control strategy for neural network models
Nahas, E. P., Henson, M. A., & Seborg, D. E. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80022-2 · Cited by 297
Machine Learning in Materials Science: Recent Progress and Emerging Applications
Mueller, T., Kusne, A. G., & Ramprasad, R. (2016) · Reviews in Computational Chemistry · doi:10.1002/9781119148739.ch4 · Cited by 295
Ling, H., Koutsouras, D. A., Kazemzadeh, S., van de Burgt, Y., Yan, F., & Gkoupidenis, P. (2020) · Applied Physics Reviews · doi:10.1063/1.5122249 · Cited by 294
SPAN: SPIKE PATTERN ASSOCIATION NEURON FOR LEARNING SPATIO-TEMPORAL SPIKE PATTERNS
MOHEMMED, A., SCHLIEBS, S., MATSUDA, S., & KASABOV, N. (2012) · International Journal of Neural Systems · doi:10.1142/s0129065712500128 · Cited by 270
Manzhos, S., & Carrington, T. (2006) · The Journal of Chemical Physics · doi:10.1063/1.2336223 · Cited by 256
The Integration of Artificial Intelligence into Clinical Practice
Karalis, V. D. (2024) · Applied Biosciences · doi:10.3390/applbiosci3010002 · Cited by 255
Early History of Machine Learning
Fradkov, A. L. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.1888 · Cited by 190
Christensen, J. C., Estepp, J. R., Wilson, G. F., & Russell, C. A. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.091 · Cited by 144
Sutherland, S. M., Chawla, L. S., Kane-Gill, S. L., Hsu, R. K., Kramer, A. A., Goldstein, S. L., Kellum, J. A., Ronco, C., Bagshaw, S. M., & on behalf of the 15 ADQI Consensus Group (2016) · Canadian Journal of Kidney Health and Disease · doi:10.1186/s40697-016-0099-4 · Cited by 115
Noll, P., & Henkel, M. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.10.018 · Cited by 60
“The back-propagation learning algorithm for neural network training was first applied in the PhD thesis of Paul Werbos in 1974 for estimation of a dynamic model that predicts nationalism and social communications [97–98].”
BackgroundMethodStructural Control: Past, Present, and Future
(1997) · doi:10.1061/(asce)0733-9399(1997)123:9(897
Metadata
- Authors
- Widrow, B., & Lehr, M. A.
- Venue
- Proceedings of the IEEE
- Published
- 1990
- Volume
- 78
- Issue
- 9
- Pages
- 1415-1442
- ISSN
- 0018-9219 (ISSN-L)
- OpenAlex
- W2116424792
- Cited by
- 2,242
- References
- 92
- FWCI
- 43.92
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.