The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
A review of evolutionary artificial neural networks
Abstract
Research on potential interactions between connectionist learning systems, i.e., artificial neural networks (ANNs), and evolutionary search procedures, like genetic algorithms (GAs), has attracted a lot of attention recently. Evolutionary ANNs (EANNs) can be considered as the combination of ANNs and evolutionary search procedures. This article first distinguishes among three kinds of evolution in EANNs, i.e., the evolution of connection weights, of architectures, and of learning rules. Then it reviews each kind of evolution in detail and analyzes critical issues related to different evolutions. the review shows that although a lot of work has been done on the evolution of connection weights and architectures, few attempts have been made to understand the evolution of learning rules. Interactions among different evolutions are seldom mentioned in current research. However, the evolution of learning rules and its interactions with other kinds of evolution, play a vital role in EANNs. Finally, this article briefly describes a general framework for EANNs, which not only includes the aforementioned three kinds of evolution, but also considers interactions among them. © 1993 John Wiley & Sons, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
Handbook of Genetic Algorithms
Davis, L. D. (1991) · Cumulative Index of Computer Aided Architectural Design · Cited by 7,330
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
(1989) · Cited by 3,214
Research works printed but not linked: 40
- “Evolution of connectionist networks,” In Preprints of the Int. Symp. on AI, Reasoning & Creativity, (Ed.), Griffith University, Queensland, Australia, 1991, pp. 49–52.
- Adaptation in Natural and Artificial Systems, University of Michigan Press, Ann Arbor, MI, 1975.
- , and , “A survey of evolution strategies,” In Proceedings of the Fourth International Conference on Genetic Algorithms, R. K. Belew and L. B. Booker, (Eds.), Morgan Kaufmann, San Mateo, CA, 1991, pp. 2–9.
- Sejnowski, 1987, Complex Systems, 1, 145
- “Two problems with backpropagation and other steepest-descent learning procedures for networks,” In Proceedings of 8th Annual Conference of the Cognitive Science Society, (Erlbaum, Hillsdale, NJ, 1986), pp. 823–831.
- and , “Optimizing neural networks using faster, more accurate genetic search,” In Proceedings of the Third International Conference on Genetic Algorithms and Their Applications, (Ed.), Morgan Kaufmann, San Mateo, CA, 1989, pp. 391–396.
- and , “Parametric connectivity: Training of constrained networks using genetic algorithms,” In Proceedings of the Third International Conference on Genetic Algorithms and Their Applications, J. D. Schaffer (Ed.), Morgan Kaufmann, San Mateo, CA, 1989, pp. 370–374.
- and , Training a Neural Network with a Genetic Algorithm, Technical Report, Dept. of Elec. Eng., Univ. of Queensland, January 1990.
- and , “Parallel algorithms for learning in neural networks with evolution strategy,” In Proceedings of Parallel Computing 89, , and (Eds.), Elsevier Science Publishers B. V., Amsterdam, 1989, pp. 275–280.
- Genetic Neural Networks on MIMD Computers (compressed edition), Ph.D. Thesis, Dept of Theoretical Phys., University of Edinburgh, Scotland, U. K. 1990.
- “Genetic programming,” In Proceedings of International Joint Conference on Neural Netowrks, Vol. 1, Erlbaum, Hillsdale, NJ, 1990, pp. 194–197.
- “The GENITOR algorithm and selective pressure: Why rank-based allocation of reproductive trials is best,” In Proceedings of the Third International Conference on Genetic Algorithms and Their Applications, J. D. Schaffer (Ed.), Morgan Kaufmann, San Mateo, CA, 1989, pp. 116–121.
- Takahashi, 1991, Optical Computing and Processing, 1, 175
- Rosenberg, 1967, Dissertation Abstract International, 28, 2732b
- Wilson, 1987, Machine Learning, 2, 199
- Szu, 1987, Proceedings of IEEE, 75, 1538, 10.1109/PROC.1987.13916 · doi:10.1109/proc.1987.13916
- “Optimization by genetic annealing,” In Proceedings of the Second Australian Conference on Neural Networks, M. Jabri (Ed.), Sydney, Australia, 1991, pp. 94–97.
- Kitano, 1990, Complex Systems, 4, 461
- , and , “Towards the genetic synthesis of neural networks,” In Proceedings of the Third International Conference on Genetic Algorithms and Their Applications, J. D. Schaffer (Ed.), Morgan Kaufmann, San Mateo, CA, 1989, pp. 360–369.
- , and , “Optimisation of artificial neural network structure using genetic techniques implemented on multiple transputers,” Proceedings of Transputing '91, 1991.
- “Darwinian optimization of synthetic neural systems,” In Proceedings of the First IEEE International Conference on Neural Networks, Vol. 3, M. Caudill and C. Butler (Eds.), IEEE, New York, 1987, pp. 769–775.
- and , “Breeding intelligent automata,” In Proceedings of the First IEEE International Conference on Neural Networks, Vol. 3, M. Caudill and C. Butler, (Eds.), IEEE, New York, 1987, pp. 63–69.
- and , “Towards the evolution of symbols,” In Proceedings of Second International Conference on Genetic Algorithms and Their Applications, Erlbaum, Hillsdale, NJ, 1987, pp. 123–131.
- and , “The evolution of connectivity: Pruning neural networks using genetic algorithms,” In Proceedings of International Joint Conference on Neural Networks, I-134-I-137, Erlbaum, Hillsdale, NJ, 1990.
- and , “GENNET—System for computer aided neural network design using genetic algorithms,” In Proceedings of International Joint Conference on Neural Networks, I-102-I-105, Erlbaum, Hillsdale, NJ, 1990.
- , , and , “Preadaption in neural circuits,” In Proceedings of International Joint Conference on Neural Networks, I-202-I-205, Erlbaum, Hillsdale, NJ, 1990.
- , and , “Neural networks, genetic algorithm and fuzzy logic for forecasting,” In Proceedings of the Third International Conference on Advanced Trading Technologies—AI Applications on Wall Street and Worldwide, New York, 1992 (to appear).
- “Learning by gradient descent in function space,” In Proceedings of IEEE International Conference on System, Man, and Cybernetics, Los Angeles, CA, 1990, pp. 242–247.
- Fogel, 1991, IEEE Trans. on Neural Networks, 2, 490, 10.1109/72.134286 · doi:10.1109/72.134286
- Merrill, 1991, Neural Networks, 4, 53, 10.1016/0893-6080(91)90031-Y · DOI
- Lewin, 1975, Cell, 4
- and , “Genetic synthesis of neural network architecture,” In Handbook of Genetic Algorithms, (Ed.), Van Nostrand Reinhold, New York, 1991, pp. 203–221.
- “The fractal structure of the human lung,” In Proceedings of the Conference on Dynamic Patterns in Complex Systems, S. Kelso, (Ed.), Erlbaum, New York, 1988.
- The Organization of Behavior: A Neurophysiological Theory, Wiley, New York, 1949.
- , and , “A biologically supported error-correcting learning rule,” In Proceedings of International Conference on Artificial Neural Networks—ICANN-91, Vol. 1, T. Kohonen, K. Mäkisara, O. Simula, and J. Kangas (Eds.), Elsevier Science Publishers B. V., Amsterdam, 1991, pp. 531–536.
- Hinton, 1987, Complex Systems, 1, 495
- “Adaptation in open systems: Learning and evolution,” In Workshop Konnektionismus, and (Eds.), GMD, Augustin, Germany, 1988, pp. 122–130.
- “The evolution of behavior: Some experiments,” In Proceedings of the First International Conference on Simulation of Adaptive Behavior: From Animals to Animats, J.-A. Meyer and S. W. Wilson (Eds.), MIT Press, Cambridge, MA, 1991.
- and , “Learning from natural selection in an artificial environment,” In Proceedings of International Joint Conference on Neural Networks, Vol. 1, Erlbaum, Hillsdale, NJ, 1990, pp. 189–193.
- “Evolution of connectionist networks,” In AI and Creativity, (Ed.), Kluwer Academic Publishers, Boston, 1993.
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems
Mirjalili, S., Gandomi, A. H., Mirjalili, S. Z., Saremi, S., Faris, H., & Mirjalili, S. M. (2017) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2017.07.002 · Cited by 5,082
Gradient boosting machines, a tutorial
Natekin, A., & Knoll, A. (2013) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2013.00021 · Cited by 3,887
“If we consider connections to earlier developments, it will turn out that the well known cascade correlation neural networks (Fahlman and Lebiere, 1989; Yao, 1993) can be considered a special type of a gradient boosted model, as defined in Algorithm 1.”
BackgroundMethodEvolving artificial neural networks
Yao, X. (1999) · Proceedings of the IEEE · doi:10.1109/5.784219 · Cited by 2,981
Self-citationMaier, H. R., & Dandy, G. C. (2000) · Environmental Modelling & Software · doi:10.1016/s1364-8152(99)00007-9 · Cited by 2,377
Trends in extreme learning machines: A review
Huang, G., Huang, G.-B., Song, S., & You, K. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.001 · Cited by 1,732
Spontaneous evolution of modularity and network motifs
Kashtan, N., & Alon, U. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503610102 · Cited by 878
A new evolutionary system for evolving artificial neural networks
Yao, X., & Liu, Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572107 · Cited by 874
Self-citationZhang, J.-R., Zhang, J., Lok, T.-M., & Lyu, M. R. (2007) · Applied Mathematics and Computation · doi:10.1016/j.amc.2006.07.025 · Cited by 706
Designing neural networks through neuroevolution
Stanley, K. O., Clune, J., Lehman, J., & Miikkulainen, R. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0006-z · Cited by 689
Metaheuristics: A bibliography
Osman, I. H., & Laporte, G. (1996) · Annals of Operations Research · doi:10.1007/bf02125421 · Cited by 672
Metaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V. K., Abraham, A., & Snášel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 606
Combinations of genetic algorithms and neural networks: a survey of the state of the art
Schaffer, J. D., Whitley, D., & Eshelman, L. J. (2003) · [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks · doi:10.1109/cogann.1992.273950 · Cited by 570
Particle swarm optimiser with neighbourhood operator
Suganthan, P. N. (2003) · Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) · doi:10.1109/cec.1999.785514 · Cited by 514
Kwok, T.-Y., & Yeung, D.-Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572102 · Cited by 493
Genetic evolution of the topology and weight distribution of neural networks
Maniezzo, V. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.265959 · Cited by 436
Evolution of homing navigation in a real mobile robot
Floreano, D., & Mondada, F. (1996) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.499791 · Cited by 421
Evolutionary artificial neural networks: a review
Ding, S., Li, H., Su, C., Yu, J., & Jin, F. (2013) · Artificial Intelligence Review · doi:10.1007/s10462-011-9270-6 · Cited by 412
An evolutionary artificial neural networks approach for breast cancer diagnosis
Abbass, H. A. (2002) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(02)00028-3 · Cited by 407
Evolutionary Large-Scale Multi-Objective Optimization: A Survey
Tian, Y., Si, L., Zhang, X., Cheng, R., He, C., Tan, K. C., & Jin, Y. (2022) · ACM Computing Surveys · doi:10.1145/3470971 · Cited by 401
Benti, N. E., Chaka, M. D., & Semie, A. G. (2023) · Sustainability · doi:10.3390/su15097087 · Cited by 378
Promises and challenges of evolvable hardware
Yao, X., & Higuchi, T. (1999) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.740672 · Cited by 283
Self-citationMaking use of population information in evolutionary artificial neural networks
Yao, X., & Liu, Y. (1998) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.678637 · Cited by 257
Self-citationWhitehead, B. A., & Choate, T. D. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.508930 · Cited by 253
DeepPROTACs is a deep learning-based targeted degradation predictor for PROTACs
Li, F., Hu, Q., Zhang, X., Sun, R., Liu, Z., Wu, S., Tian, S., Ma, X., Dai, Z., Yang, X., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-34807-3 · Cited by 159
Chow, J. C. L., & Li, K. (2024) · JMIR Bioinformatics and Biotechnology · doi:10.2196/64406 · Cited by 75
Metadata
- Authors
- Yao, X.
- Venue
- International Journal of Intelligent Systems
- Publisher
- Hindawi Limited
- Published
- 1993
- Volume
- 8
- Issue
- 4
- Pages
- 539-567
- ISSN
- 0884-8173 (ISSN-L)
- 1098-111X
- OpenAlex
- W2072245049
- Cited by
- 492
- References
- 54
- FWCI
- 10.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 8278 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.