The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index.
Human-competitive results produced by genetic programming
Open accessAbstract
Genetic programming has now been used to produce at least 76 instances of results that are competitive with human-produced results. These human-competitive results come from a wide variety of fields, including quantum computing circuits, analog electrical circuits, antennas, mechanical systems, controllers, game playing, finite algebras, photonic systems, image recognition, optical lens systems, mathematical algorithms, cellular automata rules, bioinformatics, sorting networks, robotics, assembly code generation, software repair, scheduling, communication protocols, symbolic regression, reverse engineering, and empirical model discovery. This paper observes that, despite considerable variation in the techniques employed by the various researchers and research groups that produced these human-competitive results, many of the results share several common features. Many of the results were achieved by using a developmental process and by using native representations regularly used by engineers in the fields involved. The best individual in the initial generation of the run of genetic programming often contains only a small number of operative parts. Most of the results that duplicated the functionality of previously issued patents were novel solutions, not infringing solutions. In addition, the production of human-competitive results, as well as the increased intricacy of the results, are broadly correlated to increased availability of computing power tracked by Moore’s law. The paper ends by predicting that the increased availability of computing power (through both parallel computing and Moore’s law) should result in the production, in the future, of an increasing flow of human-competitive results, as well as more intricate and impressive results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
Self-citationI.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
Optimum Settings for Automatic Controllers
Ziegler, J. G., & Nichols, N. B. (1942) · Journal of Fluids Engineering · doi:10.1115/1.4019264 · Cited by 5,212
PID Controllers: Theory, Design, and Tuning
Åström, K. J., & Hägglund, T. J. (1995) · Lund University Publications (Lund University) · Cited by 4,741
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
Distilling Free-Form Natural Laws from Experimental Data
Schmidt, M., & Lipson, H. (2009) · Science · doi:10.1126/science.1165893 · Cited by 2,890
Optimum Settings for Automatic Controllers
Ziegler, J. G., & Nichols, N. B. (1993) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.2899060 · Cited by 2,460
Induction: Processes of Inference, Learning, and Discovery
Holland, J. H., Holyoak, K. J., Nisbett, R. E., Thagard, P. R., & Smoliar, S. W. (1987) · IEEE Expert · doi:10.1109/mex.1987.4307100 · Cited by 2,305
Mellor, D. H. (1981) · Cited by 1,981
Genetic programming II: Automatic discovery of reusable programs
(1995) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(95)90099-3 · Cited by 1,901
Banzhaf, W., Francone, F. D., Keller, R. E., & Nordin, P. C. (1998) · Cited by 1,678
Induction: Processes Of Inference
Holland, J. H., Holyoak, K. J., Nisbett, R. E., & Thagard, P. (1986) · The MIT Press eBooks · doi:10.7551/mitpress/3729.001.0001 · Cited by 1,534
Some studies in machine learning using the game of checkers
Samuel, A. L. (2000) · IBM Journal of Research and Development · doi:10.1147/rd.441.0206 · Cited by 1,439
Optimum Setting for Automatic Controllers
Zieglar, J. G. (1942) · Medical Entomology and Zoology · Cited by 1,155
Genetic Programming: An Introduction
Banzhaf, W., Keller, R. E., & Nordin, P. C. (1997) · Cited by 1,052
Automated reverse engineering of nonlinear dynamical systems
Bongard, J., & Lipson, H. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609476104 · Cited by 792
Pattern-Directed Inference Systems
(1978) · Elsevier eBooks · doi:10.1016/c2013-0-11671-6 · Cited by 777
Genetic Programming III: Darwinian Invention and Problem Solving
Koza, J. R., André, D., Bennett, F. H., & Keane, M. A. (1999) · Medical Entomology and Zoology · Cited by 763
Self-citationAutomatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761
Advances in Genetic Programming
(1996) · The MIT Press eBooks · doi:10.7551/mitpress/1109.001.0001 · Cited by 724
Koza, J. R. (1990) · Cited by 721
Self-citationAdvances in genetic programming
Fogel, D. B. (1995) · Biosystems · doi:10.1016/0303-2647(95)90007-1 · Cited by 703
(2005) · Genetic Programming Series · doi:10.1007/b137549 · Cited by 693
A Representation for the Adaptive Generation of Simple Sequential Programs
Cramer, N. L. (1985) · international conference on Genetic algorithms · Cited by 641
A learning system based on genetic adaptive algorithms
Smith, S. F. (1980) · Medical Entomology and Zoology · Cited by 539
Holland, J. H., & Reitman, J. S. (1978) · Pattern-Directed Inference Systems · doi:10.1016/b978-0-12-737550-2.50020-8 · Cited by 539
Genetic Programming III - Darwinian Invention and Problem Solving
Nordin, P. (1999) · Evolutionary Computation · doi:10.1162/evco.1999.7.4.451 · Cited by 501
Cognitive systems based on adaptive algorithms
Holland, J. H., & Reitman, J. S. (1977) · ACM SIGART Bulletin · doi:10.1145/1045343.1045373 · Cited by 469
Proceedings of the Genetic and Evolutionary Computation Conference - GECCO - 2006
Keijzer, M., Lipson, H., Bosman, P. A. N., & Cwi, N. (2006) · Data Archiving and Networked Services (DANS) · Cited by 431
Proceedings: Second international conference on intelligent systems for molecular biology
Altman, R. A., Brutlag, D. L., Karp, P. D., Lathrop, R. H., & Searls, D. B. (1994) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 420
Koza, J. R., Bennett, F. H., Andre, D., & Keane, M. A. (1996) · Artificial Intelligence in Design ’96 · doi:10.1007/978-94-009-0279-4_9 · Cited by 361
Self-citation2021 IEEE Congress on Evolutionary Computation (CEC)
(2021) · doi:10.1109/cec45853.2021 · Cited by 350
Hierarchical genetic algorithms operating on populations of computer programs
Koza, J. R. (1989) · International Joint Conference on Artificial Intelligence · Cited by 294
Self-citationEvolving 3D Morphology and Behavior by Competition
Sims, K. (1994) · Artificial Life · doi:10.1162/artl.1994.1.4.353 · Cited by 284
Genetic Algorithms and their Applications
(2013) · Psychology Press eBooks · doi:10.4324/9780203761595 · Cited by 276
Genetic Programming 1998: Proceedings of the Third Annual Conference
Koza, J. R., Banzhaf, W., Kumar Chellapilla, A., Deb, K., Dorigo, M., Fogel, D. B., Garzón, M., Goldberg, D. E., Iba, H., & Riolo, R. (1999) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.1999.771172 · Cited by 275
Self-citationA genetic programming approach to automated software repair
Forrest, S., Nguyen, T., Weimer, W., & Le Goues, C. (2009) · Proceedings of the 11th Annual conference on Genetic and evolutionary computation · doi:10.1145/1569901.1570031 · Cited by 236
Genetic Programming: Theory and Practice
O’Reilly, U.-M., Yu, T., Riolo, R., & Worzel, B. (2006) · Genetic Programming · doi:10.1007/0-387-23254-0_1 · Cited by 226
Adding Learning to the Cellular Development of Neural Networks: Evolution and the Baldwin Effect
Gruau, F., & Whitley, D. (1993) · Evolutionary Computation · doi:10.1162/evco.1993.1.3.213 · Cited by 206
Artificial Intelligence in Design ’96
Gero, J. S., & Sudweeks, F. (1996) · Springer eBooks · doi:10.1007/978-94-009-0279-4 · Cited by 194
Hearing Colors, Tasting Shapes
Ramachandran, V. S., & Hubbard, E. M. (2003) · Scientific American · doi:10.1038/scientificamerican0503-52 · Cited by 178
(1995) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(95)90071-3 · Cited by 166
Automatic Creation of Human-Competitive Programs and Controllers by Means of Genetic Programming
Koza, J. R., Keane, M. A., Yu, J., Bennett, F. H., & Mydlowec, W. (2000) · Genetic Programming and Evolvable Machines · doi:10.1023/a:1010076532029 · Cited by 164
Self-citationAdvances in Genetic Programming
(1999) · The MIT Press eBooks · doi:10.7551/mitpress/1110.001.0001 · Cited by 152
(1997) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(97)84604-4 · Cited by 150
2022 IEEE Congress on Evolutionary Computation (CEC)
(2022) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec55065.2022.9870329 · Cited by 147
Two-dimensional photonic crystals designed by evolutionary algorithms
Preble, S. F., Lipson, M. F., & Lipson, H. (2005) · Applied Physics Letters · doi:10.1063/1.1862783 · Cited by 135
Genetic algorithms and their applications
Grefenstette, J. J. (1987) · Cited by 129
Finding a better-than-classical quantum AND/OR algorithm using genetic programming
Spector, L. C., Barnum, H., Bernstein, H. J., & Swamy, N. (2003) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.1999.785553 · Cited by 128
Toward an Evolvable Model of Development for Autonomous Agent Synthesis
Dellaert, F., & Beer, R. D. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/1428.003.0028 · Cited by 117
André, D., Bennett, F. H., III, & Koza, J. R. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3242.003.0004 · Cited by 112
Self-citationGenetic synthesis of Boolean neural networks with a cell rewriting developmental process
Gruau, F. (2003) · doi:10.1109/cogann.1992.273948 · Cited by 111
Koza, J. R., Bennett, F. H., André, D., & Keane, M. A. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3242.003.0018 · Cited by 93
Self-citationAndré, D., & Teller, A. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48422-1_28 · Cited by 88
Genetic Synthesis of Modular Neural Networks
Gruau, F. (1993) · international conference on Genetic algorithms · Cited by 86
Using the genetic algorithm to generate LISP source code to solve the prisoner's dilemma
Fujiko, C., & Dickinson, J. (1987) · international conference on Genetic algorithms · Cited by 82
Koza, J. R., Bennett, F. H., André, D., & Keane, M. A. (2002) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/icec.1996.542327 · Cited by 74
Self-citationGP-EndChess: Using Genetic Programming to Evolve Chess Endgame Players
Hauptman, A., & Sipper, M. (2005) · Lecture notes in computer science · doi:10.1007/978-3-540-31989-4_11 · Cited by 73
Genetic programming for quantum computers
Spector, L. C., Barnum, H., & Bernstein, H. J. (1998) · Bristol Research (University of Bristol) · Cited by 72
Quantum Computing Applications of Genetic Programming
(1999) · The MIT Press eBooks · doi:10.7551/mitpress/1110.003.0010 · Cited by 70
Automated Discovery of Composite SAT Variable-Selection Heuristics
Fukunaga, A. S. (2002) · Cited by 67
Koza, J. R., Keane, M. A., & Streeter, M. J. V. (2003) · Scientific American · doi:10.1038/scientificamerican0203-52 · Cited by 67
Self-citationGenetic programming for finite algebras
Spector, L. C., Clark, D. M., Lindsay, I., Barr, B., & Klein, J. (2008) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1389095.1389343 · Cited by 65
Conference, G. P. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3242.001.0001 · Cited by 59
Genetic Micro Programming of Neural Networks
(2003) · The MIT Press eBooks · doi:10.7551/mitpress/1108.003.0030 · Cited by 58
Evolving Local Search Heuristics for SAT Using Genetic Programming
Fukunaga, A. S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24855-2_59 · Cited by 57
Evolving local and global weighting schemes in information retrieval
Cummins, R., & O’Riordan, C. (2006) · Information Retrieval · doi:10.1007/s10791-006-1682-6 · Cited by 50
Automatic Quantum Computer Programming: A Genetic Programming Approach (Genetic Programming)
Spector, L. C. (2006) · Springer eBooks · Cited by 49
Quantum circuits for OR and AND of ORs
Barnum, H., Bernstein, H. J., & Spector, L. C. (2000) · Journal of Physics A Mathematical and General · doi:10.1088/0305-4470/33/45/304 · Cited by 49
Automated synthesis of computational circuits using genetic programming
Koza, J. R., Bennett, F. H., Lohn, J. D., Dunlap, F., Keane, M. A., & André, D. (2002) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/icec.1997.592353 · Cited by 47
Self-citationEvolutionary learning of local descriptor operators for object recognition
Pérez, C. B., & Gustavo Olague, A. (2009) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1569901.1570043 · Cited by 45
Evolution of an Efficient Search Algorithm for the Mate-In-N Problem in Chess
Hauptman, A., & Sipper, M. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-71605-1_8 · Cited by 41
GP-Gammon: Genetically Programming Backgammon Players
Azaria, Y., & Sipper, M. (2005) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-005-2990-0 · Cited by 40
Koza, J. R., Bennett, F. H., André, D., & Keane, M. A. (1997) · Lecture notes in computer science · doi:10.1007/3-540-63173-9_56 · Cited by 35
Self-citationGP-Gammon: Using Genetic Programming to Evolve Backgammon Players
Azaria, Y., & Sipper, M. (2005) · Lecture notes in computer science · doi:10.1007/978-3-540-31989-4_12 · Cited by 34
Morphogenesis for evolvable systems
Kitano, H. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61093-6_5 · Cited by 34
Evolution of a human-competitive quantum fourier transform algorithm using genetic programming
Massey, P., Clark, J. A., & Stepney, S. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068288 · Cited by 26
Machine invention of quantum computing circuits by means of genetic programming
Spector, L. C., & Klein, J. (2008) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060408000188 · Cited by 26
Automated re-invention of six patented optical lens systems using genetic programming
Koza, J. R., Al-Sakran, S. H., & Jones, L. W. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068337 · Cited by 25
Self-citationLearning invariant region descriptor operators with genetic programming and the F-measure
Pérez, C. B., & Gustavo Olague, A. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761178 · Cited by 24
Evolutionary Algorithms And Intelligent Tools In Engineering Optimization
Annicchiarico, W., Périaux, J., Cerrolaza, M., & Winter, G. (2005) · Cited by 24
Evolving blackbox quantum algorithms using genetic programming
Stadelhofer, R., Banzhaf, W., & Suter, D. (2008) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s089006040800019x · Cited by 18
Routine Duplication of Post-2000 Patented Inventions by Means of Genetic Programming
Streeter, M. J. V., Keane, M. A., & Koza, J. R. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45984-7_3 · Cited by 15
Self-citationSolving iterated functions using genetic programming
Schmidt, M. D., & Lipson, H. (2009) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/1570256.1570292 · Cited by 12
Attaining Human–Competitive Game Playing with Genetic Programming
Sipper, M. (2006) · Lecture notes in computer science · doi:10.1007/11861201_4 · Cited by 11
Collet, P., van Hemert, J., Tomassini, M., Tettamanzi, A. G. B., & Keijzer, M. (2005) · Lecture notes in computer science · doi:10.1007/b107383 · Cited by 10
Koza, J. R., Al-Sakran, S. H., & Jones, L. W. (2008) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060408000176 · Cited by 6
Self-citationKoza, J. R., André, D., & Keane, M. A. (2004) · Cited by 5
Self-citation
Cited by
GenProg: A Generic Method for Automatic Software Repair
Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.104 · Cited by 1,085
Automatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761
From evolutionary computation to the evolution of things
Eiben, A. E., & Smith, J. (2015) · Nature · doi:10.1038/nature14544 · Cited by 496
Metadata
- Authors
- Koza, J. R.
- Venue
- Genetic Programming and Evolvable Machines
- Published
- 2010-05-25
- Volume
- 11
- Issue
- 3-4
- Pages
- 251-284
- ISSN
- 1389-2576 (ISSN-L)
- 1573-7632
- OpenAlex
- W2037343293
- Cited by
- 321
- References
- 90
- FWCI
- 22.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.