AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence
Open accessAbstract
Perhaps the most ambitious scientific quest in human history is the creation of general artificial intelligence, which roughly means AI that is as smart or smarter than humans. The dominant approach in the machine learning community is to attempt to discover each of the pieces required for intelligence, with the implicit assumption that some future group will complete the Herculean task of figuring out how to combine all of those pieces into a complex thinking machine. I call this the "manual AI approach". This paper describes another exciting path that ultimately may be more successful at producing general AI. It is based on the clear trend in machine learning that hand-designed solutions eventually are replaced by more effective, learned solutions. The idea is to create an AI-generating algorithm (AI-GA), which automatically learns how to produce general AI. Three Pillars are essential for the approach: (1) meta-learning architectures, (2) meta-learning the learning algorithms themselves, and (3) generating effective learning environments. I argue that either approach could produce general AI first, and both are scientifically worthwhile irrespective of which is the fastest path. Because both are promising, yet the ML community is currently committed to the manual approach, I argue that our community should increase its research investment in the AI-GA approach. To encourage such research, I describe promising work in each of the Three Pillars. I also discuss AI-GA-specific safety and ethical considerations. Because it it may be the fastest path to general AI and because it is inherently scientifically interesting to understand the conditions in which a simple algorithm can produce general AI (as happened on Earth where Darwinian evolution produced human intelligence), I argue that the pursuit of AI-GAs should be considered a new grand challenge of computer science research.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The proposed ADAS introduces a novel area in AI-GA research.
“The proposed Automated Design of Agentic Systems (ADAS) introduces a novel area in AI-GA research, potentially accelerating the development of Artificial General Intelligence (AGI) beyond current manual approaches (Clune, 2019).”
From Automated Design of Agentic Systems (2024) · cites this paper as Clune, 2019
The history of machine learning reveals a recurring theme: manually created artifacts become replaced by learned, more efficient solutions over time as we get more compute and data.
“However, the history of machine learning reveals a recurring theme: manually created artifacts become replaced by learned, more efficient solutions (Clune, 2019) over time as we get more compute and data (Sutton, 2019).”
From Automated Design of Agentic Systems (2024) · cites this paper as Clune, 2019
Self-improving AI systems' continued development appears inevitable.
“Furthermore, as self-improving AI systems become prominent (Clune, 2019; Fernando et al., 2024; Lu et al., 2024a; Zelikman et al., 2022), their continued development appears inevitable.”
From Automated Design of Agentic Systems (2024) · cites this paper as Clune, 2019
Any advancement that increases the autonomous capabilities of AI systems introduces its own set of safety considerations, especially for systems that improve in an open-ended way.
“Any advancement that increases the autonomous capabilities of AI systems introduces its own set of safety considerations (Bengio et al., 2024), especially for systems that improve in an open-ended way (Ecoffet et al., 2020; Clune, 2019).”
From Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents (2025) · cites this paper as Clune, 2019
Manually crafted artifacts are often replaced by learnable and optimizable ones.
“manually crafted artifacts are often replaced by learnable and optimizable ones”
From EvoFlow: Evolving Diverse Agentic Workflows On The Fly (2025) · cites this paper as Clune, 2019
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · see citing works
Artificial intelligence: a modern approach
Kumar, D. A., Balasubramanian, S., Byeon, D. H., & Manerkar, P. G. V. (1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 22,182 · see citing works
GAN(Generative Adversarial Nets)
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · see citing works
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · see citing works
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · see citing works
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273 · see citing works
(2010) · Cited by 14,134 · see citing works
(2010) · International Conference on Machine Learning · Cited by 13,995 · see citing works
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · see citing works
(2016) · Cited by 11,679 · see citing works
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · see citing works
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260 · cited 1× · see citing works
“This same phenomenon has occurred in other modes of machine learning, such as sound (e.g. speech-to-text systems) [63], touch [49], natural language understanding and translation [36, 8, 177], and many more [52].”
BackgroundModel-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · see citing works
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · see citing works
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899 · see citing works
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merriënboer, B., Bahdanau, D., & Bengio, Y. (2014) · SSST@EMNLP · doi:10.3115/v1/w14-4012 · Cited by 7,251 · see citing works
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691 · see citing works
The Cultural Origins of Human Cognition
Tomasello, M. (2009) · doi:10.2307/j.ctvjsf4jc · Cited by 6,368 · see citing works
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · see citing works
Self-citationNeural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,091 · see citing works
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636 · see citing works
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578 · see citing works
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513 · see citing works
Dynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167 · see citing works
Computer vision: algorithms and applications
Szeliski, R. (2011) · Choice Reviews Online · doi:10.5860/choice.48-5140 · Cited by 4,007 · see citing works
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. P. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,269 · see citing works
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258 · see citing works
Self-citation(1989) · Cited by 3,214 · see citing works
Evolving artificial neural networks
Yao, X. (1999) · Proceedings of the IEEE · doi:10.1109/5.784219 · Cited by 2,995 · see citing works
Apprenticeship learning via inverse reinforcement learning
Abbeel, P., & Ng, A. Y. (2004) · doi:10.1145/1015330.1015430 · Cited by 2,873 · see citing works
Optimization as a Model for Few-Shot Learning
Ravi, S., & Larochelle, H. (2017) · International Conference on Learning Representations · Cited by 2,766 · see citing works
Catastrophic forgetting in connectionist networks
French, R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01294-2 · Cited by 2,311 · see citing works
PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY
Wagner, G. P., & Altenberg, L. (1996) · Evolution · doi:10.1111/j.1558-5646.1996.tb02339.x · Cited by 2,065 · see citing works
Progressive Neural Architecture Search
Liu, C., Zoph, B., Neumann, M., Shlens, J., Wei, H., Li, L.-J., Fei-Fei, L., Yuille, A., Huang, J., & Murphy, K. P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_2 · Cited by 1,946 · see citing works
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846 · see citing works
Curiosity-Driven Exploration by Self-Supervised Prediction
Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815 · see citing works
Continual Learning Through Synaptic Intelligence
Zenke, F., Poole, B., & Ganguli, S. (2017) · arXiv · doi:10.48550/arxiv.1703.04200 · Cited by 1,784 · see citing works
Understanding Neural Networks Through Deep VisualizationPreprint
Yosinski, J., Clune, J., Nguyen, A. M., Fuchs, T. J., & Lipson, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06579 · Cited by 1,687 · see citing works
Self-citation(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621 · see citing works
(1998) · Kybernetes · doi:10.1108/k.1998.27.9.1093.3 · Cited by 1,576 · see citing works
Learning to learn by gradient descent by gradient descent
Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., Shillingford, B., & de Freitas, N. (2016) · arXiv · doi:10.48550/arxiv.1606.04474 · Cited by 1,486 · see citing works
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412 · see citing works
ALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. A. (2018) · doi:10.1184/r1/6603146 · Cited by 1,403 · see citing works
Hinton, G. E., Krizhevsky, A., & Wang, S. D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_6 · Cited by 1,360 · see citing works
Concrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314 · see citing works
Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit
Hahnloser, R. H. R., Sarpeshkar, R., Mahowald, M. A., Douglas, R. J., & Seung, H. S. (2000) · Nature · doi:10.1038/35016072 · Cited by 1,293 · see citing works
Abandoning Objectives: Evolution Through the Search for Novelty Alone
Lehman, J., & Stanley, K. O. (2011) · Evolutionary Computation · doi:10.1162/evco_a_00025 · Cited by 1,216 · see citing works
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126 · see citing works
Principles of brain evolution.
Striedter, G. (2005) · Choice Reviews Online · doi:10.5860/choice.42-5260 · Cited by 1,124 · see citing works
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2017) · arXiv · doi:10.48550/arxiv.1712.01815 · Cited by 1,102 · see citing works
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,043 · see citing works
Evolution Strategies as a Scalable Alternative to Reinforcement Learning
Salimans, T., Ho, J., Chen, X., Sidor, S., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1703.03864 · Cited by 1,027 · see citing works
Robustness and Evolvability in Living Systems
Wagner, A. (2005) · Princeton University Press eBooks · doi:10.1515/9781400849383 · Cited by 975 · see citing works
The ethics of artificial intelligence
Bostrom, N., & Yudkowsky, E. (2014) · The Cambridge Handbook of Artificial Intelligence · doi:10.1017/cbo9781139046855.020 · Cited by 918 · cited 1× · see citing works
“The question of whether and why we should create general AI is a complicated one and is the focus of many articles [143, 41, 4, 18, 15].”
BackgroundMiikkulainen, R. P., Liang, J., Meyerson, E., Rawal, A., Fink, D., Francon, O., Raju, B., Shahrzad, H., Navruzyan, A., Duffy, N., et al. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-815480-9.00015-3 · Cited by 854 · see citing works
Reinforcement Learning with Unsupervised Auxiliary TasksPreprint
Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05397 · Cited by 826 · see citing works
What is intrinsic motivation? A typology of computational approaches
Oudeyer, P.-Y. (2007) · Frontiers in Neurorobotics · doi:10.3389/neuro.12.006.2007 · Cited by 811 · see citing works
Evolving 3D Morphology and Behavior by Competition
Sims, K. (1994) · Artificial Life · doi:10.1162/artl.1994.1.353 · Cited by 800 · see citing works
A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks
Stanley, K. O., D’Ambrosio, D. B., & Gauci, J. (2009) · Artificial Life · doi:10.1162/artl.2009.15.2.15202 · Cited by 781 · see citing works
The evolutionary origin of complex features
Lenski, R. E., Ofria, C., Pennock, R. T., & Adami, C. (2003) · Nature · doi:10.1038/nature01568 · Cited by 754 · see citing works
Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2056368 · Cited by 747 · see citing works
Curious model-building control systems
Schmidhuber, J. (1991) · [Proceedings] 1991 IEEE International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.170605 · Cited by 733 · see citing works
Compositional pattern producing networks: A novel abstraction of development
Stanley, K. O. (2007) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-007-9028-8 · Cited by 714 · see citing works
On the Computational Power of Neural Nets
Siegelmann, H. T., & Sontag, E. D. (1995) · Journal of Computer and System Sciences · doi:10.1006/jcss.1995.1013 · Cited by 703 · see citing works
Designing neural networks through neuroevolution
Stanley, K. O., Clune, J., Lehman, J., & Miikkulainen, R. P. (2018) · Nature Machine Intelligence · doi:10.1038/s42256-018-0006-z · Cited by 702 · see citing works
Self-citationSuch, F. P., Madhavan, V., Conti, E., Lehman, J., Stanley, K. O., & Clune, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06567 · Cited by 689 · see citing works
Self-citationVisualizing and Understanding Neural Models in NLP
Li, J., Chen, X., Hovy, E. H., & Jurafsky, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1082 · Cited by 673 · see citing works
Noisy Networks for ExplorationPreprint
Fortunato, M., Azar, M. G., Piot, B., Menick, J., Osband, I., Graves, A., Mnih, V., Munos, R., Hassabis, D., Pietquin, O., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10295 · Cited by 664 · see citing works
Human-level performance in 3D multiplayer games with population-based reinforcement learning
Jaderberg, M., Czarnecki, W. M., Dunning, I., Marris, L., Lever, G., Castañeda, A. G., Beattie, C., Rabinowitz, N. C., Morcos, A. S., Ruderman, A., et al. (2019) · Science · doi:10.1126/science.aau6249 · Cited by 662 · see citing works
Research Priorities for Robust and Beneficial Artificial Intelligence
Russell, S., Dewey, D., & Tegmark, M. (2015) · AI Magazine · doi:10.1609/aimag.v36i4.2577 · Cited by 637 · see citing works
FeUdal Networks for Hierarchical Reinforcement LearningPreprint
Vezhnevets, A. S., Osindero, S., Schaul, T., Heess, N., Jaderberg, M., Silver, D., & Kavukcuoglu, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01161 · Cited by 608 · see citing works
The evolutionary origins of modularity
Clune, J., Mouret, J.-B., & Lipson, H. (2013) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2012.2863 · Cited by 600 · see citing works
Self-citationPlug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space
Nguyen, A., Clune, J., Bengio, Y., Dosovitskiy, A., & Yosinski, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.374 · Cited by 597 · see citing works
Self-citationEvolution of biological complexity
Adami, C., Ofria, C., & Collier, T. C. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.9.4463 · Cited by 592 · see citing works
Pigliucci, M. (2007) · Nature Reviews Genetics · doi:10.1038/nrg2278 · Cited by 579 · see citing works
Learning to reinforcement learn
Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M. (2016) · arXiv · doi:10.48550/arxiv.1611.05763 · Cited by 579 · see citing works
Learning to Learn Using Gradient Descent
Hochreiter, S., Younger, A. S., & Conwell, P. R. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44668-0_13 · Cited by 575 · see citing works
Behavioral Cloning from Observation
Torabi, F., Warnell, G., & Stone, P. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/687 · Cited by 574 · see citing works
Langton, C. G. (1995) · Cited by 571 · see citing works
Universal Artificial Intellegence
Hutter, M. (2005) · Texts in Theoretical Computer Science An EATCS Series · doi:10.1007/b138233 · Cited by 523 · see citing works
Procedural Content Generation in Games
Shaker, N., Togelius, J., & Nelson, M. J. (2016) · Computational Synthesis and Creative Systems · doi:10.1007/978-3-319-42716-4 · Cited by 519 · see citing works
RL$^2$: Fast Reinforcement Learning via Slow Reinforcement Learning
Duan, Y., Schulman, J., Chen, X., Bartlett, P. L., Sutskever, I., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1611.02779 · Cited by 503 · see citing works
Dayan, P., & Hinton, G. E. (1992) · Cited by 488 · see citing works
Diversity is All You Need: Learning Skills without a Reward Function
Eysenbach, B., Gupta, A., Ibarz, J., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1802.06070 · Cited by 480 · see citing works
A Taxonomy for Artificial Embryogeny
Stanley, K. O., & Miikkulainen, R. P. (2003) · Artificial Life · doi:10.1162/106454603322221487 · Cited by 426 · see citing works
Mermillod, M., Bugaïska, A., & Bonin, P. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00504 · Cited by 425 · see citing works
Parameter Space Noise for ExplorationPreprint
Plappert, M., Houthooft, R., Dhariwal, P., Sidor, S., Chen, R. Y., Chen, X., Asfour, T., Abbeel, P., & Andrychowicz, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01905 · Cited by 423 · see citing works
Illuminating search spaces by mapping elitesPreprint
Mouret, J.-B., & Clune, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.04909 · Cited by 407 · see citing works
Self-citationLarge-Scale Study of Curiosity-Driven Learning
Burda, Y., Edwards, H., Pathak, D., Storkey, A., Darrell, T., & Efros, A. A. (2018) · arXiv · doi:10.48550/arxiv.1808.04355 · Cited by 401 · see citing works
Evolving a diversity of virtual creatures through novelty search and local competition
Lehman, J., & Stanley, K. O. (2011) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2001576.2001606 · Cited by 391 · see citing works
Regularized Evolution for Image Classifier Architecture Search
Real, E., Aggarwal, A., Huang, Y., & Le, Q. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014780 · Cited by 328 · see citing works
Open Problems in Artificial Life
Bedau, M. A., McCaskill, J. S., Packard, N. H., Rasmussen, S., Adami, C., Green, D. G., Ikegami, T., Kaneko, K., & Ray, T. S. (2000) · Artificial Life · doi:10.1162/106454600300103683 · Cited by 298 · see citing works
Wierstra, D., Schaul, T., Peters, J., & Schmidhuber, J. (2008) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2008.4631255 · Cited by 282 · see citing works
Automatic Definition of Modular Neural Networks
Gruau, F. (1994) · Adaptive Behavior · doi:10.1177/105971239400300202 · Cited by 272 · see citing works
Emergent Complexity via Multi-Agent CompetitionPreprint
Bansal, T., Pachocki, J., Sidor, S., Sutskever, I., & Mordatch, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03748 · Cited by 266 · see citing works
Deep learning for tactile understanding from visual and haptic data
Gao, Y., Hendricks, L. A., Kuchenbecker, K. J., & Darrell, T. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487176 · Cited by 264 · see citing works
Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study
Mouret, J.-B., & Doncieux, S. (2011) · Evolutionary Computation · doi:10.1162/evco_a_00048 · Cited by 254 · see citing works
Ponce, C. R., Xiao, W., Schade, P. F., Hartmann, T. S., Kreiman, G., & Livingstone, M. S. (2019) · Cell · doi:10.1016/j.cell.2019.04.005 · Cited by 245 · see citing works
Building high-level features using large scale unsupervised learningPreprint
Le, Q. V., Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., & Ng, A. Y. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1112.6209 · Cited by 236 · see citing works
Episodic Curiosity through ReachabilityPreprint
Savinov, N., Raichuk, A., Marinier, R., Vincent, D., Pollefeys, M., Lillicrap, T., & Gelly, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.02274 · Cited by 231 · see citing works
Creating High-Level Components with a Generative Representation for Body-Brain Evolution
Hornby, G. S., & Pollack, J. B. (2002) · Artificial Life · doi:10.1162/106454602320991837 · Cited by 226 · see citing works
An Evolutionary Approach to Synthetic Biology: Zen and the Art of Creating Life
Ray, T. S. (1993) · Artificial Life · doi:10.1162/artl.1993.1.179 · Cited by 219 · see citing works
Visualizing and Understanding Atari AgentsPreprint
Greydanus, S., Koul, A., Dodge, J. E., & Fern, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00138 · Cited by 216 · see citing works
Cheney, N., MacCurdy, R. B., Clune, J., & Lipson, H. (2013) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2463372.2463404 · Cited by 211 · see citing works
Self-citationGo-Explore: a New Approach for Hard-Exploration Problems
Ecoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1901.10995 · Cited by 205 · see citing works
Self-citationAn empirical analysis of collaboration methods in cooperative coevolutionary algorithms
Wiegand, R. P., Liles, W. C., & Jong, K. A. D. (2001) · Cited by 201 · see citing works
Learning an Embedding Space for Transferable Robot Skills
Hausman, K., Springenberg, J. T., Wang, Z., Heess, N., & Riedmiller, M. (2018) · International Conference on Learning Representations · Cited by 189 · see citing works
Conti, E., Madhavan, V., Such, F. P., Lehman, J., Stanley, K. O., & Clune, J. (2018) · neural information processing systems · Cited by 182 · see citing works
Self-citationLearning Curve Prediction with Bayesian Neural Networks
Klein, A., Falkner, S., Springenberg, J. T., & Hutter, F. (2017) · International Conference on Learning Representations · Cited by 176 · see citing works
Neural Architecture Search with Bayesian Optimisation and Optimal Transport
Kandasamy, K., Neiswanger, W., Schneider, J., Póczos, B., & Xing, E. P. (2018) · neural information processing systems · Cited by 172 · see citing works
Convergent Learning: Do different neural networks learn the same representations?Preprint
Li, Y., Yosinski, J., Clune, J., Lipson, H., & Hopcroft, J. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.07543 · Cited by 169 · see citing works
Self-citationWang, R., Lehman, J., Clune, J., & Stanley, K. O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01753 · Cited by 166 · see citing works
Self-citationFinn, C., & Levine, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.11622 · Cited by 160 · see citing works
Learning to OptimizePreprint
Li, K., & Malik, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01885 · Cited by 159 · see citing works
Third-Person Imitation LearningPreprint
Stadie, B. C., Abbeel, P., & Sutskever, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01703 · Cited by 153 · see citing works
Akam, T. E., Costa, R. M., & Dayan, P. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004648 · Cited by 150 · see citing works
On the Performance of Indirect Encoding Across the Continuum of Regularity
Clune, J., Stanley, K. O., Pennock, R. T., & Ofria, C. (2011) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2010.2104157 · Cited by 149 · see citing works
Self-citationNeural Modularity Helps Organisms Evolve to Learn New Skills without Forgetting Old Skills
Ellefsen, K. O., Mouret, J.-B., & Clune, J. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004128 · Cited by 148 · see citing works
Self-citationWhy Greatness Cannot Be Planned: The Myth of the Objective
Stanley, K. O., & Lehman, J. (2015) · doi:10.1007/978-3-319-15524-1 · Cited by 139 · see citing works
Ideal Evaluation from Coevolution
de Jong, E. D., & Pollack, J. B. (2004) · Evolutionary Computation · doi:10.1162/106365604773955139 · Cited by 137 · see citing works
Ficici, S. G., & Pollack, J. B. (1998) · Cited by 133 · see citing works
Everitt, T., Lea, G., & Hütter, M. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/768 · Cited by 129 · see citing works
Reinforcement Learning for Improving Agent Design
Ha, D. (2019) · Artificial Life · doi:10.1162/artl_a_00301 · Cited by 124 · see citing works
Born to learn: The inspiration, progress, and future of evolved plastic artificial neural networks
Soltoggio, A., Stanley, K. O., & Risi, S. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.013 · Cited by 124 · see citing works
Schmidhuber, J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00313 · Cited by 121 · see citing works
Semi-distributed Representations and Catastrophic Forgetting in Connectionist Networks
French, R. M. (1992) · Connection Science · doi:10.1080/09540099208946624 · Cited by 119 · see citing works
Illuminating Generalization in Deep Reinforcement Learning through Procedural Level Generation
Justesen, N., Torrado, R. R., Bontrager, P., Khalifa, A., Togelius, J., & Risi, S. (2018) · OAR@UM (University of Malta) · doi:10.48550/arxiv.1806.10729 · Cited by 117 · see citing works
The evolutionary origins of hierarchy
Mengistu, H., Huizinga, J., Mouret, J.-B., & Clune, J. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004829 · Cited by 115 · see citing works
Self-citationOvercoming the bootstrap problem in evolutionary robotics using behavioral diversity
Mouret, J.-B., & Doncieux, S. (2009) · 2009 IEEE Congress on Evolutionary Computation · doi:10.1109/cec.2009.4983077 · Cited by 106 · see citing works
Understanding Deep Image Representations by Inverting ThemPreprint
Mahendran, A., & Vedaldi, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.0035 · Cited by 105 · see citing works
Differentiable plasticity: training plastic neural networks with backpropagationPreprint
Miconi, T., Clune, J., & Stanley, K. O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.02464 · Cited by 103 · see citing works
Self-citationEfficiently evolving programs through the search for novelty
Lehman, J., & Stanley, K. O. (2010) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1830483.1830638 · Cited by 103 · see citing works
Learning Montezuma's Revenge from a Single DemonstrationPreprint
Salimans, T., & Chen, R. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03381 · Cited by 102 · see citing works
General Video Game Level Generation
Khalifa, A., Pérez-Liébana, D., Lucas, S. M., & Togelius, J. (2016) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2908812.2908920 · Cited by 99 · see citing works
Designing Application-Specific Neural Networks Using the Genetic Algorithm
Harp, S. A., Samad, T., & Guha, A. (1989) · Cited by 95 · see citing works
Artificial Intelligence and Responsible Innovation
Brundage, M. (2016) · Synthese Library/Synthese library · doi:10.1007/978-3-319-26485-1_32 · Cited by 94 · see citing works
Kouvaris, K., Clune, J., Kounios, L., Brede, M., & Watson, R. A. R. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005358 · Cited by 92 · see citing works
Self-citationBootstrapping on the adaptive landscape
Conrad, M. (1979) · Biosystems · doi:10.1016/0303-2647(79)90009-1 · Cited by 81 · see citing works
Learning to Continually LearnPreprint
Beaulieu, S., Frati, L., Miconi, T., Lehman, J., Stanley, K. O., Clune, J., & Cheney, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09571 · Cited by 80 · see citing works
Self-citationImitating Latent Policies from Observation
Edwards, A. D., Sahni, H., Schroecker, Y., & Isbell, C. L. (2018) · arXiv · doi:10.48550/arxiv.1805.07914 · Cited by 79 · see citing works
How novelty search escapes the deceptive trap of learning to learn
Risi, S., Vanderbleek, S. D., Hughes, C. E., & Stanley, K. O. (2009) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1569901.1569923 · Cited by 75 · see citing works
The Incremental Pareto-Coevolution Archive
de Jong, E. D. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24854-5_55 · Cited by 73 · see citing works
Unsupervised Meta-Learning for Reinforcement LearningPreprint
Gupta, A., Eysenbach, B., Finn, C., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04640 · Cited by 66 · see citing works
A Theory of Universal Artificial Intelligence based on Algorithmic ComplexityPreprint
Hütter, M. (2000) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0004001 · Cited by 65 · see citing works
On the deleterious effects of a priori objectives on evolution and representation
Woolley, B. G., & Stanley, K. O. (2011) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2001576.2001707 · Cited by 64 · see citing works
ES is more than just a traditional finite-difference approximator
Lehman, J., Chen, J., Clune, J., & Stanley, K. O. (2018) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3205455.3205474 · Cited by 64 · see citing works
Self-citationLehman, J., Clune, J., Misevic, D., Adami, C., Altenberg, L., Beaulieu, J., Bentley, P. J., Bernard, S., Beslon, G., Bryson, D., et al. (2018) · arXiv (Cornell University) · Cited by 63 · see citing works
Self-citationLearning From Demonstration in the Wild
Behbahani, F., Shiarlis, K., Chen, X., Kurin, V., Kasewa, S., Stirbu, C., Gomes, J., Paul, S., Oliehoek, F. A., Messias, J. V., et al. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794412 · Cited by 57 · see citing works
On the relationship between environmental and morphological complexity in evolved robots
Auerbach, J. E., & Bongard, J. (2012) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2330163.2330238 · Cited by 53 · see citing works
Soros, L. B., & Stanley, K. O. (2014) · doi:10.1162/978-0-262-32621-6-ch128 · Cited by 51 · see citing works
Brant, J. C., & Stanley, K. O. (2017) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3071178.3071186 · Cited by 47 · see citing works
From Nodes to Networks: Evolving Recurrent Neural NetworksPreprint
Rawal, A., & Miikkulainen, R. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04439 · Cited by 47 · see citing works
Backpropamine: training self-modifying neural networks with differentiable neuromodulated plasticityPreprint
Miconi, T., Rawal, A., Clune, J., & Stanley, K. O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10585 · Cited by 47 · see citing works
Self-citationNguyen, A., Yosinski, J., & Clune, J. (2016) · Evolutionary Computation · doi:10.1162/evco_a_00189 · Cited by 46 · see citing works
Self-citationEvolving neural networks that are both modular and regular
Huizinga, J., Clune, J., & Mouret, J.-B. (2014) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2576768.2598232 · Cited by 44 · see citing works
Self-citationFirst experiments with PowerPlay
Srivastava, R. K., Steunebrink, B. R., & Schmidhuber, J. (2013) · Neural Networks · doi:10.1016/j.neunet.2013.01.022 · Cited by 42 · see citing works
Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks
Velez, R., & Clune, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187736 · Cited by 42 · see citing works
Self-citationEvolved Electrophysiological Soft Robots
Cheney, N., Clune, J., & Lipson, H. (2014) · Conference on Artificial Life (ALIFE) · doi:10.1162/978-0-262-32621-6-ch037 · Cited by 36 · see citing works
Self-citationFixed-weight networks can learn
Cotter, N. E., & Conwell, P. R. (1990) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1990.137898 · Cited by 34 · see citing works
From modulated Hebbian plasticity to simple behavior learning through noise and weight saturation
Soltoggio, A., & Stanley, K. O. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.06.005 · Cited by 31 · see citing works
Clune, J., Goldsby, H. J., Ofria, C., & Pennock, R. T. (2010) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2010.1557 · Cited by 31 · see citing works
Self-citationStanton, C., & Clune, J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0162235 · Cited by 27 · see citing works
Self-citationNovelty search creates robots with general skills for exploration
Velez, R., & Clune, J. (2014) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2576768.2598225 · Cited by 26 · see citing works
Self-citationMengistu, H., Lehman, J., & Clune, J. (2016) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2908812.2908838 · Cited by 25 · see citing works
Self-citationThe Emergence of Canalization and Evolvability in an Open-Ended, Interactive Evolutionary System
Huizinga, J., Stanley, K. O., & Clune, J. (2018) · Artificial Life · doi:10.1162/artl_a_00263 · Cited by 21 · see citing works
Self-citationHuizinga, J., & Clune, J. (2022) · Evolutionary Computation · doi:10.1162/evco_a_00301 · Cited by 20 · see citing works
Self-citationKounios, L., Clune, J., Kouvaris, K., Wagner, G. P., Pavličev, M., Weinreich, D. M., & Watson, R. A. R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.05955 · Cited by 17 · see citing works
Self-citationNeuromodulation Improves the Evolution of Forward Models
Norouzzadeh, M. S., & Clune, J. (2016) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2908812.2908837 · Cited by 16 · see citing works
Self-citationRobots that can adapt like natural animals.
Cully, A., Clune, J., & Mouret, J.-B. (2014) · Cited by 15 · see citing works
Self-citationMaximum Individual Complexity is Indefinitely Scalable in Geb
Channon, A. (2019) · Artificial Life · doi:10.1162/artl_a_00285 · Cited by 9 · see citing works
Botvinick, M., Barrett, D. G. T., Battaglia, P., de Freitas, N., Kumaran, D., Leibo, J. Z., Lillicrap, T., Modayil, J., Mohamed, S., Rabinowitz, N. C., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.08378 · Cited by 5 · see citing works
Flagged first, then by citations
9 of the 189 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Unity: A General Platform for Intelligent Agents
Juliani, A., Berges, V.-P., Teng, E., Cohen, A., Harper, J., Elion, C., Goy, C., Gao, Y., Henry, H., Mattar, M., et al. (2018) · arXiv · doi:10.48550/arxiv.1809.02627 · Cited by 626 · see citing works
“It has been argued in recent work that generating effective and diverse learning environments (often as a co-evolutionary process involving agent and environment) is a critical component for developing artificial general intelligence (Wang et al., 2019; Clune, 2019).”
BackgroundInductive biases for deep learning of higher-level cognition
Goyal, A., & Bengio, Y. (2022) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0068 · Cited by 300 · see citing works
MetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental Learning
Chi, Z., Gu, L., Liu, H., Wang, Y., Yu, Y., & Tang, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01377 · Cited by 173 · see citing works
Artificial intelligence in cancer diagnosis and therapy: Current status and future perspective
Sufyan, M., Shokat, Z., & Ashfaq, U. A. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107356 · Cited by 149 · see citing works
Increasing generality in machine learning through procedural content generation
Risi, S., & Togelius, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0208-z · Cited by 142 · see citing works
Triguero, I., Molina, D., Poyatos, J., Del Ser, J., & Herrera, F. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102135 · Cited by 90 · see citing works
Multi-task learning for natural language processing in the 2020s: Where are we going?
Worsham, J., & Kalita, J. K. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.05.031 · Cited by 84 · see citing works
Learning to Continually LearnPreprint
Beaulieu, S., Frati, L., Miconi, T., Lehman, J., Stanley, K. O., Clune, J., & Cheney, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09571 · Cited by 80 · see citing works
Self-citationContinual Object Detection: A review of definitions, strategies, and challenges
Menezes, A. G., de Moura, G., Alves, C., & de Carvalho, A. C. P. L. F. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.01.041 · Cited by 77 · see citing works
Such, F. P., Rawal, A., Lehman, J., Stanley, K. O., & Clune, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.07768 · Cited by 67 · see citing works
Self-citationImproving Generalization in Meta Reinforcement Learning using Learned ObjectivesPreprint
Kirsch, L., van Steenkiste, S., & Schmidhuber, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04098 · Cited by 69 · see citing works
A Survey on Goal-Oriented Semantic Communication: Techniques, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · IEEE Access · doi:10.1109/access.2024.3381967 · Cited by 61 · see citing works
Open-Ended Learning Leads to Generally Capable Agents
Open Ended Learning Team, Stooke, A., Mahajan, A., Barros, C., Deck, C., Bauer, J., Sygnowski, J., Trebacz, M., Jaderberg, M., Mathieu, M., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.12808 · Cited by 56 · see citing works
Wang, R., Lehman, J., Rawal, A., Zhi, J., Li, Y., Clune, J., & Stanley, K. O. (2020) · arXiv · doi:10.48550/arxiv.2003.08536 · Cited by 53 · see citing works
Self-citationOpen-endedness in synthetic biology: A route to continual innovation for biological design
Stock, M., & Gorochowski, T. E. (2024) · Science Advances · doi:10.1126/sciadv.adi3621 · Cited by 33 · see citing works
A Comprehensive Overview and Survey of Recent Advances in Meta-LearningPreprint
Peng, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.11149 · Cited by 33 · see citing works
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
Yamada, Y., Lange, R. T., Lu, C., Hu, S., Lu, C., Foerster, J., Clune, J., & Ha, D. (2025) · arXiv · doi:10.48550/arxiv.2504.08066 · Cited by 32 · see citing works
Self-citationA Qualitative Approach to the Public Perception of AI
Hick, A., & Ziefle, M. (2022) · International Journal on Cybernetics & Informatics · doi:10.5121/ijci.2022.110401 · Cited by 30 · see citing works
Yamakawa, H. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.09.004 · Cited by 22 · see citing works
Darwin Gödel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15063 · Cited by 34 · see citing works
Self-citationHuman-Timescale Adaptation in an Open-Ended Task Space
Adaptive Agent Team, Bauer, J., Baumli, K., Baveja, S., Behbahani, F., Bhoopchand, A., Bradley-Schmieg, N., Chang, M., Clay, N., Collister, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.07608 · Cited by 19 · see citing works
Poyatos, J., Molina, D., Martínez-Seras, A., Ser, J. D., & Herrera, F. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110757 · Cited by 23 · see citing works
Meta-Learning with Sparse Experience Replay for Lifelong Language LearningPreprint
Holla, N., Mishra, P., Yannakoudakis, H., & Shutova, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.04891 · Cited by 19 · see citing works
Dynamics-Aware Quality-Diversity for Efficient Learning of Skill Repertoires
Lim, B., Grillotti, L., Bernasconi, L., & Cully, A. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811559 · Cited by 15 · see citing works
Learning few-shot imitation as cultural transmission
Bhoopchand, A., Brownfield, B., Collister, A., Dal Lago, A., Edwards, A., Everett, R., Fréchette, A., Oliveira, Y. G., Hughes, E., Mathewson, K. W., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-42875-2 · Cited by 14 · see citing works
Computational Psychiatry for Computers
Schulz, E., & Dayan, P. (2020) · iScience · doi:10.1016/j.isci.2020.101772 · Cited by 14 · see citing works
Qualities, challenges and future of genetic algorithms: a literature reviewPreprint
Vié, A., Kleinnijenhuis, A. M., & Farmer, D. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.05277 · Cited by 14 · see citing works
Fülöp, M. T., Ionescu, C. A., Măgdaș, N., Ștefan, M. C., & Topor, D. I. (2025) · Economics · doi:10.1515/econ-2025-0155 · Cited by 13 · see citing works
Improving Generalization in Meta Reinforcement Learning using Neural ObjectivesPreprint
Kirsch, L., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv (Cornell University) · Cited by 14 · see citing works
Genie: Generative Interactive Environments
Bruce, J., Dennis, M., Edwards, A., Parker-Holder, J., Shi, Y., Hughes, E., Lai, M., Mavalankar, A., Steigerwald, R., Apps, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2402.15391 · Cited by 23 · see citing works
“…from unseen action-free videos of simulated reinforcement learning (RL) environments, indicating that Genie may hold the key to unlocking unlimited data for training the next generation of generalist agents (Bauer et al., 2023; Clune, 2019; Open Ended Learning Team et al., 2021; Reed et al., 2022).”
BackgroundSelf-citationReinforcement learning beyond the Bellman equation: Exploring critic objectives using evolution
Leite, A., Candadai, M., & Izquierdo, E. J. (2020) · Conference on Artificial Life (ALIFE) · doi:10.1162/isal_a_00338 · Cited by 12 · see citing works
Navigating the landscape of multiplayer games
Omidshafiei, S., Tuyls, K., Czarnecki, W. M., Santos, F. C., Rowland, M., Connor, J. T., Hennes, D., Müller, P. F., Pérolat, J., Vylder, B. D., et al. (2020) · RePEc: Research Papers in Economics · Cited by 12 · see citing works
Artificial Intelligence and Society: Pros and Cons of the Present, Future Prospects
Nikolenko, K. (2022) · Futurity Philosophy. · doi:10.57125/fp.2022.06.30.05 · Cited by 11 · see citing works
Multi-Agent Risks from Advanced AI
Hammond, L., Chan, A., Clifton, J., Hoelscher-Obermaier, J., Khan, A., McLean, E., Smith, C., Barfuss, W., Foerster, J., Gavenčiak, T., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.14143 · Cited by 10 · see citing works
Seshagiri, S., & Prema, K. V. (2025) · IEEE Access · doi:10.1109/access.2025.3536479 · Cited by 10 · see citing works
A Novel Scheme for Generating Context-Aware Images Using Generative Artificial Intelligence
Kim, H., Choi, J.-H., & Choi, J. (2024) · IEEE Access · doi:10.1109/access.2024.3368871 · Cited by 9 · see citing works
A Survey on Challenges in Designing Cognitive Engines
Saghiri, A. M. (2020) · International Conference on Web Research (ICWR) · doi:10.1109/icwr49608.2020.9122273 · Cited by 9 · see citing works
Automated Design of Agentic Systems
Hu, S., Lu, C., & Clune, J. (2024) · arXiv · doi:10.48550/arxiv.2408.08435 · Cited by 10 · see citing works
“Research in AI-Generating Algorithms (AI-GAs, Clune (2019)) and AutoML (Hutter et al., 2019) aims to replace handcrafted components in AI systems by learning them.”
InfluentialSelf-citationGeneral-Purpose Models for the Chemical Sciences: LLMs and Beyond
Alampara, N., Aneesh, A., Ríos-García, M., Mirza, A., Schilling-Wilhelmi, M., Aghajani, A. A., Sun, M., Prastalo, G., & Jablonka, K. M. (2026) · Chemical Reviews · doi:10.1021/acs.chemrev.5c00583 · Cited by 12 · see citing works
The role of non-genetic information in evolutionary frameworks
Moran, K. L., Shlyakhtina, Y., & Portal, M. M. (2021) · Critical Reviews in Biochemistry and Molecular Biology · doi:10.1080/10409238.2021.1908949 · Cited by 7 · see citing works
Scaling Down Deep Learning with MNIST-1DPreprint
Greydanus, S., & Kobak, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14439 · Cited by 7 · see citing works
Meta-SpikePropamine: learning to learn with synaptic plasticity in spiking neural networks
Schmidgall, S., & Hays, J. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1183321 · Cited by 6 · see citing works
Surana, S., Lim, B., & Cully, A. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161267 · Cited by 6 · see citing works
Open Questions in Creating Safe Open-ended AI: Tensions Between Control and Creativity
Ecoffet, A., Clune, J., & Lehman, J. (2020) · The 2020 Conference on Artificial Life · doi:10.1162/isal_a_00323 · Cited by 6 · see citing works
Self-citationGrounding Artificial Intelligence in the Origins of Human BehaviorPreprint
Nisioti, E., & Moulin-Frier, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08564 · Cited by 6 · see citing works
Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · arXiv · doi:10.48550/arxiv.2505.22954 · Cited by 5 · see citing works
Self-citationAutomating the Search for Artificial Life With Foundation Models
Kumar, A., Lu, C., Kirsch, L., Tang, Y., Stanley, K. O., Isola, P., & Ha, D. (2025) · Artificial Life · doi:10.1162/artl.a.8 · Cited by 5 · see citing works
Finding online neural update rules by learning to rememberPreprint
Gregor, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03124 · Cited by 5 · see citing works
Zhi, J., Wang, R., Clune, J., & Stanley, K. O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11164 · Cited by 7 · see citing works
Self-citationSelf-Organizing Intelligent Matter: A blueprint for an AI generating algorithmPreprint
Gregor, K., & Besse, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07627 · Cited by 10 · see citing works
Meta-Learning of Structured Task Distributions in Humans and MachinesPreprint
Kumar, S., Dasgupta, I., Cohen, J. D., Daw, N. D., & Griffiths, T. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02317 · Cited by 7 · see citing works
Exploring the Dynamic Properties of Interaction in Mixed-Initiative Procedural Content Generation
Alvarez, A. (2020) · doi:10.24834/isbn.9789178771400 · Cited by 5 · see citing works
BADGER: Learning to (Learn [Learning Algorithms] through Multi-Agent Communication)Preprint
Rosa, M., Afanasjeva, O., Andersson, S., Davidson, J., Guttenberg, N., Hlubuček, P., Poliak, M., Vítků, J., & Feyereisl, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01513 · Cited by 6 · see citing works
Training Learned Optimizers with Randomly Initialized Learned OptimizersPreprint
Metz, L., Freeman, C. D., Maheswaranathan, N., & Sohl‐Dickstein, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07367 · Cited by 4 · see citing works
Adaptive General Search Framework for Games and Beyond
Sironi, C. F., & Winands, M. H. M. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619115 · Cited by 3 · see citing works
Navigating the Landscape of Games.Preprint
Omidshafiei, S., Tuyls, K., Czarnecki, W. M., Santos, F. C., Rowland, M., Connor, J. T., Hennes, D., Müller, P. F., Pérolat, J., Vylder, B. D., et al. (2020) · arXiv (Cornell University) · Cited by 3 · see citing works
MPLP: Learning a Message Passing Learning ProtocolPreprint
Randazzo, E., Niklasson, E., & Mordvintsev, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00970 · Cited by 4 · see citing works
Toward Building Science Discovery MachinesPreprint
Khalili, A., & Bouchachia, A. (2021) · arXiv.org · doi:10.48550/arxiv.2103.15551 · Cited by 1 · see citing works
Artificial General Intelligence: A New Perspective, with Application to Scientific DiscoveryPreprint
Khalili, A. (2019) · doi:10.31224/osf.io/duz8g · Cited by 2 · see citing works
Learning to learn online with neuromodulated synaptic plasticity in spiking neural networksPreprint
Schmidgall, S., & Hays, J. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.06.24.497562 · Cited by 3 · see citing works
Kim, H., Choi, J.-H., & Choi, J. (2024) · IEEE Access · doi:10.1109/access.2024.3476933 · Cited by 2 · see citing works
Meta-Learning of Compositional Task Distributions in Humans and Machines.Preprint
Kumar, S., Dasgupta, I., Cohen, J., Daw, N. D., & Griffiths, T. L. (2020) · arXiv (Cornell University) · Cited by 2 · see citing works
A Brief Survey of Associations Between Meta-Learning and General AIPreprint
Peng, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.04283 · Cited by 2 · see citing works
The Red Queen Gödel Machine: Co-Evolving Agents and Their Evaluators
Iacob, A., Jovanović, A., Shen, W. F., Burkhardt, D., Kurmanji, M., Tastan, N., Sani, L., Venanzi, N. A. E., Nie, J., Odonnat, A., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.26294 · Cited by 1 · see citing works
“C.2).”
de Almeida, A. L. (2022) · Revista de Estudos em Educação e Diversidade - REED · doi:10.22481/reed.v3i7.10336 · Cited by 1 · see citing works
Artificial General Intelligence: Pressure Cooker or Crucible?
Sipper, M. (2022) · Computer · doi:10.1109/mc.2022.3169399 · Cited by 1 · see citing works
Stable Diffusion With Generative AI
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets48608 · Cited by 1 · see citing works
Technology roadmap toward the completion of whole-brain architecture with BRA-driven development
Yamakawa, H., Tawatsuji, Y., Ashihara, Y., Fukawa, A., Arakawa, N., Takahashi, K., & Matsuo, Y. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2024.101300 · Cited by 1 · see citing works
Non-convex Optimization Using Parameter Continuation Methods for Deep Neural Networks
Pathak, H. N., & Paffenroth, R. C. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-6759-9_12 · Cited by 1 · see citing works
Zou, L. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-89931-4.00011-0 · Cited by 2 · see citing works
Ruman, M., & Guy, T. V. (2024) · IEEE Access · doi:10.1109/access.2024.3497589 · Cited by 1 · see citing works
Semi-Supervised Class DiscoveryPreprint
Nixon, J., Liu, J. Z., & Berthelot, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03480 · Cited by 1 · see citing works
Evolutionary Self-Replication as a Mechanism for Producing Artificial IntelligencePreprint
Schmidgall, S., & Hays, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08057 · Cited by 1 · see citing works
Exploring Game Design through Human-AI Collaboration
Alvarez, A. (2022) · doi:10.24834/isbn.9789178773084 · Cited by 1 · see citing works
Artificial Intelligence: A Kalam and Sufi PerspectivePreprint
Khalili, A. M. (2023) · Preprints.org · doi:10.20944/preprints202306.0363.v1 · Cited by 1 · see citing works
Artificial Intelligence: A Kalam and Sufi PerspectivePreprint
Khalili, A. (2024) · Preprints.org · doi:10.20944/preprints202306.0363.v5 · Cited by 1 · see citing works
Zhang, J., Zhao, B., Yang, W., Foerster, J., Clune, J., Jiang, M., Devlin, S., & Shavrina, T. (2026) · arXiv · doi:10.48550/arxiv.2603.19461
Self-citationEvoFlow: Evolving Diverse Agentic Workflows On The Fly
Zhang, G., Chen, K., Wan, G., Chang, H., Cheng, H., Wang, K., Hu, S., & Bai, L. (2025) · arXiv · doi:10.48550/arxiv.2502.07373
“The progress of machine learning consistently reveals a recurring pattern: manually crafted artifacts are often replaced by learnable and optimizable ones (Tyson & Zysman, 2022; Clune, 2019).”
Mendel Gödel Machine: Recursive Self-Improving Coding Agents via Comparative Evolution
Liu, C., Liu, Y., Yan, S., Tresp, V., & Ma, Y. (2026) · arXiv · doi:10.48550/arxiv.2608.07645
Open-ended Search through Minimal Criterion Coevolution
Brant, J. C. (2020) · Journal of International Crisis and Risk Communication Research
Metalearning: Sparse Variable-Structure AutomataPreprint
Fekri, P., Safavi, A., Zadeh, M., & Setoodeh, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.00315
User-Oriented Smart General AI System under Causal InferencePreprint
Peng, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14561
A method of supervised learning from conflicting data with hidden contextsPreprint
Zhang, T., Jiang, Y., & Chen, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.12113
Learning to Cooperate with Unseen Agent via Meta-Reinforcement LearningPreprint
Charakorn, R., Manoonpong, P., & Dilokthanakul, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.03431 · Cited by 1 · see citing works
Artificial Intelligence: A Kalam and Sufi PerspectivePreprint
Khalili, A. M. (2023) · Preprints.org · doi:10.20944/preprints202306.0363.v2
Artificial Intelligence: A Kalam and Sufi PerspectivePreprint
Khalili, A. M. (2023) · Preprints.org · doi:10.20944/preprints202306.0363.v3
Withdrawn: Artificial Intelligence: A Kalam and Sufi PerspectivePreprint
Khalili, A. M. (2023) · Preprints.org · doi:10.20944/preprints202306.0363.v4
Artificial Intelligence: A Kalam and Sufi PerspectivePreprint
Khalili, A. (2024) · Preprints.org · doi:10.20944/preprints202306.0363.v6
Frequency-Histogram Coarse Graining in Elementary and 2-Dimensional Cellular Automata
Jain, S., & Nichele, S. (2024) · Nordic Machine Intelligence · doi:10.5617/nmi.10458
Generative Fusion: AI-Powered Image Synthesis Through Gan and NLP Integration
KARTHIK, P., & DINIESH, N. (2025) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem44258
Self-Organizing Models of Brain Wiring: Developmental Programs for Evolving Intelligence
Warner, J., & Miikkulainen, R. P. (2025) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3712255.3734341
Artificial Intelligence and Its Role in the Healthcare Sector
Bastone, A. (2026) · SpringerBriefs in health care management and economics · doi:10.1007/978-3-032-14298-6_2
Solving Rubik's Cube with a Robot Hand
OpenAI, Akkaya, I., Andrychowicz, M., Chociej, M., Litwin, M., McGrew, B., Petron, A., Paino, A., Plappert, M., Powell, G., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.07113 · Cited by 602 · see citing works
- Authors
- Clune, J.
- Affiliations
- University of Wyoming (US)
- Corresponding author
- Clune, Jeff
- ORCID
- Clune, Jeff
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1905.10985
- OpenAlex
- W2946004135
- Cited by
- 82
- References
- 189
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 10 · 2023: 10 · 2022: 10 · 2021: 14 · 2020: 25 · 2019: 5 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (CAREER, 1453549)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- artificial general intelligence, meta-learning, AI safety, AI ethics, evolution of intelligence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review