CoChat
Sign Up
PreprintCited by 1Artificial Intelligence ApplicationsEvolutionary Algorithms and ApplicationsAI-based Problem Solving and Planning

Recursive self-improvement of AI research agents

Open access
Srikanth, Dhruv, Zhao, Bingchen, Xu, Dixing, Wu, Yuxiang, Jiang, Zhengyao·2026·arXiv
DOI 10.48550/arxiv.2609.26457arXiv 2609.26457
Open this paper in CoChat — free accountOpen PDF

Abstract

AI agents are beginning to automate research and development across the AI stack, from improving training efficiency to optimizing inference. A natural next step is to improve the research efficiency of the agents themselves. When an AI research agent's own code is the object of optimization, each accepted rewrite becomes the agent that the next round edits. We refer to this loop as recursive self-improvement. Its significance lies in a long-standing trend, in which increased cumulative spending on R&D yields diminishing returns. Sustained self-improvement offers a way to counter this trend. We present AIDE^2, a system that implements this loop for a frontier AI research agent. It proposes changes to its own code, benchmarks modified versions of itself on a suite of AI R&D tasks, and keeps the changes that perform best on hidden evaluations. In an autonomous 8-day run, AIDE^2 discovered seven successive improvements, ranging from a new search policy to memory mechanisms that compress and manage the agent's growing context. These gains generalize to four held-out benchmarks spanning machine learning engineering, heuristic algorithm engineering, and physics-based weather forecasting, the last of which is out of distribution from the selection tasks. On all four, the strongest discovered agent matches or exceeds a human-engineered production research agent that ranks among the strongest on FML-Bench. On a separate held-out task family, the discovered agents also exhibit reduced reward hacking, a property the loop never explicitly optimized for: the rate falls from 55% to 32% during the run, 7 percentage points below the human-engineered agent. Together, these results show that an AI research agent can improve its own research efficiency through recursive self-improvement, and that these gains transfer to tasks and domains the loop never encountered.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2609.26457

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 108

  1. L. A. Agrawal, D. Lee, S. Tan, W. Ma, K. Elmaaroufi, R. Sandadi, S. A. Seshia, K. Sen, D. Klein, I. Stoica, J. E. Gonzalez, O. Khattab, A. G. Dimakis, and M. Zaharia. optimize_anything: Unified text optimization can outperform specialized systems. In Proceedings of the ACM Conference on AI and Agentic Systems, pages 1-16. ACM, 2026a. URL https://doi.org/10.1145/3786335.3813167. · DOI
  2. L. A. Agrawal, S. Tan, D. Soylu, N. Ziems, R. Khare, K. Opsahl-Ong, A. Singhvi, H. Shandilya, M. J. Ryan, M. Jiang, C. Potts, K. Sen, A. G. Dimakis, I. Stoica, D. Klein, M. Zaharia, and O. Khattab. GEPA: Reflective prompt evolution can outperform reinforcement learning. In International Conference on Learning Representations, 2026b. URL https://arxiv.org/abs/2507.19457. Oral presentation. 1, 12 · arXiv
  3. M. Andrychowicz, M. Denil, S. Gómez, M. W. Hoffman, D. Pfau, T. Schaul, B. Shillingford, and N. de Freitas. Learning to learn by gradient descent by gradient descent. In Advances in Neural Information Processing Systems, volume 29, 2016. 13
  4. J.-Y. Audibert, R. Munos, and C. Szepesvári. Exploration-exploitation tradeoff using variance estimates in multi- armed bandits. Theoretical Computer Science, 410(19):1876-1902, 2009. doi: 10.1016/j.tcs.2009.01.016. URL https://doi.org/10.1016/j.tcs.2009.01.016. · DOI
  5. P. Auer, N. Cesa-Bianchi, and P. Fischer. Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2-3):235-256, May 2002. doi: 10.1023/A:1013689704352. URL https://doi.org/10.1023/A: 1013689704352. · DOI · Paper page
  6. J. Baek, S. K. Jauhar, S. Cucerzan, and S. J. Hwang. ResearchAgent: Iterative research idea generation over scientific literature with large language models. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6709-6738. Association for Computational Linguistics, 2025. doi: 10.18653/v1/2025. naacl-long.342. URL https://aclanthology.org/2025.naacl-long.342/. 1, 12 · DOI · Paper page
  7. R. Battiti, M. Brunato, and F. Mascia. Reactive Search and Intelligent Optimization, volume 45 of Operations Research/Computer Science Interfaces Series. Springer, New York, NY, 2008. ISBN 978-0-387-09623-0. doi: 10.1007/978-0-387-09624-7. URL https://doi.org/10.1007/978-0-387-09624-7. · DOI
  8. N. Bloom, C. I. Jones, J. Van Reenen, and M. Webb. Are ideas getting harder to find? American Economic Review, 110(4):1104-1144, Apr. 2020. doi: 10.1257/aer.20180338. URL https://doi.org/10.1257/ aer.20180338. · DOI · Paper page
  9. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996. doi: 10.1007/BF00058655. URL https://doi.org/10.1007/BF00058655. · DOI · Paper page
  10. E. Cantú-Paz. A survey of parallel genetic algorithms. Calculateurs parallèles, réseaux et systèmes répartis, 10 (2):141-171, 1998. ISSN 1260-3198.
  11. M. Cemri, S. Agrawal, A. Gupta, S. Liu, A. Cheng, Q. Mang, A. Naren, L. E. Erdogan, K. Sen, M. Zaharia, A. Dimakis, and I. Stoica. AdaEvolve: Adaptive LLM driven zeroth-order optimization. arXiv preprint arXiv:2602.20133, 2026. URL https://arxiv.org/abs/2602.20133. · arXiv
  12. J. S. Chan, N. Chowdhury, O. Jaffe, J. Aung, D. Sherburn, E. Mays, G. Starace, K. Liu, L. Maksin, T. Patwardhan, A. Mądry, and L. Weng. MLE-bench: Evaluating machine learn- ing agents on machine learning engineering. In International Conference on Learning Rep- resentations, 2025. URL https://proceedings.iclr.cc/paper_files/paper/2025/hash/ 7e3767db483c942b883eb4f8cfb74e31-Abstract-Conference.html. Oral presentation. 4, 6, 24
  13. X. Chen, C. Liang, D. Huang, E. Real, K. Wang, H. Pham, X. Dong, T. Luong, C.-J. Hsieh, Y. Lu, and Q. V. Le. Symbolic discovery of optimization algorithms. In Advances in Neural Information Processing Sys- tems, volume 36, 2023. URL https://proceedings.neurips.cc/paper_files/paper/2023/hash/ 9a39b4925e35cf447ccba8757137d84f-Abstract-Conference.html.
  14. Y. Chen, M. W. Hoffman, S. Gómez Colmenarejo, M. Denil, T. P. Lillicrap, M. Botvinick, and N. de Freitas. Learning to learn without gradient descent by gradient descent. In Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 748-756.
  15. PMLR, 2017. URL https://proceedings.mlr.press/v70/chen17e.html.
  16. C.-A. Cheng, A. Nie, and A. Swaminathan. Trace is the next AutoDiff: Generative optimization with rich feedback, execution traces, and LLMs. In Advances in Neural Information Processing Systems, volume 37, 2024. URL https://arxiv.org/abs/2406.16218. · arXiv
  17. A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby. An image is worth 16x16 words: Transformers for image recognition at scale. In International Conference on Learning Representations, 2021. URL https: //arxiv.org/abs/2010.11929.
  18. D. Falck, S. Sabri, A. Surina, T. Foster, A. Sims, S. Devlin, D. Rogers, T. Collins, K. Aleksiev, L. Kirsch, and E. Hughes. Training AI scientists to replicate research. arXiv preprint arXiv:2608.13331, 2026. URL https://arxiv.org/abs/2608.13331. · arXiv
  19. C. Fernando, D. S. Banarse, H. Michalewski, S. Osindero, and T. Rocktäschel. Promptbreeder: Self-referential self-improvement via prompt evolution. In International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 13481-13544. PMLR, 2024. URL https://proceedings. mlr.press/v235/fernando24a.html.
  20. C. Finn, P. Abbeel, and S. Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceed- ings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Re- search, pages 1126-1135. PMLR, 2017. URL https://proceedings.mlr.press/v70/finn17a.html.
  21. T. S. Foster, B. Al Omari, T. Fu, T. Mann, C. Domond, L. Cipolina-Kun, B. Gauri, M. Aghamelu, A. D. Goldie, E. Helenowski, J.-C. Gagnon-Audet, A. Pepe, S. Nazir, D. Izcovich, N. Levi, R. Hazra, K. Hambardzumyan, N. Baldwin, X. Li, M. Josifoski, P. Giampouras, M. Jalili Sabet, A. Sims, H. Momand, T. Shavrina, D. Magka, J. Weston, Y. Wang, A. Goyal, J. Henriques, Y. Bachrach, E. McMilin, and J. N. Foerster. AI research preference models. arXiv preprint arXiv:2608.13940, 2026. URL https://arxiv.org/abs/2608.13940. · arXiv
  22. L. Franceschi, P. Frasconi, S. Salzo, R. Grazzi, and M. Pontil. Bilevel programming for hyperparameter optimization and meta-learning. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 1568-1577. PMLR, 2018. URL https: //proceedings.mlr.press/v80/franceschi18a.html.
  23. H.-a. Gao, J. Geng, W. Hua, M. Hu, X. Juan, H. Liu, S. Liu, J. Qiu, X. Qi, Y. Wu, H. Wang, H. Xiao, Y. Zhou, S. Zhang, J. Zhang, J. Xiang, Y. Fang, Q. Zhao, D. Liu, Q. Ren, C. Qian, Z. Wang, M. Hu, H. Wang, Q. Wu, H. Ji, and M. Wang. A survey of self-evolving agents: What, when, how, and where to evolve on the path to artificial super intelligence. Transactions on Machine Learning Research, 2026. URL https://arxiv.org/ abs/2507.21046. · arXiv
  24. A. E. Ghareeb, B. Chang, L. Mitchener, A. Yiu, C. J. Szostkiewicz, D. Shved, G. J. Gyimesi, J. M. Laurent, S. M. Wright, M. T. Razzak, A. D. White, S. C. Finnemann, M. M. Hinks, and S. G. Rodriques. A multi-agent system for automating scientific discovery. Nature, 655(8122):497-505, 2026. doi: 10.1038/s41586-026-10652-y. URL https://doi.org/10.1038/s41586-026-10652-y. · DOI
  25. D. E. Goldberg and K. Deb. A comparative analysis of selection schemes used in genetic algorithms. In G. J. E. Rawlins, editor, Foundations of Genetic Algorithms, volume 1, pages 69-93.
  26. Morgan Kaufmann, San Mateo, CA, 1991. ISBN 1-55860-170-8. doi: 10.1016/B978-0-08-050684-5.50008-2. URL https: //doi.org/10.1016/B978-0-08-050684-5.50008-2. · DOI
  27. A. D. Goldie, Z. Wang, A. Hayler, D. Nathani, E. Toledo, K. Thampiratwong, A. Kalisz, M. Beukman, H. Erlebach, A. Letcher, S. Reddy, C. Wibault, T. Wolf, C. O'Neill, U. Berdica, N. Roberts, S. Rahmani, R. Raileanu, S. Whiteson, and J. N. Foerster. DiscoGen: Procedural generation of algorithm discovery tasks in machine learning. In International Conference on Machine Learning, 2026. URL https://arxiv.org/abs/2603. 17863.
  28. I. J. Good. Speculations concerning the first ultraintelligent machine. In F. L. Alt and M. Rubinoff, editors, Advances in Computers, volume 6, pages 31-88. Academic Press, 1965. doi: 10.1016/S0065-2458(08) 60418-0. URL https://doi.org/10.1016/S0065-2458(08)60418-0. · DOI · Paper page
  29. J. Gottweis, W.-H. Weng, A. Daryin, T. Tu, P. Sirkovic, A. Myaskovsky, G. Glowaty, F. Weissenberger, A. Orlandi, D. Popovici, A. Palepu, K. Rong, R. Tanno, K. Saab, F. Zhang, J. Blum, A. Carroll, K. Kulkarni, N. Tomasev, D. Zverinski, I. Rendulic, E. Vedadi, F. Hasler, L. Rimanic, M. Boia, I. Budiselic, B. Feinstein, M. Bellaiche, T. Sheffer, J. Freyberg, J. Ratcliff, O. Bertolli, K. Chou, A. Hassidim, B. Gokturk, A. Vahdat, Y. Guan, V. Dhillon, E. D. Vaishnav, B. Lee, T. R. D. Costa, J. R. Penadés, G. Peltz, Y. Matias, J. Manyika, D. Hassabis, Y. Xu, P. Kohli, A. Pawlosky, A. Karthikesalingam, and V. Natarajan. Accelerating scientific discovery with Co-Scientist. Nature, 655(8122):487-496, 2026. doi: 10.1038/s41586-026-10644-y. URL https: //doi.org/10.1038/s41586-026-10644-y. · DOI
  30. E. Grefenstette, B. Amos, D. Yarats, P. M. Htut, A. Molchanov, F. Meier, D. Kiela, K. Cho, and S. Chintala. Generalized inner loop meta-learning. arXiv preprint arXiv:1910.01727, 2019. URL https://arxiv.org/ abs/1910.01727. · arXiv
  31. Q. Guo, R. Wang, J. Guo, B. Li, K. Song, X. Tan, G. Liu, J. Bian, and Y. Yang. Connecting large language models with evolutionary algorithms yields powerful prompt optimizers. In International Conference on Learning Representations, 2024. URL https://arxiv.org/abs/2309.08532. · arXiv
  32. K. Hambardzumyan, N. Baldwin, E. Toledo, R. Hazra, M. Kuchnik, B. Al Omari, T. S. Foster, A. Protopopov, J.-C. Gagnon-Audet, I. Mediratta, K. Niu, M. Shvartsman, A. Lupidi, A. Audran-Reiss, P. Pathak, T. Shavrina, D. Magka, H. Momand, D. Dunfield, N. Cancedda, P. Stenetorp, C.-J. Wu, J. N. Foerster, Y. Bachrach, and M. Josifoski. AIRA 2 : Overcoming bottlenecks in AI research agents. arXiv preprint arXiv:2603.26499, 2026. URL https://arxiv.org/abs/2603.26499. · arXiv
  33. S. Hochreiter, A. S. Younger, and P. R. Conwell. Learning to learn using gradient descent. In Artificial Neural Networks -ICANN 2001, pages 87-94. Springer, 2001. doi: 10.1007/3-540-44668-0_13. URL https://link.springer.com/chapter/10.1007/3-540-44668-0_13. · DOI
  34. S. Hu, C. Lu, and J. Clune. Automated design of agentic systems. In International Conference on Learn- ing Representations, 2025. URL https://proceedings.iclr.cc/paper_files/paper/2025/hash/ 36b7acf6f6010652b3f2a433774a66fe-Abstract-Conference.html. Poster presentation. 1, 12
  35. Q. Huang, J. Vora, P. Liang, and J. Leskovec. MLAgentBench: Evaluating language agents on machine learning experimentation. In International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 20271-20309. PMLR, 2024. URL https://proceedings.mlr.press/v235/ huang24y.html.
  36. E. Hughes, M. Dennis, J. Parker-Holder, F. Behbahani, A. Mavalankar, Y. Shi, T. Schaul, and T. Rocktäschel. Position: Open-endedness is essential for artificial superhuman intelligence. In International Conference on Machine Learning, 2024. URL https://arxiv.org/abs/2406.04268. · arXiv
  37. A. Iacob, A. Jovanović, W. F. Shen, D. Burkhardt, M. Kurmanji, N. Tastan, L. Sani, N. A. E. Venanzi, A. Odonnat, Z. Cao, B. Marino, X. Qiu, and N. D. Lane. The Red Queen Gödel machine: Co-evolving agents and their evaluators. arXiv preprint arXiv:2606.26294, 2026. URL https://arxiv.org/abs/2606.26294. · arXiv
  38. Y. Imajuku, K. Horie, Y. Iwata, K. Aoki, N. Takahashi, and T. Akiba. ALE-bench: A benchmark for long- horizon objective-driven algorithm engineering. In Advances in Neural Information Processing Systems, volume 38, 2025. URL https://proceedings.neurips.cc/paper_files/paper/2025/hash/ e555eab2c68f886052f404397ea52001-Abstract-Datasets_and_Benchmarks_Track.html. Datasets and Benchmarks Track. 6, 24
  39. P. Jansen, O. Tafjord, M. Radensky, P. Siangliulue, T. Hope, B. D. Mishra, B. P. Majumder, D. S. Weld, and P. Clark. CodeScientist: End-to-end semi-automated scientific discovery with code-based experimentation. In Findings of the Association for Computational Linguistics: ACL 2025, pages 13370-13467. Association for Computational Linguistics, 2025. doi: 10.18653/v1/2025.findings-acl.692. URL https://aclanthology. org/2025.findings-acl.692/. 1, 12 · DOI
  40. Z. Jiang, D. Schmidt, D. Srikanth, D. Xu, I. Kaplan, D. Jacenko, and Y. Wu. AIDE: AI-driven exploration in the space of code. arXiv preprint arXiv:2502.13138, 2025. URL https://arxiv.org/abs/2502.13138. 1, 4, 11, 25 · arXiv
  41. O. Khattab, A. Singhvi, P. Maheshwari, Z. Zhang, K. Santhanam, S. Vardhamanan, S. Haq, A. Sharma, T. T. Joshi, H. Moazam, H. Miller, M. Zaharia, and C. Potts. DSPy: Compiling declarative language model calls into state-of-the-art pipelines. In International Conference on Learning Representations, 2024. URL https://arxiv.org/abs/2310.03714. · arXiv
  42. H. Kim, Y. Lee, G. Lee, C. Finn, and K. Lee. WHALE: A simple recipe for joint harness-weight optimization. arXiv preprint arXiv:2609.00196, 2026. URL https://arxiv.org/abs/2609.00196. · arXiv
  43. L. Kocsis and C. Szepesvári. Bandit based Monte-Carlo planning. In J. Fürnkranz, T. Scheffer, and M. Spiliopoulou, editors, Machine Learning: ECML 2006, volume 4212 of Lecture Notes in Computer Science, pages 282-293, Berlin, Heidelberg, 2006. Springer. ISBN 978-3-540-45375-8. doi: 10.1007/11871842_29. URL https://doi.org/10.1007/11871842_29. · DOI
  44. J. R. Koza. Genetic programming as a means for programming computers by natural selection. Statistics and Computing, 4(2), 1994.
  45. I. Kulikov, C. Whitehouse, T. Wu, Y. Nie, S. Saha, E. Helenowski, W. Yuan, O. Golovneva, J. Lanchantin, Y. Bachrach, J. Foerster, X. Li, H. Fang, S. Sukhbaatar, and J. Weston. Autodata: An agentic data scientist to create high quality synthetic data. arXiv preprint arXiv:2606.25996, 2026. URL https://arxiv.org/ abs/2606.25996. · arXiv
  46. R. T. Lange, Q. Sun, A. Prasad, M. Faldor, Y. Tang, and D. Ha. Towards robust agentic CUDA kernel benchmarking, verification, and optimization. arXiv preprint arXiv:2509.14279, 2025. URL https://arxiv.org/abs/ 2509.14279. · arXiv
  47. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
  48. Y. Lee, R. S. Nair, Q. Zhang, K. Lee, O. Khattab, and C. Finn. Meta-Harness: End-to-end optimization of model harnesses. In Conference on Language Modeling, 2026. URL https://arxiv.org/abs/2603.28052. 1, 12 · arXiv
  49. J. Lehman, J. Gordon, S. Jain, K. Ndousse, C. Yeh, and K. O. Stanley. Evolution through large models. arXiv preprint arXiv:2206.08896, 2022. URL https://arxiv.org/abs/2206.08896. · arXiv
  50. G. Liao, H. Qin, Y. Wang, A. Golden, M. Kuchnik, Y. Yetim, R. Xiao, J. J. Ang, C. Fu, Y. He, S. Hsia, Z. Jiang, R. Levenstein, D. Li, L. Li, A. Mathews, V. Puvvada, F. Shi, N. Yan, X. Yu, U. Pashkevich, M. Steiner, C.-J. Wu, and G. Liu. KernelEvolve: Scaling agentic kernel coding for heterogeneous AI accelerators at Meta. In 2026 ACM/IEEE 53rd Annual International Symposium on Computer Architecture (ISCA), pages 733-747, 2026. doi: 10.1109/ISCA66397.2026.00063. 1, 11 · DOI
  51. M. Lin, H. Lu, Z. Shi, B. He, R. Mao, Z. Zhang, Z. Wu, X. Tang, H. Liu, Z. Dai, X. Zhang, S. Wang, B. Dumoulin, and J. Pei. Position: Agentic evolution is the path to evolving LLMs. arXiv preprint arXiv:2602.00359, 2026. URL https://arxiv.org/abs/2602.00359. · arXiv
  52. B. Liu, S. Yu, Y. Jiang, A. Qu, A. Zhao, Z. Liu, J. Kim, Z. Zhou, S. Kim, T. Ren, M. Liu, H. Yu, Z. Chen, W. Shi, P. P. Liang, L. Zettlemoyer, Y. Choi, and N. Jaques. SPADE: Self-play in adaptive synthetic executable environments. arXiv preprint arXiv:2608.19197, 2026a. URL https://arxiv.org/abs/2608.19197. · arXiv
  53. F. Liu, R. Zhang, Z. Xie, R. Sun, K. Li, Q. Hu, P. Guo, X. Lin, X. Tong, M. Yuan, Z. Wang, Z. Lu, and Q. Zhang. LLM4AD: A platform for algorithm design with large language model. arXiv preprint arXiv:2412.17287, 2024. URL https://arxiv.org/abs/2412.17287. 1, 11 · arXiv
  54. S. Liu, S. Agarwal, M. Maheswaran, M. Cemri, Z. Li, Q. Mang, A. Naren, E. Boneh, A. Cheng, M. Z. Pan, A. Du, K. Keutzer, A. Cheung, A. G. Dimakis, K. Sen, M. Zaharia, and I. Stoica. EvoX: Meta-evolution for automated discovery. arXiv preprint arXiv:2602.23413, 2026b. URL https://arxiv.org/abs/2602.23413. · arXiv
  55. C. Lu, S. Holt, C. Fanconi, A. J. Chan, J. Foerster, M. van der Schaar, and R. T. Lange. Discovering preference optimization algorithms with and for large language models. In Advances in Neural Information Processing Systems, volume 37, 2024. URL https://arxiv.org/abs/2406.08414. · arXiv
  56. C. Lu, C. Lu, R. T. Lange, Y. Yamada, S. Hu, J. Foerster, D. Ha, and J. Clune. Towards end-to-end automation of AI research. Nature, 651(8107):914-919, Mar. 2026. doi: 10.1038/s41586-026-10265-5. URL https: //doi.org/10.1038/s41586-026-10265-5. 1, 11, 25 · DOI · Paper page
  57. M. Luby, A. Sinclair, and D. Zuckerman. Optimal speedup of Las Vegas algorithms. Information Processing Letters, 47(4):173-180, 1993. doi: 10.1016/0020-0190(93)90029-9. URL https://doi.org/10.1016/ 0020-0190(93)90029-9. · DOI
  58. A. Lupidi, B. Gauri, T. S. Foster, B. Al Omari, D. Magka, A. Pepe, A. Audran-Reiss, M. Aghamelu, N. Baldwin, L. Cipolina-Kun, J.-C. Gagnon-Audet, C. H. Leow, S. Lefdal, H. Mossalam, A. Moudgil, S. Nazir, E. Tewolde, I. Urrego, J. Armengol Estape, A. Budhiraja, G. Chaurasia, A. Charnalia, D. Dunfield, K. Hambardzumyan, D. Izcovich, M. Josifoski, I. Mediratta, K. Niu, P. Pathak, M. Shvartsman, E. Toledo, A. Protopopov, R. Raileanu, A. Miller, T. Shavrina, J. Foerster, and Y. Bachrach. AIRS-bench: a suite of tasks for frontier AI research science agents. arXiv preprint arXiv:2602.06855, 2026. URL https://arxiv.org/abs/2602.06855. · arXiv
  59. D. Maclaurin, D. Duvenaud, and R. Adams. Gradient-based hyperparameter optimization through reversible learning. In Proceedings of the 32nd International Conference on Machine Learning, volume 37 of Proceedings of Machine Learning Research, pages 2113-2122. PMLR, 2015. URL https://proceedings.mlr.press/ v37/maclaurin15.html.
  60. Y. Meng, D. Srikanth, B. Zhao, Z. Jiang, and Y. Wu. AutoData: Agentic search for pre-training data selection. arXiv preprint arXiv:2609.19754, 2026. URL https://arxiv.org/abs/2609.19754. · arXiv
  61. J.-B. Mouret and J. Clune. Illuminating search spaces by mapping elites. arXiv preprint arXiv:1504.04909, 2015. URL https://arxiv.org/abs/1504.04909. · arXiv
  62. K. Murphy. Model discovery agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models. arXiv preprint arXiv:2608.09696, 2026. URL https://arxiv.org/abs/2608. 09696. · arXiv
  63. D. Nathani, L. Madaan, N. Roberts, N. Bashlykov, A. Menon, V. Moens, A. Budhiraja, D. Magka, V. Vorotilov, G. Chaurasia, D. Hupkes, R. S. Cabral, T. Shavrina, J. Foerster, Y. Bachrach, W. Y. Wang, and R. Raileanu. MLGym: A new framework and benchmark for advancing AI research agents. arXiv preprint arXiv:2502.14499, 2025. URL https://arxiv.org/abs/2502.14499. · arXiv
  64. A. Novikov, N. Vũ, M. Eisenberger, E. Dupont, P.-S. Huang, A. Z. Wagner, S. Shirobokov, B. Kozlovskii, F. J. R. Ruiz, A. Mehrabian, M. P. Kumar, A. See, S. Chaudhuri, G. Holland, A. Davies, S. Nowozin, P. Kohli, and M. Balog. AlphaEvolve: A coding agent for scientific and algorithmic discovery. arXiv preprint arXiv:2506.13131, 2025. URL https://arxiv.org/abs/2506.13131. 1, 11 · arXiv
  65. J. Oh, M. Hessel, W. M. Czarnecki, Z. Xu, H. P. van Hasselt, S. P. Singh, and D. Silver. Discover- ing reinforcement learning algorithms. In Advances in Neural Information Processing Systems, vol- ume 33, pages 1060-1070, 2020. URL https://proceedings.neurips.cc/paper/2020/hash/ 0b96d81f0494fde5428c7aea243c9157-Abstract.html.
  66. J. Oh, G. Farquhar, I. Kemaev, D. A. Calian, M. Hessel, L. Zintgraf, S. Singh, H. van Hasselt, and D. Silver. Discovering state-of-the-art reinforcement learning algorithms. Nature, 648:312-319, 2025. doi: 10.1038/ s41586-025-09761-x. URL https://www.nature.com/articles/s41586-025-09761-x. 13 · DOI
  67. A. Ouyang, S. Guo, S. Arora, A. L. Zhang, W. Hu, C. Ré, and A. Mirhoseini. KernelBench: Can LLMs write efficient GPU kernels? In International Conference on Machine Learning, volume 267 of Proceedings of Machine Learning Research, pages 47356-47415. PMLR, 2025. URL https://proceedings.mlr.press/v267/ ouyang25a.html. 8, 24
  68. R. Pryzant, D. Iter, J. Li, Y. T. Lee, C. Zhu, and M. Zeng. Automatic prompt optimization with "gradient descent" and beam search. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023. URL https://arxiv.org/abs/2305.03495. · arXiv
  69. A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9, 2019.
  70. S. Rasp, S. Hoyer, A. Merose, I. Langmore, P. Battaglia, T. Russell, A. Sanchez-Gonzalez, V. Yang, R. Carver, S. Agrawal, M. Chantry, Z. Ben Bouallegue, P. Dueben, C. Bromberg, J. Sisk, L. Barrington, A. Bell, and F. Sha. WeatherBench 2: A benchmark for the next generation of data-driven global weather models. Journal of Advances in Modeling Earth Systems, 16(6):e2023MS004019, June 2024. doi: 10.1029/2023MS004019. URL https://doi.org/10.1029/2023MS004019. 6, 25 · DOI · Paper page
  71. P. Ray, P. P. Brahma, Z. Liu, and E. Barsoum. AdaptEvolve: Improving efficiency of evolutionary AI agents through adaptive model selection. In Findings of the Association for Computational Linguistics: ACL 2026, pages 40625-40633, 2026. doi: 10.18653/v1/2026.findings-acl.2019. URL https://aclanthology. org/2026.findings-acl.2019/. · DOI
  72. E. Real, C. Liang, D. So, and Q. Le. AutoML-Zero: Evolving machine learning algorithms from scratch. In Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 8007-8019. PMLR, 2020. URL https://proceedings.mlr.press/v119/ real20a.html.
  73. M. Robeyns, M. Szummer, and L. Aitchison. A self-improving coding agent. arXiv preprint arXiv:2504.15228, 2025. URL https://arxiv.org/abs/2504.15228. · arXiv
  74. B. Romera-Paredes, M. Barekatain, A. Novikov, M. Balog, M. P. Kumar, E. Dupont, F. J. R. Ruiz, J. S. Ellenberg, P. Wang, O. Fawzi, P. Kohli, and A. Fawzi. Mathematical discoveries from program search with large language models. Nature, 625(7995):468-475, 2024. doi: 10.1038/s41586-023-06924-6. URL https: //www.nature.com/articles/s41586-023-06924-6. · DOI · Paper page
  75. M. Samvelyan, S. C. Raparthy, A. Lupu, E. Hambro, A. H. Markosyan, M. Bhatt, Y. Mao, M. Jiang, J. Parker- Holder, J. Foerster, T. Rocktäschel, and R. Raileanu. Rainbow teaming: Open-ended generation of diverse adversarial prompts. In Advances in Neural Information Processing Systems, volume 37, 2024. URL https: //arxiv.org/abs/2402.16822.
  76. S. Schmidgall, Y. Su, Z. Wang, X. Sun, J. Wu, X. Yu, J. Liu, M. Moor, Z. Liu, and E. Barsoum. Agent Labora- tory: Using LLM agents as research assistants. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 5977-6043. Association for Computational Linguistics, 2025. doi: 10.18653/v1/2025. findings-emnlp.320. URL https://aclanthology.org/2025.findings-emnlp.320/. 1, 12 · DOI · Paper page
  77. S. Schmidgall, X. Zhu, M. Shaw, L. Yang, V. Liévin, J. Yang, Y. Zhuang, T. Strother, A. Bijamov, M. W. Sun, A. Palepu, J. Chen, D. Steiner, J. Shreibati, W.-H. Weng, Y. Zhao, X. Hu, N. Zahn, S. Garg, J. Kirby, Y. Gan, J. Li, D. Thakkar, S. Azizi, D. Racz, J. Gottweis, V. Natarajan, C. Wu, T. Danino, K. Rong, H. Wang, B. Schillings, Y. Cheng, Q. V. Le, and T. Tu. Accelerating scientific research with Gemini in the real-world. arXiv preprint arXiv:2608.26701, 2026. URL https://arxiv.org/abs/2608.26701. · arXiv
  78. J. Schmidhuber. A 'self-referential' weight matrix. In ICANN '93: Proceedings of the International Conference on Artificial Neural Networks, Amsterdam, pages 446-450. Springer, 1993. doi: 10.1007/978-1-4471-2063-6_ 107. · DOI
  79. J. Schmidhuber. Gödel Machines: Fully self-referential optimal universal self-improvers. In B. Goertzel and C. Pennachin, editors, Artificial General Intelligence, Cognitive Technologies, pages 199-226. Springer, Berlin, Heidelberg, 2007. doi: 10.1007/978-3-540-68677-4_7. URL https://doi.org/10.1007/ 978-3-540-68677-4_7. · DOI · Paper page
  80. N. Shinn, F. Cassano, E. Berman, A. Gopinath, K. Narasimhan, and S. Yao. Reflexion: Language agents with verbal reinforcement learning. In Advances in Neural Information Processing Systems, volume 36, 2023. URL https://arxiv.org/abs/2303.11366. · arXiv
  81. C. Si, T. Hashimoto, and D. Yang. The ideation-execution gap: Execution outcomes of LLM-generated versus human research ideas. arXiv preprint arXiv:2506.20803, 2025a. URL https://arxiv.org/abs/2506. 20803. · arXiv
  82. C. Si, D. Yang, and T. Hashimoto. Can LLMs generate novel research ideas? A large-scale human study with 100+ NLP researchers. In International Conference on Learning Representations, 2025b. URL https: //arxiv.org/abs/2409.04109. 1, 12
  83. C. Si, Z. Yang, Y. Choi, E. Candès, D. Yang, and T. Hashimoto. Towards execution-grounded automated AI research. arXiv preprint arXiv:2601.14525, 2026. URL https://arxiv.org/abs/2601.14525. · arXiv
  84. J. Skalse, N. H. R. Howe, D. Krasheninnikov, and D. Krueger. Defining and characterizing reward hacking. In Advances in Neural Information Processing Systems, volume 35, pages 9460-9471, 2022. URL https://proceedings.neurips.cc/paper_files/paper/2022/file/ 3d719fee332caa23d5038b8a90e81796-Paper-Conference.pdf.
  85. J. E. Smith and R. L. Winkler. The optimizer's curse: Skepticism and postdecision surprise in decision analysis. Management Science, 52(3):311-322, 2006. doi: 10.1287/mnsc.1050.0451. URL https://doi.org/10. 1287/mnsc.1050.0451. · DOI
  86. G. Starace, O. Jaffe, D. Sherburn, J. Aung, J. S. Chan, L. Maksin, R. Dias, E. Mays, B. Kinsella, W. Thompson, J. Heidecke, A. Glaese, and T. Patwardhan. PaperBench: Evaluating AI's ability to replicate AI research. In International Conference on Machine Learning, volume 267 of Proceedings of Machine Learning Research, pages 56843-56873. PMLR, 2025. URL https://proceedings.mlr.press/v267/starace25a.html.
  87. E. X. Tan, J. Lanchantin, S. Dhuliawala, D. Li, T. Nguyen, J. Xu, P. Yu, I. Kulikov, S. Sukhbaatar, J. Weston, X. Li, and O. Golovneva. Self-improving pretraining: using post-trained models to pretrain better models. arXiv preprint arXiv:2601.21343, 2026. URL https://arxiv.org/abs/2601.21343. · arXiv
  88. R. Tanese. Distributed genetic algorithms. In J. D. Schaffer, editor, Proceedings of the Third International Conference on Genetic Algorithms, pages 434-439, San Mateo, CA, 1989. Morgan Kaufmann. ISBN 1-55860- 066-3. URL https://dl.acm.org/doi/10.5555/645512.657245. · DOI
  89. R. Tiwari, K. Sareen, L. A. Agrawal, J. E. Gonzalez, M. Zaharia, K. Keutzer, I. S. Dhillon, R. Agarwal, and D. Khatri. Learning, fast and slow: Towards LLMs that adapt continually. arXiv preprint arXiv:2605.12484, 2026. URL https://arxiv.org/abs/2605.12484. · arXiv
  90. E. Toledo, K. Hambardzumyan, M. Josifoski, R. Hazra, N. Baldwin, A. Audran-Reiss, M. Kuchnik, D. Magka, M. Jiang, A. M. Lupidi, A. Lupu, R. Raileanu, T. Shavrina, K. Niu, J.-C. Gagnon-Audet, M. Shvartsman, S. Sodhani, A. H. Miller, A. Charnalia, D. Dunfield, C.-J. Wu, P. Stenetorp, N. Can- cedda, J. N. Foerster, and Y. Bachrach. AI research agents for machine learning: Search, ex- ploration, and generalization in MLE-bench. In Advances in Neural Information Processing Systems, volume 38, 2025. URL https://proceedings.neurips.cc/paper_files/paper/2025/hash/ 328b81881da145412f2bc56c998dfb6a-Abstract-Conference.html. Spotlight presentation. 1, 11, 25
  91. D. Trehan and P. Chopra. Why LLMs aren't scientists yet: Lessons from four autonomous research attempts. arXiv preprint arXiv:2601.03315, 2026. URL https://arxiv.org/abs/2601.03315. · arXiv
  92. G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar. Voyager: An open-ended embodied agent with large language models. Transactions on Machine Learning Research, 2024a. URL https://arxiv.org/abs/2305.16291. · arXiv
  93. X. Wang, C. Li, Z. Wang, F. Bai, H. Luo, J. Zhang, N. Jojic, E. P. Xing, and Z. Hu. PromptAgent: Strategic planning with language models enables expert-level prompt optimization. In International Conference on Learning Representations, 2024b. URL https://arxiv.org/abs/2310.16427. · arXiv
  94. J. Weston and J. Foerster. AI & human co-improvement for safer co-superintelligence. arXiv preprint arXiv:2512.05356, 2025. URL https://arxiv.org/abs/2512.05356. · arXiv
  95. H. Wijk, T. Lin, J. Becker, S. Jawhar, N. Parikh, T. Broadley, L. Chan, M. Chen, J. Clymer, J. Dhyani, E. Ericheva, K. Garcia, B. Goodrich, N. Jurkovic, H. Karnofsky, M. Kinniment, A. Lajko, S. Nix, L. Sato, W. Saunders, M. Taran, B. West, and E. Barnes. RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts. arXiv preprint arXiv:2411.15114, 2024. URL https://arxiv.org/abs/ 2411.15114. · arXiv
  96. Y. Yamada, R. T. Lange, C. Lu, S. Hu, C. Lu, J. Foerster, J. Clune, and D. Ha. The AI Scientist-v2: Workshop- level automated scientific discovery via agentic tree search. arXiv preprint arXiv:2504.08066, 2025. URL https://arxiv.org/abs/2504.08066. 11, 25 · arXiv
  97. C. Yang, X. Wang, Y. Lu, H. Liu, Q. V. Le, D. Zhou, and X. Chen. Large language models as optimizers. In International Conference on Learning Representations, 2024. URL https://arxiv.org/abs/2309.03409. · arXiv
  98. H. Yang, M. Xerri, S. Park, H. Zhang, Y. Feng, S. A. Kogilathota, and J. Zhou. Self-improvement of large language models: A technical overview and future outlook. Transactions on Machine Learning Research, 2026. URL https://arxiv.org/abs/2603.25681. · arXiv
  99. X. Yin, X. Wang, L. Pan, L. Lin, X. Wan, and W. Y. Wang. Gödel agent: A self-referential agent framework for recursively self-improvement. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 27890-27913. Association for Computational Linguistics, 2025. doi: 10.18653/v1/2025.acl-long.1354. URL https://aclanthology.org/2025.acl-long.1354/. · DOI · Paper page
  100. E. Zelikman, E. Lorch, L. Mackey, and A. T. Kalai. Self-taught optimizer (STOP): Recursively self-improving code generation. In Conference on Language Modeling, 2024. URL https://openreview.net/forum? id=46Zgqo4QIU. Spotlight presentation. 1, 12
  101. J. Zhang, J. Xiang, Z. Yu, F. Teng, X. Chen, J. Chen, M. Zhuge, X. Cheng, S. Hong, J. Wang, B. Zheng, B. Liu, Y. Luo, and C. Wu. AFlow: Automating agentic workflow generation. In International Conference on Learning Representations, 2025. URL https://arxiv.org/abs/2410.10762. 1, 12 · arXiv
  102. J. Zhang, S. Hu, C. Lu, R. T. Lange, and J. Clune. Darwin Gödel Machine: Open-ended evolution of self-improving agents. In International Conference on Learning Representa- tions, 2026a. URL https://proceedings.iclr.cc/paper_files/paper/2026/hash/ aa5f5e6eb6f613ec412f1d948dfa21a5-Abstract-Conference.html. Poster presentation. 1, 12
  103. B. Zhao, D. Magka, M. Jiang, X. Li, R. Raileanu, T. Shavrina, J.-C. Gagnon-Audet, K. Niu, S. Sodhani, M. Shvarts- man, A. Lupu, A. Lupidi, E. Toledo, K. Hambardzumyan, M. Josifoski, T. Foster, L. Cipolina-Kun, A. Charnalia, D. Dunfield, A. H. Miller, O. Mac Aodha, J. Foerster, and Y. Bachrach. The automated LLM speedrunning benchmark: Reproducing NanoGPT improvements. In Advances in Neural Information Processing Systems, volume 38, pages 31311-31355, 2025. doi: 10.52202/085713-0928. · DOI
  104. B. Zhao, D. Srikanth, Y. Wu, and Z. Jiang. SpecBench: Measuring reward hacking in long-horizon coding agents. arXiv preprint arXiv:2605.21384, 2026. URL https://arxiv.org/abs/2605.21384. · arXiv
  105. L. Zheng, W.-L. Chiang, Y. Sheng, S. Zhuang, Z. Wu, Y. Zhuang, Z. Lin, Z. Li, D. Li, E. P. Xing, H. Zhang, J. E. Gonzalez, and I. Stoica. Judging LLM-as-a-judge with MT-bench and chatbot arena. In Advances in Neural Information Processing Systems, volume 36, pages 46595-46623.
  106. Curran Associates, Inc., 2023. doi: 10.52202/075280-2020. URL https://proceedings.neurips.cc/paper_files/paper/2023/ hash/91f18a1287b398d378ef22505bf41832-Abstract-Datasets_and_Benchmarks.html. · DOI · Paper page
  107. Y. Zhou, A. I. Muresanu, Z. Han, K. Paster, S. Pitis, H. Chan, and J. Ba. Large language models are human-level prompt engineers. In International Conference on Learning Representations, 2023. URL https://arxiv. org/abs/2211.01910.
  108. Q. Zou, H. H. Lam, W. Zhao, T. Chen, Y. Tang, S. Yu, Y. Zhu, S. Anumasa, Z. Zhang, T. Zhang, C. Liu, Z. Jiang, A. Goyal, and D. Liu. FML-bench: A controlled study of AI research agent strategies from the perspective of search dynamics. arXiv preprint arXiv:2605.17373, 2026. URL https://arxiv.org/abs/2605.17373. 2, 5, 6, 25 · arXiv

Cited by

Sorted by citations

Authors
Srikanth, D., Zhao, B., Xu, D., Wu, Y., & Jiang, Z.
ORCID
Wu, Yuxiang
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2609.26457
arXiv
2609.26457
OpenAlex
W7214127912
Cited by
0
References
6
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
Keywords
recursive self-improvement, research efficiency, reward hacking, transfer learning, search policy, memory mechanisms, context compression, weather forecasting, machine learning engineering

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review