AIDE: AI-Driven Exploration in the Space of Code
Open accessAbstract
Machine learning, the foundation of modern artificial intelligence, has driven innovations that have fundamentally transformed the world. Yet, behind advancements lies a complex and often tedious process requiring labor and compute intensive iteration and experimentation. Engineers and scientists developing machine learning models spend much of their time on trial-and-error tasks instead of conceptualizing innovative solutions or research hypotheses. To address this challenge, we introduce AI-Driven Exploration (AIDE), a machine learning engineering agent powered by large language models (LLMs). AIDE frames machine learning engineering as a code optimization problem, and formulates trial-and-error as a tree search in the space of potential solutions. By strategically reusing and refining promising solutions, AIDE effectively trades computational resources for enhanced performance, achieving state-of-the-art results on multiple machine learning engineering benchmarks, including our Kaggle evaluations, OpenAI MLE-Bench and METRs RE-Bench.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Integrating tree-search strategies with LLMs allows structured exploration of reasoning paths, enhancing systematic reasoning and comprehensiveness, though at the cost of increased complexity, higher computational demands, and challenges in scalability.
“Another promising direction is the integration of tree-search strategies with LLMs (Jiang et al., 2025), allowing structured exploration of reasoning paths. This approach enhances systematic reasoning and comprehensiveness, though at the cost of increased complexity, higher computational demands, and challenges in scalability.”
From The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search (2025) · cites this paper as Jiang et al., 2025
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredAIDE is an advanced search algorithm often used for optimizing code solutions.
“AIDE (Jiang et al., 2025) is an advanced search algorithm often used for optimizing code solutions (OpenAI, 2025b).”
From SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents (2026) · cites this paper as Jiang et al., 2025
AIDE uses tree search with draft, debug, and improve branching.
“It uses tree search with draft, debug, and improve branching.”
From SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents (2026) · cites this paper as Jiang et al., 2025
AIDE introduced tree search for code generation, using draft-debug-improve branching to explore the solution space.
“AIDE (Jiang et al., 2025) introduced tree search for code generation, using draft-debug-improve branching to explore the solution space.”
From SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents (2026) · cites this paper as Jiang et al., 2025
This is a common observation; see e.g. the improvements to software development capabilities from AIDE or recent work on KernelBench.
“This is a common obervation; see e.g. the improvements to software development capabilities from AIDE [50] or recent work on KernelBench: [51]”
From Measuring AI Ability to Complete Long Software Tasks (2025) · cites this paper as [50]
AIDE combines LLM-based code generation with tree search, demonstrating state-of-the-art performance on the MLEBench benchmark.
“AIDE (Jiang et al., 2025) combines LLM-based code generation with tree search, demonstrating state-of-the-art performance on the MLEBench benchmark (Chan et al., 2025), designed for machine learning engineering tasks.”
From The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search (2025) · cites this paper as Jiang et al., 2025
In AIDE, each node represents a potential solution state with a corresponding scalar evaluation score, and nodes are iteratively selected for further debugging or refinement based on these scores.
“In AIDE, each node represents a potential solution state with a corresponding scalar evaluation score (e.g., validation accuracy). Nodes are iteratively selected for further debugging or refinement based on these scores.”
From The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search (2025) · cites this paper as Jiang et al., 2025
Existing search mechanisms are limited by information isolation between branches and lack adaptive exploration strategies.
“First, existing search mechanisms are limited by information isolation between branches and lack adaptive exploration strategies.”
From MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery (2026) · cites this paper as [12]
The Introduction (p. 1) criticizes existing methods for requiring predefined search spaces and for sometimes searching inefficiently, but does not identify information isolation between branches or a lack of adaptive exploration as their limitations. Section 3.1 (p. 3) describes how AIDE summarizes its solution tree and selects nodes; it does not establish the claimed shortcomings of existing mechanisms. Searches for branch isolation and adaptive exploration found no passage making that comparison. (LLM, conf=0.70)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 20
- S. Falkner, A. Klein, and F. Hutter. BOHB: Robust and Efficient Hyperparameter Optimization at Scale. In Proc. of ICML , volume 35, 2018.
- M. Feurer, A. Klein, K. Eggensperger, J. T. Springenberg, M. Blum, and F. Hutter. Efficient and Robust Automated Machine Learning. In Proc. of NeurIPS , volume 28, 2015.
- Qian Huang, Jian Vora, Percy Liang, and Jure Leskovec. Mlagentbench: Evaluating language agents on machine learning experimentation. In Forty-first International Conference on Machine Learning , 2024.
- Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, and Ion Stoica. Livecodebench: Holistic and contamination free evaluation of large language models for code. In The Thirteenth International Conference on Learning Representations , 2025. URL https://openreview.net/forum?id=chfJJYC3iL .
- Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R Narasimhan. SWE-bench: Can language models resolve real-world github issues? In The Twelfth International Conference on Learning Representations , 2024. URL https://openreview. net/forum?id=VTF8yNQM66 .
- H. Jin, Q. Song, and X. Hu. Auto-Keras: An Efficient Neural Architecture Search System. In Proc. of ACM SIGKDD (KDD) , 2019.
- H. Jin, F. Chollet, Q. Song, and X. Hu. AutoKeras: An AutoML Library for Deep Learning. Journal of Machine Learning Research , 24(6):1-7, 2023.
- Leslie Pack Kaelbling, Michael L Littman, and Anthony R Cassandra. Planning and acting in partially observable stochastic domains. Artificial Intelligence , 101(1-2):99-134, 1998.
- E. LeDell and S. Poirier. H2O AutoML: Scalable Automatic Machine Learning. In Proc. of the AutoML Conference , pages 1-8, 2020a.
- Erin LeDell and Sebastien Poirier. H2O AutoML: Scalable automatic machine learning. 7th ICML Workshop on Automated Machine Learning (AutoML) , July 2020b. URL https://www.automl. org/wp-content/uploads/2020/07/AutoML\_2020\_paper\_61.pdf .
- H. Liu, K. Simonyan, and Y. Yang. DARTS: Differentiable Architecture Search. In Proc. of ICLR , 2019.
- J. Mueller and et al. AutoGluon: AutoML for Text, Image, and Tabular Data. Scientific Reports , 14 (1):72889, 2024.
- R. S. Olson and J. H. Moore. TPOT: A Tree-based Pipeline Optimization Tool for Automating Machine Learning. In ICML AutoML Workshop , 2016.
- H. Pham, M. Y. Guan, B. Zoph, Q. V. Le, and J. Dean. Efficient Neural Architecture Search via Parameter Sharing. In Proc. of ICML , volume 35, 2018.
- E. Real, A. Aggarwal, Y. Huang, and Q. V. Le. Regularized Evolution for Image Classifier Architecture Search. In Proc. of AAAI , 2019.
- Y. Shen, K. Song, X. Tan, D. Li, W. Lu, and Y. Zhuang. HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face. In Proc. of NeurIPS , 2023.
- C. Thornton, F. Hutter, H. H. Hoos, and K. Leyton-Brown. Auto-WEKA 2.0: Automatic Model Selection and Hyperparameter Optimization in WEKA. Journal of Machine Learning Research , 14(1):267-281, 2013a.
- C. Thornton, F. Hutter, H. H. Hoos, and K. Leyton-Brown. Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms. In Proc. of ACM SIGKDD (KDD) , 2013b.
- S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao. ReAct: Synergizing Reasoning and Acting in Language Models. In Proc. of ICLR , 2023.
- B. Zoph and Q. V. Le. Neural Architecture Search with Reinforcement Learning. In Proc. of ICLR , 2017.
Cited by
Sorted by citations
Towards end-to-end automation of AI research
Lu, C., Lu, C., Lange, R. T., Yamada, Y., Hu, S., Foerster, J., Ha, D., & Clune, J. (2026) · Nature · doi:10.1038/s41586-026-10265-5 · Cited by 116 · see citing works
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
Yamada, Y., Lange, R. T., Lu, C., Hu, S., Lu, C., Foerster, J., Clune, J., & Ha, D. (2025) · arXiv · doi:10.48550/arxiv.2504.08066 · Cited by 32 · see citing works
Measuring AI Ability to Complete Long Software Tasks
Kwa, T., West, B., Becker, J., Deng, A., Garcia, K., Hasin, M., Jawhar, S., Kinniment, M., Rush, N., Von Arx, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2503.14499 · Cited by 14 · see citing works
An Agentic Framework for Autonomous Metamaterial Modeling and Inverse Design
Lu, D., Malof, J. M., & Padilla, W. J. (2025) · ACS Photonics · doi:10.1021/acsphotonics.5c01514 · Cited by 11 · see citing works
Measuring AI Ability to Complete Long Software Tasks
Kwa, T., West, B., Becker, J., Deng, A., Garcia, K., Hasin, M., Jawhar, S., Kinniment, M., Rush, N., Von Arx, S., et al. (2025) · Advances in Neural Information Processing Systems 38 · doi:10.52202/085713-3086 · Cited by 1 · see citing works
SpecBench: Measuring Reward Hacking in Long-Horizon Coding Agents
Zhao, B., Srikanth, D., Wu, Y., & Jiang, Z. (2026) · arXiv · doi:10.48550/arxiv.2605.21384 · Cited by 1 · see citing works
Self-citationMLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery
Du, S., Yan, X., Shi, J., Cao, Z., Feng, S., Liang, Z., Sun, B., Peng, T., Zhou, Y., Li, X., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.06473
Liu, Z., Wu, J., Peng, R., Ji, Y., Li, D., Jiang, R., & Zhang, Y. (2026) · arXiv · doi:10.48550/arxiv.2608.03501
ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution
Lange, R. T., Imajuku, Y., & Cetin, E. (2025) · arXiv · doi:10.48550/arxiv.2509.19349
Zhang, Y., Chen, L., Zhao, W., Zhang, H., Qiao, C., Liu, Z. C., Chung, C. H., Tan, M. C. J., Wang, M., Tham, Y. C., et al. (2026) · medRxiv · doi:10.64898/2026.01.15.26344200
PACE: Unleashing the Power of Code Embeddings to Boost AutoML Agents
Zhao, G., Liang, H., Tang, H., Ma, Y., Liu, J., Du, Z., Zheng, Y., Xiao, C., & Hao, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817742
- Authors
- Jiang, Z., Schmidt, D., Srikanth, D., Xu, D., Kaplan, I., Jacenko, D., & Wu, Y.
- ORCID
- Wu, Yuxiang
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2502.13138
- OpenAlex
- W4407760093
- Cited by
- 4
- References
- 0
- Citations by year
- 2026: 3 · 2025: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- machine learning engineering, large language models, program optimization, tree search, trial and error, code search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
