DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressively
Open accessAbstract
While previous AI Scientist systems can generate novel findings, they often lack the focus to produce scientifically valuable contributions that address pressing human-defined challenges. We introduce DeepScientist, a system designed to overcome this by conducting goal-oriented, fully autonomous scientific discovery over month-long timelines. It formalizes discovery as a Bayesian Optimization problem, operationalized through a hierarchical evaluation process consisting of "hypothesize, verify, and analyze". Leveraging a cumulative Findings Memory, this loop intelligently balances the exploration of novel hypotheses with exploitation, selectively promoting the most promising findings to higher-fidelity levels of validation. Consuming over 20,000 GPU hours, the system generated about 5,000 unique scientific ideas and experimentally validated approximately 1100 of them, ultimately surpassing human-designed state-of-the-art (SOTA) methods on three frontier AI tasks by 183.7\%, 1.9\%, and 7.9\%. This work provides the first large-scale evidence of an AI achieving discoveries that progressively surpass human SOTA on scientific tasks, producing valuable findings that genuinely push the frontier of scientific discovery. To facilitate further research into this process, we will open-source all experimental logs and system code at https://github.com/ResearAI/DeepScientist/.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The formulation captures a broad class of agentic systems, ranging from a single agent solving reasoning tasks with tool augmentation to teams of role-specialized agents collaboratively developing software or conducting scientific inquiry.
“This formulation captures a broad class of agentic systems, ranging from a single agent solving reasoning tasks with tool augmentation to teams of role-specialized agents collaboratively developing software (Qian et al., 2024; Wang et al., 2025l) or conducting scientific inquiry (Weng et al., 2025).”
From Memory in the Age of AI Agents (2025) · cites this paper as Weng et al., 2025
The proposed formulation captures a broad class of agentic systems, ranging from a single agent solving reasoning tasks with tool augmentation to teams of role-specialized agents collaboratively developing software or conducting scientific inquiry.
“This formulation captures a broad class of agentic systems, ranging from a single agent solving reasoning tasks with tool augmentation to teams of role-specialized agents collaboratively developing software (Qian et al., 2024; Wang et al., 2025l) or conducting scientific inquiry (Weng et al., 2025).”
From Memory in the Age of AI Agents (2025) · cites this paper as Weng et al., 2025
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Efficient Memory Management for Large Language Model Serving with PagedAttention
Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J., Zhang, H., & Stoica, I. (2023) · Proceedings of the 29th Symposium on Operating Systems Principles · doi:10.1145/3600006.3613165 · Cited by 1,817 · see citing works
A Tutorial on Bayesian OptimizationPreprint
Frazier, P. I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02811 · Cited by 1,423 · see citing works
The Falcon Series of Open Language ModelsPreprint
Almazrouei, E., Alobeidli, H., AlShamsi, A., Cappelli, A., Cojocaru, R.-A., Debbah, M., Goffinet, É., Hesslow, D., Launay, J., Malartic, Q., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2311.16867 · Cited by 813 · see citing works
Discovering faster matrix multiplication algorithms with reinforcement learning
Fawzi, A., Balog, M., Huang, A., Hubert, T., Romera-Paredes, B., Barekatain, M., Novikov, A., R. Ruiz, F. J., Schrittwieser, J., Swirszcz, G., et al. (2022) · Nature · doi:10.1038/s41586-022-05172-4 · Cited by 478 · see citing works
Program Synthesis with Large Language Models
Austin, J., Odena, A., Nye, M., Bosma, M., Michalewski, H., Dohan, D., Jiang, E., Cai, C., Terry, M., Le, Q., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07732 · Cited by 388 · cited 1× · see citing works
“Although most of these attempts failed, the system-generated ACRA method ultimately advanced the MPBB (Austin et al., 2021) from a human SOTA of 190.25 to 193.90 tokens/second by identifying stable suffix patterns, as shown in Figure 3.”
InfluentialThe Virtual Lab of AI agents designs new SARS-CoV-2 nanobodies
Swanson, K., Wu, W., Bulaong, N. L., Pak, J. E., & Zou, J. (2025) · Nature · doi:10.1038/s41586-025-09442-9 · Cited by 169 · see citing works
Accelerating scientific discovery with Co-Scientist
Gottweis, J., Weng, W.-H., Daryin, A., Tu, T., Sirkovic, P., Myaskovsky, A., Glowaty, G., Weissenberger, F., Orlandi, A., Popovici, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.18864 · Cited by 158
DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process
Zhu, M.-J., Weng, Y., Yang, L.-Y., & Zhang, Y. (2025) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2503.08569 · Cited by 137
Self-citationThe AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
Lu, C., Lu, C., Lange, R. T., Foerster, J., Clune, J., & Ha, D. (2024) · arXiv · doi:10.48550/arxiv.2408.06292 · Cited by 118 · see citing works
AI-Researcher: Autonomous Scientific Innovation
Tang, J., Xia, L., Li, Z., & Huang, C. (2025) · Neural Information Processing Systems · doi:10.48550/arxiv.2505.18705 · Cited by 116
Large Language Models are Better Reasoners with Self-Verification
Weng, Y., Zhu, M., Xia, F., Li, B., He, S., Liu, S., Sun, B., Liu, K., & Zhao, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.167 · Cited by 110 · see citing works
Self-citationXia, H., Yang, Z., Dong, Q., Wang, P., Li, Y., Ge, T., Liu, T., Li, W., & Sui, Z. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.456 · Cited by 82 · see citing works
AgentRxiv: Towards Collaborative Autonomous ResearchPreprint
Schmidgall, S., & Moor, M. (2025) · arXiv.org · doi:10.48550/arxiv.2503.18102 · Cited by 81 · see citing works
Combining data and theory for derivable scientific discovery with AI-Descartes
Cornelio, C., Dash, S., Austel, V., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37236-y · Cited by 74 · see citing works
Baek, J., Jauhar, S. K., Cucerzan, S., & Hwang, S. J. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.342 · Cited by 46 · see citing works
Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions
Hou, X., Zhao, Y., Wang, S., & Wang, H. (2025) · arXiv · doi:10.48550/arxiv.2503.23278 · Cited by 43
Penadés, J. R., Gottweis, J., He, L., Patkowski, J. B., Shurick, A., Weng, W.-H., Tu, T., Palepu, A., Myaskovsky, A., Pawlosky, A., et al. (2025) · doi:10.1101/2025.02.19.639094 · Cited by 42 · cited 1× · see citing works
“Systems like CycleResearcher (Weng et al., 2025) handle writing, DeepReview (Zhu et al., 2025a) manages reviewing, and co-scientists (Gottweis et al., 2025; Penadés et al., 2025; Swanson et al., 2025; Baek et al., 2025) aid in hypothesis generation.”
Penadés, J. R., Gottweis, J., He, L., Patkowski, J. B., Daryin, A., Weng, W.-H., Tu, T., Palepu, A., Myaskovsky, A., Pawlosky, A., et al. (2025) · Cell · doi:10.1016/j.cell.2025.08.018 · Cited by 42 · see citing works
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
Yamada, Y., Lange, R. T., Lu, C., Hu, S., Lu, C., Foerster, J., Clune, J., & Ha, D. (2025) · arXiv · doi:10.48550/arxiv.2504.08066 · Cited by 32 · see citing works
Agent Laboratory: Using LLM Agents as Research AssistantsPreprint
Schmidgall, S., Su, Y., Wang, Z., Sun, X., Wu, J., Yu, X., Liu, J., Moor, M., Liu, Z., & Barsoum, E. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.04227 · Cited by 29 · see citing works
Reimagining research papers as interactive and reliable AI agents
Miao, J., Davis, J. R., Zhang, Y., Pritchard, J. K., & Zou, J. (2026) · Nature · doi:10.1038/s41586-026-11044-y · Cited by 29 · see citing works
Self-citationAI Scientists Fail Without Strong Implementation Capability
Zhu, M., Xie, Q.-J., Weng, Y., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2506.01372 · Cited by 23
Self-citationEvolving scientific discovery by unifying data and background knowledge with AI Hilbert
Cory-Wright, R., Cornelio, C., Dash, S., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-50074-w · Cited by 20 · see citing works
SkipBERT: Efficient Inference with Shallow Layer Skipping
Wang, J., Chen, K., Chen, G., Shou, L., & McAuley, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.503 · Cited by 18 · see citing works
How Far Are AI Scientists from Changing the World?Preprint
Xie, Q.-J., Weng, Y.-X., Zhu, M.-J., Shen, F.-C., Huang, S.-L., Lin, Z., Zhou, J.-H., Mao, Z.-L., Yang, Z.-J., Yang, L.-Y., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2507.23276 · Cited by 16 · see citing works
Self-citationWolters, C., Yang, X., Schlichtmann, U., & Suzumura, T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.08413 · Cited by 15 · see citing works
Scaling Laws in Scientific Discovery with AI and Robot ScientistsPreprint
Zhang, P.-S., Zhang, H., Xu, H., Xu, R.-J., Wang, Z., Wang, C., Garg, A., Li, Z., Ajoudani, A., & Liu, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.22444 · Cited by 11 · see citing works
MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
Chan, J. S., Chowdhury, N., Jaffe, O., Aung, J., Sherburn, D., Mays, E., Starace, G., Liu, K., Maksin, L., Patwardhan, T., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.07095 · Cited by 7 · see citing works
AI becomes a masterbrain scientistPreprint
Yang, Z., Wang, Y., & Zhang, L. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.04.19.537579 · Cited by 6 · see citing works
PaperBench: Evaluating AI's Ability to Replicate AI Research
Starace, G., Jaffe, O., Sherburn, D., Aung, J., Chan, J. S., Maksin, L., Dias, R., Mays, E., Kinsella, B., Thompson, W., et al. (2025) · arXiv · doi:10.48550/arxiv.2504.01848 · Cited by 4 · see citing works
Prompt-based system for personality and interpersonal reactivity prediction
Li, B., & Weng, Y. (2022) · Software Impacts · doi:10.1016/j.simpa.2022.100296 · Cited by 3 · see citing works
Self-citationControlLM: Crafting Diverse Personalities for Language ModelsPreprint
Weng, Y., He, S., Liu, K., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.10151 · Cited by 2 · see citing works
Self-citationWei, Y., Yu, X., Weng, Y., Ma, H., Zhang, Y., Zhao, J., & Liu, K. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679900 · Cited by 2 · see citing works
Self-citationBerkovich, J., David, N. S., & Buehler, M. J. (2026) · Advanced Science · doi:10.1002/advs.202511352 · Cited by 1 · see citing works
ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution
Lange, R. T., Imajuku, Y., & Cetin, E. (2025) · arXiv · doi:10.48550/arxiv.2509.19349 · cited 1×
“…function: Unlike previously studied tasks such as early-stage machine learning (Schmidgall et al., 2025a), algorithmic design (Novikov et al., 2025; Lange et al., 2025), or scientific software development (Aygün et al., 2025), A defining characteristic of frontier scientific discovery is that each…”
An AI system to help scientists write expert-level empirical software
Aygün, E., Belyaeva, A., Comanici, G., et al. (2025) · arXiv · doi:10.48550/arxiv.2509.06503
Artificial Text Detection with Multiple Training Strategies
Li, B., Weng, Y., Song, Q., & Deng, H. (2022) · arXiv · doi:10.48550/arxiv.2212.05194
Self-citation
Flagged first, then by citations
Research works printed but not linked: 20
- Guangsheng Bao, Yanbin Zhao, Juncai He, and Yue Zhang. Glimpse: Enabling white-box methods to use proprietary models for zero-shot llm-generated text detection. In The Thirteenth Interna- tional Conference on Learning Representations, a.
- Guangsheng Bao, Yanbin Zhao, Zhiyang Teng, Linyi Yang, and Yue Zhang. Fast-detectgpt: Effi- cient zero-shot detection of machine-generated text via conditional probability curvature. In The Twelfth International Conference on Learning Representations, b.
- Cristina Cornelio, Takuya Ito, Ryan Cory-Wright, Sanjeeb Dash, and Lior Horesh. The need for verification in ai-driven scientific discovery, 2025. URL https://arxiv.org/abs/2509. 01398.
- Liam Dugan, Alyssa Hwang, Filip Trhlík, Andrew Zhu, Josh Magnus Ludan, Hainiu Xu, Daphne Ippolito, and Chris Callison-Burch. RAID: A shared benchmark for robust evaluation of machine- generated text detectors. In Proceedings of the 62nd Annual Meeting of the Association for Com- putational Linguistics (Volume 1: Long Papers), pp. 12463-12492, Bangkok, Thailand, August 2024. Association for Computational Linguistics. URL https://aclanthology.org/ 2024.acl-long.674.
- Alexander Fleming. Penicillin. British medical journal, 2(4210):386, 1941.
- Roman Garnett. Bayesian optimization. Cambridge University Press, 2023.
- Soumya Suvra Ghosal, Souradip Chakraborty, Jonas Geiping, Furong Huang, Dinesh Manocha, and Amrit Bedi. A survey on the possibilities & impossibilities of AI-generated text detec- tion. Transactions on Machine Learning Research, 2023. ISSN 2835-8856. URL https: //openreview.net/forum?id=AXtFeYjboj. Survey Certification.
- Martin A Green. Silicon solar cells: evolution, high-efficiency design and efficiency enhancements. Semiconductor science and technology, 8(1):1, 1993.
- Abhimanyu Hans, Avi Schwarzschild, Valeriia Cherepanova, Hamid Kazemi, Aniruddha Saha, Micah Goldblum, Jonas Geiping, and Tom Goldstein. Spotting llms with binoculars: Zero- shot detection of machine-generated text. In International Conference on Machine Learning, pp. 17519-17537. PMLR, 2024.
- Xiaomeng Hu, Pin-Yu Chen, and Tsung-Yi Ho. Radar: Robust ai-text detection via adversarial learning. Advances in neural information processing systems, 36:15077-15095, 2023.
- Intology. Zochi technical report. arXiv, 2025.
- Gordon Moore. Moore's law. Electronics Magazine, 38(8):114, 1965.
- Samuel Schmidgall, Yusheng Su, Ze Wang, Ximeng Sun, Jialian Wu, Xiaodong Yu, Jiang Liu, Zicheng Liu, and Emad Barsoum. Agent laboratory: Using llm agents as research assistants. arXiv preprint arXiv:2501.04227, 2025b. · arXiv
- Jinyan Su, Terry Yue Zhuo, Di Wang, and Preslav Nakov. Detectllm: Leveraging log rank infor- mation for zero-shot detection of machine-generated text. In The 2023 Conference on Empirical Methods in Natural Language Processing.
- Yixuan Weng, Minjun Zhu, Fei Xia, Bin Li, Shizhu He, Kang Liu, and Jun Zhao. Mastering sym- bolic operations: Augmenting language models with compiled neural networks. In The Twelfth International Conference on Learning Representations.
- Yixuan Weng, Minjun Zhu, Guangsheng Bao, Hongbo Zhang, Jindong Wang, Yue Zhang, and Linyi Yang. Cycleresearcher: Improving automated research via automated review. In The Thirteenth International Conference on Learning Representations, 2025. URL https://openreview. net/forum?id=bjcsVLoHYs.
- Qiujie Xie, Qingqiu Li, Zhuohao Yu, Yuejie Zhang, Yue Zhang, and Linyi Yang. An empirical analysis of uncertainty in large language model evaluations. In The Thirteenth International Con- ference on Learning Representations, 2025a. URL https://openreview.net/forum? id=J4xLuCt2kg.
- Guibin Zhang, Junhao Wang, Junjie Chen, Wangchunshu Zhou, Kun Wang, and Shuicheng Yan. Agentracer: Who is inducing failure in the llm agentic systems?, 2025a. URL https: //arxiv.org/abs/2509.03312.
- Shaokun Zhang, Ming Yin, Jieyu Zhang, Jiale Liu, Zhiguang Han, Jingyang Zhang, Beibin Li, Chi Wang, Huazheng Wang, Yiran Chen, and Qingyun Wu. Which agent causes task failures and when? on automated failure attribution of LLM multi-agent systems. In Forty-second In- ternational Conference on Machine Learning, 2025c. URL https://openreview.net/ forum?id=GazlTYxZss.
- Minjun Zhu, Yixuan Weng, Linyi Yang, and Yue Zhang. Personality alignment of large language models. In The Thirteenth International Conference on Learning Representations, 2025b.
Cited by
Sorted by citations
Memory in the Age of AI Agents
Hu, Y., Liu, S., Yue, Y., Zhang, G., Liu, B., Zhu, F., Lin, J., Guo, H., Dou, S., Xi, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.13564 · Cited by 1 · see citing works
Self-citation
- Authors
- Weng, Y., Zhu, M., Xie, Q., Sun, Q., Lin, Z., Liu, S., & Zhang, Y.
- Affiliations
- Westlake University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2509.26603
- OpenAlex
- W7084099156
- Cited by
- 0
- References
- 37
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Social Sciences › Decision Sciences › Information Systems and Management › Research, Science, and Academia
- Keywords
- AI scientists, autonomous scientific discovery, Bayesian optimization, hypothesis generation, exploration-exploitation balance, hypothesis verification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
