Autonomous LLM-Driven Research — from Data to Human-Verifiable Research Papers
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Artificial intelligence (AI) promises to accelerate scientific discovery, but it remains unclear whether AI systems can perform fully autonomous research, and whether they can do so while adhering to key scientific values, such as transparency, traceability, and verifiability. The aim of this study was to develop and evaluate an AI-automation platform that performs transparent, traceable, and human-verifiable scientific research. METHODS: To mimic human scientific practices, we built "data-to-paper," an automation platform that guides interacting large language model (LLM) agents through a complete stepwise research process that starts with annotated data and results in comprehensive research papers, while programmatically backtracing information flow and allowing human oversight and interactions. The platform can run fully autonomously (in autopilot mode) or with human intervention (in copilot mode). RESULTS: In autopilot mode, provided only with annotated data, data-to-paper raised hypotheses; designed research plans; wrote and debugged analysis codes; generated and interpreted results; and created complete, information-traceable research papers. Even though the research novelty of manuscripts created by data-to-paper was relatively limited, the process demonstrated the autonomous generation of de novo quantitative insights from data, such as unraveling associations between health indicators and clinical outcomes. For simple research goals and datasets, a fully autonomous cycle can create manuscripts that independently recapitulate the findings of peer-reviewed biomedical publications without major errors in about 80 to 90% of cases. Yet, as goal or data complexity increases, human copiloting becomes critical for ensuring accuracy and overall quality. By tracking information flow through the steps, the platform creates "data-chained" manuscripts, in which downstream results are programmatically linked to upstream code and data, thus setting a new standard for the verifiability of scientific outputs. CONCLUSIONS: Our work demonstrates the potential for AI-driven acceleration of scientific discovery in data-driven biomedical research and beyond, while enhancing, rather than jeopardizing, traceability, transparency, and verifiability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A Survey on Large Language Model based Autonomous Agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.11432 · Cited by 1,925
Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.01852 · Cited by 1,172
SPECTER: Document-level Representation Learning using Citation-informed Transformers
Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.207 · Cited by 1,108
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050
Competition-level code generation with AlphaCode
Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Dal Lago, A., et al. (2022) · Science · doi:10.1126/science.abq1158 · Cited by 1,043
Competition-Level Code Generation with AlphaCode
Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Lago, A. D., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.07814 · Cited by 1,043
The Rise and Potential of Large Language Model Based Agents: A Survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07864 · Cited by 972
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970
ChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868
Summary of ChatGPT-Related research and perspective towards the future of large language models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100017 · Cited by 855
Research works printed but not linked: 14
- Tu T Palepu A Schaekermann M et al. Towards conversational diagnostic AI. January 11 2024 (http://arXiv.org/abs/2401.05654). Preprint. · arXiv
- 10.1056/AIoa2400196 · doi:10.1056/aioa2400196 · Paper page
- Wilson EB. An introduction to scientific research. McGraw-Hill Book Company, 1952.
- Ji Z Lee N Frieske R et al. Survey of hallucination in natural language generation. February 8 2022 (http://arXiv.org/abs/2202.03629). Preprint. · arXiv
- Touvron H Martin L Stone K et al. Llama 2: open foundation and fine-tuned chat models. July 18 2023 (http://arXiv.org/abs/2307.09288). Preprint. · arXiv
- Rozière B Gehring J Gloeckle F et al. Code Llama: open foundation models for code. August 24 2023 (http://arXiv.org/abs/2308.12950). Preprint. · arXiv
- Wu Q Bansal G Zhang J et al. AutoGen: enabling next-gen LLM applications via multi-agent conversation. August 16 2023 (http://arXiv.org/abs/2308.08155). Preprint. · arXiv
- Hong S Zhuge M Chen J et al. MetaGPT: meta programming for a multi-agent collaborative framework. August 1 2023 (http://arXiv.org/abs/2308.00352). Preprint. · arXiv
- Madaan A Tandon N Gupta P et al. Self-refine: iterative refinement with self-feedback. March 30 2023 (http://arXiv.org/abs/2303.17651). Preprint. · arXiv
- Rolle-Lake L, Robbins E. Behavioral risk factor surveillance system. In: StatPearls. Treasure Island, FL: StatPearls Publishing, 2023 (https://www.ncbi.nlm.nih.gov/pubmed/31971707).
- Majumder BP Surana H Agarwal D et al. Data-driven discovery with large generative models. February 21 2024 (http://arXiv.org/abs/2402.13610). Preprint. · arXiv
- Abdel-Rehim A Zenil H Orhobor O et al. Scientific hypothesis generation by a large language model: laboratory validation in breast cancer treatment. May 20 2024 (http://arXiv.org/abs/2405.12258). Preprint. · arXiv
- Wang Q Downey D Ji H Hope T. SciMON: scientific inspiration machines optimized for novelty. May 23 2023 (http://arXiv.org/abs/2305.14259). Preprint. · arXiv
- Lu C Lu C Lange RT Foerster J Clune J Ha D. The AI scientist: towards fully automated open-ended scientific discovery. August 12 2024 (http://arXiv.org/abs/2408.06292). Preprint. · arXiv
Cited by
Artificial Intelligence for Materials Discovery, Development, and Optimization
Madika, B., Saha, A., Kang, C., Buyantogtokh, B., Agar, J., Wolverton, C. M., Voorhees, P., Littlewood, P., Kalinin, S., & Hong, S. (2025) · ACS Nano · doi:10.1021/acsnano.5c04200 · Cited by 171
Towards end-to-end automation of AI research
Lu, C., Lu, C., Lange, R. T., Yamada, Y., Hu, S., Foerster, J., Ha, D., & Clune, J. (2026) · Nature · doi:10.1038/s41586-026-10265-5 · Cited by 116
A multi-agent system for automating scientific discovery
Ghareeb, A. E., Chang, B., Mitchener, L., Angela, Y., Szostkiewicz, C. J., Shved, D., Gyimesi, G. J., Laurent, J. M., Wright, S. M., Razzak, M. T., et al. (2026) · Nature · doi:10.1038/s41586-026-10652-y · Cited by 454
How can artificial intelligence transform the training of medical students and physicians?
Ning, Y., Ong, J. C. L., Cheng, H., Wang, H., Ting, D. S. W., Tham, Y. C., Wong, T. Y., & Liu, N. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100900 · Cited by 77
Responsible AI in biotechnology: balancing discovery, innovation and biosecurity risks
Wheeler, N. E. (2025) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2025.1537471 · Cited by 71
Large language models for clinical decision support in gastroenterology and hepatology
Wiest, I. C., Bhat, M., Clusmann, J., Schneider, C. V., Jiang, X., & Kather, J. N. (2025) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/s41575-025-01108-1 · Cited by 50
Leng, Y., Zhong, Y., Gu, Z., Li, P., Cui, H., Li, X., Liu, Y., & Wan, J. (2025) · ACS Materials Letters · doi:10.1021/acsmaterialslett.4c02674 · Cited by 31
ORFS-agent: Tool-Using Agents for Chip Design Optimization
Ghose, A., Kahng, A. B., Kundu, S., & Wang, Z. (2025) · ACM/IEEE Workshop on Machine Learning for CAD (MLCAD) · doi:10.1109/mlcad65511.2025.11189204 · Cited by 35
Gen AI and research integrity: Where to now?
Vasconcelos, S. M. R., & Marušić, A. (2025) · EMBO Reports · doi:10.1038/s44319-025-00424-6 · Cited by 15
Why can’t epidemiology be automated (yet)?
Bann, D., Lowther, E., Wright, L., & Kovalchuk, Y. (2025) · International Journal of Epidemiology · doi:10.1093/ije/dyaf210 · Cited by 9
Autonomous Self‐Evolving Research on Biomedical Data: The DREAM Paradigm
Deng, L., Wu, Y., Ren, Y., & Lu, H. J. (2025) · Advanced Science · doi:10.1002/advs.202417066 · Cited by 13
Toward autonomous discovery: agentic AI and the future of ophthalmic research
Soetikno, B. T., Nielsen, C. S., Pollreisz, A., & Ting, D. S. W. (2025) · Current Opinion in Ophthalmology · doi:10.1097/icu.0000000000001179 · Cited by 5
Yang, J. J., & Hwang, S. (2025) · Blood Research · doi:10.1007/s44313-025-00062-w · Cited by 11
Oyelade, O. N., Wang, H., & Rafferty, K. J. (2025) · ACM Computing Surveys · doi:10.1145/3774628 · Cited by 10
Yang, R., Tong, J., Wang, H., Huang, H. F., Hu, Z., Li, P., Liu, N., Lindsell, C. J., Pencina, M. J., Chen, Y., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf137 · Cited by 9
AI4Research: a survey of artificial intelligence for scientific research
Chen, Q., Yang, M., Qin, L., Liu, J., Yan, Z., Guan, J., Peng, D., Ji, Y., Li, H., Hu, M., et al. (2026) · Science China Information Sciences · doi:10.1007/s11432-025-5000-y · Cited by 4
Sebastian, J., Moon, J.-M., & Camburn, E. M. (2025) · AERA Open · doi:10.1177/23328584251389621 · Cited by 2
Challenges, Limitations, and Ethical Considerations of AI in Immunology and Healthcare
Rajchenberg, D., Hess, R., Lins, M. P., Manor, A., Degany, O., & Shoenfeld, Y. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-9725-1.ch014 · Cited by 5
The Promise and Perils of Autonomous AI in Science
Gao, J., & Harrison, E. M. (2024) · NEJM AI · doi:10.1056/aie2401073 · Cited by 4
LLM-based design process for manual assembly
Jonek, M., Gerlach, A., & Manns, M. (2025) · Procedia CIRP · doi:10.1016/j.procir.2025.08.175 · Cited by 2
Sun, Y., Chen, Z., Cai, H., & Lü, X. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106171 · Cited by 2
Towards an AI biomedical scientist: Accelerating discoveries in neurodegenerative disease
Roberts, K. F., Landsness, E. C., Reese, J., Elbert, D., Strobel, G., Wu, E., Chen, Y., Lai, A., Abrams, Z. B., Zhu, M., et al. (2026) · The Journal of Prevention of Alzheimer's Disease · doi:10.1016/j.tjpad.2025.100398 · Cited by 1
Novák, A., Oblaković, G., Njavro, M., & Ehler, M. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12062-7 · Cited by 1
Application of large language models in medical diagnosis: A bibliometric review
Zhang, Q., Wang, H., Li, H., Jiao, F., Zhou, H., & Li, M. (2026) · Digital Health · doi:10.1177/20552076261462624 · Cited by 2
Wu, Y.-L., Fu, D. J., Zhou, Y., Wagner, S. K., & Keane, P. A. (2026) · Journal of Medical Internet Research · doi:10.2196/99597 · Cited by 2
A review of trends and patterns in transportation journals from 2000 to 2024
Wandelt, S., Zheng, C., & Sun, X. (2025) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2025.101406 · Cited by 6
AI Tools and Technologies for Academic Research
Szendi, A., Kuttor, D., & Pál, Z. (2025) · Springer eBooks · doi:10.1007/978-3-031-94809-1_3 · Cited by 1
Towards Autonomous Geospatial Scientific Inquiry: A Multi-Agent AI Co-Scientist FrameworkPreprint
Akinboyewa, T., & Li, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6753098 · Cited by 1
Shi, X., Tian, Z., Tan, S., & Wang, X. (2026) · medRxiv · doi:10.64898/2026.04.02.26350091
Memp: Exploring Agent Procedural Memory
Fang, R., Liang, Y., Wang, X., Wu, J., Qiao, S., Xie, P., Huang, F., Chen, H., & Zhang, N. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.866 · Cited by 174
Closing the Empirical Loop: Autonomous AI Agents Conduct End‐to‐end Research With Human Participants
Wehr, G., Rideaux, R., Fox, A. J., Lightfoot, D. R., Tangen, J. M., Mattingley, J. B., & Ehrhardt, S. E. (2026) · Advanced Science · doi:10.1002/advs.76675
范琳煊, Li, P. H., Wang, Q., Zhang, J., Wang, S., Liu, Y., & Wan, J. (2026) · Progress in Natural Science Materials International · doi:10.1016/j.pnsc.2026.04.008
Synthesis‐GPT: An Intelligent Assistant for Solid‐State Electrolyte Synthesis
Li, B. R., Li, P. H., Zhong, Y., Yan, Z., Yu, Z., Ning, Z., Ouyang, C., Chen, X., Jin, H., Yang, L., et al. (2026) · Small Structures · doi:10.1002/sstr.70448 · Cited by 1
Bellucci, G., Gu, W., Rose, P. W., & Baranzini, S. E. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1883853 · Cited by 1
An agentic AI environment to support biomedical research in collaborative academic environmentsPreprint
Wu, T., Browne, T. S., Meawad, M., Emam, H. E., Simsam, N. H., Xia, Y., Jaafar, A., Ma, A., Kabbani, B., Gupta, V., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.24.753565
Model and tools for content generation and publication based on large language models
Kazarian, A., Teslyuk, V., & Pukach, A. I. (2026) · Informatyka Automatyka Pomiary w Gospodarce i Ochronie Środowiska · doi:10.35784/iapgos.8512
An Expert-Curated Benchmark for Frontier and Local LLMs Querying a Biomedical Knowledge GraphPreprint
Medagbe, J. F. P., Kilyungi, M., Isaac, A., Kabua, A., Lisso, F., Wambua, S., Williams, R. L., & Prins, P. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.04.756532
Structured Scaling of AI Discovery Across Diverse Scientific Domains
Ye, H., Lin, H., Tang, J., Luo, Y., Thapa, R., Yang, C., Su, C., Yang, R., Liu, R., Li, R., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.19341
Metadata
- Authors
- Ifargan, T., Hafner, L., Kern, M., Alcalay, O., & Kishony, R.
- Affiliations
- Technion – Israel Institute of Technology (IL)
- Epsio, Tel Aviv, Israel
- Venue
- NEJM AI
- Publisher
- Massachusetts Medical Society
- Published
- 2025-01-01
- Volume
- 2
- Issue
- 1
- Pages
- AIoa2400555-AIoa2400555
- ISSN
- 2836-9386 (ISSN-L)
- OpenAlex
- W4404941741
- Cited by
- 34
- References
- 26
- Citations by year
- 2026: 13 · 2025: 20
- FWCI
- 50.38
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- NEJM AI (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- large language models, autonomous research, human verification, data-driven research, AI-assisted scientific writing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.