PreprintCited by 54Scientific Computing and Data ManagementArtificial Intelligence ApplicationsBiomedical Text Mining and Ontologies

From Intention To Implementation: Automating Biomedical Research via LLMs

Open access
Luo, Yi, Shi, Linghang, Li, Yihao, Zhuang, Aobo, Gong, Yeyun, Liu, Ling, Lin, Chen·2024·arXiv

Preprint — published as 10.1007/s11432-024-4485-0

Abstract

Conventional biomedical research is increasingly labor-intensive due to the exponential growth of scientific literature and datasets. Artificial intelligence (AI), particularly Large Language Models (LLMs), has the potential to revolutionize this process by automating various steps. Still, significant challenges remain, including the need for multidisciplinary expertise, logicality of experimental design, and performance measurements. This paper introduces BioResearcher, the first end-to-end automated system designed to streamline the entire biomedical research process involving dry lab experiments. BioResearcher employs a modular multi-agent architecture, integrating specialized agents for search, literature processing, experimental design, and programming. By decomposing complex tasks into logically related sub-tasks and utilizing a hierarchical learning approach, BioResearcher effectively addresses the challenges of multidisciplinary requirements and logical complexity. Furthermore, BioResearcher incorporates an LLM-based reviewer for in-process quality control and introduces novel evaluation metrics to assess the quality and automation of experimental protocols. BioResearcher successfully achieves an average execution success rate of 63.07% across eight previously unmet research objectives. The generated protocols, on average, outperform typical agent systems by 22.0% on five quality metrics. The system demonstrates significant potential to reduce researchers' workloads and accelerate biomedical discoveries, paving the way for future innovations in automated research systems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2412.09429

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Narrow systems for research planning, molecular prediction, and chemical synthesis could combine into a workflow capable of designing dangerous new chemical compounds.

    “For example, narrow systems for research planning, predicting the properties of molecules, and synthesising new chemicals could, when combined, lead to a complex 'test and iterate' automated workflow capable of designing dangerous new chemical compounds far beyond the scope of the initial systems' capabilities (Boiko et al., 2023; Luo et al., 2024; Urbina et al., 2022).”

    From Multi-Agent Risks from Advanced AI (2025) · cites this paper as Luo et al., 2024

    Section 3.1 describes a system that combines research planning with literature processing and executable code for dry-lab biomedical experiments. The paper does not establish the proposed combination with molecular prediction and chemical synthesis, or the resulting ability to design dangerous compounds. Its Future Works section says wet-lab integration remains a possibility for future research; page numbers were not available in our copy. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 64 references couldn’t be matched to a known paper.

Research works printed but not linked: 9

  1. National Research Council (US) Committee for Monitoring the Nation's Changing Needs for Biomedical, Behavioral, and Clinical Personnel. Advancing the Nation's Health Needs: NIH Research Training Programs. Washington (DC): National Academies Press (US), 2005.
  2. Wang X, Li J, Wu X, et al. Huatuo-26M, a Large-scale Chinese Medical QA Dataset. In: Chiruzzo L, Ritter A, Wang L, eds. Findings of the Association for Computational Linguistics: Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics, Albuquerque, New Mexico, USA, 2025. 3828-3848.
  3. Bolton E, Venigalla A, Yasunaga M, et al. Biomedlm: A 2.7 b parameter language model trained on biomedical text. arXiv Preprint, 2024, arXiv:2403.18421. · arXiv
  4. Hu E J, Shen Y, Wallis P, et al. Lora: Low-rank adaptation of large language models. In: The Tenth International Conference on Learning Representations, Virtual Event, 2022, 1: 3.
  5. Fan Z H, Wei L, Tang J L, et al. AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator. In: Rambow O, Wanner L, Apidianaki M, Al-Khalifa H, Eugenio B D, Schockaert S, eds. Proceedings of the 31st International Conference on Computational Linguistics, Abu Dhabi, UAE, 2025, 10183-10213.
  6. LI G. Ai4r: The fifth scientific research paradigm. Bulletin of Chinese Academy of Sciences, 2024, 39: 1-9.
  7. Huang K, Qu Y, Cousins H, et al. Crispr-gpt: An llm agent for automated design of gene-editing experiments. arXiv Preprint, 2024, arXiv:2404.18021. · arXiv
  8. Arnold C. Cloud labs: where robots do the research. Nature, 2022, 606: 612-613.
  9. Wu Q Y, Bansal G, Zhang J Y, et al. Autogen: Enabling next-gen LLM applications via multi-agent conversation framework. arXiv preprint, 2023, abs/2308.08155. · arXiv

Cited by

Sorted by citations

Authors
Luo, Y., Shi, L., Li, Y., Zhuang, A., Gong, Y., Liu, L., & Lin, C.
Affiliations
  • Xiamen University (CN)
  • Microsoft Research Asia (China) (CN)
  • Georgia Institute of Technology (US)
Corresponding author
Gong, Yeyun
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
68
Issue
7
ISSN
1869-1919 (ISSN-L)
OpenAlex
W4405355275
Cited by
53
References
64
Citations by year
2026: 45 · 2025: 8
FWCI
53.24
Type
journal article
Language
en
Open access
Locations
  • Science China Information Sciences (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Natural Science Foundation of China (62432011)
Topics
  • Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
Keywords
large language models, multi-agent systems, experimental design, literature searching, hierarchical learning, research automation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review