AI and biosecurity: The need for governance
Open accessAbstract
Governments should evaluate advanced models and if needed impose safety measures
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AI systems that design proteins, antibodies, and other therapeutic biomolecules could be used to develop harmful products, such as bioweapons or environmentally disruptive species.
“For example, AI systems that design proteins, antibodies, and other therapeutic biomolecules could be used to develop harmful products, such as bioweapons or environmentally disruptive species [106–108].”
From Autonomous artificial intelligence, scientific research, and human values (2026) · cites this paper as [106]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050 · see citing works
Generalized biomolecular modeling and design with RoseTTAFold All-Atom
Krishna, R., Wang, J., Ahern, W., Sturmfels, P., Venkatesh, P., Kalvet, I., Lee, G. R., Morey-Burrows, F. S., Anishchenko, I., Humphreys, I. R., et al. (2024) · Science · doi:10.1126/science.adl2528 · Cited by 978 · see citing works
Sequence modeling and design from molecular to genome scale with Evo
Nguyen, E., Poli, M., Durrant, M. G., Thomas, A. W., Kang, B., Sullivan, J., Ng, M. Y., Lewis, A., Patel, A., Lou, A., et al. (2024) · doi:10.1101/2024.02.27.582234 · Cited by 592 · see citing works
Self-citationSequence modeling and design from molecular to genome scale with Evo
Nguyen, E., Poli, M., Durrant, M. G., Kang, B., Katrekar, D., Li, D. B., Bartie, L. J., Thomas, A. W., King, S. H., Brixi, G., et al. (2024) · Science · doi:10.1126/science.ado9336 · Cited by 580 · see citing works
Self-citationSelf-driving laboratories to autonomously navigate the protein fitness landscape
Rapp, J. T., Bremer, B. J., & Romero, P. A. (2024) · Nature Chemical Engineering · doi:10.1038/s44286-023-00002-4 · Cited by 219 · see citing works
Learning from prepandemic data to forecast viral escape
Thadani, N. N., Gurev, S. F., Notin, P., Youssef, N., Rollins, N. J., Ritter, D., Sander, C., Gal, Y., & Marks, D. S. (2023) · Nature · doi:10.1038/s41586-023-06617-0 · Cited by 212 · see citing works
The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4Preprint
AI4Science, M., & Quantum, M. (2023) · arXiv.org · doi:10.48550/arxiv.2311.07361 · Cited by 199 · see citing works
Ni, B., Kaplan, D. L., & Buehler, M. J. (2023) · Chem · doi:10.1016/j.chempr.2023.03.020 · Cited by 87 · see citing works
Emergent autonomous scientific research capabilities of large language models
Boiko, D. A., MacKnight, R., & Gomes, G. (2023) · arXiv · doi:10.48550/arxiv.2304.05332 · Cited by 72 · see citing works
Protein design meets biosecurity
Baker, D. A., & Church, G. M. (2024) · Science · doi:10.1126/science.ado1671 · Cited by 56 · see citing works
Variational autoencoder for design of synthetic viral vector serotypes
Lyu, S., Sowlati‐Hashjin, S., & Garton, M. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-023-00787-2 · Cited by 23 · see citing works
Insidious Insights: Implications of viral vector engineering for pathogen enhancement
Sandbrink, J. B., Alley, E. C., Watson, M. C., Koblentz, G. D., & Esvelt, K. M. (2022) · Gene Therapy · doi:10.1038/s41434-021-00312-3 · Cited by 19 · see citing works
Pannu, J., Bloomfield, D., Zhu, A., MacKnight, R., Gomes, G., Cicero, A. J., & Inglesby, T. V. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4873106 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- [6]Lyu S, Sowlati-Hashjin S, Garton M, Nat. Mach. Intell 6, 147 (2024).
- [15]National Academies of Sciences, Engineering, and Medicine; Division on Earth and Life Studies; Board on Chemical Sciences and Technology; Board on Life Sciences; Committee on Strategies for Identifying and Addressing Potential Biodefense Vulnerabilities Posed by Synthetic Biology, Biodefense in the Age of Synthetic Biology (National Academies Press, 2018).
Cited by
Sorted by citations
Autonomous artificial intelligence, scientific research, and human values
Resnik, D. B., Hosseini, M., & Hauswald, R. (2026) · AI and Ethics · doi:10.1007/s43681-025-00908-0 · Cited by 15 · see citing works
- Authors
- Bloomfield, D., Pannu, J., Zhu, A. W., Ng, M. Y., Lewis, A., Bendavid, E., Asch, S. M., Hernandez-Boussard, T., Cicero, A., & Inglesby, T.
- Affiliations
- Johns Hopkins University (US)
- Stanford Medicine (US)
- Department of Medicine (Biomedical Informatics), Stanford School of Medicine, Stanford University, Stanford, CA, USA.
- Venue
- Science
- Published
- 2024-08-23
- Volume
- 385
- Issue
- 6711
- Pages
- 831-833
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC12158449
- OpenAlex
- W4401752277
- Cited by
- 50
- References
- 13
- Citations by year
- 2026: 28 · 2025: 21 · 2024: 1
- FWCI
- 20.72
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Open Philanthropy Project
- National Institutes of Health (UL1TR003142, UM1TR004921)
- National Center for Advancing Translational Sciences
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Law, AI, and Intellectual Property
- Social Sciences › Sociology and Political Science › Global Security and Public Health
- Keywords
- artificial intelligence, biosecurity, AI governance, safety regulations, government oversight
- MeSH terms
- Biosecurity, Administrative Personnel, Artificial Intelligence, Government, Humans, Models, Biological, Security Measures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
