PreprintCited by 35CRISPR and Genetic EngineeringGenomics and Phylogenetic StudiesRNA and protein synthesis mechanisms

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Semantic mining of functional de novo genes from a genomic language model

Open access
Merchant, Aditi T., King, Samuel H., Nguyen, Eric, Hie, Brian L.·2024·Nature

Preprint — published as 10.1038/s41586-025-09749-7

Abstract

Generative genomics models can design increasingly complex biological systems. However, effectively controlling these models to generate novel sequences with desired functions remains a major challenge. Here, we show that Evo, a 7-billion parameter genomic language model, can perform function-guided design that generalizes beyond natural sequences. By learning semantic relationships across multiple genes, Evo enables a genomic “autocomplete” in which a DNA prompt encoding a desired function instructs the model to generate novel DNA sequences that can be mined for similar functions. We term this process “semantic mining,” which, unlike traditional genome mining, can access a sequence landscape unconstrained by discovered evolutionary innovation. We validate this approach by experimentally testing the activity of generated anti-CRISPR proteins and toxin-antitoxin systems, including de novo genes with no significant homology to any natural protein. Strikingly, in-context protein design with Evo achieves potent activity and high experimental success rates even in the absence of structural hypotheses, known evolutionary conservation, or task-specific fine-tuning. We then use Evo to autocomplete millions of prompts to produce SynGenome, a first-of-its-kind database containing over 120 billion base pairs of AI-generated genomic sequences that enables semantic mining across many possible functions. The semantic mining paradigm enables functional exploration that ventures beyond the observed evolutionary universe.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2024.12.17.628962

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 98

  1. 10.1038/s41586-024-07487-w · DOI · Paper page
  2. 10.1126/science.adi1910 · DOI
  3. 10.1101/gr.10.8.1074 · DOI
  4. 10.1038/75556 · DOI · Paper page
  5. 10.1371/journal.pone.0161879 · DOI · Paper page
  6. 10.1038/s41467-024-46489-0 · DOI
  7. 10.1093/nar/gkab335 · DOI
  8. 10.1093/nar/gkae1082 · DOI
  9. 10.1038/nn1525 · DOI
  10. 10.1093/bioinformatics/btac020 · DOI · Paper page
  11. 10.1038/s41467-022-28865-w · DOI · Paper page
  12. 10.1186/1471-2105-10-421 · DOI · Paper page
  13. 10.1038/s41586-023-06612-5 · DOI
  14. 10.1093/femsre/fuad052 · DOI
  15. 10.1038/s41467-024-49215-y · DOI
  16. 10.1007/s00239-010-9352-0 · DOI
  17. 10.1128/jb.127.3.1550-1557.1976 · DOI
  18. 10.3389/fpls.2023.1164461 · DOI
  19. 10.1093/nar/gkv1276 · DOI
  20. 10.1093/bioinformatics/btp163 · DOI · Paper page
  21. 10.1186/s13742-015-0080-7 · DOI
  22. 10.1093/nar/gkae1010 · DOI · Paper page
  23. 10.1128/jb.173.11.3500-3506.1991 · DOI
  24. 10.1146/annurev-biochem-011420-111224 · DOI
  25. 10.1093/database/baac010 · DOI
  26. 10.1126/science.aar4120 · DOI
  27. 10.1038/s41586-024-07552-4 · DOI · Paper page
  28. 10.1093/nar/gkaa219 · DOI
  29. R. Esfandiarpoor and S. H. Bach . Follow-up differential descriptions: Language models resolve ambiguities for image classification, 2024. URL http://arxiv.org/abs/2311.07593. · arXiv
  30. 10.1111/j.1467-968X.1957.tb00568.x · DOI
  31. 10.7554/eLife.46540 · DOI
  32. 10.1128/jb.00763-19 · DOI
  33. 10.1002/cpbi.108 · DOI · Paper page
  34. 10.1038/76443 · DOI
  35. 10.1126/science.aba0372 · DOI
  36. 10.1038/srep43358 · DOI
  37. 10.1093/nar/gkad962 · DOI
  38. 10.1080/00437956.1954.11659520 · DOI · Paper page
  39. T. Hayes , R. Rao , H. Akin , N. J. Sofroniew , D. Oktay , Z. Lin , R. Verkuil , V. Q. Tran , J. Deaton , M. Wiggert , R. Badkundri , I. Shafkat , J. Gong , A. Derry , R. S. Molina , N. Thomas , Y. Khan , C. Mishra , C. Kim , L. J. Bartie , M. Nemeth , P. D. Hsu , T. Sercu , S. Candido , and A. Rives . Simulating 500 million years of evolution with a language model, 2024. URL https://www.biorxiv.org/content/10.1101/2024.07.01.600583v1. Pages: 2024.07.01.600583 Section: New Results. · DOI
  40. 10.1038/s41587-023-01763-2 · DOI
  41. 10.1093/nar/gkaa857 · DOI
  42. 10.1038/nature19946 · DOI · Paper page
  43. 10.1186/1471-2105-11-119 · DOI
  44. 10.1016/S0022-2836(61)80072-7 · DOI · Paper page
  45. 10.1126/science.adr6006 · DOI
  46. J. Kaplan , S. McCandlish , T. Henighan , T. B. Brown , B. Chess , R. Child , S. Gray , A. Radford , J. Wu , and D. Amodei . Scaling laws for neural language models, 2020. URL http://arxiv.org/abs/2001.08361. · arXiv
  47. 2002, MAFFT: a novel method for rapid multiple sequence alignment based on fast fourier transform, 30, 3059
  48. 10.1016/j.molcel.2018.05.025 · DOI
  49. 10.1016/j.cell.2023.12.028 · DOI
  50. 10.1016/j.cels.2024.04.008 · DOI
  51. 10.1038/nbt.1603 · DOI
  52. 10.1126/science.ade2574 · DOI · Paper page
  53. 10.1038/s41587-022-01618-2 · DOI · Paper page
  54. 10.1128/jb.05535-11 · DOI
  55. 2023, Laughing hyena distillery: Extracting compact recurrences from convolutions, 36, 17072
  56. 10.1128/jb.177.17.4851-4856.1995 · DOI
  57. O. Mañas , P. Astolfi , M. Hall , C. Ross , J. Urbanek , A. Williams , A. Agrawal , A. Romero-Soriano , and M. Drozdzal . Improving text-to-image consistency via automatic prompt optimization, 2024. URL http://arxiv.org/abs/2403.17804. · arXiv
  58. 10.1093/nar/gkr466 · DOI
  59. 10.1016/j.mib.2008.02.005 · DOI
  60. 10.1093/nar/gkaa913 · DOI · Paper page
  61. 10.1089/cmb.2006.13.1028 · DOI
  62. 10.1016/j.tim.2024.05.005 · DOI
  63. 10.1073/pnas.1936192100 · DOI
  64. 10.1126/science.ado9336 · DOI · Paper page
  65. L. Ouyang , J. Wu , X. Jiang , D. Almeida , C. L. Wainwright , P. Mishkin , C. Zhang , S. Agarwal , K. Slama , A. Ray , J. Schulman , J. Hilton , F. Kelton , L. Miller , M. Simens , A. Askell , P. Welinder , P. Christiano , J. Leike , and R. Lowe . Training language models to follow instructions with human feedback, 2022. URL http://arxiv.org/abs/2203.02155. · arXiv
  66. 10.1073/pnas.96.6.2896 · DOI
  67. M. Pacesa , L. Nickel , J. Schmidt , E. Pyatova , C. Schellhaas , L. Kissling , A. Alcaraz-Serna , Y. Cho , K. H. Ghamary , L. Vinué , B. J. Yachnin , A. M. Wollacott , S. Buckley , S. Georgeon , C. A. Goverde , G. N. Hatzopoulos , P. Gönczy , Y. D. Muller , G. Schwank , S. Ovchinnikov , and B. E. Correia . BindCraft: one-shot design of functional protein binders, 2024. URL https://www.biorxiv.org/content/10.1101/2024.09.30.615802v1. Pages: 2024.09.30.615802 Section: New Results. · DOI
  68. 10.1038/nrmicro.2017.120 · DOI
  69. 10.1093/nar/gkae997 · DOI
  70. 10.1038/ncomms6890 · DOI · Paper page
  71. 10.1002/pro.3943 · DOI
  72. 10.1093/nar/gkab906 · DOI
  73. N. Praljak , H. Yeh , M. Moore , M. Socolich , R. Ranganathan , and A. L. Ferguson . Natural language prompts guide the design of novel functional protein sequences, 2024. URL https://www.biorxiv.org/content/10.1101/2024.11.11.622734v1. Pages: 2024.11.11.622734 Section: New Results. · DOI
  74. 10.1016/j.micres.2022.127159 · DOI
  75. R. Rafailov , A. Sharma , E. Mitchell , S. Ermon , C. D. Manning , and C. Finn . Direct preference optimization: Your language model is secretly a reward model, 2024. URL http://arxiv.org/abs/2305.18290. · arXiv
  76. 10.1016/j.cobme.2024.100553 · DOI
  77. 2002, Congruent evolution of different classes of non-coding DNA in prokaryotic genomes, 30, 4264
  78. 10.1093/protein/12.2.85 · DOI · Paper page
  79. 10.3390/microorganisms10081660 · DOI
  80. 2022, Database resources of the national center for biotechnology information, 50, D20
  81. 10.1126/sciadv.1701620 · DOI
  82. 10.1016/j.molcel.2015.10.008 · DOI · Paper page
  83. 10.1016/j.cell.2019.07.046 · DOI
  84. 10.1038/nbt.3988 · DOI · Paper page
  85. 10.1093/nar/gki408 · DOI
  86. F. Tesson , E. Huiting , L. Wei , J. Ren , M. Johnson , R. Planel , J. Cury , Y. Feng , J. Bondy-Denomy , and A. Bernheim . Exploring the diversity of anti-defense systems across prokaryotes, phages, and mobile genetic elements, 2024. URL https://www.biorxiv.org/content/10.1101/2024.08.21.608784v1. Pages: 2024.08.21.608784 Section: New Results. · DOI · Paper page
  87. 10.1093/genetics/iyad031 · DOI
  88. 10.1038/s41586-024-07642-3 · DOI
  89. 10.1093/bioinformatics/18.5.679 · DOI
  90. 10.1038/s41587-023-01773-0 · DOI · Paper page
  91. R. Verkuil , O. Kabeli , Y. Du , B. I. M. Wicky , L. F. Milles , J. Dauparas , D. Baker , S. Ovchinnikov , T. Sercu , and A. Rives . Language models generalize beyond natural proteins, 2022. URL https://www.biorxiv.org/content/10.1101/2022.12.21.521521v1. Pages: 2022.12.21.521521 Section: New Results. · DOI · Paper page
  92. 10.1038/s41592-019-0686-2 · DOI · Paper page
  93. 10.1093/nar/gkaa432 · DOI
  94. 10.1038/s41586-023-06415-8 · DOI · Paper page
  95. J. Wei , X. Wang , D. Schuurmans , M. Bosma , B. Ichter , F. Xia , E. Chi , Q. Le , and D. Zhou . Chain-of-thought prompting elicits reasoning in large language models, 2023. URL http://arxiv.org/abs/2201.11903. · arXiv
  96. 10.1186/s13059-017-1382-0 · DOI · Paper page
  97. 10.1093/nar/gki524 · DOI · Paper page
  98. 10.1016/j.jmb.2017.12.007 · DOI · Paper page

Metadata

Authors
Merchant, A. T., King, S. H., Nguyen, E., & Hie, B. L.
Affiliations
Arc Research Institute (US)
Corresponding author
Hie, Brian L.
Venue
Nature
Publisher
openRxiv
Published
2024-12-18
Volume
649
Issue
8097
Pages
749-758
ISSN
0028-0836 (ISSN-L)
OpenAlex
W4416386075
Cited by
35
References
1
Citations by year
2026: 30 · 2025: 5
FWCI
10.52
Type
journal article
Language
en
Open access
Locations
  • Nature (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › CRISPR and Genetic Engineering
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA and protein synthesis mechanisms
Keywords
genomic language models, semantic design, anti-CRISPR proteins, toxin-antitoxin systems, prokaryotic genes
MeSH terms
Artificial Intelligence, Models, Genetic, Semantics, Genomics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review