PreprintCited by 79RNA and protein synthesis mechanismsRNA Interference and Gene DeliveryRNA Research and Splicing

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Deep generative models generate mRNA sequences with enhanced translation capacity and stability

Open access

Preprint — published as 10.1126/science.adr8470

Abstract

Despite the tremendous success of messenger RNA (mRNA) COVID-19 vaccines, the extension of this modality to a broader spectrum of diseases necessitates substantial enhancements, particularly in the design of mRNAs with elevated expression levels and extended durability. Here we present GEMORNA, a deep generative model designed to generate novel mRNA coding sequences (CDSs) and untranslated regions (UTRs) with superior translation capacity, comparable to the sophisticated task of language translation and free-form poetry composition with accurate grammar and semantics. Our AI model was trained on an extensive collection of RNA sequences from diverse families, further enhanced with labeled data to refine its performance. Remarkably, we demonstrate that our AI-generated mRNAs exhibited 8.2-fold and 15.9-fold increases in firefly luciferase expression compared to benchmark mRNAs in two different cell types. Additionally, Our AI- designed COVID-19 mRNA vaccine elicited a 4-fold increase in anti-COVID antibody titer in mice relative to BNT162b2. Furthermore, GEMORNA’s versatility extends to circular mRNA design, which we facilitated a 27-fold increase in human erythropoietin protein expression in vivo than a systematically optimized benchmark sequence. We also created circular mRNAs with substantial improvements in expression levels, durability and anti-tumor cell cytotoxicity in mRNA-transduced CAR-T cells compared with an experimentally validated benchmark. In summary, GEMORNA generates novel mRNA sequences with significant performance improvements and has the potential to enable a wide range of therapeutic and vaccine applications.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2024.06.20.599727

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 26

  1. 2020, mRNA vaccine era – mechanisms, drug platform and clinical prospection, International Journal of Molecular Sciences, 21, 6582, 10.3390/ijms21186582 · DOI · Paper page
  2. 10.1038/nrd.2017.243 · DOI · Paper page
  3. ) Mihir Metkar , Christopher S Pepin , and Melissa J Moore . Tailor made: the art of therapeutic mRNA design. Nature Reviews Drug Discovery, pages 1–17, 2023. · DOI
  4. 10.1016/j.tibtech.2004.04.006 · DOI · Paper page
  5. 10.1093/nar/15.3.1281 · DOI · Paper page
  6. 10.1186/S13073-021-00835-9/FIGURES/4 · DOI
  7. 2020, Codon optimization with deep learning to enhance protein expression, Scientific Reports, 10, 17617, 10.1038/s41598-020-74091-z · DOI
  8. 2023, ICOR: improving codon optimization with recurrent neural networks, BMC Bioinformatics, 24, 132, 10.1186/s12859-023-05246-8 · DOI
  9. 10.1038/s41586-023-06127-z · DOI · Paper page
  10. 10.1038/s41467-022-31121-w · DOI
  11. 2020, Leveraging mRNA sequences and nanoparticles to deliver SARS-CoV-2 antigens in vivo, Advanced Materials, 32, 2004452, 10.1002/adma.202004452 · DOI · Paper page
  12. 10.1038/s41587-019-0164-5 · DOI · Paper page
  13. 2021, High-throughput 5’ UTR engineering for enhanced protein production in non-viral gene therapies, Nature Communications, 12, 4138, 10.1038/s41467-021-24436-7 · DOI · Paper page
  14. ) Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , Łukasz Kaiser , and Illia Polosukhin . Attention is all you need. Advances in Neural Information Processing Systems, 30, 2017.
  15. 10.1016/j.cell.2016.05.070 · DOI
  16. 2019, Phuc Vihn Nguyen Lam, Nobuko Hamasaki-Katagiri, Ekaterina Osipova, Vahan Simonyan, Haim Bar, Codon and codon-pair usage tables (cocoputs): facilitating genetic variation analyses and recombinant gene design. Journal of Molecular Biology, 431, 2434
  17. 10.1038/mt.2008.200 · DOI · Paper page
  18. ) Thomas E Mulroney , Tuija Poyry , Juan Carlos Yam-Puc , Maria Rust , Robert F Harvey , Lajos Kalmar , Emily Horner , Lucy Booth , Alexander P Ferreira , Mark Stoneley , et al. N1-methylpseudouridylation of mRNA causes +1 ribosomal frameshifting. Nature, pages 1–6, 2023. · DOI
  19. 10.7554/eLife.45396 · DOI · Paper page
  20. 2023, Engineering circular RNA for enhanced protein production, Nature Biotechnology, 41, 262, 10.1038/s41587-022-01393-0 · DOI
  21. David A Siegel , Olivier Le Tonqueze , Anne Biton , Noah Zaitlen , David J Erle . Massively parallel analysis of human 3′ UTRs reveals that AU-rich element length and registration predict mRNA destabilization. G3 Genes|Genomes|Genetics, 12(1), jkab404. · DOI
  22. 2629, Engineering circular RNA for potent and stable translation in eukaryotic cells, Nature Communications, 9, 2018
  23. 10.1016/J.MOLCEL.2021.07.042 · DOI
  24. 2021, Comparative analysis of assays to measure CAR T-cell-mediated cytotoxicity, Nature Protocols, 16, 1331, 10.1038/s41596-020-00467-0 · DOI · Paper page
  25. 2022, Informative RNA base embedding for RNA structural alignment and clustering by deep representation learning, NAR Genomics and Bioinformatics, 4, lqac012, 10.1093/nargab/lqac012 · DOI
  26. ) Yanyi Chu , Dan Yu , Yupeng Li , Kaixuan Huang , Yue Shen, Le Cong , Jason Zhang , and Mengdi Wang . A 5’ UTR Language Model for Decoding Untranslated Regions of mRNA and Function Predictions. BioRxiv, pages 2023–10, 2023.

Metadata

Authors
Zhang, H., Liu, H., Xu, Y., Liu, Y., Wang, J., Qin, Y., Wang, H., Ma, L., Xun, Z., Lu, T. K., & Cao, J.
Affiliations
  • Harvard University (US)
  • Massachusetts Institute of Technology (US)
Corresponding author
  • Lu, Timothy K.
  • Cao, Jicong
Venue
Science
Publisher
openRxiv
Published
2024-06-20
Volume
390
Issue
6773
Pages
eadr8470-eadr8470
ISSN
0036-8075 (ISSN-L)
OpenAlex
W4413786633
Cited by
79
References
1
Citations by year
2026: 69 · 2025: 8 · 2024: 2
FWCI
23.25
Type
journal article
Language
en
Open access
Licence
cc-by-nd
Locations
  • Science (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nd)
  • PubMed (publishedVersion)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA and protein synthesis mechanisms
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA Interference and Gene Delivery
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA Research and Splicing
Keywords
mRNA design, deep generative models, transformer models, mRNA vaccines, mRNA therapeutics, translational capacity, mRNA stability, untranslated regions, coding sequences, erythropoietin, circular RNA, chimeric antigen receptor T cells, tumor cytotoxicity
MeSH terms
Deep Learning, RNA, Circular, COVID-19, SARS-CoV-2, COVID-19 Vaccines, Animals, Antibodies, Viral, Erythropoietin, Female, Humans, Mice, Inbred BALB C, Mice, Inbred C57BL, RNA, Messenger, Protein Biosynthesis, Untranslated Regions, RNA Stability, Luciferases, Firefly, Mice

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review