Machine Learning for Designing Next-Generation mRNA Therapeutics
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
High Resolution Image Download MS PowerPoint Slide Conspectus Over just the last 2 years, mRNA therapeutics and vaccines have undergone a rapid transition from an intriguing concept to real-world impact. However, whereas some aspects of mRNA therapeutics, such as the use of chemical modifications to increase stability and reduce immunogenicity, have been extensively optimized for over two decades, other aspects, particularly the selection and design of the noncoding leader and trailer sequences which control translation efficiency and stability, have received comparably less attention. In practice, such 5′ and 3′ untranslated regions (UTRs) are often borrowed from highly expressed human genes with few or no modifications, as in the case for the Pfizer/BioNTech Covid vaccine. Focusing on the 5′UTR, we here argue that model-driven design is a promising alternative that provides unprecedented control over 5′UTR function. We review recent work that combines synthetic biology with machine learning to build quantitative models that relate ribosome loading, and thus translation efficiency, to the 5′UTR sequence. We first introduce an experimental approach that uses polysome profiling and high-throughput sequencing to quantify ribosome loading for hundreds of thousands of 5′UTRs in parallel. We apply this approach to measure ribosome loading in synthetic RNA libraries with a random sequence inserted into the 5′UTR. We then review Optimus 5-Prime, a convolutional neural network model trained on the experimental data. We highlight that very accurate models of biological regulation can be learned from synthetic data sets with degenerate 5′UTRs. We validate model predictions not only on held-out data sets from our random library but also on a large library of over 30 000 human 5′UTR fragments and using translation reporter data collected independently by other groups. Both the experiment and model are compatible with commonly used chemically modified nucleosides, in particular, pseudouridine (Ψ) and 1-methyl-pseudouridine (m 1 Ψ). We find that, in general, 5′UTRs have very similar impacts when combined with different protein-coding sequences and even in the context of different chemical modifications. We demonstrate that Optimus 5-Prime can be combined with design algorithms to generate de novo sequences with precisely defined translation efficiencies. We emphasize recent developments in design algorithms that rely on activation maximization and generative modeling to improve both the fitness and diversity of designed sequences. Compared with prior approaches such as genetic algorithms, we show that these approaches are not only faster but also less likely to get stuck in local sequence optima. Finally, we discuss how the approach reviewed here can be generalized to other gene regions and applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine
Polack, F. P., Thomas, S. J., Kitchin, N., Absalon, J., Gurtman, A., Lockhart, S., Perez, J. L., Pérez Marc, G., Moreira, E. D., Zerbini, C., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2034577 · Cited by 14,592
Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine
Baden, L. R., El Sahly, H. M., Essink, B., Kotloff, K., Frey, S., Novak, R., Diemert, D., Spector, S. A., Rouphael, N., Creech, C. B., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2035389 · Cited by 10,119
Kozak, M. (1986) · Cell · doi:10.1016/0092-8674(86)90762-2 · Cited by 4,741
mRNA vaccines — a new era in vaccinology
Pardi, N., Hogan, M. J., Porter, F. W., & Weissman, D. (2018) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2017.243 · Cited by 4,667
Lipid nanoparticles for mRNA delivery
Hou, X., Zaks, T., Langer, R., & Dong, Y. (2021) · Nature Reviews Materials · doi:10.1038/s41578-021-00358-0 · Cited by 4,076
Genome-Wide Analysis in Vivo of Translation with Nucleotide Resolution Using Ribosome Profiling
Ingolia, N. T., Ghaemmaghami, S., Newman, J. R. S., & Weissman, J. S. (2009) · Science · doi:10.1126/science.1168978 · Cited by 3,853
The mechanism of eukaryotic translation initiation and principles of its regulation
Jackson, R. J., Hellen, C. U. T., & Pestova, T. V. (2010) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm2838 · Cited by 2,759
ClinVar: public archive of interpretations of clinically relevant variants
Landrum, M. J., Lee, J. M., Benson, M., Brown, G., Chao, C., Chitipiralla, S., Gu, B., Hart, J., Hoffman, D., Hoover, J., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1222 · Cited by 2,758
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484
mRNA-based therapeutics--developing a new class of drugs
Sahin, U., Karikó, K., & Türeci, Ö. (2014) · Nature Reviews Drug Discovery · doi:10.1038/nrd4278 · Cited by 2,474
A census of human RNA-binding proteins
Gerstberger, S., Hafner, M., & Tuschl, T. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3813 · Cited by 2,032
Karikó, K., Muramatsu, H., Welsh, F. A., Ludwig, J., Kato, H., Akira, S., & Weissman, D. (2008) · Molecular Therapy · doi:10.1038/mt.2008.200 · Cited by 1,930
Automated design of synthetic ribosome binding sites to control protein expression
Salis, H. M., Mirsky, E. A., & Voigt, C. A. (2009) · Nature Biotechnology · doi:10.1038/nbt.1568 · Cited by 1,844
mRNA vaccines for infectious diseases: principles, delivery and clinical translation
Chaudhary, N., Weissman, D., & Whitehead, K. A. (2021) · Nature Reviews Drug Discovery · doi:10.1038/s41573-021-00283-5 · Cited by 1,555
Translational control by 5′-untranslated regions of eukaryotic mRNAs
Hinnebusch, A. G., Ivanov, I. P., & Sonenberg, N. (2016) · Science · doi:10.1126/science.aad9868 · Cited by 1,079
Functional 5′ UTR mRNA structures in eukaryotic translation regulation and how to find them
Leppek, K., Das, R., & Barna, M. (2018) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm.2017.103 · Cited by 949
Andries, O., Mc Cafferty, S., De Smedt, S. C., Weiss, R., Sanders, N. N., & Kitada, T. (2015) · Journal of Controlled Release · doi:10.1016/j.jconrel.2015.08.051 · Cited by 701
Cell-type-specific signatures of microRNAs on target mRNA expression
Sood, P., Krek, A., Zavolan, M., Macino, G., & Rajewsky, N. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0511045103 · Cited by 650
Human 5′ UTR design and variant effect prediction from a massively parallel translation assay
Sample, P. J., Wang, B., Reid, D. W., Presnyak, V., McFadyen, I. J., Morris, D. R., & Seelig, G. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0164-5 · Cited by 442
Self-citationThe challenge and prospect of mRNA therapeutics landscape
Weng, Y., Li, C., Yang, T., Hu, B., Zhang, M., Guo, S., Xiao, H., Liang, X.-J., & Huang, Y. (2020) · Biotechnology Advances · doi:10.1016/j.biotechadv.2020.107534 · Cited by 417
Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2021) · doi:10.1101/2021.03.29.437587 · Cited by 399
Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28776-w · Cited by 399
mRNA therapeutics in cancer immunotherapy
Beck, J. D., Reidenbach, D., Salomon, N., Sahin, U., Türeci, Ö., Vormehr, M., & Kranz, L. M. (2021) · Molecular Cancer · doi:10.1186/s12943-021-01348-0 · Cited by 385
Orlandini von Niessen, A. G., Poleganov, M. A., Rechner, C., Plaschke, A., Kranz, L. M., Fesser, S., Diken, M., Löwer, M., Vallazza, B., Beissert, T., et al. (2019) · Molecular Therapy · doi:10.1016/j.ymthe.2018.12.011 · Cited by 365
Tunable protein synthesis by transcript isoforms in human cells
Floor, S. N., & Doudna, J. A. (2016) · eLife · doi:10.7554/elife.10921 · Cited by 265
Decoding mRNA translatability and stability from the 5′ UTR
Jia, L., Mao, Y., Ji, Q., Dersh, D., Yewdell, J. W., & Qian, S.-B. (2020) · Nature Structural & Molecular Biology · doi:10.1038/s41594-020-0465-x · Cited by 248
Cap 1 Messenger RNA Synthesis with Co‐transcriptional CleanCap ® Analog by In Vitro Transcription
Henderson, J. M., Ujita, A., Hill, E., Yousif‐Rosales, S., Smith, C., Ko, N., McReynolds, T., Cabral, C. R., Escamilla‐Powers, J. R., & Houston, M. E. (2021) · Current Protocols · doi:10.1002/cpz1.39 · Cited by 231
Kuhn, A. N., Diken, M., Kreiter, S., Selmi, A., Kowalska, J., Jemielity, J., Darzynkiewicz, E., Huber, C., Türeci, Ö., & Sahin, U. (2010) · Gene Therapy · doi:10.1038/gt.2010.52 · Cited by 226
A Deep Neural Network for Predicting and Engineering Alternative Polyadenylation
Bogard, N., Linder, J., Rosenberg, A. B., & Seelig, G. (2019) · Cell · doi:10.1016/j.cell.2019.04.046 · Cited by 215
Self-citationSebastian, M., Schröder, A., Scheel, B., Hong, H. S., Muth, A., von Boehmer, L., Zippelius, A., Mayer, F., Reck, M., Atanackovic, D., et al. (2019) · Cancer Immunology, Immunotherapy · doi:10.1007/s00262-019-02315-x · Cited by 209
Kwon, H., Kim, M., Seo, Y., Moon, Y. S., Lee, H. J., Lee, K., & Lee, H. (2018) · Biomaterials · doi:10.1016/j.biomaterials.2017.11.034 · Cited by 208
Cuperus, J. T., Groves, B., Kuchina, A., Rosenberg, A. B., Jojic, N., Fields, S., & Seelig, G. (2017) · Genome Research · doi:10.1101/gr.224964.117 · Cited by 205
Self-citationQuantitative analysis of mammalian translation initiation sites by FACS‐seq
Noderer, W. L., Flockhart, R. J., Bhaduri, A., Diaz de Arce, A. J., Zhang, J., Khavari, P. A., & Wang, C. L. (2014) · Molecular Systems Biology · doi:10.15252/msb.20145136 · Cited by 178
mRNA-Based Protein Replacement Therapy for the Heart
Magadum, A., Kaur, K., & Zangi, L. (2019) · Molecular Therapy · doi:10.1016/j.ymthe.2018.11.018 · Cited by 176
MicroRNAs Enable mRNA Therapeutics to Selectively Program Cancer Cells to Self-Destruct
Jain, R., Frederick, J. P., Huang, E. Y., Burke, K. E., Mauger, D. M., Andrianova, E. A., Farlow, S. J., Siddiqui, S., Pimentel, J., Cheung-Ong, K., et al. (2018) · Nucleic Acid Therapeutics · doi:10.1089/nat.2018.0734 · Cited by 164
High-throughput 5’ UTR engineering for enhanced protein production in non-viral gene therapies
Cao, J., Novoa, E. M., Zhang, Z., Chen, W. C. W., Liu, D., Choi, G. C. G., Wong, A. S. L., Wehrspaun, C., Kellis, M., & Lu, T. K. (2021) · Nature Communications · doi:10.1038/s41467-021-24436-7 · Cited by 159
Delivery of mRNA Therapeutics for the Treatment of Hepatic Diseases
Trepotec, Z., Lichtenegger, E., Plank, C., Aneja, M. K., & Rudolph, C. (2019) · Molecular Therapy · doi:10.1016/j.ymthe.2018.12.012 · Cited by 115
Linder, J., Bogard, N., Rosenberg, A. B., & Seelig, G. (2020) · Cell Systems · doi:10.1016/j.cels.2020.05.007 · Cited by 107
Self-citationVariant SARS-CoV-2 mRNA vaccines confer broad neutralization as primary or booster series in mice
Wu, K., Choi, A., Koch, M., Elbashir, S., Ma, L., Lee, D., Woods, A., Henry, C., Palandjian, C., Hill, A., et al. (2021) · doi:10.1101/2021.04.13.439482 · Cited by 101
Linares-Fernández, S., Moreno, J., Lambert, E., Mercier-Gouy, P., Vachez, L., Verrier, B., & Exposito, J.-Y. (2021) · Molecular Therapy - Nucleic Acids · doi:10.1016/j.omtn.2021.10.007 · Cited by 62
Roth, N., Schön, J., Hoffmann, D., Thran, M., Thess, A., Mueller, S. O., Petsch, B., & Rauch, S. (2021) · doi:10.1101/2021.05.13.443734 · Cited by 18
Cited by
Optimizing 5’UTRs for mRNA-delivered gene editing using deep learning
Castillo-Hair, S., Fedak, S., Wang, B., Linder, J., Havens, K., Certo, M., & Seelig, G. (2024) · Nature Communications · doi:10.1038/s41467-024-49508-2 · Cited by 98
Self-citationHow will generative AI disrupt data science in drug discovery?
Vert, J.-P. (2023) · Nature Biotechnology · doi:10.1038/s41587-023-01789-6 · Cited by 73
Selection of UTRs in mRNA-Based Gene Therapy and Vaccines
Volkhin, I. A., Paremskaia, A. I., Dashian, M. A., Smeshnova, D. S., Pavlov, R. E., Mityaeva, O. N., Volchkov, P. Y., & Deviatkin, A. A. (2025) · Biochemistry (Moscow) · doi:10.1134/s0006297924604659 · Cited by 7
Metadata
- Authors
- Castillo-Hair, S. M., & Seelig, G.
- Venue
- Accounts of Chemical Research
- Publisher
- American Chemical Society (ACS)
- Published
- 2021-12-14
- Volume
- 55
- Issue
- 1
- Pages
- 24-34
- ISSN
- 0001-4842 (ISSN-L)
- 1520-4898
- OpenAlex
- W4200232768
- Cited by
- 113
- References
- 41
- FWCI
- 3.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.