A 5′ UTR language model for decoding untranslated regions of mRNA and function predictions
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
The 5’ UTR, a regulatory region at the beginning of an mRNA molecule, plays a crucial role in regulating the translation process and impacts the protein expression level. Language models have showcased their effectiveness in decoding the functions of protein and genome sequences. Here, we introduced a language model for 5’ UTR, which we refer to as the UTR-LM. The UTR-LM is pre-trained on endogenous 5’ UTRs from multiple species and is further augmented with supervised information including secondary structure and minimum free energy. We fine-tuned the UTR-LM in a variety of downstream tasks. The model outperformed the best-known benchmark by up to 42% for predicting the Mean Ribosome Loading, and by up to 60% for predicting the Translation Efficiency and the mRNA Expression Level. The model also applies to identifying unannotated Internal Ribosome Entry Sites within the untranslated region and improves the AUPR from 0.37 to 0.52 compared to the best baseline. Further, we designed a library of 211 novel 5’ UTRs with high predicted values of translation efficiency and evaluated them via a wet-lab assay. Experiment results confirmed that our top designs achieved a 32.5% increase in protein production level relative to well-established 5’ UTR optimized for therapeutics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lorenz, R., Bernhart, S. H., Höner zu Siederdissen, C., Tafer, H., Flamm, C., Stadler, P. F., & Hofacker, I. L. (2011) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-6-26 · Cited by 5,098
Cunningham, F., Allen, J. E., Allen, J., Alvarez-Jarreta, J., Amode, M. R., Armean, I. M., Austine-Orimoloye, O., Azov, A. G., Barnes, I., Bennett, R., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1049 · Cited by 1,923
Translational control by 5′-untranslated regions of eukaryotic mRNAs
Hinnebusch, A. G., Ivanov, I. P., & Sonenberg, N. (2016) · Science · doi:10.1126/science.aad9868 · Cited by 1,079
Functional 5′ UTR mRNA structures in eukaryotic translation regulation and how to find them
Leppek, K., Das, R., & Barna, M. (2018) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm.2017.103 · Cited by 949
Calvo, S. E., Pagliarini, D. J., & Mootha, V. K. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0810916106 · Cited by 914
Downstream secondary structure facilitates recognition of initiator codons by eukaryotic ribosomes
Kozak, M. (1990) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.87.21.8301 · Cited by 553
Human 5′ UTR design and variant effect prediction from a massively parallel translation assay
Sample, P. J., Wang, B., Reid, D. W., Presnyak, V., McFadyen, I. J., Morris, D. R., & Seelig, G. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0164-5 · Cited by 442 · cited 11×
“We compared the UTR-LM MRL model with benchmark methods from the MRL prediction literature 6,7,9 across eight synthetic libraries.”
BackgroundMethodResultInfluentialCombinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2021) · doi:10.1101/2021.03.29.437587 · Cited by 399
Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28776-w · Cited by 399 · cited 1×
“The HBB-5'UTR, a 5' UTR from the human hemoglobin subunit beta, is commonly used in studies of mRNA translation and stability 27 .”
BackgroundTransformer protein language models are unsupervised structure learners
Rao, R., Meier, J., Sercu, T., Ovchinnikov, S., & Rives, A. (2020) · doi:10.1101/2020.12.15.422761 · Cited by 341
Cited by
ERNIE-RNA: an RNA language model with structure-enhanced representations
Yin, W., Zhang, Z., Zhang, S., He, L., Zhang, R., Jiang, R., Liu, G., Wang, J., Zhang, X., Qin, T., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-64972-0 · Cited by 55
HydraRNA: a hybrid architecture based full-length RNA language model
Li, G., Jiang, F., Zhu, J., Cui, H., Wang, Z., & Chen, W. (2025) · Genome Biology · doi:10.1186/s13059-025-03853-7 · Cited by 10
Selection of UTRs in mRNA-Based Gene Therapy and Vaccines
Volkhin, I. A., Paremskaia, A. I., Dashian, M. A., Smeshnova, D. S., Pavlov, R. E., Mityaeva, O. N., Volchkov, P. Y., & Deviatkin, A. A. (2025) · Biochemistry (Moscow) · doi:10.1134/s0006297924604659 · Cited by 7
RNALens: Study on 5’ UTR Modeling and Cell-Specificity
Mao, L., Tian, Y., Qian, K.-W., & Song, Y. (2025) · doi:10.1101/2025.07.20.665722 · Cited by 1
Enhancement of mRNA translation efficiency through 5’-UTR engineering
Broset, E., Blasco-Machín, I., Lampaya, V., Matute, C., Toro-Córdova, A., & Martínez-Oliván, J. (2025) · doi:10.1101/2025.09.30.679448
Metadata
- Authors
- Chu, Y., Yu, D., Li, Y., Huang, K., Shen, Y., Cong, L., Zhang, J., & Wang, M.
- Venue
- Nature Machine Intelligence
- Published
- 2024-04-05
- Volume
- 6
- Issue
- 4
- Pages
- 449-460
- ISSN
- 2522-5839 (ISSN-L)
- OpenAlex
- W4393981110
- Cited by
- 139
- References
- 16
- FWCI
- 16.15
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A 5′ UTR language model for decoding untranslated regions of mRNA and function predictions. https://app.cochat.ai/papers/10.1038/s42256-024-00823-9
- The paper
- Chu, Y., Yu, D., Li, Y., Huang, K., Shen, Y., Cong, L., Zhang, J., & Wang, M. (2024). A 5′ UTR language model for decoding untranslated regions of mRNA and function predictions. Nature Machine Intelligence. https://doi.org/10.1038/s42256-024-00823-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.