Cited by 450RNA and protein synthesis mechanismsRNA Research and SplicingRNA modifications and cancer

Human 5′ UTR design and variant effect prediction from a massively parallel translation assay

Open access
Sample, Paul J., Wang, Ban, Reid, David W., Presnyak, Vlad, McFadyen, Iain J., Morris, David R., Seelig, Georg·2019·Nature Biotechnology

Published version of a preprint

Abstract

The ability to predict the impact of cis-regulatory sequences on gene expression would facilitate discovery in fundamental and applied biology. Here we combine polysome profiling of a library of 280,000 randomized 5' untranslated regions (UTRs) with deep learning to build a predictive model that relates human 5' UTR sequence to translation. Together with a genetic algorithm, we use the model to engineer new 5' UTRs that accurately direct specified levels of ribosome loading, providing the ability to tune sequences for optimal protein expression. We show that the same approach can be extended to chemically modified RNA, an important feature for applications in mRNA therapeutics and synthetic biology. We test 35,212 truncated human 5' UTRs and 3,577 naturally occurring variants and show that the model predicts ribosome loading of these sequences. Finally, we provide evidence of 45 single-nucleotide variants (SNVs) associated with human diseases that substantially change ribosome loading and thus may represent a molecular basis for disease.

AI snapshot

Written from the paper’s full text.

TL;DR

The paper combines polysome profiling of a 280,000-member randomized human 5′ UTR library with a convolutional neural network, Optimus 5-Prime, to predict ribosome loading from 5′ UTR sequence. The model explains up to 93% of mean ribosome load variation, predicts effects of human variants and modified RNA, and enables genetic-algorithm design of 5′ UTRs for targeted translation.

Key findings

  • Optimus 5-Prime explained 93% of MRL variation in a held-out test set of 20,000 sequences, versus at best 66% for position-specific k-mer linear models; it also predicted full polysome distributions with an average 83% of variation across fractions.
  • The model generalized to an mCherry reporter library (77% and 78% of MRL variation in two experiments), to 35,212 common human 5′ UTRs plus 3,577 ClinVar variants (81% of MRL variation), and to Ψ- and m1Ψ-modified RNA (68% and 76% of variability, respectively).
  • For human variant effects, the model explained 55% of observed MRL change and predicted direction for 64% of variants; 45 SNVs had log2 differences >0.5 or <−0.5, including CPOX rs867711777 (−0.89), RPL5 rs376208311 (−0.87), and TMEM127 rs121908813 (−1.5).
  • A genetic algorithm designed 12,000 UTRs for target MRLs; after retraining on 6,082 target-MRL UTRs and 2,695 unseen random UTRs, held-out target-MRL performance improved from r² = 0.386 to 0.772.

Methods

  • A 280,000-member eGFP library with 50-nt random 5′ UTRs was in vitro transcribed, transfected into HEK293T cells, polysome-profiled, sequenced, and converted to mean ribosome load (MRL); validation included mCherry, modified UTP, human/ClinVar, and 25–100 nt length libraries.
  • A CNN was trained on 260,000 sequences and tested on 20,000, using Keras/TensorFlow, grid-search hyperparameters, three convolution layers, and a dense layer; separate models predicted polysome fractions and were used with a genetic algorithm for UTR design.
  • Human analyses used the first 50 nt upstream of annotated translation initiation sites for 35,212 Ensembl transcripts and 3,577 ClinVar variants; a generalized model used 76,319 random sequences of 25–100 nt and test sets of 7,600 random and 7,600 human UTRs.

Limitations

  • The paper states that the model was trained on synthetic random sequences, that the 50-nt model covers only 13% of human 5′ UTRs, that the 25–100 nt extension covers 29%, and that longer UTRs had lower read coverage and lower test-set quality.
  • The paper notes lower accuracy for variant effect prediction because it compares two noisy measurements and most variants have little effect; it also reports divergence at very high MRLs due to unusual poly-U composition, corrected by retraining, and lower mCherry accuracy partly due to protocol differences.
  • Evident from the text: experiments use HEK293T/HEK293 cells, transfected IVT mRNA, and eGFP/mCherry reporters rather than endogenous chromatin/transcription contexts; polysome profiling measures ribosome loading, with protein output validated only for selected UTRs, and the model does not include 5′ cap structure or 3′ UTR sequence.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41587-019-0164-5

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

24 of 51 cited sources checked · 9 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    A fully rational approach to designing functional 5′ UTRs has not yet been implemented.

    “While there has been some success in this effort in prokaryotes, yeast and even mammalian cells27,34–36, a fully rational approach to designing functional 5′ UTRs has not yet been implemented.”
    Quote in the paperSubstantial claim4 of 4 sources checked
    • cites [27] Ferreira, J. P., Overton, K. W. & Wang, C. L. Tuning gene expression with synthetic upstream open reading frames. Proc. Natl Acad. Sci. USA 110, 11284–11289 (2013). source

      The opening discussion says there were few systematic approaches for precisely controlling recombinant-protein translation in mammalian cells, which supports the claim’s general concern about design methods. It does not say that a fully rational approach to designing functional 5′ UTRs had never been implemented; the Discussion instead describes the authors’ own systematic approach using engineered RNA leaders. The claim is broader than the source supports. (LLM, conf=0.80)

      Experimental — accuracy not yet measured
    • cites [34] Seo, S. W. et al. Predictive design of mRNA translation initiation region to control prokaryotic translation efficiency. Metab. Eng. 15, 67–74 (2013). source
    • cites [35] Jensen, M. K. & Keasling, J. D. Recent applications of synthetic biology tools for yeast metabolic engineering. FEMS Yeast Res. 15, 1–10 (2015). source

      The editorial’s section “Yeast synthetic biology: new tools to unlock cellular function” discusses advances in synthetic-part design, but does not address 5′ UTRs or whether a fully rational approach to designing them has been implemented. Searches for 5′ UTR design and the claimed limitation found no passage that settles it; the copy has no page numbers. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
    • cites [36] Salis, H. M., Mirsky, E. A. & Voigt, C. A. Automated design of synthetic ribosome binding sites to control protein expression. Nat. Biotechnol. 27, 946–950 (2009). source

      The Materials and Methods section (Software Implementation; page unavailable) says the authors implemented an RBS Calculator that optimizes ribosome-binding-site sequences to rationally control protein expression. This contradicts the unqualified assertion that a rational design approach had not been implemented, although the paper addresses bacterial ribosome-binding sites rather than every feature of a 5′ UTR. (LLM, conf=0.77)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Premisecitation

    Only 13% of human 5′ UTRs are shorter than 50 nt and thus covered by Optimus 5-Prime.

    “Because only 13% of human 5′ UTRs are shorter than 50 nt and thus covered by Optimus 5-Prime, we next asked whether the approach introduced here could be extended to longer 5′ UTRs.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [44] Mignone, F. et al. Untranslated regions of mRNAs. Genome Biol. 3, reviews0004.1 (2002). source

      The Structural features of untranslated regions section (page not available) says 5′ UTRs average 100–200 nucleotides and vary widely in length. It does not give the proportion of human 5′ UTRs shorter than 50 nucleotides or discuss coverage by Optimus 5-Prime. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
    • cites [45] Leppek, K., Das, R. & Barna, M. Functional 5′ UTR mRNA structures in eukaryotic translation regulation and how to find them. Nat. Rev. Mol. Cell Biol. 19, 158–174 (2018). source

      The section ‘5′ UTRs as platforms for RNA structure’ (page unavailable) reports a median human 5′ UTR length of 218 nucleotides, supporting the general point that many are longer than 50 nt. It does not give the 13% figure or discuss which UTRs Optimus 5-Prime covers. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Premisecitation

    Earlier MPRAs designed to learn aspects of 5′ UTR cis-regulation relied on FACS or growth selection to stratify libraries by activity.

    “Earlier MPRAs designed to learn aspects of 5′ UTR cis-regulation relied on FACS10,11 or growth selection12 to stratify libraries by activity.”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites [10] Noderer, W. L. et al. Quantitative analysis of mammalian translation initiation sites by FACS-seq. Mol. Syst. Biol. 10, 748 (2014). source
    • cites [11] Kosuri, S. et al. Composability of regulatory sequences controlling transcription and translation in Escherichia coli. Proc. Natl Acad. Sci. USA 110, 14024–14029 (2013). source
    • cites [12] Cuperus, J. T. et al. Deep learning of the regulatory grammar of yeast 5′ untranslated regions from 500,000 random sequences. Genome Res. 27, 2015–2024 (2017). source
  • Premisecitation

    Translation initiation is largely dependent on start codons and their context and position relative to a CDS.

    “Translation initiation is largely dependent on start codons and their context and position relative to a CDS12,17.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [12] Cuperus, J. T. et al. Deep learning of the regulatory grammar of yeast 5′ untranslated regions from 500,000 random sequences. Genome Res. 27, 2015–2024 (2017). source
    • cites [17] Hinnebusch, A. G., Ivanov, I. P. & Sonenberg, N. Translational control by 5′-untranslated regions of eukaryotic mRNAs. Science 352, 1413–1416 (2016). source
  • Premisecitation

    The sequence of the 5′ untranslated region (5′ UTR) is a primary determinant of translation efficiency.

    “The sequence of the 5′ untranslated region (5′ UTR) is a primary determinant of translation efficiency1,2.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [1] Araujo, P. R. et al. Before it gets started: regulating translation at the 5′ UTR. Comp. Funct. Genom. 2012, 475731 (2012). source
    • cites [2] Jackson, R. J., Hellen, C. U. T. & Pestova, T. V. The mechanism of eukaryotic translation initiation and principles of its regulation. Nat. Rev. Mol. Cell Biol. 11, 113–127 (2010). source
  • Classified as probably not a substantial claim. 23
  • May combine two claims. 21
  • The quote only partly states this claim. 1
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    How 5′ UTR sequences affect translation is only beginning to be understood.

    “Genetic variants play a major role in phenotypic differences between individuals38 and how these sequences affect translation is only beginning to be understood39,40.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [39] Battle, A. et al. Impact of regulatory variation from RNA to protein. Science 347, 664–667 (2015). source

      In the section labeled Abstract (page unavailable), the paper says that how genetic differences affect gene expression through translation has not been fully characterized. That supports the general point that understanding is incomplete, but the cited passage does not specifically address how 5′ UTR sequences affect translation. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
    • cites [40] Cenik, C. et al. Integrative analysis of RNA, translation, and protein levels reveals distinct regulatory variation across humans. Genome Res. 25, 1610–1621 (2015). source

      The Discussion (page unavailable) says the molecular mechanisms linking sequence to translation remain an interesting question and that less is known about positive regulation by upstream open reading frames. The Results show that 5′ UTR variants affect translation, but the paper does not characterize understanding of all 5′ UTR sequence effects as only beginning. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The two uridine analogs pseudouridine (Ψ) or 1-methyl-pseudouridine (m1Ψ) are widely used for mRNA therapeutics because they can increase mRNA stability and help modulate the host immune response.

    “The two uridine analogs pseudouridine (Ψ) or 1-methyl-pseudouridine (m1Ψ) are widely used for mRNA therapeutics because they can increase mRNA stability and help modulate the host immune response31,32.”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [31] Karikó, K. et al. Incorporation of pseudouridine into mRNA yields superior nonimmunogenic vector with increased translational capacity and biological stability. Mol. Ther. 16, 1833–1840 (2008). source

      The Introduction reports that pseudouridine (Ψ) suppresses RNA-mediated immune activation, and the Discussion describes increased biological stability of Ψ-modified mRNA as a likely contributor to enhanced translation. The paper does not address 1-methyl-pseudouridine (m1Ψ) or establish that both analogs are widely used in mRNA therapeutics. Page numbers are unavailable in our copy. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
    • cites [32] Anderson, B. R. et al. Incorporation of pseudouridine into mRNA enhances translation by diminishing PKR activation. Nucleic Acids Res. 38, 5884–5892 (2010). source

      The Introduction and Discussion (page numbers unavailable) support pseudouridine’s role in reducing innate immune activation and its potential for therapeutic mRNA delivery. They do not establish that either analog increases mRNA stability, and the paper does not address 1-methyl-pseudouridine or establish that both analogs are widely used in therapeutics. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim.

    Premisecitation

    Massively parallel reporter assays coupled with machine learning have proven useful in addressing similar voids by producing quantitative biological insight that would be difficult to achieve through traditional approaches.

    “Massively parallel reporter assays (MPRAs) – methods that assess thousands to millions of sequence variants in a single experiment – coupled with machine learning have proven useful in addressing similar voids by producing quantitative biological insight that would be difficult to achieve through traditional approaches3–9.”
    Quote in the paperSubstantial claim3 of 7 sources checked
    • cites [3] Angermueller, C., Pärnamaa, T., Parts, L. & Stegle, O. Deep learning for computational biology. Mol. Syst. Biol. 12, 878 (2016). source

      Checked before — its earlier verdict is held back until a new check runs.

    • cites [4] Alipanahi, B., Delong, A., Weirauch, M. T. & Frey, B. J. Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning. Nat. Biotechnol. 33, 831–838 (2015). source
    • cites [5] Zhou, J. & Troyanskaya, O. G. Predicting effects of noncoding variants with deep learning-based sequence model. Nat. Methods 12, 931–934 (2015). source

      The Abstract describes DeepSEA, a deep-learning model that learns from large-scale chromatin-profiling data to predict effects of noncoding variants. This supports the broader point that machine learning can provide quantitative biological insight, but the paper does not describe coupling machine learning with massively parallel reporter assays. A search for “reporter” found no relevant passage. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites [6] Kleftogiannis, D., Kalnis, P. & Bajic, V. B. DEEP: a general computational framework for predicting enhancers. Nucleic Acids Res. 43, e6 (2015). source

      Checked before — its earlier verdict is held back until a new check runs.

    • cites [7] Liu, F., Li, H., Ren, C., Bo, X. & Shu, W. PEDLA: predicting enhancers with a deep learning-based algorithmic framework. Sci. Rep. 6, 28517 (2016). source

      Checked before — its earlier verdict is held back until a new check runs.

    • cites [8] Kelley, D. R., Snoek, J. & Rinn, J. L. Basset: learning the regulatory code of the accessible genome with deep convolutional neural networks. Genome Res. 26, 990–999 (2016). source

      The Results section (‘In silico saturation mutagenesis’; page unavailable) describes parallel reporter assays as a way to measure the activity of many mutations, and presents Basset’s machine-learning predictions as an in silico approach to the same problem. It does not report coupling an MPRA with machine learning; Basset was trained on DNase-seq accessibility data, so the cited paper supports the broader point about quantitative insight but not the claimed combination. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites [9] Zhao, W. et al. Massively parallel functional annotation of 3′ untranslated regions. Nat. Biotechnol. 32, 387–391 (2014). source

      The main text (page unavailable) describes fast-UTR, a massively parallel reporter approach that quantified effects of 3′ UTR sequences and genetic variants. It does not report coupling the assay with machine learning; it says the resulting data could be useful for refining computational prediction methods. Thus the paper supports the assay’s quantitative value, but not the machine-learning part of the claim. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Human 5′ UTR sequences vary in length from tens to thousands of nucleotides with a median length of 218 nt.

    “Human 5′ UTR sequences vary in length from tens to thousands of nucleotides with a median length of 218 nt44,45.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [44] Mignone, F. et al. Untranslated regions of mRNAs. Genome Biol. 3, reviews0004.1 (2002). source

      The Structural features of untranslated regions section (page not available in our copy) says that 5′ UTR lengths vary within a species from about a dozen to a few thousand nucleotides, supporting the claimed range. It does not give a median of 218 nt for human 5′ UTRs; it reports an average of 100–200 nt across diverse taxonomic classes instead. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
    • cites [45] Leppek, K., Das, R. & Barna, M. Functional 5′ UTR mRNA structures in eukaryotic translation regulation and how to find them. Nat. Rev. Mol. Cell Biol. 19, 158–174 (2018). source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Several filters did not fall into the recognized motif categories and did not match previously described PWMs for RNA binding proteins, suggesting the possibility for previously undescribed regulatory interactions.

    “Of note, several filters did not fall into either of these categories and also did not match previously described PWMs for RNA binding proteins (Tomtom29 and the Homo sapiens RBP database30), suggesting the possibility for previously undescribed regulatory interactions.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Tomtom29

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Homo sapiens RBP database30

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    A model trained on data from another polysome profiling experiment performed similarly.

    “A model trained on data from another polysome profiling experiment performed similarly (Supplementary Fig. 5a).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    We identified 2,308 additional SNVs that resulted from oligo synthesis errors, and 103 of them showed MRL changes greater than 0.5 or less than −0.5 in log2 scale.

    “We also identified 2,308 additional SNVs that resulted from oligo synthesis errors, and found that 103 of them showed MRL changes greater than 0.5 or less than −0.5 in log2 scale (Supplementary Fig. 14b).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The mCherry library contained approximately 500,000 sequences.

    “The eGFP library contained approximately 750,000 unique sequences and the mCherry library contained approximately 500,000 sequences.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The ClinVar variant rs867711777 is found in the 5′ UTR of the CPOX gene and shows a log2 difference of −0.89.

    “As an example, one of the ClinVar variants with sizeable differences in MRL, rs867711777, is found in the 5′ UTR of the CPOX gene and shows a log2 difference of −0.89.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Together with a genetic algorithm, the model was used to engineer new 5′ UTRs that accurately direct specified levels of ribosome loading, providing the ability to tune sequences for optimal protein expression.

    “Together with a genetic algorithm, we use the model to engineer new 5′ UTRs that accurately direct specified levels of ribosome loading, providing the ability to tune sequences for optimal protein expression.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The field lacks a means to accurately predict protein expression from 5′ UTR sequence alone.
    • Rests on an assumption: The first 50 bases upstream of the CDS contain the regulatory signals that mediate translation initiation beyond ribosomal recruitment to the 5′ cap.
  • May combine two claims.

    Findingown data

    Optimus 5-Prime, the CNN trained on the data, explains up to 93% of mean ribosome load variation in the test set and up to 81% of variation for 38,789 truncated human UTRs.

    “Optimus 5-Prime, the CNN trained on the data has notable performance, explaining up to 93% of mean ribosome load variation in the test set and up to 81% of variation for 38,789 truncated human UTRs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The eGFP library contained approximately 750,000 unique sequences.

    “The eGFP library contained approximately 750,000 unique sequences and the mCherry library contained approximately 500,000 sequences.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Using the expanded dataset, the retrained Optimus 5-Prime model showed increased accuracy with all sub-libraries and unchanged performance with random library sequences.

    “Using this expanded dataset, we retrained the Optimus 5-Prime model in Figure 2, which showed increased accuracy with all sub-libraries and unchanged performance with random library sequences (Supplementary Fig. 13b).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The variant rs376208311 lies in the 5′ UTR of the ribosomal subunit gene RPL5 and shows a −0.87 log2 difference in MRL.

    “The variant rs376208311 lies in the 5′ UTR of the ribosomal subunit gene RPL5 and shows a −0.87 log2 difference in MRL.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Adding a third convolution layer and additional filters to each layer improved the performance of the 5′ UTR model used for evolving new sequences.

    “sometime after training this first model we determined that adding a third convolution layer and additional filters to each layer showed improved performance.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    The model performs nearly as well after randomly splitting the training (260,000) and test (20,000) sets as with the read-count-based split.

    “However, the model performs nearly as well after randomly splitting the training (260,000) and test (20,000) sets (Supplementary Fig. 15d).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The majority of SNVs had little to no effect, but 45 had log2 differences greater than 0.5 or less than −0.5.

    “The majority of SNVs had little to no effect, but 45 had log2 differences greater than 0.5 or less than −0.5 (Supplementary Table 4, Clinvar SUB4797518).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    No sequences between the eGFP and mCherry library matched.

    “No sequences between the eGFP and mCherry library matched.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The generalized Optimus 5-Prime model performed well on both the human (r2: 0.78) and random (r2: 0.84) sequences and for 5′ UTRs of any length (r2: 0.75-0.84).

    “The generalized Optimus 5-Prime model performed well on both the human (r2: 0.78) and random (r2: 0.84) sequences (Supplementary Fig. 15c,d) and for 5′ UTRs of any length (Fig. 4e, r2: 0.75–0.84).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Overall, Optimus 5-Prime could explain 55% of the observed MRL change and accurately predicted the direction of change for 64% of the variants.

    “Overall, Optimus 5-Prime could explain 55% of the observed MRL change (Fig. 4b) and accurately predicted the direction of change for 64% of the variants.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Visualization of the filters in the first and second convolution layer revealed recognizable motifs including strong TIS sequences (e.g. ACCAUG), stop codons (TAA, TGA, TAG), uORFs, non-canonical start codons (CUG, GUG), and sequences composed of multiples of CG or AU likely involved in secondary structure formation.

    “Visualization of the filters in the first and second convolution layer revealed recognizable motifs including strong TIS sequences (e.g. ACCAUG), stop codons (TAA, TGA, TAG), uORFs, non-canonical start codons (CUG, GUG), and sequences composed of multiples of CG or AU likely involved in secondary structure formation (Fig. 2f and Supplementary Fig. 10).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    We performed 10-fold cross-validation grid search to exhaustively test hyperparameter combinations.

    “We performed 10-fold cross-validation grid search to exhaustively test hyperparameter combinations of convolution layers (2, 3), convolution filter lengths (8, 10, 12), number of convolution filters (40, 80, 120), number of nodes in the dense layer (40, 80, 120), dropout probability between all layers (0, 0.2, 0.4).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Genetic variants play a major role in phenotypic differences between individuals.

    “Genetic variants play a major role in phenotypic differences between individuals38 and how these sequences affect translation is only beginning to be understood39,40.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [38] Hernandez, R. D. et al. Singleton variants dominate the genetic architecture of human gene expression. Preprint https://doi.org/10.2139/ssrn.3151998 (2018). source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Both RT primers have unique molecular indices (UMIs).

    “Both RT primers have unique molecular indices (UMIs).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The SNV rs121908813 is implicated in familial pheochromocytoma, a condition characterized by tumors found in the neuroendocrine system that secrete high levels of catecholamines.

    “Another SNV, rs121908813, is implicated in familial pheochromocytoma, a condition characterized by tumors found in the neuroendocrine system that secrete high levels of catecholamines43.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [43] Qin, Y. et al. Germline mutations in TMEM127 confer susceptibility to pheochromocytoma. Nat. Genet. 42, 229–233 (2010). source

      Checked before — its earlier verdict is held back until a new check runs.

  • May combine two claims.

    Interpretationreasoning

    The model can be used to screen every possible SNV, insertion or deletion in the 100 bases upstream of the start codon and select those with the strongest impact on ribosome loading and thus the highest likelihood of being pathogenic.

    “Of note, predictions are not limited to common variants or even those that have been previously described; instead the model can be used to screen every possible SNV, insertion or deletion in the 100 bases upstream of the start codon – there are millions in the human genome - and select those for further study that have the strongest impact on ribosome loading and thus the highest likelihood of be”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Changes in mean ribosome load (MRL) measured in the assay reflect changes in protein expression that can affect disease pathogenicity.
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Existing approaches to this problem, such as quantitative trait locus (QTL) analysis and genome wide association studies (GWAS), are limited to common variants and cannot scale to the enormous number of rare 5′ UTR variants occurring in the human population.

    “But existing approaches to this problem, such as quantitative trait locus (QTL) analysis and genome wide association studies (GWAS) are limited to common variants and cannot scale to the enormous number of rare 5′ UTR variants occurring in the human population.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Polysome profiling has been used extensively to measure translation of native RNA isoforms, but isolating the role of 5′ UTR regulation has been difficult due to differences in the size and sequence of the concomitant coding sequences and 3′ UTRs.

    “Polysome profiling has been used extensively to measure translation of native RNA isoforms14,15 but isolating the role of 5′ UTR regulation has been difficult due to differences in the size and sequence of the concomitant coding sequences and 3′ UTRs.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [14] Floor, S. N. & Doudna, J. A. Tunable protein synthesis by transcript isoforms in human cells. elife 5, e10921 (2016). source

      Checked before — its earlier verdict is held back until a new check runs.

    • cites [15] Wang, X., Hou, J., Quedenau, C. & Chen, W. Pervasive isoform‐specific translational regulation via alternative transcription start sites in mammals. Mol. Syst. Biol. 12, 875 (2016). source

      Checked before — its earlier verdict is held back until a new check runs.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Training of the k-mer linear model involved regularization to limit overfitting and 5-fold cross validation.

    “Training involved regularization to limit overfitting and 5-fold cross validation.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Our model proved capable of predicting the effect of disease-relevant 5′ UTR variants on translation, even suggesting mechanisms of action.

    “Our model also proved capable of predicting the effect of disease-relevant 5′ UTR variants on translation, even suggesting mechanisms of action.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    UTRs were removed if the CDS sequence did not match the intended sequence.

    “UTRs were removed if the CDS sequence did not match the intended sequence.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Relative reads were calculated within each fraction to normalize differences in total read counts between fractions.

    “To normalize differences in total read counts between fractions, relative reads were calculated within each fraction.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Depletion of CPOX reduces heme biosynthesis and is the cause of hereditary coproporphyria (HCP).

    “The depletion of CPOX reduces heme biosynthesis and is the cause of hereditary coproporphyria (HCP)41.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [41] Wang, B. & Bissell, D. M. Hereditary Coproporphyria (University of Washington, 2012). .

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The model was trained over three epochs before overfitting occurred.

    “The model was trained over three epochs before overfitting occurred.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    A small portion of the electroporation was plated and resulted in ~750,000 cfu.

    “A small portion of the electroporation was plated and resulted in ~750,000 cfu and the rest was grown in liquid culture overnight (both under kanamycin selection).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    A second test set was created consisting of 7,600 human 5′ UTRs - 100 UTRs for every length from 25 to 100 nt.

    “We also created a second test set consisting of 7,600 human 5′ UTRs – 100 UTRs for every length from 25 to 100 nt.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    One cause of Diamond-Blackfan anemia is disruption or downregulation of RPL5.

    “One cause of the disease is a result of either the disruption or downregulation of RPL542.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [42] Boria, I. et al. The ribosomal basis of Diamond–Blackfan anemia: mutation and database update. Hum. Mutat. 31, 1269–1279 (2010). source

      Checked before — its earlier verdict is held back until a new check runs.

  • May combine two claims.

    Interpretationown data

    A majority of variants do not impact translation, resulting in a large cluster of variants for which the MRL change is close to zero where measurements are dominated by noise.

    “Moreover, a majority of variants do not impact translation, resulting in a large cluster of variants for which the MRL change is close to zero where measurements are dominated by noise.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Translation initiation and elongation is affected by RNA secondary structure that forms within 5′ UTRs and coding sequences, with strong structures showing the most negative effect on translation.

    “Translation initiation and elongation is also affected by RNA secondary structure that forms within 5′ UTRs and coding sequences, with strong structures showing the most negative effect on translation17,25.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [17] Hinnebusch, A. G., Ivanov, I. P. & Sonenberg, N. Translational control by 5′-untranslated regions of eukaryotic mRNAs. Science 352, 1413–1416 (2016). source

      Checked before — its earlier verdict is held back until a new check runs.

    • cites [25] Kozak, M. Influences of mRNA secondary structure on initiation by eukaryotic ribosomes. Proc. Natl Acad. Sci. USA 83, 2850–2854 (1986). source

      Checked before — its earlier verdict is held back until a new check runs.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    To ensure that 5′ UTRs of every length would be represented equally, the 100 5′ UTRs with the deepest read coverage at every length (~10% of the library) were taken as the test set, rather than using the top 10% of the entire population.

    “To ensure that 5′ UTRs of every length would be represented equally, we took the 100 5′ UTRs with the deepest read coverage at every length (~10% of the library) as the test set, rather than using the top 10% of the entire population.”
    Quote in the paperSubstantial claim
40 of 40
  • The paper relies on this without support.

    The field lacks a means to accurately predict protein expression from 5′ UTR sequence alone.

    “While many cis-regulatory elements within human 5′ UTRs have been characterized individually, the field still lacks a means to accurately predict protein expression from 5′ UTR sequence alone, limiting the ability to estimate the effects of genome-encoded variants and the ability to engineer 5′ UTRs for precise translation control.”
  • The paper relies on this without support.

    The region surrounding the start codon (the translation initiation site or Kozak sequence) is a primary determinant of whether a ribosome will begin translation.

    “The region surrounding the start codon, known as the translation initiation site (TIS) or the Kozak sequence, is a primary determinant of whether a ribosome will begin translation.”
  • The paper relies on this without support.

    The first 50 bases upstream of the CDS contain the regulatory signals that mediate translation initiation beyond ribosomal recruitment to the 5′ cap.

    “We initially focused on the first 50 bases upstream of the CDS to specifically investigate the regulatory signals that mediate the initiation of translation beyond ribosomal recruitment to the 5′ cap.”
  • The paper relies on this without support.

    TMEM127 acts as a tumor suppressor.

    “TMEM127 acts as a tumor suppressor and decreased expression of it could explain the observed pathogenicity of this variant.”
  • The paper relies on this without support.

    The variant rs376208311 is associated with Diamond-Blackfan anemia (BDA).

    “This variant is associated with Diamond-Blackfan anemia (BDA).”
  • The paper relies on this without support.

    Changes in mean ribosome load (MRL) measured in the assay reflect changes in protein expression that can affect disease pathogenicity.

    “select those for further study that have the strongest impact on ribosome loading and thus the highest likelihood of being pathogenic.”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The authors of ref. [46] also demonstrated that MRL inversely correlates with minimal free energy values.

    “It should be pointed out that the authors of ref. [46] also demonstrated that MRL inversely correlates with minimal free energy values.”

    From Effects of Combinations of Untranslated-Region Sequences on Translation of mRNA (2023) · cites this paper as [46]

    The Results section (‘Evaluation of mRNA containing Ψ and m1Ψ’) reports a positive, not inverse, correlation between mean ribosome load and predicted minimum free energy for U, Ψ, and m1Ψ. The supplied passage does not give a page number. (LLM, conf=0.92)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • Higher GC content and highly negative folding minimal free energy (ΔG) of 5′UTRs correlate with inhibition of translation.

    “In addition to greater length, the TPL sequence has a higher GC content and highly negative folding minimal free energy (ΔG), which correlates with inhibition of translation [4,7,45,46] (Table 1).”

    From Effects of Combinations of Untranslated-Region Sequences on Translation of mRNA (2023) · cites this paper as [46]

    In Results, “MPRA design and validation” (page unavailable), the paper reports that strong RNA secondary structures have a negative effect on translation and that comparing 5′ UTR minimum free energy with ribosome load captured this repressive effect. It does not establish a separate correlation between higher GC content and translation inhibition; the TPL sequence measurements are the citing authors’ own observations. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • In TPL, the presence of unique cis- and/or trans-regulatory elements that ensure efficient translation is indirectly confirmed by evidence obtained via assessment of predicted mean ribosomal loading (MRL) with the Optimus 5-Prime algorithm.

    “In TPL, the presence of unique cis- and/or trans-regulatory elements that ensure efficient translation is indirectly confirmed by evidence obtained via assessment of predicted mean ribosomal loading (MRL) with the Optimus 5-Prime algorithm [46].”

    From Effects of Combinations of Untranslated-Region Sequences on Translation of mRNA (2023) · cites this paper as [46]

    The Results section (“Modeling 5′ UTRs and ribosome loading”; page unavailable) establishes that Optimus 5-Prime predicts MRL from 5′ UTR sequence and that predicted MRL correlates with protein expression. The paper does not assess TPL or establish that TPL contains unique cis- or trans-regulatory elements; its model results cannot, by themselves, confirm their presence there. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • On the basis of 280,000 different 5′UTR sequences, the authors of that paper demonstrated that MRL values range from 2 to 11.

    “On the basis of 280,000 different 5′UTR sequences, the authors of that paper demonstrated that MRL values range from 2 to 11.”

    From Effects of Combinations of Untranslated-Region Sequences on Translation of mRNA (2023) · cites this paper as [46]

    Online Methods (“Sequence Processing”) says the authors selected 280,000 distinct 5′ UTR sequences for the eGFP library and calculated mean ribosome load (MRL) for them. The Results (“Modeling 5′ UTRs and ribosome loading”) also identifies the 280,000-member library, but the passages found do not establish that its MRL values ranged from 2 to 11. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Using a new set of 5′ UTR synthetic sequences based on selection of synthetic 5′ UTRs with high ribosome loading improved mRNA translation.

    “Here, we improved the mRNA translation by using a new set of 5′ UTR synthetic sequences based on the selection of synthetic 5′ UTRs with high ribosome loading.22”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Sample, P. J., Wang, B., Reid, D. W., Presnyak, V., McFadyen, I. J., Morris, D. R., & Seelig, G.
Affiliations
  • University of Washington (US)
  • Moderna Therapeutics (United States) (US)
Corresponding author
Seelig, Georg
Venue
Nature Biotechnology
Published
2019-07
Volume
37
Issue
7
Pages
803-809
ISSN
  • 0733-222X (ISSN-L)
  • 1087-0156
  • 1546-1696
OpenAlex
W2955231772
Cited by
442
References
52
Citations by year
2026: 71 · 2025: 92 · 2024: 96 · 2023: 58 · 2022: 41 · 2021: 47 · 2020: 21 · 2019: 14 · 2018: 1
FWCI
10.18
Type
journal article
Language
en
Open access
Locations
  • Nature Biotechnology (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
Funders
U.S. Department of Health & Human Services | NIH | National Human Genome Research Institute (R01CA207029)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA and protein synthesis mechanisms
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA Research and Splicing
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA modifications and cancer
Keywords
5' untranslated region, translation initiation, ribosome loading, cis-regulatory sequences, variant effect prediction, single nucleotide variants, RNA modification, mRNA therapeutics, synthetic biology, deep learning, genetic algorithm, sequence design, polysome profiling, disease-associated variants
MeSH terms
Base Sequence, Gene Expression Regulation, Humans, Models, Genetic, Pseudouridine, Ribosomes, RNA, Messenger, Protein Biosynthesis, Reproducibility of Results, 5' Untranslated Regions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-05.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-05.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review