Deep learning of the regulatory grammar of yeast 5′ untranslated regions from 500,000 random sequences
Open accessPublished version of a preprint
Abstract
Our ability to predict protein expression from DNA sequence alone remains poor, reflecting our limited understanding of cis -regulatory grammar and hampering the design of engineered genes for synthetic biology applications. Here, we generate a model that predicts the protein expression of the 5′ untranslated region (UTR) of mRNAs in the yeast Saccharomyces cerevisiae. We constructed a library of half a million 50-nucleotide-long random 5′ UTRs and assayed their activity in a massively parallel growth selection experiment. The resulting data allow us to quantify the impact on protein expression of Kozak sequence composition, upstream open reading frames (uORFs), and secondary structure. We trained a convolutional neural network (CNN) on the random library and showed that it performs well at predicting the protein expression of both a held-out set of the random 5′ UTRs as well as native S. cerevisiae 5′ UTRs. The model additionally was used to computationally evolve highly active 5′ UTRs. We confirmed experimentally that the great majority of the evolved sequences led to higher protein expression rates than the starting sequences, demonstrating the predictive power of this model.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Translation initiation is largely dependent on start codons and their context and position relative to a CDS.
“Translation initiation is largely dependent on start codons and their context and position relative to a CDS12,17.”
From Human 5′ UTR design and variant effect prediction from a massively parallel translation assay (2019) · cites this paper as [12]
Earlier MPRAs designed to learn aspects of 5′ UTR cis-regulation relied on FACS or growth selection to stratify libraries by activity.
“Earlier MPRAs designed to learn aspects of 5′ UTR cis-regulation relied on FACS10,11 or growth selection12 to stratify libraries by activity.”
From Human 5′ UTR design and variant effect prediction from a massively parallel translation assay (2019) · cites this paper as [12]
FACS- and growth-selection-based MPRAs require expression of a single library variant per cell that must be transcribed within the cell from a DNA template, making it difficult to distinguish between the effects of transcriptional and translational control.
“These techniques require the expression of a single library variant per cell that must be transcribed within the cell from a DNA template, making it difficult to distinguish between the effects of transcriptional and translational control.”
From Human 5′ UTR design and variant effect prediction from a massively parallel translation assay (2019) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249 · see citing works
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447 · see citing works
A compendium of RNA-binding motifs for decoding gene regulation
Ray, D., Kazan, H., Cook, K. B., Weirauch, M. T., Najafabadi, H. S., Li, X., Gueroussov, S., Albu, M., Zheng, H., Yang, A., et al. (2013) · Nature · doi:10.1038/nature12311 · Cited by 1,480 · see citing works
Evaluation of methods for modeling transcription factor sequence specificity
DREAM5 Consortium, Weirauch, M. T., Cote, A., Norel, R., Annala, M., Zhao, Y., Riley, T. R., Saez-Rodriguez, J., Cokelaer, T., Vedenko, A., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2486 · Cited by 381 · see citing works
Flagged first, then by citations
Research works printed but not linked: 72
- Akashi H. 2003 Translational selection and yeast proteome evolution. Genetics 164: 1291– 1303. 12930740 PMC1462678
- Alipanahi B, Delong A, Weirauch MT, Frey BJ. 2015 Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning. Nat Biotechnol 33: 831– 838. 26213851
- Amberg DC, Burke D, Strathern JN. 2005 Methods in yeast genetics: a Cold Spring Harbor Laboratory course manual. Cold Spring Harbor Laboratory Press, Cold Spring Harbor, NY.
- Babendure JR, Babendure JL, Ding J-H, Tsien RY. 2006 Control of mammalian translation by mRNA structure near caps. RNA 12: 851– 861. 16540693 PMC1440912
- Baim SB, Sherman F. 1988 mRNA structures influencing translation in the yeast Saccharomyces cerevisiae. Mol Cell Biol 8: 1591– 1601. 2837649 PMC363319
- Baker Brachmann C, Davies A, Cost GJ, Caputo E, Li J, Hieter P, Boeke JD. 1998 Designer deletion strains derived from Saccharomyces cerevisiae S288C: a useful set of strains and plasmids for PCR-mediated gene disruption and other applications. Yeast 14: 115– 132. 9483801
- Benatuil L, Perez JM, Belk J, Hsieh C-M. 2010 An improved yeast transformation method for the generation of very large human antibody libraries. Protein Eng Des Sel 23: 155– 159. 20130105
- Brennan MB, Struhl K. 1980 Mechanisms of increasing expression of a yeast gene in Escherichia coli. J Mol Biol 136: 333– 338. 6990004
- Capra JA, Paeschke K, Singh M, Zakian VA, Pringle T. 2010 G-quadruplex DNA sequences are evolutionarily conserved and associated with distinct genomic features in Saccharomyces cerevisiae. PLoS Comput Biol 6: e1000861. 20676380 PMC2908698
- Cavener DR, Ray SC. 1991 Eukaryotic start and stop translation sites. Nucleic Acids Res 19: 3185– 3192. 1905801 PMC328309
- Chen J, Ding M, Pederson DS. 1994 Binding of TFIID to the CYC1 TATA boxes in yeast occurs independently of upstream activating sequences. Proc Natl Acad Sci 91: 11909– 11913. 7991556 PMC45345
- Creamer TJ, Darby MM, Jamonnak N, Schaughency P, Hao H, Wheelan SJ, Corden JL. 2011 Transcriptome-wide binding sites for components of the Saccharomyces cerevisiae non-poly(A) termination pathway: Nrd1, Nab3, and Sen1. PLoS Genet 7: e1002329. 22028667 PMC3197677
- Crooks GE, Hon G, Chandonia J-M, Brenner SE. 2004 WebLogo: a sequence logo generator. Genome Res 14: 1188– 1190. 15173120 PMC419797
- Dobin A, Davis CA, Schlesinger F, Drenkow J, Zaleski C, Jha S, Batut P, Chaisson M, Gingeras TR. 2013 STAR: ultrafast universal RNA-seq aligner. Bioinformatics 29: 15– 21. 23104886 PMC3530905
- Dunham MJ, Fowler DM. 2013 Contemporary, yeast-based approaches to understanding human genetic variation. Curr Opin Genet Dev 23: 658– 664. 24252429 PMC3864666
- Dvir S, Velten L, Sharon E, Zeevi D, Carey LB, Weinberger A, Segal E. 2013 Deciphering the rules by which 5′-UTR sequences affect protein expression in yeast. Proc Natl Acad Sci 110: E2792– E2801. 23832786 PMC3725075
- Gibson DG, Young L, Chuang R-Y, Venter JC, Hutchison CA, Smith HO. 2009 Enzymatic assembly of DNA molecules up to several hundred kilobases. Nat Methods 6: 343– 345. 19363495
- Gietz RD, Schiestl RH. 2007 High-efficiency yeast transformation using the LiAc/SS carrier DNA/PEG method. Nat Protoc 2: 31– 34. 17401334
- Gruber AR, Lorenz R, Bernhart SH, Neubock R, Hofacker IL. 2008 The Vienna RNA Websuite. Nucleic Acids Res 36: W70– W74. 18424795 PMC2447809
- Gruber AR, Bernhart SH, Lorenz R. 2015 The ViennaRNA Web Services. Methods Mol Biol 1269: 307– 326. 25577387
- Guo Z, Russo P, Yun DF, Butler JS, Sherman F. 1995 Redundant 3′ end-forming signals for the yeast CYC1 mRNA. Proc Natl Acad Sci 92: 4211– 4214. 7753784 PMC41913
- Hamilton R, Watanabe CK, De Boer HA. 1987 Compilation and comparison of the sequence context around the AUG startcodons in Saccharomyces cerevisiae mRNAs. Nucleic Acids Res 15: 3581– 3593. 3554144 PMC340751
- Hietpas RT, Jensen JD, Bolon DNA. 2011 Experimental illumination of a fitness landscape. Proc Natl Acad Sci 108: 7896– 7901. 21464309 PMC3093508
- Huber F, Bunina D, Gupta I, Khmelinskii A, Meurer M, Theer P, Steinmetz LM, Knop M. 2016 Protein abundance control by non-coding antisense transcription. Cell Rep 15: 2625– 2636. 27292640 PMC4920891
- Kelley DR, Snoek J, Rinn JL. 2016 Basset: learning the regulatory code of the accessible genome with deep convolutional neural networks. Genome Res 26: 990– 999. 27197224 PMC4937568
- Kingma DP, Ba JL. 2014 Adam: a method for stochastic optimization. arXiv: 1412.6980 [cs.LG]. · arXiv
- Kinney JB, Murugan A, Callan CG, Cox EC. 2010 Using deep sequencing to characterize the biophysical mechanism of a transcriptional regulatory sequence. Proc Natl Acad Sci 107: 9158– 9163. 20439748 PMC2889059
- Kleftogiannis D, Kalnis P, Bajic VB. 2015 DEEP: a general computational framework for predicting enhancers. Nucleic Acids Res 43: e6. 25378307 PMC4288148
- Kosuri S, Goodman DB, Cambray G, Mutalik VK, Gao Y, Arkin AP, Endy D, Church GM. 2013 Composability of regulatory sequences controlling transcription and translation in Escherichia coli. Proc Natl Acad Sci 110: 14024– 14029. 23924614 PMC3752251
- Kwasnieski JC, Mogno I, Myers CA, Corbo JC, Cohen BA. 2012 Complex effects of nucleotide variants in a mammalian cis-regulatory element. Proc Natl Acad Sci 109: 19498– 19503. 23129659 PMC3511131
- Lamping E, Niimi M, Cannon RD. 2013 Small, synthetic, GC-rich mRNA stem-loop modules 5′ proximal to the AUG start-codon predictably tune gene expression in yeast. Microb Cell Fact 12: 74. 23895661 PMC3765126
- Lanchantin J, Singh R, Lin Z, Qi Y. 2016 Deep Motif: visualizing genomic sequence classifications. arXiv: 1605.01133 [cs.LG]. · arXiv
- Linz B, Koloteva N, Vasilescu S, McCarthy JE. 1997 Disruption of ribosomal scanning on the 5′-untranslated region, and not restriction of translational initiation per se, modulates the stability of nonaberrant mRNAs in the yeast Saccharomyces cerevisiae. J Biol Chem 272: 9131– 9140. 9083042
- Liu F, Li H, Ren C, Bo X, Shu W. 2016 PEDLA: predicting enhancers with a deep learning-based algorithmic framework. Sci Rep 6: 28517. 27329130 PMC4916453
- Looman AC, Kuivenhoven JA. 1993 Influence of the three nucleotides upstream of the initiation codon on expression of the Escherichia coli lacZ gene in Saccharomyces cerevisiae. Nucleic Acids Res 21: 4268– 4271. 8414981 PMC310060
- Lorenz R, Bernhart SH, Höner zu Siederdissen C, Tafer H, Flamm C, Stadler PF, Hofacker IL. 2011 ViennaRNA Package 2.0. Algorithms Mol Biol 6: 26. 22115189 PMC3319429
- Lubliner S, Regev I, Maya L-P, Edelheit S, Weinberger A, Segal E. 2015 Core promoter sequence in yeast is a major determinant of expression level. Genome Res 25: 1008– 1017. 25969468 PMC4484384
- Martens C, Krett B, Laybourn PJ. 2001 RNA polymerase II and TBP occupy the repressed CYC1 promoter. Mol Microbiol 40: 1009– 1019. 11401707
- Melnikov A, Murugan A, Zhang X, Tesileanu T, Wang L, Rogov P, Feizi S, Gnirke A, Callan CG, Kinney JB, 2012 Systematic dissection and optimization of inducible enhancers in human cells using a massively parallel reporter assay. Nat Biotechnol 30: 271– 277. 22371084 PMC3297981
- Morris DR, Geballe AP. 2000 Upstream open reading frames as regulators of mRNA translation. Mol Cell Biol 20: 8635– 8642. 11073965 PMC86464
- Mumberg D, Müller R, Funk M. 1995 Yeast vectors for the controlled expression of heterologous proteins in different genetic backgrounds. Gene 156: 119– 122. 7737504
- Nakagawa S, Niimura Y, Gojobori T, Tanaka H, Miura K. 2008 Diversity of preferred nucleotide sequences around the translation initiation codon in eukaryote genomes. Nucleic Acids Res 36: 861– 871. 18086709 PMC2241899
- Noderer WL, Flockhart RJ, Bhaduri A, Diaz de Arce AJ, Zhang J, Khavari PA, Wang CL. 2014 Quantitative analysis of mammalian translation initiation sites by FACS-seq. Mol Syst Biol 10: 748. 25170020 PMC4299517
- Oikonomou P, Goodarzi H, Tavazoie S. 2014 Systematic identification of regulatory elements in conserved 3′ UTRs of human transcripts. Cell Rep 7: 281– 292. 24656821 PMC4430845
- Olesen J, Hahn S, Guarente L. 1987 Yeast HAP2 and HAP3 activators both bind to the CYC1 upstream activation site, UAS2, in an interdependent manner. Cell 51: 953– 961. 2826015
- Park D, Morris AR, Battenhouse A, Iyer VR. 2014 Simultaneous mapping of transcript ends at single-nucleotide resolution and identification of widespread promoter-associated non-coding RNA governed by TATA elements. Nucleic Acids Res 42: 3736– 3749. 24413663 PMC3973313
- Patwardhan RP, Hiatt JB, Witten DM, Kim MJ, Smith RP, May D, Lee C, Andrie JM, Lee S-I, Cooper GM, 2012 Massively parallel functional dissection of mammalian enhancers in vivo. Nat Biotechnol 30: 265– 270. 22371081 PMC3402344
- Pfeifer K, Arcangioli B, Guarente L. 1987 Yeast HAP1 activator competes with the factor RC2 for binding to the upstream activation site UAS1 of the CYC1 gene. Cell 49: 9– 18. 3030567
- Pop C, Rouskin S, Ingolia NT, Han L, Phizicky EM, Weissman JS, Koller D. 2014 Causal signals between codon bias, mRNA structure, and the efficiency of translation and elongation. Mol Syst Biol 10: 770. 25538139 PMC4300493
- Quang D, Xie X. 2016 DanQ: a hybrid convolutional and recurrent deep neural network for quantifying the function of DNA sequences. Nucleic Acids Res 44: e107. 27084946 PMC4914104
- Rich MS, Payen C, Rubin AF, Ong GT, Sanchez MR, Yachie N, Dunham MJ, Fields S. 2016 Comprehensive analysis of the SUL1 promoter of Saccharomyces cerevisiae. Genetics 203: 191– 202. 26936925 PMC4858773
- Ringnér M, Krogh M, Mignone F, Gissi C, Liuni S, Pesole G, Hurowitz E, Brown P, Jansen R, Bashirullah A, 2005 Folding free energies of 5′-UTRs impact post-transcriptional regulation on a genomic scale in yeast. PLoS Comput Biol 1: e72. 16355254 PMC1309706
- Rosenberg AB, Patwardhan RP, Shendure J, Seelig G. 2015 Learning the sequence determinants of alternative splicing from millions of random sequences. Cell 163: 698– 711. 26496609
- Rouskin S, Zubradt M, Washietl S, Kellis M, Weissman JS. 2013 Genome-wide probing of RNA structure reveals active unfolding of mRNA structures in vivo. Nature 505: 701– 705. 24336214 PMC3966492
- Rubin AF, Lucas N, Bajjalieh SM, Papenfuss AT, Speed TP, Fowler DM. 2016 Enrich2: a statistical framework for analyzing deep mutational scanning data. bioRxiv 10.1101/075150. PMC5547491 28784151 · DOI
- Salis HM, Mirsky EA, Voigt CA. 2009 Automated design of synthetic ribosome binding sites to control protein expression. Nat Biotechnol 27: 946– 950. 19801975 PMC2782888
- Sanger F, Nicklen S, Coulson AR. 1977 DNA sequencing with chain-terminating inhibitors. Proc Natl Acad Sci 74: 5463– 5467. 271968 PMC431765
- Scanlon TC, Gray EC, Griswold KE. 2009 Quantifying and resolving multiple vector transformants in S. cerevisiae plasmid libraries. BMC Biotechnol 9: 95. 19930565 PMC2784458
- Schulz D, Schwalb B, Kiesel A, Baejen C, Torkler P, Gagneur J, Soeding J, Cramer P. 2013 Transcriptome surveillance by selective termination of noncoding RNA synthesis. Cell 155: 1075– 1087. 24210918
- Shalem O, Sharon E, Lubliner S, Regev I, Maya L-P, Yakhini Z, Segal E. 2015 Systematic dissection of the sequence determinants of gene 3′ end mediated expression control. PLoS Genet 11: e1005147. 25875337 PMC4398552
- Sharon E, Kalma Y, Sharp A, Raveh-Sadka T, Levo M, Zeevi D, Keren L, Yakhini Z, Weinberger A, Segal E. 2012 Inferring gene regulatory logic from high-throughput measurements of thousands of systematically designed promoters. Nat Biotechnol 30: 521– 530. 22609971 PMC3374032
- Sharp PM, Cowe E. 1991 Synonymous codon usage in Saccharomyces cerevisiae. Yeast 7: 657– 678. 1776357
- Starita LM, Young DL, Islam M, Kitzman JO, Gullingsrud J, Hause RJ, Fowler DM, Parvin JD, Shendure J, Fields S. 2015 Massively parallel functional analysis of BRCA1 RING domain variants. Genetics 200: 413– 422. 25823446 PMC4492368
- Thireos G, Penn MD, Greer H. 1984 5′ untranslated sequences are required for the translational control of a yeast regulatory gene. Proc Natl Acad Sci 81: 5096– 5100. 6433345 PMC391644
- Treitel MA, Carlson M. 1995 Repression by SSN6-TUP1 is directed by MIG1, a repressor/activator protein. Proc Natl Acad Sci 92: 3132– 3136. 7724528 PMC42119
- Wang X-Q, Rothnagel JA. 2004 5′-Untranslated regions with multiple upstream AUG codons can support low-level translation via leaky scanning and reinitiation. Nucleic Acids Res 32: 1382– 1391. 14990743 PMC390293
- Wang Y, Liu T, Xu D, Shi H, Zhang C, Mo Y-Y, Wang Z, Gardiner-Garden M, Frommer M, Cedar H, 2016 Predicting DNA methylation state of CpG dinucleotide using genome topological features and deep networks. Sci Rep 6: 19598. 26797014 PMC4726425
- Watanabe K, Yabe M, Kasahara K, Kokubo T. 2015 A random screen using a novel reporter assay system reveals a set of sequences that are preferred as the TATA or TATA-like elements in the CYC1 promoter of Saccharomyces cerevisiae. PLoS One 10: e0129357. 26046838 PMC4457894
- Werner M, Feller A, Messenguy F, Piérard A. 1987 The leader peptide of yeast gene CPA1 is essential for the translational repression of its expression. Cell 49: 805– 813. 3555844
- Yagil G, Shimron F, Tal M. 1998 DNA unwinding in the CYC1 and DED1 yeast promoters. Gene 225: 153– 162. 9931479
- Yoon H, Miller SP, Pabich EK, Donahue TF. 1992 SSL1, a suppressor of a HIS4 5′-UTR stem–loop mutation, is essential for translation initiation and affects UV resistance in yeast. Genes Dev 6: 2463– 2477. 1340463
- Zhou J, Troyanskaya OG. 2015 Predicting effects of noncoding variants with deep learning-based sequence model. Nat Methods 12: 931– 934. 26301843 PMC4768299
Cited by
Sorted by citations
Human 5′ UTR design and variant effect prediction from a massively parallel translation assay
Sample, P. J., Wang, B., Reid, D. W., Presnyak, V., McFadyen, I. J., Morris, D. R., & Seelig, G. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0164-5 · Cited by 442 · see citing works
Self-citationMason, D. M., Friedensohn, S., Weber, C. R., Jordi, C., Wagner, B., Meng, S. M., Ehling, R. A., Bonati, L., Dahinden, J., Gainza, P., et al. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00699-9 · Cited by 308 · see citing works
Zrimec, J., Börlin, C. S., Buric, F., Muhammad, A. S., Chen, R., Siewers, V., Verendel, V., Nielsen, J., Töpel, M., & Zelezniak, A. (2020) · Nature Communications · doi:10.1038/s41467-020-19921-4 · Cited by 174 · see citing works
Gene expression is encoded in all parts of a co-evolving interacting gene regulatory structure
Zrimec, J., Buric, F., Muhammad, A. S., Chen, R., Verendel, V., Töpel, M., & Zelezniak, A. (2019) · doi:10.1101/792531 · Cited by 173 · see citing works
Hold out the genome: a roadmap to solving the cis-regulatory code
de Boer, C. G., & Taipale, J. (2024) · Nature · doi:10.1038/s41586-023-06661-w · Cited by 107 · see citing works
Manrubia, S., Cuesta, J. A., Aguirre, J., Ahnert, S. E., Altenberg, L., Cano, A. V., Catalán, P., Diaz-Uriarte, R., Elena, S. F., García-Martín, J. A., et al. (2021) · Physics of Life Reviews · doi:10.1016/j.plrev.2021.03.004 · Cited by 88 · see citing works
- Authors
- Cuperus, J. T., Groves, B., Kuchina, A., Rosenberg, A. B., Jojic, N., Fields, S., & Seelig, G.
- Affiliations
- Howard Hughes Medical Institute (US)
- University of Washington (US)
- Corresponding author
- Fields, Stanley
- Seelig, Georg
- Venue
- Genome Research
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2017-11-02
- Volume
- 27
- Issue
- 12
- Pages
- 2015-2024
- ISSN
- 1088-9051 (ISSN-L)
- 1549-5469
- PMC
- PMC5741052
- OpenAlex
- W2951203227
- Cited by
- 205
- References
- 4
- Citations by year
- 2026: 19 · 2025: 21 · 2024: 25 · 2023: 25 · 2022: 23 · 2021: 27 · 2020: 26 · 2019: 24 · 2018: 14 · 2017: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- Genome Research (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Defense Advanced Research Projects Agency (W911NF-11-2-0068)
- National Science Foundation (CCF 1317653)
- National Institutes of Health (P41 GM103533)
- Howard Hughes Medical Institute
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA and protein synthesis mechanisms
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA Research and Splicing
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Fungal and yeast genetics research
- Keywords
- 5' untranslated region, protein expression prediction, Saccharomyces cerevisiae, Kozak sequence, upstream open reading frames, mRNA secondary structure, convolutional neural networks, computational evolution, synthetic biology, gene design
- MeSH terms
- Machine Learning, Computer Simulation, Models, Genetic, RNA, Fungal, RNA, Messenger, Saccharomyces cerevisiae, Gene Library, Neural Networks, Computer, Alternative Splicing, 5' Untranslated Regions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review