DNA language models are powerful predictors of genome-wide variant effects
Open accessPublished version of a preprint
Abstract
The expanding catalog of genome-wide association studies (GWAS) provides biological insights across a variety of species, but identifying the causal variants behind these associations remains a significant challenge. Experimental validation is both labor-intensive and costly, highlighting the need for accurate, scalable computational methods to predict the effects of genetic variants across the entire genome. Inspired by recent progress in natural language processing, unsupervised pretraining on large protein sequence databases has proven successful in extracting complex information related to proteins. These models showcase their ability to learn variant effects in coding regions using an unsupervised approach. Expanding on this idea, we here introduce the Genomic Pre-trained Network (GPN), a model designed to learn genome-wide variant effects through unsupervised pretraining on genomic DNA sequences. Our model also successfully learns gene structure and DNA motifs without any supervision. To demonstrate its utility, we train GPN on unaligned reference genomes of Arabidopsis thaliana and seven related species within the Brassicales order and evaluate its ability to predict the functional impact of genetic variants in A. thaliana by utilizing allele frequencies from the 1001 Genomes Project and a comprehensive database of GWAS. Notably, GPN outperforms predictors based on popular conservation scores such as phyloP and phastCons. Our predictions for A. thaliana can be visualized as sequence logos in the UCSC Genome Browser ( https://genome.ucsc.edu/s/gbenegas/gpn-arabidopsis ). We provide code ( https://github.com/songlab-cal/gpn ) to train GPN for any given species using its DNA sequence alone, enabling unsupervised prediction of variant effects across the entire genome.
AI snapshot
Written from the paper’s full text.
TL;DR
The authors introduce GPN, a multispecies DNA language model trained by self-supervision on reference genomes, and show it can score genome-wide variant effects without functional genomics data. In Arabidopsis thaliana, GPN achieves state-of-the-art unsupervised variant effect prediction and improves GWAS hit enrichment when combined with linkage disequilibrium.
Key findings
- GPN embeddings distinguish genomic regions without supervision: logistic regression on averaged embeddings reached 96% accuracy for coding sequences and 51% for ncRNA, far above k-mer baselines (k=3: 8%–70%; k=6: 15%–67%).
- In a 1-Mb test region, GPN perplexities were lower at constrained sites—splice donors median 1.02, splice acceptors 1.03, start codons 1.08, CDS2 2.24, CDS1 2.44, CDS3 2.79, stop codons 2.8—than in intergenic/intronic regions (median 3.24; Mann–Whitney P < 10⁻¹⁷).
- Across over 10 million SNPs from the 1001 Genomes Project, the lowest 0.1% of GPN scores showed 5.5-fold enrichment in rare variants; GPN outperformed phyloP and phastCons, despite weak correlations with phyloP (r=0.22) and phastCons (r=0.13), and could score 14.2% of variants that phyloP/phastCons could not.
- For AraGWAS variants, the lower 1% of GPN × LD scores were 10.3-fold enriched in GWAS hits versus the upper 99%, while other methods showed less than 7.5-fold enrichment; with the full variant set (n=510,462), GPN × LD achieved even higher odds ratios.
Methods
- GPN was pretrained on unaligned reference genomes from A. thaliana and seven related Brassicales species (8 genomes total), holding out A. thaliana chromosomes 4 and 5 for validation and testing. Training used 512-bp windows with 256-bp step, reverse-complement augmentation, and masked language modeling with 15% of nucleotides masked; the model was a convolutional neural network with 25 convolutional blocks, 512-dimensional embeddings, trained for 150,000 steps on 4 NVIDIA A100 80 GB GPUs.
- Variant effect scores were computed as the log-likelihood ratio between alternate and reference alleles, averaged over forward and reverse strands. Analyses included in silico mutagenesis, over 10 million naturally occurring SNPs from the 1001 Genomes Project, and around half a million AraGWAS variants across 462 phenotypes.
- GPN × LD was defined as a stratified LD score: a weighted sum of GPN scores using squared Pearson correlations (r²) within 100 kb, with Fisher’s exact test used for odds ratios and P-values.
Limitations
- The paper states that repetitive elements remain challenging: down-weighting repeats only partially mitigates issues, and the current proof-of-concept model is considerably smaller—by 200 times—than the largest published protein language model. It also notes that incorporating multiple sequence alignments would be bottlenecked by noncoding alignment quality, and that the current method averages forward/reverse strand outputs rather than using reverse-complement equivariance.
- The paper states that performance relative to phyloP and phastCons varies by variant class and threshold, and that GPN’s advantage is strongest at the extreme tail of the score distribution.
- Evident from the text: evaluation is limited to A. thaliana and related Brassicales; no human or broader species validation is presented, and the single-species model performed substantially worse, indicating dependence on multispecies training data.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 13 cited sources checked · 0 supported · 0 flagged
- Findingown data
GPN classification accuracy cannot be achieved merely through k-mer frequencies.
“This level of classification accuracy cannot be achieved merely through k-mer frequencies (k=3: 8% to 70%; k=6: 15% to 67%; see SI Appendix, Fig. S1).”
Quote in the paperSubstantial claim - Findingown data
GPN × LD effectively distinguishes GWAS hits from nonhits in the example locus.
“With this approach, GPN × LD effectively distinguishes GWAS hits from nonhits in this example locus (Fig. 6 A, Bottom).”
Quote in the paperSubstantial claim - Findingown data
Putative functional SNPs, defined as the lowest 0.1% of GPN scores, exhibit a 5.5-fold enrichment in rare variants.
“Putative functional SNPs, defined as the lowest 0.1% of GPN scores, exhibit a 5.5-fold enrichment in rare variants (Fig. 5C); see SI Appendix, Fig. S8 for different allele frequency thresholds.”
Quote in the paperSubstantial claim - Findingown data
The highest confusion in classifying genomic regions using GPN embeddings was between intergenic regions and ncRNAs.
“As summarized in Fig. 2B, the highest confusion was observed between intergenic regions and ncRNAs; this may be partly explained by errors in ncRNA annotation, which is especially challenging given their low expression levels and poor conservation (33).”
Quote in the paperNot a substantial claim - Findingown data
GPN presents a unified approach capable of accurate unsupervised prediction of genome-wide variant effects.
“GPN presents a unified approach capable of accurate unsupervised prediction of genome-wide variant effects.”
Quote in the paperSubstantial claim
- Findingown data
GPN × LD achieves much higher odds ratios when considering the full variant set, including regions that do not align to other Brassicales.
“Furthermore, GPN × LD achieves much higher odds ratios when considering the full variant set, including regions that do not align to other Brassicales (Fig. 6E); failed alignment could be partly due to genomic rearrangements that may be potentially associated with local adaptation in A. thaliana (45).”
Quote in the paperNot a substantial claim - Findingown data
The GPN model trained on only a single species performs substantially worse.
“The model trained on only a single species performs substantially worse (SI Appendix, Fig. S10A).”
- Also stated in: § Unsupervised Variant Effect Prediction. · plain
“The model trained on only a single species performs worse (SI Appendix, Fig. S10B).”
Quote in the paperNot a substantial claim - Also stated in: § Unsupervised Variant Effect Prediction. · plain
- Findingown data
GPN performs comparably to phyloP and phastCons when using less stringent thresholds for defining putative functional SNPs.
“GPN performs comparably to phyloP and phastCons when using less stringent thresholds for defining putative functional SNPs (SI Appendix, Fig. S9), indicating its particular strength in detecting deleterious variants at the extreme tail.”
Quote in the paperNot a substantial claim - Findingown data
Start and stop codon motifs are generally well predicted.
“Start and stop codon motifs are also generally well predicted (examples in SI Appendix, Fig. S3).”
Quote in the paperNot a substantial claim - Findingnone given
GPN achieves state-of-the-art variant effect prediction for A. thaliana.
“While the current implementation of GPN achieves state-of-the-art variant effect prediction for A. thaliana”
Quote in the paperSubstantial claim - Findingcitation
Some identified motifs are well-documented in the literature but do not have a significant match in PlantTFDB, such as the third motif.
“Some of the identified motifs are well-documented in the literature but do not have a significant match in this database, such as the third motif (39) in Fig. 3B.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [39] A. Evrard, T. Ndatimana, T. Eulgem, FORCA, a promoter element that responds to crosstalk between defense and light signaling. BMC Plant Biol. 9, 1– 13 (2009). 19128484 PMC2640394 source
Not checked in the free run.
- Findingown data
The alternative abs(phyloP) did not achieve a significant enrichment.
“We also considered the alternative abs(phyloP) (the absolute value of phyloP), but it did not achieve a significant enrichment.”
Quote in the paperNot a substantial claim - Findingown data
The confidence of GPN's predictions can help reveal regulatory grammar, such as transcription factor binding motifs.
“Additionally, the confidence of GPN’s predictions can help reveal regulatory grammar, such as transcription factor binding motifs.”
- Also stated in: § DNA Motifs Revealed by High-Confidence Model Predictions. · plain
“Applying the adapted TF-MoDISco to GPN scores in promoter regions, we identified approximately a hundred and sixty motifs (SI Appendix, Fig. S5), with four examples shown in Fig. 3B, the first two having a significant match in PlantTFDB (20) [with q-value <0.05 in Tomtom (38)].”
Quote in the paperSubstantial claim - Also stated in: § DNA Motifs Revealed by High-Confidence Model Predictions. · plain
- Findingown data
Across the genome and all traits, the tail of GPN × LD scores is greatly enriched in GWAS hits, much more so than the tail of raw GPN scores.
“More generally, across the genome and all traits, the tail of GPN × LD scores is greatly enriched in GWAS hits, much more so than the tail of raw GPN scores (Fig. 6B).”
Quote in the paperSubstantial claim - Findingown data
The GPN model trained with an intermediate loss weight on repeats achieves the best performance for GWAS enrichment.
“Interestingly, the GPN model trained with an intermediate loss weight on repeats achieves the best performance (SI Appendix, Fig. S6D).”
Quote in the paperNot a substantial claim - Findingown data
The proportion of low GPN scores for repeat variants depends on the training loss weight on repeats.
“Furthermore, the proportion of low GPN scores for repeat variants depends on the training loss weight on repeats (SI Appendix, Fig. S6A).”
Quote in the paperNot a substantial claim - Findingown data
GPN's prediction confidence correlates with the expected functionality of sites.
“The model’s prediction confidence correlates with the expected functionality of the sites.”
Quote in the paperSubstantial claim - Findingown data
GPN achieves state-of-the-art performance in Arabidopsis thaliana for genome-wide variant effect prediction.
“achieving state-of-the-art performance in Arabidopsis thaliana, a model organism for plant biology and a source of insight into human diseases.”
- Also stated in: § Abstract · boosted
“We demonstrate its utility by achieving state-of-the-art performance in Arabidopsis thaliana, a model organism for plant biology closely related to many agriculturally important species, as well as a source of insight into human diseases (30).”
- Also stated in: § Discussion · boosted
“We demonstrate that GPN outperforms other genome-wide variant effect predictors in A. thaliana, a model species for plant biology.”
Quote in the paperSubstantial claim - Also stated in: § Abstract · boosted
- Findingnone given
GPN can score genome-wide variants on a unified scale.
“The capability of GPN to score genome-wide variants on a unified scale renders it ideal for integration into rare disease diagnosis, fine-mapping, and polygenic risk scores, including burden tests.”
Quote in the paperSubstantial claim - Findingown data
The first two example motifs have a significant match in PlantTFDB (q-value <0.05 in Tomtom).
“with four examples shown in Fig. 3B, the first two having a significant match in PlantTFDB (20) [with q-value <0.05 in Tomtom (38)].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [20] F. Tian, D. C. Yang, Y. Q. Meng, J. Jin, G. Gao, PlantRegMap: Charting functional regulatory maps in plants. Nucleic Acids Res. 48, D1104– D1113 (2020). 31701126 PMC7145545
Not checked in the free run.
- cites [38] S. Gupta, J. A. Stamatoyannopoulos, T. L. Bailey, W. S. Noble, Quantifying similarity between motifs. Genome Biol. 8, 1– 9 (2007). PMC1852410 17324271 source
Not checked in the free run.
- Findingown data
Some variants within repetitive elements were assigned rather low GPN scores, ranking close to missense variants.
“However, we observed that some variants within repetitive elements were assigned rather low GPN scores, ranking close to missense variants.”
Quote in the paperNot a substantial claim - Findingown data
Applying adapted TF-MoDISco to GPN scores in promoter regions identified approximately 160 motifs.
“Applying the adapted TF-MoDISco to GPN scores in promoter regions, we identified approximately a hundred and sixty motifs (SI Appendix, Fig. S5), with four examples shown in Fig. 3B, the first two having a significant match in PlantTFDB (20) [with q-value <0.05 in Tomtom (38)].”
Quote in the paperNot a substantial claim - Findingown data
GPN's internal representation of DNA sequences can distinguish genomic regions such as introns, untranslated regions, and coding sequences.
“GPN’s internal representation of DNA sequences can distinguish genomic regions like introns, untranslated regions, and coding sequences.”
- Also stated in: § Unsupervised Clustering of Genomic Regions. · plain
“Notably, GPN, trained without any supervision, has learned to distinguish genomic regions such as intergenic, introns, coding sequences (CDS), untranslated regions (UTR), and noncoding RNA (ncRNA).”
Quote in the paperNot a substantial claim - Also stated in: § Unsupervised Clustering of Genomic Regions. · plain
- Findingown data
GPN can give substantially different scores to variants in strong linkage disequilibrium with each other, if their surrounding contexts are different.
“An advantage of GPN is that it can give substantially different scores to variants in strong linkage disequilibrium (LD) with each other, if their surrounding contexts are different, e.g., Fig. 6A, Top).”
Quote in the paperSubstantial claim - Findingown data
Variants with lower GPN scores are, on average, less frequent in the population.
“Notably, variants with lower GPN scores are, on average, less frequent in the population, suggesting they could be under purifying selection (Fig. 5B, full distribution in SI Appendix, Fig. S7).”
Quote in the paperSubstantial claim - Findingown data
Within codons, the third nucleotide position (CDS3) is generally predicted with lower confidence than the first two positions (CDS1, CDS2).
“Similarly, within codons, the third nucleotide position (CDS3), which usually does not affect amino acid identity, is generally predicted with lower confidence than the first two positions (CDS1, CDS2).”
Quote in the paperNot a substantial claim - Findingown data
Across a 1-Mb region in the test chromosome, model perplexities in splice donors, splice acceptors, start codons, CDS2, CDS1, CDS3, and stop codons are significantly smaller than those in intergenic and intronic regions.
“Across a 1-Mb region in the test chromosome (containing 264 genes and 471 transcripts), model perplexities in splice donors (median =1.02), splice acceptors (median = 1.03), start codons (median =1.08), CDS2 (median =2.24), CDS1 (median =2.44), CDS3 (median =2.79), and stop codons (median =2.8) are significantly smaller than those in intergenic and intronic regions (median =3.24, all Mann–Whitney”
Quote in the paperSubstantial claim - Findingnone given
Missense variants are predicted to have a bigger impact than synonymous variants.
“As expected, missense variants are predicted to have a bigger impact than synonymous variants.”
Quote in the paperNot a substantial claim - Findingown data
GPN outperforms genome-wide conservation scores such as phyloP and phastCons.
“Moreover, GPN outperforms genome-wide conservation scores such as phyloP and phastCons, which rely on whole-genome alignments of 18 closely related species (20).”
- Also stated in: § Unsupervised Variant Effect Prediction. · plain
“GPN outperforms other genome-wide variant effect predictors for Arabidopsis, specifically phyloP and phastCons, which are conservation scores derived from a broader set of 18 Brassicales species (Fig. 5D).”
Quote in the paperSubstantial claim - Also stated in: § Unsupervised Variant Effect Prediction. · plain
- Findingreasoning
Down-weighting repeats only partially mitigates the issues posed by repetitive elements.
“Our proposed down-weighting of repeats only partially mitigates these issues”
Quote in the paperNot a substantial claim - Findingown data
The four lowest scored variant types are splice donor, splice acceptor, stop gained, and start lost variants.
“For example, the four lowest scored variant types are splice donor, splice acceptor, stop gained, and start lost variants, which significantly disrupt the open reading frame.”
Quote in the paperNot a substantial claim - Findingown data
GPN is able to score variants that could not be scored by phyloP and phastCons due to unsuccessful whole-genome alignment (14.2% of all variants).
“A notable advantage of GPN is that it is able to score variants that could not be scored by phyloP and phastCons due to unsuccessful whole-genome alignment (14.2% of all variants).”
Quote in the paperSubstantial claim - Findingown data
Reducing the weight of prediction loss for repetitive regions led to lower test perplexity in nonrepetitive regions.
“We found that reducing the weight of prediction loss for repetitive regions led to lower test perplexity in nonrepetitive regions, which are often of greater interest (SI Appendix, Table S2).”
Quote in the paperNot a substantial claim - Findingcitation
The ranking of variant types based on the lowest percentile of GPN scores is generally consistent with established notions of deleteriousness.
“The ranking of variant types based on the lowest percentile of GPN scores is generally consistent with established notions of deleteriousness (41)*.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [41] W. McLaren, The ensembl variant effect predictor. Genome Biol. 17, 1– 14 (2016). 27268795 PMC4893825 source
Not checked in the free run.
- Findingown data
Exonic positions are predicted with higher confidence than surrounding introns, except for canonical splice acceptor and donor dinucleotide motifs.
“For example, exonic positions are predicted with higher confidence than the surrounding introns, except for the canonical splice acceptor and donor dinucleotide motifs.”
Quote in the paperNot a substantial claim - Interpretationown data
GPN's particular strength is in detecting deleterious variants at the extreme tail.
“GPN performs comparably to phyloP and phastCons when using less stringent thresholds for defining putative functional SNPs (SI Appendix, Fig. S9), indicating its particular strength in detecting deleterious variants at the extreme tail.”
Quote in the paperSubstantial claim - Premisecitation
Repetitive elements are significantly overrepresented in eukaryotic genomes.
“First, these elements are significantly overrepresented (31).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [31] G. Bourque, Ten things you should know about transposable elements. Genome Biol. 19, 1– 12 (2018). 30454069 PMC6240941 source
Not checked in the free run.
- Interpretationown data
Variants with lower GPN scores could be under purifying selection.
“Notably, variants with lower GPN scores are, on average, less frequent in the population, suggesting they could be under purifying selection (Fig. 5B, full distribution in SI Appendix, Fig. S7).”
Quote in the paperSubstantial claim - Premisecitation
Repetitive elements display reduced sequence variation compared to other regions, particularly younger repeats with little time to accumulate mutations.
“Second, repetitive elements display reduced sequence variation compared to other regions, in particular younger repeats with little time to accumulate mutations (47).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [47] W. Zhou, G. Liang, P. L. Molloy, P. A. Jones, DNA methylation enables transposable element-driven genome expansion. Proc. Natl. Acad. Sci. U.S.A. 117, 19359– 19366 (2020). 32719115 PMC7431005 source
Not checked in the free run.
- Interpretationreasoning
GPN's results lay the foundation for developing state-of-the-art genome-wide variant effect predictors for any species using genomic sequence alone.
“Our results lay the foundation for developing state-of-the-art genome-wide variant effect predictors for any species using genomic sequence alone, which can be readily integrated into GWAS fine-mapping and polygenic risk scores.”
Quote in the paperSubstantial claim - Interpretationreasoning
GPN can be applied to any species with a reference genome, even in the absence of expensive functional genomics data.
“Our model, trained solely on DNA sequences, can be applied to any species with a reference genome, even in the absence of expensive functional genomics data.”
Quote in the paperSubstantial claim - Interpretationreasoning
These factors together may cause differences in model likelihoods in repetitive regions to be less clearly associated with differences in fitness.
“We believe that these factors together may cause differences in model likelihoods in these regions to be less clearly associated with differences in fitness.”
Quote in the paperNot a substantial claim - Interpretationreasoning
DNA language models represent a powerful framework for genome-wide variant effect prediction.
“In conclusion, DNA language models represent a powerful framework for genome-wide variant effect prediction”
Quote in the paperSubstantial claim
- May combine two claims. 14
- Classified as probably not a substantial claim. 22
May combine two claims.
Findingown dataGPN achieves significant odds ratios when computed only within particular variant classes, but its performance relative to phyloP and phastCons varies.
“GPN also achieves significant odds ratios when computed only within particular variant classes, but its performance relative to phyloP and phastCons varies (SI Appendix, Fig. S9).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataModerate down-weighting results in a similar improvement in perplexity for nonrepetitive regions without sacrificing genome-wide perplexity as much as full down-weighting.
“Compared to full down-weighting, moderate down-weighting results in a similar improvement in perplexity for nonrepetitive regions without sacrificing genome-wide perplexity as much.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataMost variants in the 1001 Genomes Project have a neutral GPN score, with a heavy tail of putative functional variants with negative GPN scores.
“While most variants have a neutral GPN score, there is a heavy tail of putative functional variants with negative GPN scores (Fig. 5A).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataSNPs with the lower 1% of GPN × LD scores are 10.3-fold enriched in GWAS hits compared to the upper 99% of GPN × LD scores, while less than 7.5-fold enrichment was observed for other methods.
“In particular, by analyzing odds ratios (Fig. 6C), we found that SNPs with the lower 1% of GPN × LD scores are 10.3-fold enriched in GWAS hits compared to the upper 99% of GPN × LD scores, while less than 7.5-fold enrichment was observed for other methods (Fig. 6D); see SI Appendix, Fig. S11 for different thresholds.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataA slightly higher odds ratio is achieved by the GPN model trained with an intermediate loss weight on repeats.
“On a separate note, a slightly higher odds ratio is achieved by the GPN model trained with an intermediate loss weight on repeats (SI Appendix, Fig. S6C).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataA logistic regression classifier trained on averaged GPN embeddings achieved highest accuracy on CDS (96%) and lowest on ncRNA (51%).
“To quantify GPN’s ability to distinguish genomic regions, we trained a logistic regression classifier using the averaged embeddings as features, achieving the highest accuracy on CDS (96%) and the lowest on ncRNA (51%), the least frequent class.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationGPN is considerably smaller-by 200 times-than the largest published protein language model.
“Our current proof-of-concept model is considerably smaller—by 200 times—than the largest published protein language model (49).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [49] Z. Lin, Evolutionary-scale prediction of atomic-level protein structure with a language model. Science 379, 1123– 1130 (2023). 36927031 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataGPN embeddings can distinguish different repeat families to some extent.
“We also note that, to some extent, GPN embeddings can distinguish different repeat families (SI Appendix, Fig. S2).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn models with 0.0 and 0.1 down-weighting, respectively, 8% and 9% of repeat variants are ranked before the first decile of missense variants, compared to 27% in the model without any down-weighting.
“More precisely, in models with 0.0 and 0.1 down-weighting, respectively, 8% and 9% of repeat variants are ranked before the first decile of missense variants. These represent a substantial decrease compared to the 27% observed in the model without any down-weighting (SI Appendix, Fig. S6B, Fisher’s exact test P<10−300).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone givenGPN does not rely on whole-genome alignments, which can often have lower quality in noncoding regions.
“Furthermore, GPN does not rely on whole-genome alignments, which can often have a lower quality in noncoding regions.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataGPN scores are only weakly correlated with phyloP (r=0.22, P<10−300) and phastCons (r=0.13, P<10−300).
“In fact, GPN scores are only weakly correlated with phyloP (r=0.22,P<10−300) and phastCons (r=0.13,P<10−300).”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationGPN is genome-wide, can be trained on genomic sequence alone, and is cell-type and mechanism agnostic.
“Similar to phyloP and phastCons, GPN is genome-wide, can be trained on genomic sequence alone, and is cell-type and mechanism agnostic (46).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [46] P. F. Sullivan, Leveraging base pair mammalian constraint to understand genetic variation and human disease. Science 380, abn293 (2023). PMC10259825 37104612
Not checked in the free run.
May combine two claims.
Findingown dataPerplexity in CDS2 is significantly smaller than that in CDS1, which is significantly smaller than that in CDS3.
“Perplexity in CDS2 is significantly smaller than that in CDS1, which in turn is significantly smaller than that in CDS3 (all Mann–Whitney P-values <10−300), consistent with their different expected levels of constraint (18).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [18] K. S. Pollard, M. J. Hubisz, K. R. Rosenbloom, A. Siepel, Detection of nonneutral substitution rates on mammalian phylogenies. Genome Res. 20, 110– 121 (2010). 19858363 PMC2798823 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe separate model trained on the single genome of A. thaliana obtained a test perplexity of 3.13 (3.17 on nonrepeat regions).
“This model obtained a higher test perplexity of 3.13 (3.17 on nonrepeat regions).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe separate model trained on the single genome of A. thaliana would soon start overfitting.
“as we noticed it would soon start overfitting”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataIn our initial experiments, convolutional models converged faster than transformer models.
“In our initial experiments, we noticed that convolutional models converged faster than transformer models.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenphyloP and phastCons only consider nucleotide frequencies at a specific site, whereas GPN can learn from joint nucleotide distributions across all similar contexts appearing in the genome.
“The key distinction is that while phyloP and phastCons only consider nucleotide frequencies at a specific site, GPN can learn from joint nucleotide distributions across all similar contexts appearing in the genome.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe lower perplexity in nonrepetitive regions upon down-weighting repeats can be attributed to the model allocating fewer parameters exclusively to repetitive elements.
“The lower perplexity in nonrepetitive regions upon down-weighting repeats can be attributed to the model allocating fewer parameters exclusively to repetitive elements.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningGPN can be readily integrated into GWAS fine-mapping and polygenic risk scores.
“Our results lay the foundation for developing state-of-the-art genome-wide variant effect predictors for any species using genomic sequence alone, which can be readily integrated into GWAS fine-mapping and polygenic risk scores.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationThe confusion between intergenic regions and ncRNAs may be partly explained by errors in ncRNA annotation.
“As summarized in Fig. 2B, the highest confusion was observed between intergenic regions and ncRNAs; this may be partly explained by errors in ncRNA annotation, which is especially challenging given their low expression levels and poor conservation (33).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33] Z. Lu, Identification and characterization of novel lncRNAs in Arabidopsis thaliana. Biochem. Biophys. Res. Commun. 488, 348– 354 (2017). 28499866
Not checked in the free run.
May combine two claims.
InterpretationreasoningSince GPN is trained only on DNA sequence, it can be readily applied to understudied nonmodel organisms even in the absence of extensive functional genomics data, while still providing state-of-the-art unsupervised variant effect prediction genome-wide.
“Since GPN is trained only on DNA sequence, it can be readily applied to understudied nonmodel organisms even in the absence of extensive functional genomics data, while still providing state-of-the-art unsupervised variant effect prediction genome-wide.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationLarger models and more extensive training data can enhance performance.
“Mounting evidence suggests that larger models and more extensive training data can enhance performance (48).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [48] J. Kaplan, Scaling laws for neural language models. arXiv [Preprint] (2020). http://arxiv.org/abs/2001.08361 (Accessed 3 July 2023).
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenA. thaliana chromosomes 4 and 5 were held out for validation and testing, respectively.
“We held out A. thaliana chromosomes 4 and 5 for validation and testing, respectively.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe linear complexity of convolution simplifies inference or fine-tuning on longer sequences such as entire chromosomes.
“The linear complexity of convolution also simplifies inference or fine-tuning on longer sequences such as entire chromosomes, which in the case of transformers might require chunking (with some overlap) and aggregating the results.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenVariants with different consequences in different transcripts were excluded, and only variant types with at least 1,000 variants were compared.
“We compared scores for variant types with at least 1,000 variants, and we excluded variants with different consequences in different transcripts.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningWhen comparing to phyloP and phastCons, variants where these scores are undefined were excluded.
“When comparing to phyloP and phastCons, we excluded variants where these scores are undefined (due to the lack of whole-genome alignment).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationConvolutional models have shown similarly good performance as transformer architectures in natural language and protein modeling.
“While language model pretraining successes were first showcased by transformer architectures, convolutional models have shown similarly good performance in natural language (55) and protein modeling (56).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [55] Y. Tay, “Are pretrained convolutions better than pretrained transformers?” in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), C. Zong, F. Xia, W. Li, R. Navigli, Eds. (Association for Computational Linguistics, Online, 2021), pp. 4349–4359.
Not checked in the free run.
- cites [56] K. K. Yang, A. X. Lu, N. Fusi, “Convolutions are competitive with transformers for protein sequence pretraining” in ICLR2022 Machine Learning for Drug Discovery (2022). 38428432
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisereasoningThe 1001 Genomes genotype matrix is binary because all accessions are homozygous, as Arabidopsis is predominantly selfing.
“This genotype matrix is binary, since all the accessions are homozygous, as Arabidopsis is predominantly selfing.”
Quote in the paperNot a substantial claim- Rests on an assumption: Arabidopsis is predominantly selfing.
Probably not a substantial claim: may not pass S4 (based).
Premisenone givenThe association P-value is invariant to recoding of reference and alternate alleles.
“Since the association P-value is invariant to recoding of reference and alternate alleles, we took the absolute value of GPN scores.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenUsing single-nucleotide tokens makes interpretation easier, particularly for unsupervised variant effect prediction.
“While a thorough benchmark of different tokenization strategies is lacking, using single-nucleotide tokens makes interpretation easier, in particular for unsupervised variant effect prediction.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenWindows in each chromosome were predicted by a model trained on the remaining chromosomes.
“Windows in each chromosome were predicted by a model trained on the remaining chromosomes.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Interpretationown dataThe locality of convolutions may be a good inductive bias for modeling DNA sequences at this scale.
“The locality of convolutions may be a good inductive bias for modeling DNA sequences at this scale.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenWindows with ambiguous annotation were excluded from the analysis.
“Windows with ambiguous annotation (e.g., 50% CDS and 50% intron) were excluded from the analysis.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The GPN score, defined as the log-likelihood ratio between the alternate and reference allele, is a valid pathogenicity or functionality score for single-nucleotide polymorphisms.
“GPN can be employed to calculate a pathogenicity or functionality score for any single-nucleotide polymorphism (SNP) in the genome using the log-likelihood ratio between the alternate and reference allele (GPN score, Fig. 1).”
The paper relies on this without support.
Rare variants are more likely to be deleterious or functional than common variants.
“Putative functional SNPs, defined as the lowest 0.1% of GPN scores, exhibit a 5.5-fold enrichment in rare variants (Fig. 5C); see SI Appendix, Fig. S8 for different allele frequency thresholds.”
The paper relies on this without support.
Arabidopsis is predominantly selfing.
“as Arabidopsis is predominantly selfing”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The limited separation of 3′ UTR regions from other elements suggests that the model has not fully learned to distinguish this type of element, or that many of these regions might be mis-annotated.
“The limited separation of 3′ UTR regions from other elements suggests that the model has not fully learned to distinguish this type of element, or as previously suggested, that many of these regions might be mis-annotated37.”
From Nucleotide Transformer: building and evaluating robust foundation models for human genomics (2025) · cites this paper as [37]
The citation is attached to the suggestion that many 3′ UTR regions might be mis-annotated. In Results, “Unsupervised Clustering of Genomic Regions” (page unavailable), the paper suggests annotation errors for ncRNAs, not 3′ UTRs. Searches for 3′ UTR annotation and classification found no passage in our copy addressing that suggestion. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764 · see citing works
The Human Genome Browser at UCSC
Kent, W. J., Sugnet, C. W., Furey, T. S., Roskin, K. M., Pringle, T. H., Zahler, A. M., & Haussler, A. D. (2002) · Genome Research · doi:10.1101/gr.229102 · Cited by 10,400 · see citing works
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826 · see citing works
The Ensembl Variant Effect Predictor
McLaren, W., Gil, L., Hunt, S. E., Riat, H. S., Ritchie, G. R. S., Thormann, A., Flicek, P., & Cunningham, F. (2016) · Genome Biology · doi:10.1186/s13059-016-0974-4 · Cited by 8,099 · see citing works
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101 · see citing works
LD Score regression distinguishes confounding from polygenicity in genome-wide association studies
Schizophrenia Working Group of the Psychiatric Genomics Consortium, Bulik-Sullivan, B. K., Loh, P.-R., Finucane, H. K., Ripke, S., Yang, J., Patterson, N., Daly, M. J., Price, A. L., & Neale, B. M. (2015) · Nature Genetics · doi:10.1038/ng.3211 · Cited by 5,559 · see citing works
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,523 · see citing works
Evolutionarily conserved elements in vertebrate, insect, worm, and yeast genomes
Siepel, A., Bejerano, G., Pedersen, J. S., Hinrichs, A. S., Hou, M., Rosenbloom, K., Clawson, H., Spieth, J., Hillier, L. W., Richards, S., et al. (2005) · Genome Research · doi:10.1101/gr.3715005 · Cited by 4,408 · see citing works
10 Years of GWAS Discovery: Biology, Function, and Translation
Visscher, P. M., Wray, N. R., Zhang, Q., Sklar, P., McCarthy, M. I., Brown, M. A., & Yang, J. (2017) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.06.005 · Cited by 3,719 · see citing works
CADD: predicting the deleteriousness of variants throughout the human genome
Rentzsch, P., Witten, D., Cooper, G. M., Shendure, J., & Kircher, M. (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1016 · Cited by 3,534 · see citing works
Sequence logos: a new way to display consensus sequences
Schneider, T. D., & Stephens, R. M. (1990) · Nucleic Acids Research · doi:10.1093/nar/18.20.6097 · Cited by 3,396 · see citing works
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.03771 · Cited by 3,347 · see citing works
Performance of neural network basecalling tools for Oxford Nanopore sequencing
Wick, R. R., Judd, L. M., & Holt, K. E. (2019) · Genome Biology · doi:10.1186/s13059-019-1727-y · Cited by 3,221 · see citing works
Predicting splicing from primary sequence with deep learning
Jaganathan, K., Kyriazopoulou Panagiotopoulou, S., McRae, J. F., Darbandi, S. F., Knowles, D., Li, Y. I., Kosmicki, J. A., Arbelaez, J., Cui, W., Schwartz, G. B., et al. (2019) · Cell · doi:10.1016/j.cell.2018.12.015 · Cited by 2,853 · see citing works
Detection of nonneutral substitution rates on mammalian phylogenies
Pollard, K. S., Hubisz, M. J., Rosenbloom, K. R., & Siepel, A. (2010) · Genome Research · doi:10.1101/gr.097857.109 · Cited by 2,353 · see citing works
Predicting effects of noncoding variants with deep learning–based sequence model
Zhou, J., & Troyanskaya, O. G. (2015) · Nature Methods · doi:10.1038/nmeth.3547 · Cited by 2,338 · see citing works
Quantifying similarity between motifs
Gupta, S., Stamatoyannopoulos, J. A., Bailey, T. L., & Noble, W. S. (2007) · Genome Biology · doi:10.1186/gb-2007-8-2-r24 · Cited by 2,058 · see citing works
Ancient DNA and the rewriting of human history: be sparing with Occam’s razor
Haber, M., Mezzavilla, M., Xue, Y., & Tyler-Smith, C. (2016) · Genome Biology · doi:10.1186/s13059-015-0866-z · Cited by 1,924 · see citing works
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · Cited by 1,749 · see citing works
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526 · see citing works
RNA virus interference via CRISPR/Cas13a system in plants
Aman, R., Ali, Z., Butt, H., Mahas, A., Aljedaani, F., Khan, M. Z., Ding, S., & Mahfouz, M. (2018) · Genome Biology · doi:10.1186/s13059-017-1381-1 · Cited by 1,497 · see citing works
Ten things you should know about transposable elements
Bourque, G., Burns, K. H., Gehring, M., Gorbunova, V., Seluanov, A., Hammell, M., Imbeault, M., Izsvák, Z., Levin, H. L., Macfarlan, T. S., et al. (2018) · Genome Biology · doi:10.1186/s13059-018-1577-z · Cited by 1,430 · see citing works
Big Bird: Transformers for Longer Sequences
Zaheer, M., Guruganesh, G., Dubey, A., Ainslie, J., Alberti, C., Ontanon, S., Pham, P., Ravula, A., Wang, Q., Yang, L., et al. (2020) · arXiv · doi:10.48550/arxiv.2007.14062 · Cited by 1,349 · see citing works
1,135 Genomes Reveal the Global Pattern of Polymorphism in Arabidopsis thaliana
Alonso‐Blanco, C., Andrade, J., Becker, C., Bemm, F., Bergelson, J. M., Borgwardt, K. M., Cao, J., Chae, E., Dezwaan, T. M., Ding, W., et al. (2016) · Cell · doi:10.1016/j.cell.2016.05.063 · Cited by 1,339 · see citing works
Effective gene expression prediction from sequence by integrating long-range interactions
Avsec, Ž., Agarwal, V., Visentin, D., Ledsam, J. R., Grabska-Barwinska, A., Taylor, K. R., Assael, Y., Jumper, J., Kohli, P., & Kelley, D. R. (2021) · Nature Methods · doi:10.1038/s41592-021-01252-x · Cited by 1,326 · see citing works
Ji, Y., Zhou, Z., Liu, H., & Davuluri, R. V. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab083 · Cited by 1,303 · see citing works
DANN: a deep learning approach for annotating the pathogenicity of genetic variants
Quang, D. X., Chen, Y., & Xie, X. S. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu703 · Cited by 1,073 · see citing works
PlantRegMap: charting functional regulatory maps in plants
Tian, F., Yang, D.-C., Meng, Y.-Q., Jin, J., & Gao, G. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz1020 · Cited by 1,019 · see citing works
Simulation physiologischer Regelkreise mit der objektorientierten Modellbibliothek “HumanLib”
Brunberg, A., Spillner, J. W., Autschbach, R., & Abel, D. (2011) · at - Automatisierungstechnik · doi:10.1524/auto.2011.0951 · Cited by 1,008 · see citing works
Efficiently Modeling Long Sequences with Structured State Spaces
Gu, A., Goel, K., & Ré, C. (2021) · arXiv · doi:10.48550/arxiv.2111.00396 · Cited by 805 · see citing works
Disease variant prediction with deep generative models of evolutionary data
Frazer, J., Notin, P., Dias, M., Gomez, A., Min, J. K., Brock, K., Gal, Y., & Marks, D. S. (2021) · Nature · doi:10.1038/s41586-021-04043-8 · Cited by 791 · see citing works
Language models enable zero-shot prediction of the effects of mutations on protein function
Meier, J., Rao, R., Verkuil, R., Liu, J., Sercu, T., & Rives, A. (2021) · doi:10.1101/2021.07.09.450648 · Cited by 635 · see citing works
Gazal, S., Finucane, H. K., Furlotte, N. A., Loh, P.-R., Palamara, P. F., Liu, X., Schoech, A., Bulik-Sullivan, B., Neale, B. M., Gusev, A., et al. (2017) · Nature Genetics · doi:10.1038/ng.3954 · Cited by 525 · see citing works
Status and prospects of genome‐wide association studies in plants
Tibbs‐Cortes, L. E., Zhang, Z., & Yu, J. (2021) · The Plant Genome · doi:10.1002/tpg2.20077 · Cited by 483 · see citing works
A method to predict the impact of regulatory variants from DNA sequence
Lee, D., Gorkin, D. U., Baker, M., Strober, B. J., Asoni, A. L., McCallion, A. S., & Beer, M. (2015) · Nature Genetics · doi:10.1038/ng.3331 · Cited by 417 · see citing works
A guide for the diagnosis of rare and undiagnosed disease: beyond the exome
Marwaha, S., Knowles, J. W., & Ashley, E. A. (2022) · Genome Medicine · doi:10.1186/s13073-022-01026-w · Cited by 365 · see citing works
Functionally informed fine-mapping and polygenic localization of complex trait heritability
Weissbrod, O., Hormozdiari, F., Benner, C., Cui, R., Ulirsch, J., Gazal, S., Schoech, A. P., van de Geijn, B., Reshef, Y., Márquez-Luna, C., et al. (2020) · Nature Genetics · doi:10.1038/s41588-020-00735-5 · Cited by 364 · see citing works
Rao, R., Liu, J., Verkuil, R., Meier, J., Canny, J. F., Abbeel, P., Sercu, T., & Rives, A. (2021) · doi:10.1101/2021.02.12.430858 · Cited by 350 · see citing works
Predicting 3D genome folding from DNA sequence with Akita
Fudenberg, G., Kelley, D. R., & Pollard, K. S. (2020) · Nature Methods · doi:10.1038/s41592-020-0958-x · Cited by 292 · see citing works
A sequence-based global map of regulatory activity for deciphering human genetics
Chen, K. M., Wong, A. K., Troyanskaya, O. G., & Zhou, J. (2022) · Nature Genetics · doi:10.1038/s41588-022-01102-2 · Cited by 269 · see citing works
MMSplice: modular modeling improves the predictions of genetic variant effects on splicing
Cheng, J., Nguyen, T. Y. D., Cygan, K. J., Çelik, M. H., Fairbrother, W. G., Avsec, Ž., & Gagneur, J. (2019) · Genome Biology · doi:10.1186/s13059-019-1653-z · Cited by 235 · see citing works
Shrikumar, A., Tian, K., Avsec, Ž., Shcherbina, A., Banerjee, A., Sharmin, M., Nair, S., & Kundaje, A. (2018) · arXiv · doi:10.48550/arxiv.1811.00416 · Cited by 229 · see citing works
DNA methylation enables transposable element-driven genome expansion
Zhou, W., Liang, G., Molloy, P. L., & Jones, P. A. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1921719117 · Cited by 181 · see citing works
Convolutions are competitive with transformers for protein sequence pretrainingPreprint
Yang, K. K., Fusi, N., & Lu, A. X. (2024) · bioRxiv · doi:10.1101/2022.05.19.492714 · Cited by 172 · see citing works
The pan-genome and local adaptation of Arabidopsis thaliana
Kang, M., Wu, H., Liu, H., Liu, W., Zhu, M., Han, Y., Liu, W., Chen, C., Song, Y., Tan, L., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-42029-4 · Cited by 139 · see citing works
Self-citationConvolutions are competitive with transformers for protein sequence pretraining
Yang, K. K., Fusi, N., & Lu, A. X. (2024) · Cell Systems · doi:10.1016/j.cels.2024.01.008 · Cited by 137 · see citing works
The Impact of Arabidopsis on Human Health: Diversifying Our Portfolio
Jones, A. M., Chory, J., Dangl, J. L., et al. (2008) · Cell · doi:10.1016/j.cell.2008.05.040 · Cited by 135 · see citing works
Leveraging base-pair mammalian constraint to understand genetic variation and human disease
Sullivan, P. F., Meadows, J. R. S., Gazal, S., Phan, B. N., Li, X., Genereux, D. P., Dong, M. X., Bianchi, M., Andrews, G., Sakthikumar, S., et al. (2023) · Science · doi:10.1126/science.abn2937 · Cited by 110 · see citing works
The AraGWAS Catalog: a curated and standardized Arabidopsis thaliana GWAS catalog
Togninalli, M., Seren, Ü., Meng, D., Fitz, J., Nordborg, M., Weigel, D., Borgwardt, K. M., Korte, A., & Grimm, D. G. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkx954 · Cited by 106 · see citing works
Predicting the impact of non-coding variants on DNA methylation
Zeng, H., & Gifford, D. K. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkx177 · Cited by 98 · see citing works
Open problems in human trait genetics
Brandes, N., Weissbrod, O., & Linial, M. (2022) · Genome biology · doi:10.1186/s13059-022-02697-9 · Cited by 88 · see citing works
Are Pretrained Convolutions Better than Pretrained Transformers?
Tay, Y., Dehghani, M., Gupta, J. P., Aribandi, V., Bahri, D., Qin, Z., & Metzler, D. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.335 · Cited by 87 · see citing works
Detecting genome-wide directional effects of transcription factor binding on polygenic disease risk
Reshef, Y. A., Finucane, H. K., Kelley, D. R., Gusev, A., Kotliar, D., Ulirsch, J. C., Hormozdiari, F., Nasser, J., O’Connor, L., van de Geijn, B., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0196-7 · Cited by 68 · see citing works
Szlachta, K. A., Thys, R. G., Atkin, N. D., Pierce, L., Bekiranov, S., & Wang, Y. (2018) · Genome biology · doi:10.1186/s13059-018-1463-8 · Cited by 65 · see citing works
Togninalli, M., Seren, Ü., Freudenthal, J. A., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz925 · Cited by 62 · see citing works
Hoarfrost, A., Aptekmann, A. A., Farfañuk, G., & Bromberg, Y. (2022) · Nature Communications · doi:10.1038/s41467-022-30070-8 · Cited by 62 · see citing works
Yang, M., Huang, L., Huang, H., Tang, H., Zhang, N., Yang, H., Wu, J., & Mu, F. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac326 · Cited by 53 · see citing works
Identification and characterization of novel lncRNAs in Arabidopsis thaliana
Lu, Z., Xiao, X., Jiang, B., et al. (2017) · Biochemical and Biophysical Research Communications · doi:10.1016/j.bbrc.2017.05.051 · Cited by 43 · see citing works
FORCA, a promoter element that responds to crosstalk between defense and light signaling
Evrard, A., Ndatimana, T., & Eulgem, T. (2009) · BMC Plant Biology · doi:10.1186/1471-2229-9-2 · Cited by 28 · see citing works
ViBE: a hierarchical BERT model to identify eukaryotic viruses using metagenome sequencing data
Gwak, H., & Rho, M. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac204 · Cited by 28 · see citing works
Identification of bacteriophage genome sequences with representation learning
Bai, Z., Zhang, Y., Miyano, S., Yamaguchi, R., Fujimoto, K., Uematsu, S., & Imoto, S. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac509 · Cited by 26 · see citing works
The dynseq browser track shows context-specific features at nucleotide resolution
Nair, S., Barrett, A., Li, D., Raney, B. J., Lee, B. T., Kerpedjiev, P., Ramalingam, V., Pampari, A., Lekschas, F., Wang, T., et al. (2022) · Nature Genetics · doi:10.1038/s41588-022-01194-w · Cited by 5 · see citing works
The pan-genome and local adaptation of Arabidopsis thalianaPreprint
Kang, M., Wu, H., Liu, W., Zhu, M., Han, Y. K., Liu, W. Y., Chen, C., Yin, K., Zhao, Y., Yan, Z., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.18.520013 · Cited by 4 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
Research works printed but not linked: 3
- S. Mo “Multi-modal self-supervised pre-training for large-scale genome data” in NeurIPS 2021 AI for Science Workshop (2021).
- H. Zhou A. Shrikumar A. Kundaje “Towards a better understanding of reverse-complement equivariance for deep learning models in genomics” in Machine Learning in Computational Biology D. A. Knowles S. Mostafavi S.-I. Lee Eds. (PMLR 2022) pp. 1–33.
- E.W. Sayers Genome. NCBI. https://www.ncbi.nlm.nih.gov/data-hub/genome. Accessed 2 June 2023.
Cited by
Sorted by citations
Nucleotide Transformer: building and evaluating robust foundation models for human genomics
Dalla-Torre, H., Gonzalez, L., Mendoza-Revilla, J., Lopez Carranza, N., Grzywaczewski, A. H., Oteri, F., Dallago, C., Trop, E., de Almeida, B. P., Sirelkhatim, H., et al. (2025) · Nature Methods · doi:10.1038/s41592-024-02523-z · Cited by 656 · see citing works
AlphaGenome: advancing regulatory variant effect prediction with a unified DNA sequence model
Avsec, Ž., Latysheva, N., Cheng, J., Novati, G., Taylor, K. R., Ward, T., Bycroft, C., Nicolaisen, L., Arvaniti, E., Pan, J., et al. (2025) · doi:10.1101/2025.06.25.661532 · Cited by 395 · see citing works
Advancing regulatory variant effect prediction with AlphaGenome
Avsec, Ž., Latysheva, N., Cheng, J., Novati, G., Taylor, K. R., Ward, T., Bycroft, C., Nicolaisen, L., Arvaniti, E., Pan, J., et al. (2026) · Nature · doi:10.1038/s41586-025-10014-0 · Cited by 373 · see citing works
Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook.
AlSaad, R., Abd-alrazaq, A., Boughorbel, S., Ahmed, A., Renault, M.-A., Damseh, R., & Sheikh, J. (2024) · Journal of medical Internet research · doi:10.2196/59505 · Cited by 349 · see citing works
GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction
Benegas, G., Albors, C., Aw, A. J., Ye, C., & Song, Y. S. (2023) · doi:10.1101/2023.10.10.561776 · Cited by 118 · see citing works
Self-citationEvaluating the World Model Implicit in a Generative Model
Vafa, K., Chen, J., Rambachan, A., Kleinberg, J., & Mullainathan, S. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-0846 · Cited by 22 · see citing works
Implicit Language Models are RNNs: Balancing Parallelization and Expressivity
Schöne, M., Rahmani, B., Kremer, H., Falck, F., Ballani, H., & Gladrow, J. (2025) · arXiv · doi:10.48550/arxiv.2502.07827
- Authors
- Benegas, G., Batra, S. S., & Song, Y. S.
- Affiliations
- University of California, Berkeley (US)
- Corresponding author
- Song, Yun S.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2023-10-26
- Volume
- 120
- Issue
- 44
- Pages
- e2311219120-e2311219120
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC10622914
- OpenAlex
- W4387966979
- Cited by
- 157
- References
- 65
- Citations by year
- 2026: 52 · 2025: 61 · 2024: 35 · 2023: 8 · 2022: 1
- FWCI
- 13.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- HHS | NIH | National Institute of General Medical Sciences (R35-GM134922)
- Koret Foundation (Koret-UC Berkeley-Tel Aviv University Initiative in Computational Biology and Bioinformatics)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genomics and Rare Diseases
- Keywords
- DNA language models, variant effect prediction, genome-wide association study, causal variant identification, Arabidopsis thaliana, Brassicales, conservation scores, sequence logos
- MeSH terms
- DNA, Genome, Arabidopsis, Genomics, Genome-Wide Association Study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review