PreprintCited by 24Genomics and Rare DiseasesMachine Learning in BioinformaticsGenetic Associations and Epidemiology

Genome-wide prediction of disease variants with a deep protein language model

Open access
Brandes, Nadav, Goldman, Grant, Wang, Charlotte H., Ye, Chun Jimmie, Ntranos, Vasilis·2022·bioRxiv (Cold Spring Harbor Laboratory)

Abstract

Distinguishing between damaging and neutral missense variants is an ongoing challenge in human genetics, with profound implications for clinical diagnosis, genetic studies and protein engineering. Recently, deep-learning models have achieved state-of-the-art performance in classifying variants as pathogenic or benign. However, these models are currently unable to provide predictions over all missense variants, either because of dependency on close protein homologs or due to software limitations. Here we leveraged ESM1b, a 650M-parameter protein language model, to predict the functional impact of human coding variation at scale. To overcome existing technical limitations, we developed a modified ESM1b workflow and functionalized, for the first time, all proteins in the human genome, resulting in predictions for all ∼450M possible missense variant effects. ESM1b was able to distinguish between pathogenic and benign variants across ∼150K variants annotated in ClinVar and HGMD, outperforming existing state-of-the-art methods. ESM1b also exceeded the state of the art at predicting the experimental results of deep mutational scans. We further annotated ∼2M variants across ∼9K alternatively-spliced genes as damaging in certain protein isoforms while neutral in others, demonstrating the importance of considering all isoforms when functionalizing variant effects. The complete catalog of variant effect predictions is available at: https://huggingface.co/spaces/ntranoslab/esm_variants .

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2022.08.25.505311

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 50 · Cited by 24

Research works printed but not linked: 12

  1. Brandes N, Weissbrod O, Linial M (2022) Open problems in human trait genetics. Genome Biol 23:131. https://doi.org/10.1186/s13059-022-02697-9 · DOI
  2. Rehm HL, Fowler DM (2019) Keeping up with the genomes: scaling genomic variant interpretation. Genome Med 12:5. https://doi.org/10.1186/s13073-019-0700-4 · DOI
  3. Finucane HK, Bulik-Sullivan B, Gusev A, et al (2015) Partitioning heritability by functional annotation using genome-wide association summary statistics. Nat Genet 47:1228-1235. https://doi.org/10.1038/ng.3404 · DOI · Paper page
  4. Brandes N, Linial N, Linial M (2021) Genetic association studies of alterations in protein function expose recessive effects on cancer predisposition. Sci Rep 11:14901. https://doi.org/10.1038/s41598-021-94252-y · DOI
  5. Esposito D, Weile J, Shendure J, et al (2019) MaveDB: an open-source platform to distribute and interpret data from multiplexed assays of variant effect. Genome Biol 20:223. https://doi.org/10.1186/s13059-019-1845-6 · DOI
  6. Ursu O, Neal JT, Shea E, et al (2022) Massively parallel phenotyping of coding variants in cancer with Perturb-seq. Nat Biotechnol. https://doi.org/10.1038/s41587-021-01160-7 · DOI · Paper page
  7. Ng PC (2003) SIFT: predicting amino acid changes that affect protein function. Nucleic Acids Res 31:3812-3814. https://doi.org/10.1093/nar/gkg509 · DOI
  8. Elnaggar A, Ding W, Jones L, et al (2021) CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing. ArXiv Prepr ArXiv210402443
  9. Brandes N, Ofer D, Peleg Y, et al (2022) ProteinBERT: a universal deep-learning model of protein sequence and function. Bioinformatics 38:2102-2110. https://doi.org/10.1093/bioinformatics/btac020 · DOI · Paper page
  10. Boutet E, Lieberherr D, Tognolli M, et al (2016) UniProtKB/Swiss-Prot, the manually annotated section of the UniProt KnowledgeBase: how to use the entry view. In: Plant Bioinformatics. Springer, pp 23-54
  11. Meier J, Rao R, Verkuil R, et al (2021) Language models enable zero-shot prediction of the effects of mutations on protein function. bioRxiv 26. Stenson PD, Ball EV, Mort M, et al (2003) Human gene mutation database (HGMD®): 2003 update. Hum Mutat 21:577-581
  12. Nicora G, Zucca S, Limongelli I, et al (2022) A machine learning approach based on ACMG/AMP guidelines for genomic variant classification and prioritization. Sci Rep 12:2517. https://doi.org/10.1038/s41598-022-06547-3 · DOI

Authors
Brandes, N., Goldman, G., Wang, C. H., Ye, C. J., & Ntranos, V.
Affiliations
University of California, San Francisco (US)
Corresponding author
Ntranos, Vasilis
Venue
bioRxiv (Cold Spring Harbor Laboratory)
Publisher
openRxiv
Published
2022-08-26
OpenAlex
W4293530896
Cited by
24
References
50
Citations by year
2025: 3 · 2024: 7 · 2023: 12 · 2022: 2
Type
posted content
Language
en
Open access
Licence
cc-by
Locations
bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
Funders
  • Parker Institute for Cancer Immunotherapy
  • Chan Zuckerberg Initiative
  • Cardiff University
  • National Institutes of Health
  • National Human Genome Research Institute (U01HG012192, R01HG011239)
  • National Institute of Allergy and Infectious Diseases (R01AI136972)
  • National Institute of Arthritis and Musculoskeletal and Skin Diseases (R01AR071522)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genomics and Rare Diseases
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
Keywords
protein language models, deep mutational scanning, protein isoforms, alternative splicing, ClinVar, HGMD, protein engineering

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review