The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index; 9 of the 16 sources its claims cite were checked for support.
Evolutionary-scale prediction of atomic level protein structure with a language model
Open accessAbstract
Artificial intelligence has the potential to open insight into the structure of proteins at the scale of evolution. It has only recently been possible to extend protein structure prediction to two hundred million cataloged proteins. Characterizing the structures of the exponentially growing billions of protein sequences revealed by large scale gene sequencing experiments would necessitate a break-through in the speed of folding. Here we show that direct inference of structure from primary sequence using a large language model enables an order of magnitude speed-up in high resolution structure prediction. Leveraging the insight that language models learn evolutionary patterns across millions of sequences, we train models up to 15B parameters, the largest language model of proteins to date. As the language models are scaled they learn information that enables prediction of the three-dimensional structure of a protein at the resolution of individual atoms. This results in prediction that is up to 60x faster than state-of-the-art while maintaining resolution and accuracy. Building on this, we present the ESM Metage-nomic Atlas. This is the first large-scale structural characterization of metagenomic proteins, with more than 617 million structures. The atlas reveals more than 225 million high confidence predictions, including millions whose structures are novel in comparison with experimentally determined structures, giving an unprecedented view into the vast breadth and diversity of the structures of some of the least understood proteins on earth.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper introduces ESM-2 protein language models up to 15B parameters and ESMFold, an end-to-end single-sequence structure predictor that reaches atomic-resolution accuracy while being up to 60x faster than state-of-the-art pipelines. It uses ESMFold to build the ESM Metagenomic Atlas, folding over 617 million MGnify90 sequences and identifying more than 225 million high-confidence structures, many novel relative to known sequences and structures.
Key findings
- Scaling ESM-2 from 8M to 15B parameters improves language modeling and structural information: validation perplexity falls from 10.45 to 6.37, unsupervised long-range contact precision (LR P@L) rises from 0.16 to 0.54, and structure-module-only LDDT rises from 0.48 to 0.72. The 15B model reaches TM-score 0.71 on CAMEO and 0.54 on CASP14, 0.064 higher than the 150M ESM-2 model on both.
- ESMFold achieves average TM-score 0.83 on CAMEO and 0.68 on CASP14, compared with AlphaFold2 at 0.88 and 0.85 and RosettaFold at 0.82 on CAMEO. On a single NVIDIA V100 GPU, ESMFold predicts a 384-residue protein in 14.2 seconds, 6x faster than a single AlphaFold2 model, with up to ~60x speedup on shorter sequences; MSA search alone can take over 10 minutes.
- The ESM Metagenomic Atlas folds over 617 million MGnify90 sequences in 2 weeks on ~2,000 GPUs, yielding ~365 million good-confidence predictions (mean pLDDT > 0.5 and pTM > 0.5) and ~225 million high-confidence predictions (mean pLDDT > 0.7 and pTM > 0.7). In a 1-million high-confidence sample, 76.8% have <90% sequence identity to UniRef90, 12.6% have no PDB structure with TM-score > 0.5, and 10.4% have both low structural similarity (TM-score ≤ 0.5) and no close sequence homolog (<30% identity).
- Confidence is well calibrated: for high-confidence predictions (pLDDT > 0.7), CAMEO accuracy is comparable to AlphaFold2 (ESMFold LDDT = 0.83, AlphaFold2 LDDT = 0.85); for very high confidence (pLDDT > 0.9), median all-atom RMSD95 is 1.42 Å and backbone RMSD95 is 0.94 Å.
Methods
- ESM-2 is a BERT-style transformer masked language model trained on UniRef50/UniRef90 sequences, scaled from 8M to 15B parameters, with models trained for up to 500K updates (15B for 270K updates) and evaluated on held-out UniRef50 clusters.
- ESMFold adds a 48-block folding head to a frozen 3B-parameter ESM-2, trained on ~25K PDB clusters covering ~325K experimentally determined chains plus ~12M AlphaFold2-predicted structures; evaluation uses temporally held-out CAMEO (194 proteins) and CASP14 (51 targets) test sets.
- Metagenomic analysis folded MGnify90 sequences of length 20–1024, covering 99% of the database, and used Foldseek, MMseqs2, blastp, and UMAP for structural and sequence similarity analyses.
Limitations
- The paper states that ESMFold was not trained on protein complexes, so complex prediction is out of distribution; it also notes that ablating MSAs for AlphaFold and RosettaFold is an artificial single-sequence setting because those models were not explicitly trained for single sequences.
- The paper states that calibration becomes critical as structure prediction scales, and that current models are far from the limit of scale in parameters, sequence data, and compute.
- Evident from the text: this is a bioRxiv preprint not certified by peer review; ESMFold is less accurate than AlphaFold2 overall on CAMEO (0.83 vs 0.88 TM-score) and CASP14 (0.68 vs 0.85), with a larger gap on hard CAMEO targets (0.45 vs 0.62).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
71 Own result · 22 No basis given · 16 Own interpretation · 8 Own method · 5 Sources not found · 4 Supported · 3 Partly supported · 1 Couldn’t confirm · 1 No full text of the sources · accuracy not yet measured
Every source the paper cites for this claim was checked and supports it.
In the paper
“the vast majority (76.8%) of high confidence predictions being separate from UniRef90 (32) by at least 90% sequence identity”
What the sources say
- Supportedcites [32] source
The citation is attached to UniRef90, identifying the reference database used for the citing paper’s comparison. The Introduction describes UniRef90 as clustering sequences at the 90% identity level; the 76.8% figure is the citing paper’s own result, not a result attributed to this source. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Very high confidence predictions in the metagenomic atlas are expected to often be reliable at a resolution sufficient for insight similar to experimentally determined structures, such as into the biochemistry of active sites (61);”
What the sources say
- Partly supportedcites [61] sourceExperimental — accuracy not yet measured
The High-resolution models section says predicted models can meet demanding structural requirements and sometimes support ligand-binding studies; the Medium-resolution models section says predictions can help locate active sites. The paper does not assess predictions in the metagenomic atlas or establish that its very high-confidence predictions are often reliable enough to provide experimentally comparable insight into active-site biochemistry. Page numbers are unavailable in our copy. (LLM, conf=0.85)
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We fold over 617 million sequences from the MGnify90 database (25).”
What the sources say
- Partly supportedcites [25] sourceExperimental — accuracy not yet measured
The 'UPDATES TO THE MGnify PROTEIN DATABASE' section describes MGnify protein sequences clustered at 90% identity, supporting the identification of the database. It reports over 1.1 billion sequences in the full database, but does not give a count of 617 million for the 90%-clustered set. The citing authors' folding of those sequences is their own work, not a finding attributed to this source. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In a comparison with AlphaFold-Multimer (45) on a dataset of 2,978 recent multimeric complexes deposited in the PDB, ESMFold achieves the same qualitative DockQ (39) categorization for 53.2% of chain pairs, despite not being trained on protein complexes (Fig. S6).”
What the sources say
- Supportedcites [45] Richard Evans , Michael O’Neill , Alexander Pritzel , Natasha Antropova , Andrew Senior , Tim Green , Augustin Žídek , Russ Bates , Sam Blackwell , Jason Yim , Olaf Ronneberger , Sebastian Bodenstein , Michal Zielinski , Alex Bridgland , Anna Potapenko , Andrew Cowie , Kathryn Tunyasuvunakool , Rishub Jain , Ellen Clancy , Pushmeet Kohli , John Jumper , and Demis Hassabis . Protein complex prediction with AlphaFold-Multimer, March 2022. URL https://www.biorxiv.org/content/10.1101/2021.10.04.463034v2. Pages: 2021.10.04.463034 Section: New Results. source
The citation identifies AlphaFold-Multimer as the comparator. The Results (p. 5) describe this paper's AlphaFold-Multimer predictions and benchmarks. The 2,978-complex comparison and 53.2% figure are presented as the citing authors' own results, not findings attributed to this source. (LLM, conf=0.92)
- Supportedcites [39] source
Citation (39) is attached to “DockQ” and identifies the quality measure used for the categorization. The Conclusions describe DockQ as a protein–protein docking model quality score that closely recapitulates the four CAPRI quality classes; the citation is not offered as the source of the ESMFold comparison or its 53.2% result. (LLM, conf=0.93)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This training also results in the emergence of structure in the models.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Here we show that direct inference of structure from primary sequence using a large language model enables an order of magnitude speed-up in high resolution structure prediction.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We discover that an atomic resolution structure prediction can be projected from the representations of the ESM-2 language models.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We are able to complete this characterization in 2 weeks on a heterogeneous cluster of 2,000 GPUs”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This results in an improvement in speed of up to 60x on the inference forward pass alone”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The atlas reveals more than 225 million high confidence predictions”
- Also stated in: § Evolutionary-scale prediction of atomic level protein structure with a language model · p. 2 · plain
“High confidence predictions are made for over 225M structures”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Evolutionary-scale prediction of atomic level protein structure with a language model · p. 2 · plain
- It may state two separate claims as one. 32
- Probably not a substantial claim. 27
- The quote only partly states this claim. 1
- Borderline: one of the tests for a substantial claim is unclear. 1
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“This is the first large-scale structural characterization of metagenomic proteins, with more than 617 million structures.”
- Also stated in: § Evolutionary-scale prediction of atomic level protein structure with a language model · p. 2 · plain
“We present the first evolutionary scale structural characterization of a metagenomic resource, folding practically all sequences in MGnify90 (25), over 617M proteins.”
What the sources say
- Could not verifycites [25] sourceExperimental — accuracy not yet measured
The ‘UPDATES TO THE MGnify PROTEIN DATABASE’ section describes more than 1.1 billion protein sequences and their clustering, not predicted structures. Searches for the ESM Metagenomic Atlas, 617 million structures, and protein folding found no passage addressing the claimed structural characterization. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § Evolutionary-scale prediction of atomic level protein structure with a language model · p. 2 · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Our second test set consists of 51 targets from the CASP14 competition (37).”
What the sources say
- Partly supportedcites [37] sourceExperimental — accuracy not yet measured
The Introduction describes CASP14 modeling targets, supporting their use as a source for a test set. It reports 68 tertiary-structure modeling targets, but does not identify the citing authors’ 51-target selection or verify its size. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“MGnify sequence MGYP000936678158 has no significant sequence matches to any entry in UniRef90, nor any significant matches via a jackhmmer (47) reference proteome search, but has a predicted structure conserved across many nucleases (PDB 5YET B, TM-score 0.68; PDB 3HR4 A, TM-score 0.67)”
What the sources say
- Supportedcites [47] source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“During method development (e.g. hyperparameter selection), we used a temporally held out validation set obtained from the Continuous Automated Model EvaluatiOn (CAMEO) server (36) by filtering from August 2021 to January 2022.”
What the sources say
- Supportedcites [36] source
The citation identifies the CAMEO platform from which the citing authors obtained data. The Introduction describes CAMEO’s automated evaluations and says its benchmarking results are publicly available for methods development. The August 2021–January 2022 filtering is the citing authors’ own procedure, not a claim attributed to this 2018 source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The resulting ESM-2 model family significantly outperforms previously state-of-the-art ESM-1b (a ∼ 650 million parameter model) at a comparable number of parameters, and on structure prediction benchmarks it also outperforms other recent protein language models (Table S3).”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At 270K training steps the 8M parameter model has a perplexity of 10.45, and the 15B model reaches a perplexity of 6.37”
plainn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This results in prediction that is up to 60x faster than state-ofthe-art while maintaining resolution and accuracy.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This removes costly aspects of current state-of-the-art structure prediction pipelines, eliminating the need for a multiple sequence alignment, while at the same time greatly simplifying the neural architecture used for inference.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Attention patterns develop in ESM-2 that correspond to tertiary structure (Fig. 1A), and scaling leads to large improvements in the understanding of structure (Fig. 1B).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and ∼ 225 million predictions with high confidence (mean pLDDT > 0 . 7 and pTM > 0 . 7 ) corresponding to ∼ 36% of total structures folded (Fig. 3).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The first test is from CAMEO, consisting of all 194 test proteins from April 01, 2022 through June 25, 2022.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This results in a speed improvement for structure prediction of more than an order of magnitude while maintaining high resolution accuracy.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We were able to complete the predictions in 2 weeks on a cluster of approximately 2,000 GPUs (Appendix A.4.1).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On the CAMEO test set, language model perplexity has a Pearson correlation of -0.55 with the TM-score between the predicted and experimental structures; on CASP14, the correlation is -0.67 (Fig. 2B).”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This results in 25,450 clusters covering a total of 325,498 chains.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ESMFold achieves competitive accuracy with RosettaFold on CAMEO, which averages a TM-score of 0.82.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average long range P@L was 0.4287 with a standard deviation of 0.0028.”
plainn = 20- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“MGnify sequence MGYP004000959047 has no significant UniRef90 or jackhmmer reference proteome matches but its predicted structure has high similarity to experimental structures of lipid binding domains (PDB 6BYM A, TMscore 0.80; PDB 5YQP B, TM-score 0.78)”
plaincorrelationalSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using the search protocols released with AlphaFold2, including MSAs and templates, AlphaFold2 achieves 0.88 and 0.85 on CAMEO and CASP14 respectively.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For Hsu et al. (62) we generated a set of 13,477,259 structure predictions with AlphaFold2 using MSAs generated via the process in Rao et al. (40).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The 15 billion parameter model reaches a TM-score of 0.71 on the CAMEO test set and 0.54 on the CASP14 test set, 0.064 points higher than the 150 million parameter ESM-2 model on both (Fig. 1E).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This characterization reveals the structures of hundreds of millions proteins that have been previously unknown, millions of which are novel in comparison to experimentally determined structures.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ESMFold achieves an average TM-score of 0.83 on CAMEO and 0.68 on CASP14.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“No filtering is performed on these test sets, as ESMFold is able to make predictions on all sequences, including the length-2166 target T1044.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Because of the way the dataset is constructed, only 1.5% of the dataset is removed with this filter.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Language models greatly accelerate state-of-the-art high resolution structure prediction.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
Borderline substantial claim. It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On a single NVIDIA V100 GPU, ESMFold makes a prediction on a protein with 384 residues in 14.2 seconds, 6x faster than a single AlphaFold2 model.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across all models (Table S3) there is a correlation of -0.99 between validation perplexity and CASP14 TM-score, and -1.00 between validation perplexity and CAMEO TM-score”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On the CAMEO test set, ESMFold predictions have a median all-atom RMSD 95 (root-mean-squared deviation at 95% residue coverage) of 1.91 ˚ A and backbone RMSD 95 of 1.33 ˚ A.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For RoseTTAfold, the speed of the SE(3) Transformer dominates, especially at low sequence lengths.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These steps result in a total of 2978 clusters.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At low sequence lengths, ESMFold is dominated by language model performance, while the O ( N 3 ) computation of pairwise representations takes over at high sequence lengths.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Differentiation is greater in the ªmediumº and ªhardº classes, which have lower MSA depth and are better predicted by AlphaFold2.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We see an over 60x speed advantage for shorter protein sequences, and a reasonable speed advantage for longer protein sequences.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which we were able to do in 2 weeks time.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Unsupervised contact prediction results show that both RoPE and newer data significantly improve the results.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We estimate that on a homogeneous network GPU cluster of V100s, the entire 620 million sequences would take approximately 28,000 GPU days to fold”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Language model perplexity and ESMFold pLDDT are both well correlated with actual structure prediction accuracy on CASP14 and CAMEO.”
boostedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After 270K updates the 8M parameter model has a perplexity of 10.45, and the 15B model reaches a perplexity of 6.37.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After filtering, there are 104 sequences with MSA depth ≤ 100 , 70 sequences with MSA depth ≤ 10 , and 22 sequences with MSA depth = 1.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“analyzed the high-confidence subset with mean pLDDT greater than 0.9, corresponding to ∼ 59K structures.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This results in a total of 3505 unique chain pairs.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We do observe a slight regression when sampling from UniRef90 clusters”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“These capabilities develop as a function of scale, with greater capabilities emerging as computation, data, and number of parameters increase.”
What the sources say
- Not matchedcites 19±22
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Not matched
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Within a protein family, structure and function can be inferred from the patterns in sequences (4, 5).”
What the sources say
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This means that improvement on sequences with high evolutionary depth saturates at lower model scales, and improvement on sequences with low evolutionary depth continues as models increase in size.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“language models of text, despite the simplicity of their training objectives, such as filling in missing words or predicting the next word, are shown to develop emergent capabilities that are connected to the underlying meaning of the text.”
What the sources say
- Not matchedcites 19±22
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As the language models are scaled they learn information that enables prediction of the three-dimensional structure of a protein at the resolution of individual atoms.”
- Also stated in: § Evolutionary-scale prediction of atomic level protein structure with a language model · p. 2 · plain
“We discover that atomic resolution structure prediction emerges and continues to improve in language models over the four orders of magnitude in parameter scale.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § Evolutionary-scale prediction of atomic level protein structure with a language model · p. 2 · plain
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“No filtering is performed on these test sets, as ESMFold is able to make predictions on all sequences, including the length-2166 target T1044.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All train sequences which match a validation sequence with 50% sequence identity under this search are removed from the train set.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We report results by testing 3D structure prediction models on two test sets, both chosen to be temporally held out from our supervised training set.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All compared sequences are temporally held out from the training set.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“however we believe this difference is small and the UniRef90 cluster sampling is likely to help for the larger models.”
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The number of SE(3) max-iterations are artificially limited to 20 (default 200) and no MSAs are used as input for these measurements.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, this only measures the network forward time, and does not include the time taken to compute sidechains with PyRosetta or search for MSAs.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“Since BERT style models have been shown to be amenable to very large batch sizes (67), we increased our effective batch size to 2M tokens.”
What the sources say
- Not matchedcites [67] Yang You , Jing Li , Sashank Reddi , Jonathan Hseu , Sanjiv Kumar , Srinadh Bhojanapalli , Xiaodan Song , James Demmel , Kurt Keutzer , and Cho-Jui Hsieh. Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes. page 38, 2020.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“even though ESMFold is not trained on protein complexes.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper relies on this without support.
AlphaFold2 predictions provide a valid reference for assessing the accuracy of ESMFold predictions on metagenomic proteins.
“We also assess calibration against AlphaFold predictions on metagenomic proteins.”
“On a random subset of ∼ 4K metagenomic sequences, there is a high correlation (Pearson r = 0.79) between ESMFold pLDDT and the LDDT to AlphaFold2 predictions (Fig. 3A).”
The paper relies on this without support.
The MGnify90 database is representative of metagenomic protein diversity.
“We fold over 617 million sequences from the MGnify90 database (25).”
The paper relies on this without support.
The PDB database provides a comprehensive reference for experimentally determined protein structures.
“no structure is found with TM-score over 0.5 in the PDB database”
“no experimentally determined structure with a similar fold could be identified”
The paper relies on this without support.
Absolute positional encoding methods don't extrapolate well beyond the context window they are trained on.
“However, absolute positional encoding methods don't extrapolate well beyond the context window they are trained on.”
The paper relies on this without support.
Orphan proteins are very challenging for current structure prediction models due to a lack of evolutionary information.
“Due to a lack of evolutionary information, these sequences can be very challenging for current structure prediction models.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Evo also reaches competitive performance with leading protein-specific language models (41, 46–48) (Fig. 2B).”
From Sequence modeling and design from molecular to genome scale with Evo (2024) · cites this paper as [47]
The cited source says what the claim attributes to it.
In the citing paper
“Such modeling paradigms have been used successfully in the biomolecular realm, for example, to predict three-dimensional (3D) molecular structures from sequences32–34 and interactions between different molecular components.35–38”
From How to build the virtual cell with artificial intelligence: Priorities and opportunities (2024) · cites this paper as [34]
In the citing paper
“are the best and most accurate answer to the structure prediction problem to date”
From The power and pitfalls of AlphaFold2 for structure prediction beyond rigid globular proteins (2024) · cites this paper as [19]
In the citing paper
“The unprecedented accuracy of AlphaFold2,127 RosettaFold,128 and others129,130 offers, at least in principle, the opportunity to virtually screen any protein of interest with the structure-based approach, irrespective of its a priori ligandability (after AlphaFold2, the structural coverage of the human proteome increased from 48% to 76% of the total residues).131”
From Advancing Targeted Protein Degradation via Multiomics Profiling and Artificial Intelligence (2023) · cites this paper as [129]
In the citing paper
“This difficulty is amplified by the fact that the repository of publicly available structures, consisting of the combined databases of AFDB and the ESMatlas38, is approaching a billion entries.”
From Clustering predicted structures at the scale of the known protein universe (2023) · cites this paper as [38]
In the citing paper
“the ESM Atlas contains over 617 million metagenomic structures predicted by ESMFold4.”
From Fast and accurate protein structure search with Foldseek (2024) · cites this paper as [4]
In the citing paper
“Our current proof-of-concept model is considerably smaller—by 200 times—than the largest published protein language model (49).”
From DNA language models are powerful predictors of genome-wide variant effects (2023) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 4. Evolutionary-scale structural characterization of metagenomics · p. 7
“PDB 3HR4 A, TM-score 0.67”
§ Evolutionary-scale prediction of atomic level protein structure with a language model · p. 9
“The predicted structure of MGYP000936678158 aligns to an experimental structure from a bacterial nuclease (light brown, PDB: 3H4R)”
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
A Programmable Dual-RNA–Guided DNA Endonuclease in Adaptive Bacterial Immunity
Jinek, M., Chylinski, K., Fonfara, I., Hauer, M., Doudna, J. A., & Charpentier, E. (2012) · Science · doi:10.1126/science.1225829 · Cited by 17,116
ColabFold - Making protein folding accessible to all
Mirdita, M., Schütze, K., Moriwaki, Y., Heo, L., Ovchinnikov, S., & Steinegger, M. (2021) · doi:10.1101/2021.08.15.456425 · Cited by 9,391
SCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881
Varadi, M., Anyango, S., Deshpande, M., Nair, S., Natassia, C., Yordanova, G., Yuan, D., Stroe, O., Wood, G., Laydon, A., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1061 · Cited by 7,850
Research works printed but not linked: 1
- Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , Łukasz Kaiser , and Illia Polosukhin . Attention Is All You Need. In Advances in Neural Information Processing Systems, pages 5998–6008, 2017. URL https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf.
Cited by
Sorted by citations
Accurate structure prediction of biomolecular interactions with AlphaFold 3
Abramson, J., Adler, J., Dunger, J., Evans, R., Green, T., Pritzel, A., Ronneberger, O., Willmore, L., Ballard, A. J., Bambrick, J., et al. (2024) · Nature · doi:10.1038/s41586-024-07487-w · Cited by 15,861
UCSF ChimeraX : Tools for structure building and analysis
Meng, E. C., Goddard, T. D., Pettersen, E. F., Couch, G. S., Pearson, Z., Morris, J. H., & Ferrin, T. E. (2023) · Protein Science · doi:10.1002/pro.4792 · Cited by 4,706
Fast and accurate protein structure search with Foldseek
van Kempen, M., Kim, S. S., Tumescheit, C., Mirdita, M., Lee, J., Gilchrist, C. L. M., Söding, J., & Steinegger, M. (2022) · doi:10.1101/2022.02.07.479398 · Cited by 2,598
Fast and accurate protein structure search with Foldseek
van Kempen, M., Kim, S. S., Tumescheit, C., Mirdita, M., Lee, J., Gilchrist, C. L. M., Söding, J., & Steinegger, M. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-01773-0 · Cited by 2,596
Watson, J. L., Juergens, D., Bennett, N. R., Trippe, B. L., Yim, J., Eisenach, H. E., Ahern, W., Borst, A. J., Ragotte, R. J., Milles, L. F., et al. (2022) · doi:10.1101/2022.12.09.519842 · Cited by 2,369
De novo design of protein structure and function with RFdiffusion
Watson, J. L., Juergens, D., Bennett, N. R., Trippe, B. L., Yim, J., Eisenach, H. E., Ahern, W., Borst, A. J., Ragotte, R. J., Milles, L. F., et al. (2023) · Nature · doi:10.1038/s41586-023-06415-8 · Cited by 2,325
Varadi, M., Bertoni, D., Magana, P., Paramval, U., Pidruchna, I., Radhakrishnan, M., Tsenkov, M., Nair, S., Mirdita, M., Yeo, J., et al. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkad1011 · Cited by 2,052
“In the wake of the latest breakthroughs in prediction software, new databases such as the AlphaFold Protein Structure Database and the ESM Atlas ( 14 ) have emerged.”
MethodAccurate proteome-wide missense variant effect prediction with AlphaMissense
Cheng, J., Novati, G., Pan, J., Bycroft, C., Žemgulytė, A., Applebaum, T., Pritzel, A., Wong, L. H., Zielinski, M., Sargeant, T., et al. (2023) · Science · doi:10.1126/science.adg7492 · Cited by 2,163
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050
Generalized biomolecular modeling and design with RoseTTAFold All-Atom
Krishna, R., Wang, J., Ahern, W., Sturmfels, P., Venkatesh, P., Kalvet, I., Lee, G. R., Morey-Burrows, F. S., Anishchenko, I., Humphreys, I. R., et al. (2024) · Science · doi:10.1126/science.adl2528 · Cited by 978
The Rise and Potential of Large Language Model Based Agents: A Survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07864 · Cited by 972
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970
Simulating 500 million years of evolution with a language model
Hayes, T., Rao, R., Akin, H., Sofroniew, N. J., Oktay, D., Lin, Z., Verkuil, R., Tran, V. Q., Deaton, J., Wiggert, M., et al. (2025) · Science · doi:10.1126/science.ads0018 · Cited by 937
Self-citationFrom nature to industry: Harnessing enzymes for biocatalysis
Buller, R., Lutz, S., Kazlauskas, R. J., Šnajdrová, R., Moore, J. C., & Bornscheuer, U. T. (2023) · Science · doi:10.1126/science.adh8615 · Cited by 759
Automated model building and protein identification in cryo-EM maps
Jamali, K., Käll, L., Zhang, R., Brown, A., Kimanius, D., & Scheres, S. H. W. (2024) · Nature · doi:10.1038/s41586-024-07215-4 · Cited by 686
Automated model building and protein identification in cryo-EM maps
Jamali, K., Käll, L., Zhang, R., Brown, A., Kimanius, D., & Scheres, S. H. W. (2023) · doi:10.1101/2023.05.16.541002 · Cited by 686
AlphaFold2 and its applications in the fields of biology and medicine
Yang, Z., Zeng, X., Zhao, Y. C., & Chen, R. (2023) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-023-01381-z · Cited by 655
Sequence modeling and design from molecular to genome scale with Evo
Nguyen, E., Poli, M., Durrant, M. G., Kang, B., Katrekar, D., Li, D. B., Bartie, L. J., Thomas, A. W., King, S. H., Brixi, G., et al. (2024) · Science · doi:10.1126/science.ado9336 · Cited by 580
Self-citationProGen2: Exploring the boundaries of protein language models
Nijkamp, E., Ruffolo, J. A., Weinstein, E. N., Naik, N., & Madani, A. (2023) · Cell Systems · doi:10.1016/j.cels.2023.10.002 · Cited by 480
Corso, G., Stark, H., Jegelka, S., Jaakkola, T., & Barzilay, R. (2024) · Nature Reviews Methods Primers · doi:10.1038/s43586-024-00294-7 · Cited by 530
Illuminating protein space with a programmable generative model
Ingraham, J. B., Baranov, M., Costello, Z., Barber, K. W., Wang, W., Ismail, A., Frappier, V., Lord, D. M., Ng-Thow-Hing, C., Van Vlack, E. R., et al. (2023) · Nature · doi:10.1038/s41586-023-06728-8 · Cited by 444
Chai-1: Decoding the molecular interactions of life
Discovery, C., Boitreaud, J., Dent, J., McPartlon, M., Meier, J., Reis, V., Rogozhnikov, A., & Wu, K. (2024) · doi:10.1101/2024.10.10.615955 · Cited by 517
Ahdritz, G., Bouatta, N., Floristean, C., Kadyan, S., Xia, Q., Gerecke, W., O’Donnell, T. J., Berenberg, D., Fisk, I., Zanichelli, N., et al. (2024) · Nature Methods · doi:10.1038/s41592-024-02272-z · Cited by 439
“These include the ESMFold method for protein structure prediction 50 , which replaces MSAs with protein language models 51–53 , and FastFold, a community effort that has implemented substantial improvements including fast model-parallel training and inference 41 .”
Using evolutionary data to make sense of macromolecules with a “face‐lifted” ConSurf
Yariv, B., Yariv, E., Kessel, A., Masrati, G., Chorin, A. B., Martz, E., Mayrose, I., Pupko, T., & Ben‐Tal, N. (2023) · Protein Science · doi:10.1002/pro.4582 · Cited by 425
Terwilliger, T. C., Liebschner, D., Croll, T. I., Williams, C. J., McCoy, A. J., Poon, B. K., Afonine, P. V., Oeffner, R. D., Richardson, J. S., Read, R. J., et al. (2024) · Nature Methods · doi:10.1038/s41592-023-02087-4 · Cited by 411
How to build the virtual cell with artificial intelligence: Priorities and opportunities
Bunne, C., Roohani, Y., Rosen, Y., Gupta, A., Zhang, X., Roed, M., Alexandrov, T., AlQuraishi, M., Brennan, P., Burkhardt, D. B., et al. (2024) · Cell · doi:10.1016/j.cell.2024.11.015 · Cited by 393
Deep Learning in Mechanical Metamaterials: From Prediction and Generation to Inverse Design
Zheng, X., Zhang, X., Chen, T., & Watanabe, I. (2023) · Advanced Materials · doi:10.1002/adma.202302530 · Cited by 407
Clustering predicted structures at the scale of the known protein universe
Barrio-Hernandez, I., Yeo, J., Jänes, J., Mirdita, M., Gilchrist, C. L. M., Wein, T., Varadi, M., Velankar, S., Beltrao, P., & Steinegger, M. (2023) · Nature · doi:10.1038/s41586-023-06510-w · Cited by 362
De novo protein design—From new structures to programmable functions
Kortemme, T. (2024) · Cell · doi:10.1016/j.cell.2023.12.028 · Cited by 383
Burley, S. K., Bhatt, R., Bhikadiya, C., Bi, C., Biester, A., Biswas, P., Bittrich, S., Blaumann, S., Brown, R., Chao, H., et al. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae1091 · Cited by 390
ToxinPred 3.0: An improved method for predicting the toxicity of peptides
Rathore, A. S., Choudhury, S., Arora, A., Tijare, P. A., & Raghava, G. P. S. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108926 · Cited by 365
BepiPred ‐3.0: Improved B‐cell epitope prediction using protein language models
Clifford, J. N., Høie, M. H., Deleuran, S., Peters, B., Nielsen, M., & Marcatili, P. (2022) · Protein Science · doi:10.1002/pro.4497 · Cited by 296
Empowering biomedical discovery with AI agents
Gao, S., Fang, A., Huang, Y., Giunchiglia, V., Noori, A., Schwarz, J. R., Ektefaie, Y., Kondic, J., & Zitnik, M. (2024) · Cell · doi:10.1016/j.cell.2024.09.022 · Cited by 315
Before and after AlphaFold2: An overview of protein structure prediction
Bertoline, L. M. F., Lima, A. N., Krieger, J. E., & Teixeira, S. K. (2023) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2023.1120370 · Cited by 330
Open Problems in Mechanistic Interpretability
Sharkey, L., Chughtai, B., Batson, J., Lindsey, J., Wu, J., Bushnaq, L., Goldowsky-Dill, N., Heimersheim, S., Ortega, A., Bloom, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.16496 · Cited by 291
Atomic context-conditioned protein sequence design using LigandMPNN
Dauparas, J., Lee, G. R., Pecoraro, R. J., An, L., Anishchenko, I. V., Glasscock, C. J., & Baker, D. A. (2025) · Nature Methods · doi:10.1038/s41592-025-02626-1 · Cited by 341
Machine learning for antimicrobial peptide identification and design
Wan, F., Wong, F. J., Collins, J. J., & de la Fuente‐Núñez, C. (2024) · Nature Reviews Bioengineering · doi:10.1038/s44222-024-00152-x · Cited by 317
Machine learning for functional protein design
Notin, P., Rollins, N. J., Gal, Y., Sander, C., & Marks, D. S. (2024) · Nature Biotechnology · doi:10.1038/s41587-024-02127-0 · Cited by 304
Transforming Cardiovascular Care With Artificial Intelligence: From Discovery to Practice
Khera, R., Oikonomou, E. K., Nadkarni, G. N., Morley, J., Wiens, J., Butte, A. J., & Topol, E. J. (2024) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2024.05.003 · Cited by 324
Opportunities and Challenges for Machine Learning-Assisted Enzyme Engineering
Yang, J., Li, F.-Z., & Arnold, F. H. (2024) · ACS Central Science · doi:10.1021/acscentsci.3c01275 · Cited by 268
Bilingual language model for protein sequence and structure
Heinzinger, M., Weissenow, K., Sanchez, J. G., Henkel, A., Mirdita, M., Steinegger, M., & Rost, B. (2024) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqae150 · Cited by 311
Large AI Models in Health Informatics: Applications, Challenges, and the Future
Qiu, J., Li, L., Sun, J., Peng, J., Shi, P., Zhang, R., Dong, Y., Lam, K., Lo, F. P.-W., Xiao, B. J., et al. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3316750 · Cited by 267
Direct prediction of intrinsically disordered protein conformational properties from sequence
Lotthammer, J. M., Ginell, G. M., Griffith, D., Emenecker, R. J., & Holehouse, A. S. (2024) · Nature Methods · doi:10.1038/s41592-023-02159-5 · Cited by 236
DeepLoc 2.1: multi-label membrane protein type prediction using protein language models
Ødum, M. T., Teufel, F., Thumuluri, V., Armenteros, J. J. A., Johansen, A. R., Winther, O., & Nielsen, H. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae237 · Cited by 230
Fine-tuning protein language models boosts predictions across diverse tasks
Schmirler, R., Heinzinger, M., & Rost, B. (2024) · Nature Communications · doi:10.1038/s41467-024-51844-2 · Cited by 229
(2024) · doi:10.1038/s41467-024-45461-2 · Cited by 243
Self-citationGenome modeling and design across all domains of life with Evo 2Preprint
Brixi, G., Durrant, M. G., Ku, J., Poli, M., Brockman, G., Chang, D., Gonzalez, G. A., King, S. B., Li, D. B., Merchant, A. T., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.18.638918 · Cited by 218
Self-citation(2023) · doi:10.1101/2023.12.07.570727 · Cited by 207
RCSB protein Data Bank: exploring protein 3D similarities via comprehensive structural alignments
Bittrich, S., Segura, J., Duarte, J. M., Burley, S. K., & Rose, Y. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae370 · Cited by 212
Rapid in silico directed evolution by a protein language model with EVOLVEpro
Jiang, K., Yan, Z., Bernardo, M. D., Sgrizzi, S. R., Villiger, L., Kayabölen, A., Kim, B., Carscadden, J. K., Hiraizumi, M., Nishimasu, H., et al. (2024) · Science · doi:10.1126/science.adr6006 · Cited by 234
Machine Learning-Guided Protein Engineering
Kouba, P., Kohout, P., Haddadi, F., Bushuiev, A., Samusevich, R., Sedlář, J., Damborský, J., Pluskal, T., Šivic, J., & Mazurenko, S. (2023) · ACS Catalysis · doi:10.1021/acscatal.3c02743 · Cited by 218
Machine learning in preclinical drug discovery
Catacutan, D. B., Alexander, J., Arnold, A., & Stokes, J. M. (2024) · Nature Chemical Biology · doi:10.1038/s41589-024-01679-1 · Cited by 227
The complex polyploid genome architecture of sugarcane
Healey, A. L., Garsmeur, O., Lovell, J. T., Shu, S., Sreedasyam, A., Jenkins, J. W., Plott, C., Piperidis, N., Pompidor, N., Llaca, V., et al. (2024) · Nature · doi:10.1038/s41586-024-07231-4 · Cited by 219
Modeling conformational states of proteins with AlphaFold
Sala, D., Engelberger, F., Mchaourab, H. S., & Meiler, J. (2023) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2023.102645 · Cited by 182
Evaluation of AlphaFold-Multimer prediction on multi-chain protein complexes
Zhu, W., Shenoy, A., Kundrotas, P., & Elofsson, A. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad424 · Cited by 202
High-throughput prediction of protein conformational distributions with subsampled AlphaFold2
Monteiro da Silva, G., Cui, J. Y., Dalgarno, D. C., Lisi, G. P., & Rubenstein, B. M. (2024) · Nature Communications · doi:10.1038/s41467-024-46715-9 · Cited by 196
Wu, Y., & Xie, L. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.12.030 · Cited by 220
Metagenomics: An Effective Approach for Exploring Microbial Diversity and Functions
Nam, N. N., Do, H. D. K., Trinh, K. T. L., & Lee, N. Y. (2023) · Foods · doi:10.3390/foods12112140 · Cited by 213
AlphaFold-Multimer predicts cross-kingdom interactions at the plant-pathogen interface
Homma, F., Huang, J., & van der Hoorn, R. A. L. (2023) · Nature Communications · doi:10.1038/s41467-023-41721-9 · Cited by 176
Han, R., Yoon, H., Kim, G., Lee, H., & Lee, Y. (2023) · Pharmaceuticals · doi:10.3390/ph16091259 · Cited by 198
Computational and artificial intelligence-based methods for antibody development
Kim, J., McFee, M., Fang, Q., Abdin, O., & Kim, P. M. (2023) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2022.12.005 · Cited by 178
Transformers in single-cell omics: a review and new perspectives
Szałata, A., Hrovatin, K., Becker, S., Tejada-Lapuerta, A., Cui, H., Wang, B., & Theis, F. J. (2024) · Nature Methods · doi:10.1038/s41592-024-02353-z · Cited by 189
Wu, H., Liu, J., Jiang, T., Zou, Q., Qi, S., Cui, Z., Tiwari, P., & Ding, Y. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.11.018 · Cited by 190
Artificial intelligence for modelling infectious disease epidemics
Kraemer, M. U. G., Tsui, J. L.-H., Chang, S. Y., Lytras, S., Khurana, M. P., Vanderslott, S., Bajaj, S., Scheidwasser, N., Curran-Sebastian, J. L., Semenova, E., et al. (2025) · Nature · doi:10.1038/s41586-024-08564-w · Cited by 222
IgLM: Infilling language modeling for antibody sequence design
Shuai, R. W., Ruffolo, J. A., & Gray, J. J. (2023) · Cell Systems · doi:10.1016/j.cels.2023.10.001 · Cited by 191
Universal Cell Embeddings: A Foundation Model for Cell BiologyPreprint
Rosen, Y., Roohani, Y., Agrawal, A., Samotorcan, L., Quake, S. R., & Leskovec, J. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.28.568918 · Cited by 165
Easy and accurate protein structure prediction using ColabFold
Kim, G., Lee, S., Karin, E. L., Kim, H., Moriwaki, Y., Ovchinnikov, S., Steinegger, M., & Mirdita, M. (2024) · Nature Protocols · doi:10.1038/s41596-024-01060-5 · Cited by 170
State-specific protein–ligand complex structure prediction with a multiscale deep generative model
Qiao, Z., Nie, W., Vahdat, A., Miller, T. F., & Anandkumar, A. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00792-z · Cited by 210
Navigating the landscape of enzyme design: from molecular simulations to machine learning
Zhou, J., & Huang, M. (2024) · Chemical Society Reviews · doi:10.1039/d4cs00196f · Cited by 168
Efficient and accurate prediction of protein structure using RoseTTAFold2Preprint
Baek, M., Anishchenko, I. V., Humphreys, I. R., Cong, Q., Baker, D. A., & DiMaio, F. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.05.24.542179 · Cited by 170
DNA language models are powerful predictors of genome-wide variant effects
Benegas, G., Batra, S. S., & Song, Y. S. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2311219120 · Cited by 157
Uncovering new families and folds in the natural protein universe
Durairaj, J., Waterhouse, A. M., Mets, T., Brodiazhenko, T., Abdullah, M., Studer, G., Tauriello, G., Akdel, M., Andreeva, A. E., Bateman, A. G., et al. (2023) · Nature · doi:10.1038/s41586-023-06622-3 · Cited by 159
Bioinformatics approaches to discovering food-derived bioactive peptides: Reviews and perspectives
Du, Z., Comer, J. R., & Li, Y. (2023) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2023.117051 · Cited by 164
The power and pitfalls of AlphaFold2 for structure prediction beyond rigid globular proteins
Agarwal, V., & McShan, A. C. (2024) · Nature Chemical Biology · doi:10.1038/s41589-024-01638-w · Cited by 155
Artificial Intelligence for Surface‐Enhanced Raman Spectroscopy
Bi, X., Lin, L. L., Chen, Z., & Ye, J. (2023) · Small Methods · doi:10.1002/smtd.202301243 · Cited by 154
Guiding questions to avoid data leakage in biological machine learning applications
Bernett, J., Blumenthal, D. B., Grimm, D. G., Haselbeck, F., Joeres, R., Kalinina, O. V., & List, M. (2024) · Nature Methods · doi:10.1038/s41592-024-02362-y · Cited by 184
The Virtual Lab of AI agents designs new SARS-CoV-2 nanobodies
Swanson, K., Wu, W., Bulaong, N. L., Pak, J. E., & Zou, J. (2025) · Nature · doi:10.1038/s41586-025-09442-9 · Cited by 169
Gaborieau, B., Vaysset, H., Tesson, F., Charachon, I., Dib, N., Bernier, J., Dequidt, T., Georjon, H., Clermont, O., Hersen, P., et al. (2024) · Nature Microbiology · doi:10.1038/s41564-024-01832-5 · Cited by 141
Using artificial intelligence to document the hidden RNA virosphere
Hou, X., He, Y., Fang, P., Mei, S.-Q., Xu, Z., Wu, W.-C., Tian, J.-H., Zhang, S., Zeng, Z.-Y., Gou, Q.-Y., et al. (2024) · Cell · doi:10.1016/j.cell.2024.09.027 · Cited by 162
Protein remote homology detection and structural alignment using deep learning
Hamamsy, T., Morton, J. T., Blackwell, R., Berenberg, D., Carriero, N. J., Gligorijević, V., Strauss, C. E. M., Leman, J. K., Cho, K., & Bonneau, R. (2023) · Nature Biotechnology · doi:10.1038/s41587-023-01917-2 · Cited by 157
Unsupervised evolution of protein and antibody complexes with a structure-informed language model
Shanker, V. R., Bruun, T. U. J., Hie, B., & Kim, P. S. (2024) · Science · doi:10.1126/science.adk8946 · Cited by 174
Self-citationPhyre2.2: A Community Resource for Template-based Protein Structure Prediction
Powell, H. R., Islam, S. A., David, A., & Sternberg, M. J. E. (2025) · Journal of Molecular Biology · doi:10.1016/j.jmb.2025.168960 · Cited by 172
DiscoTope-3.0: improved B-cell epitope prediction using inverse folding latent representations
Høie, M. H., Gade, F. S., Johansen, J. M., Würtzen, C., Winther, O., Nielsen, M., & Marcatili, P. (2024) · Frontiers in Immunology · doi:10.3389/fimmu.2024.1322712 · Cited by 151
Active learning-assisted directed evolution
Yang, J., Lal, R., Bowden, J. C., Astudillo, R., Hameedi, M. A., Kaur, S., Hill, M., Yue, Y., & Arnold, F. H. (2025) · Nature Communications · doi:10.1038/s41467-025-55987-8 · Cited by 144
The structure assessment web server: for proteins, complexes and more
Waterhouse, A. M., Studer, G., Robin, X., Bienert, S., Tauriello, G., & Schwede, T. F. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae270 · Cited by 146
Du, Z., Ding, X., Xu, Y., & Li, Y. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad135 · Cited by 137
Zheng, W. H., Wuyun, Q., Li, Y., Zhang, C., Freddolino, L., & Zhang, Y. (2024) · Nature Methods · doi:10.1038/s41592-023-02130-4 · Cited by 138
Protenix - Advancing Structure Prediction Through a Comprehensive AlphaFold3 ReproductionPreprint
ByteDance AML AI4Science Team, Chen, X., Zhang, Y., Lu, C., Ma, W., Guan, J., Gong, C., Yang, J., Zhang, H., Zhang, K., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.08.631967 · Cited by 167
RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks
Penić, R. J., Vlašić, T., Huber, R. G., Wan, Y., & Šikić, M. (2025) · Nature Communications · doi:10.1038/s41467-025-60872-5 · Cited by 169
Rosen, Y., Brbić, M., Roohani, Y., Swanson, K., Li, Z., & Leskovec, J. (2024) · Nature Methods · doi:10.1038/s41592-024-02191-z · Cited by 144
Current trends, limitations and future research in the fungi?
Hyde, K. D., Baldrián, P., Chen, Y., Chethana, K. W. T., de Hoog, S., Doilom, M., de Farias, A. R. G., Gonçalves, M. F. M., Gonkhom, D., Gui, H., et al. (2024) · Fungal Diversity · doi:10.1007/s13225-023-00532-5 · Cited by 144
Protein language models learn evolutionary statistics of interacting sequence motifs
Zhang, Z., Wayment-Steele, H. K., Brixi, G., Wang, H., Kern, D., & Ovchinnikov, S. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2406285121 · Cited by 140
Xu, J., Li, F., Li, C., Guo, X., Landersdorfer, C. B., Shen, H., Peleg, A. Y., Li, J., Imoto, S., Yao, J., et al. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad240 · Cited by 129
Protein function prediction as approximate semantic entailment
Kulmanov, M., Guzmán-Vega, F. J., Duek Roggli, P., Lane, L., Arold, S. T., & Hoehndorf, R. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00795-w · Cited by 131
Towards multimodal foundation models in molecular cell biology
Cui, H., Tejada-Lapuerta, A., Brbić, M., Sáez-Rodríguez, J., Cristea, S., Goodarzi, H., Lotfollahi, M., Theis, F. J., & Wang, B. (2025) · Nature · doi:10.1038/s41586-025-08710-y · Cited by 151
Transformer models in biomedicine
Madan, S., Lentzen, M., Brandt, J., Rueckert, D., Hofmann‐Apitius, M., & Fröhlich, H. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02600-5 · Cited by 146
Multistate and functional protein design using RoseTTAFold sequence space diffusion
Lisanza, S. L., Gershon, J. M., Tipps, S. W. K., Sims, J. N., Arnoldt, L., Hendel, S. J., Simma, M. K., Liu, G., Yase, M., Wu, H., et al. (2024) · Nature Biotechnology · doi:10.1038/s41587-024-02395-w · Cited by 189
GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics
Zvyagin, M., Brace, A., Hippe, K., Deng, Y., Zhang, B., Bohorquez, C. O., Clyde, A., Kale, B., Perez-Rivera, D., Ma, H., et al. (2023) · The International Journal of High Performance Computing Applications · doi:10.1177/10943420231201154 · Cited by 120
Metadata
- Authors
- Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., dos Santos Costa, A., Fazel-Zarandi, M., Sercu, T., Candido, S., & Rives, A.
- Affiliations
- New York University (US)
- Stanford University (US)
- Corresponding author
- Rives, Alexander
- ORCID
- Venue
- Science
- Publisher
- openRxiv
- Published
- 2022-07-21
- Volume
- 379
- Issue
- 6637
- Pages
- 1123-1130
- ISSN
- 0036-8075 (ISSN-L)
- OpenAlex
- W4327550249
- Cited by
- 5,990
- References
- 71
- Citations by year
- 2026: 2468 · 2025: 1837 · 2024: 1170 · 2023: 485 · 2022: 23
- FWCI
- 460.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Science (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (submittedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Keywords
- protein structure prediction, large language models, protein evolution, atomic-scale structure, protein folding, structural diversity
- MeSH terms
- Machine Learning, Amino Acid Sequence, Protein Conformation, Proteins, Evolution, Molecular, Sequence Analysis, Protein
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
