The transformative power of transformers in protein structure prediction
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Transformer neural networks have revolutionized structural biology with the ability to predict protein structures at unprecedented high accuracy. Here, we report the predictive modeling performance of the state-of-the-art protein structure prediction methods built on transformers for 69 protein targets from the recently concluded 15th Critical Assessment of Structure Prediction (CASP15) challenge. Our study shows the power of transformers in protein structure modeling and highlights future areas of improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Varadi, M., Anyango, S., Deshpande, M., Nair, S., Natassia, C., Yordanova, G., Yuan, D., Stroe, O., Wood, G., Laydon, A., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1061 · Cited by 7,850
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
How significant is a protein structure similarity with TM-score = 0.5?
Xu, J., & Zhang, Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq066 · Cited by 1,142
Mariani, V., Biasini, M., Barbato, A., & Schwede, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt473 · Cited by 1,138
LGA: a method for finding 3D similarities in protein structures
Zemla, A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg571 · Cited by 1,069
High-resolution de novo structure prediction from primary sequence
Wu, R., Ding, F., Wang, R., Shen, R., Zhang, X., Luo, S., Su, C., Wu, Z., Xie, Q., Berger, B., et al. (2022) · doi:10.1101/2022.07.21.500999 · Cited by 392 · cited 10×
“Two PLM-based meth-ods performed the best with OmegaFold attaining a near-perfect GDT-TS score of 99.48, closely followed by ESMFold (GDT-TS score of 98.44), outperforming the other methods including AlphaFold2.”
InfluentialHigh‐accuracy protein structure prediction in CASP14
Pereira, J., Simpkin, A. J., Hartmann, M. D., Rigden, D. J., Keegan, R. M., & Lupas, A. N. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26171 · Cited by 314 · cited 1×
“AlphaFold2 demonstrated remarkable performance in the 14th edition of the biennial Critical Assessment of Structure Prediction (CASP14) meeting, attaining better predictive modeling accuracy than ever before (2).”
Cited by
Roche, R., Moussad, B., Shuvo, M. H., Tarafder, S., & Bhattacharya, D. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae039 · Cited by 85
Self-citationTransferable deep generative modeling of intrinsically disordered protein conformations
Janson, G., & Feig, M. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1012144 · Cited by 62
Balancing speed and precision in protein folding: a comparison of AlphaFold2, ESMFold, and OmegaFold
Hýsková, A., Maršálková, E., & Šimeček, P. (2026) · Frontiers in Genetics · doi:10.3389/fgene.2025.1715037 · Cited by 16
Tracing unknown tumor origins with a biological-pathway-based transformer model
Xie, J., Chen, Y., Luo, S., Yang, W., Lin, Y., Wang, L., Ding, X., Tong, M., & Yu, R. (2024) · Cell Reports Methods · doi:10.1016/j.crmeth.2024.100797 · Cited by 9
“24 27 The inclusion of the multiheaded attention mechanism in transformer enables the intricate extraction of gene-spe-cific features within the transcriptome, 28 which allows the transformer to effectively analyze gene interdependencies in high-dimensional, sparse biological data.”
To pack or not to pack: revisiting protein side-chain packing in the post-AlphaFold era
Vangaru, S., & Bhattacharya, D. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf297
Self-citation
Metadata
- Authors
- Moussad, B., Roche, R., & Bhattacharya, D.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2023-07-31
- Volume
- 120
- Issue
- 32
- Pages
- e2303499120-e2303499120
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W4385409403
- Cited by
- 35
- References
- 9
- FWCI
- 2.62
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The transformative power of transformers in protein structure prediction. https://app.cochat.ai/papers/10.1073/pnas.2303499120
- The paper
- Moussad, B., Roche, R., & Bhattacharya, D. (2023). The transformative power of transformers in protein structure prediction. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2303499120
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.