The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Single-sequence protein structure prediction using a language model and deep learning
Open accessPublished version of a preprint
Abstract
AlphaFold2 and related computational systems predict protein structure using deep learning and co-evolutionary relationships encoded in multiple sequence alignments (MSAs). Despite high prediction accuracy achieved by these systems, challenges remain in (1) prediction of orphan and rapidly evolving proteins for which an MSA cannot be generated; (2) rapid exploration of designed structures; and (3) understanding the rules governing spontaneous polypeptide folding in solution. Here we report development of an end-to-end differentiable recurrent geometric network (RGN) that uses a protein language model (AminoBERT) to learn latent structural information from unaligned proteins. A linked geometric module compactly represents C α backbone geometry in a translationally and rotationally invariant way. On average, RGN2 outperforms AlphaFold2 and RoseTTAFold on orphan proteins and classes of designed proteins while achieving up to a 10 6-fold reduction in compute time. These findings demonstrate the practical and theoretical strengths of protein language models relative to MSAs in structure prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“predict protein structure [8]”
From Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis (2025) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation
Hess, B., Kutzner, C., van der Spoel, D., & Lindahl, E. R. (2008) · Journal of Chemical Theory and Computation · doi:10.1021/ct700301q · Cited by 15,830
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“…potentially billions of protein sequences are increasingly available 26,35,36 , and the scaling previously observed in natural language applications 47 makes it likely that the performance of RGN2 and similar methods will continue to improve and become broadly performative over intrinsically…”
BackgroundAccurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Automatic atom type and bond type perception in molecular mechanical calculations
Wang, J., Wang, W., Kollman, P. A., & Case, D. A. (2006) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2005.12.005 · Cited by 5,517
Improved protein structure prediction using potentials from deep learning
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1923-7 · Cited by 3,378
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280 · cited 3×
“Language models were first developed as a means to extract semantic information from a sequence of words (a key requirement for natural language processing) 26 .”
BackgroundMethod
Research works printed but not linked: 2
- Ingraham, J., Riesselman, A., Sander, C. & Marks, D. Learning protein structure with a differentiable simulator. in 7th International Conference on Learning Representations. https://openreview.net/forum?id=Byg3y3C9Km (2019).
- Li, J. Universal transforming geometric network. Preprint at https://arxiv.org/abs/1908.00723 (2019). · arXiv
Cited by
Sorted by citations
Items 401–457 of 457
Mitra, U., & Singh, A. K. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-2089-7_18
Protein sequence prediction research using machine learning algorithm
Yao, Y. (2024) · International Conference on Inventive Computing and Informatics (ICICI) · doi:10.1109/icici62254.2024.00060
Algorithms for Structure Comparison and Analysis: Prediction of Structures of Proteins
D’Arminio, N., Giordano, D., Facchiano, A. M., & Marabotti, A. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00114-7
Finding Second-Generation Pharmacochaperones: Getting Help From Computational Methods
Verdino, A., Scafuri, B., Parrone, D., D’Arminio, N., Pascarella, S., Via, A., & Marabotti, A. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00202-5
Growth-promoting microorganisms for alpine grassland restoration
Li, C., & Yao, T. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-21882-8.00013-5
Advances in Computational Pipelines and Workflows in Bioinformatics
Chandra, A. A., López, Y., Dehzangi, A., Shatabda, S., Sattar, A., Kamola, P. J., Sharma, R., Shigemizu, D., Tsunoda, T., & Sharma, A. K. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00283-9
An Antigen Design Method Based on Molecular Dynamics and Deep Learning
Li, H., & Zhou, S. (2024) · IEEE International Conference on Medical Artificial Intelligence (MedAI) · doi:10.1109/medai62885.2024.00084
Big data and machine learning in endophytic drug discovery: Accelerating innovations
Kumari, S., Jain, A., Kaur, G., & Jain, S. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-31484-1.00022-0
Zhang, C., Condon, A., & Duc, K. D. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.02.641021
Boosting Protein-Protein Interaction Detection with AlphaFold Multimer and TransformersPreprint
Connesson, L., Krouk, G., & Dumortier, B. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.05.641631
Transformers: A Graph Processing Perspective
Routhu, M. S. S. S., Yanduru, S. D., Tomczak, N., & Kuppannagari, S. R. (2024) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec62836.2024.10938487
Suryamol, K. S., Mathew, L. S., & Subhash, N. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.04.062
Integrating reduced amino acid with language models for prediction of protein thermostability
Yan, Q., & Ding, Y. (2025) · Food Bioscience · doi:10.1016/j.fbio.2025.106934
Efficient and Diverse De Novo Protein Backbone Design with SE(3)-Equivariant Diffusion
Zhou, R., Yang, M., Li, Y., Zheng, X. S., Liew, A. W., Pan, S., & Guo, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8180-8_32
Data-Driven Method for Structural State Prediction and Health Assessment of Transmission Towers
Xu, H., Wang, C., Huang, H., & Chen, Y. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-7999-7_31
MFF-HPO: Protein–Phenotype Associations Prediction Based on Sequence Using Multi-Feature Fusion
Bi, X., Ji, Z., Zhang, L., Yu, G., Gao, Z., & Zhao, K. (2025) · Journal of Computational Biology · doi:10.1089/cmb.2024.0883
ClusterEmbed: Efficient Protein Structure Prediction with Clustering and Embeddings
Mu, B. (2025) · BIO Web of Conferences · doi:10.1051/bioconf/202518202013
Wang, X., Zhang, T., Cui, Z., Guo, X., Wang, F., Wang, Y., Cai, X., & Zheng, W. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.03.662909
A Review of Transformers in Medical Research and Health Care
Lin, C.-H., & Kuo, C. (2025) · Hand Clinics · doi:10.1016/j.hcl.2025.08.007
Computational Methods for Protein–Protein Interactions
Li, H., Li, Y., & Huang, S. (2025) · Wiley eBooks · doi:10.1002/9783527845828.ch7
Deep learning in protein structure prediction
Wu, J. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-332908-1.00023-4
An integrated framework to accelerate protein design through mutagenesis
Qiu, Y. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01118-3
Sculpting the future: harnessing artificial intelligence for revolutionary drug discovery
Lavecchia, A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-33885-4.00003-2
Kumar, P., & Deepak, A. (2025) · Computer Methods in Biomechanics & Biomedical Engineering · doi:10.1080/10255842.2025.2572417
Zhao, S., Gu, Y., Liu, L., & Ding, Y. (2025) · Current Bioinformatics · doi:10.2174/0115748936394443250911224648
Inferring Local Protein Structural Similarity from Sequence Alone
Ma, Z., Herrera, J. E., Buitrago-Delgado, E., Bethel, N. P., & Jinich, A. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c00114
Additional file 1 of Freeprotmap: waiting-free prediction method for protein distance map
Huang, J., Li, J., Chen, Q., Wang, X., Chen, G., & Tang, J. (2024) · Figshare · doi:10.6084/m9.figshare.25751413
MolX: A Geometric Foundation Model for Protein-Ligand ModellingPreprint
Liu, J., Pan, T., Guo, X., Ran, Z., Hao, Y., Yang, Y., Ng, A. P., Pan, S., Song, J., & Li, F. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.26.708362 · Cited by 1
PRIMED: predicting DNA binding residues by leveraging pre-trained protein language models
Zhang, L., Li, X., Song, R., Song, Q., & Fan, X. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1763313
The role of Natural Language Processing with Machine Learning
Aparna, E., Mounika, K., Kumar, B. H., Suneel, L., Prasad, J. B., & Khan, M. S. (2025) · International Conference on Recent Trends in Electrical, Electronics and Computing Technologies (ICRTEECT) · doi:10.1109/icrteect67512.2025.11448649
Wang, X., Zhang, T., Cui, Z., Guo, X., Wang, F., Wang, Y., Cai, X., & Zheng, W. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01210-2
Behbahani, Y. M. (2022) · theses.fr (ABES) · doi:10.70675/bfdded7czb638z455azaedaz4ae9f8d0a13d
Structural prediction of protein assemblies with deep learning
Bret, H. (2023) · theses.fr (ABES) · doi:10.70675/b3849091zce01z4ab0z91efz2b71d9cc754d
Yener, B. O., Göl, Ş., Kutlu, B., & Öztürk, Ö. (2026) · Journal of Bioinformatics and Computational Biology · doi:10.1142/s0219720026510029
LID-Drug: A Localized Interactive Domain-Aggregated (LID) Framework for Protein Drug Editing
Liu, M., Lou, Y., Luo, S., Yu, Y., Ren, S., & Bai, Y. D. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7078-2_12
Protein Design Enters the Artificial Intelligence Era: Foundations, Tools, and Emerging Paradigms
Mi, Y., Shukla, A., Tangney, M., Tabirca, S., & Yallapragada, V. V. B. (2026) · Computational and Structural Biotechnology Journal · doi:10.34133/csbj.0105
Tiwari, A., Raj, R., & Khurana, M. (2026) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2026.109076
Simple baselines rival protein language models in dense combinatorial protein landscapesPreprint
Talpir, I., & Fleishman, S. J. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.01.722313 · Cited by 2
From prediction to discovery: AI as an observatory of physical organization in protein space
Zheng, Y., Zhang, Z., Wang, Y., Kang, W., Ren, W., & Tang, Q.-Y. (2026) · AI for Science · doi:10.1088/3050-287x/ae78ea
Paco, K., Mendivil, M. P., Zhang, Z., Zebardast, S., Davila, C., Mooney, R. F., Olatoyinbo, P. O., Yang, T., Bassi, S., Gonzales, V., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9710622/v1
DeepSSInter : Protein–protein contact prediction with a structure‐aware protein language model
Huang, D., Lv, J., Yao, X., Lin, P., & Huang, S. (2026) · Protein Science · doi:10.1002/pro.70667
Efficient Protein Structure Modelling and Analysis Using Graph Neural Networks
Desai, S., MutalikDesai, V., Jaya, A., Patil, A. M., Harlapur, O., Hungund, B. S., & Desai, S. S. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.253
(2026) · Nature Computational Science · doi:10.1038/s43588-026-01031-8
PathFold: Predicting the Entire Protein Folding Pathway from Protein Sequence AlonePreprint
Zhang, Z., Ibtehaz, N., Kagaya, Y., Xu, Z., Punuru, P., & Kihara, D. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.08.26.747321
Chemical Language Model Applications in Medicinal Chemistry
Mishra, G., & Dixit, V. A. (2026) · Royal Society of Chemistry eBooks · doi:10.1039/9781837070206-00543
Protein Secondary Structure Prediction Based on Ensemble Learning and Bayesian Optimization
Chen, X., Jun, L., & Liu, J. (2026) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase70763.2026.11619372
Potential of inclusion bodies for disease control in aquaculture and livestock
López, D. V., Gallardo, J. A., & Torrealba, D. (2026) · Veterinary and Animal Science · doi:10.1016/j.vas.2026.100820
Zhang, J., Wu, Z., Su, J., Zhang, X., Li, Y., Li, Z., & Li, C. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag450
Self-citationKim, S. J., Lim, S., & Yang, C. (2026) · Biomedicine & Pharmacotherapy · doi:10.1016/j.biopha.2026.119932
Deep learning for protein folding
Lahiri, T., & Mondal, R. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-40338-5.00015-9
A structure-aware generative AI framework for revealing functional relationships in protein families
Shukla, D., Martin, J., Morcos, F., & Potoyan, D. A. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2536965123
Interpretable Protein-Nucleic Acid Binding Site Prediction via Domain-Guided Multimodal Learning.
Xi, W.-Y., Wang, R.-H., Ye, X.-C., Sakurai, T., & Wei, L.-Y. (2026) · ACS Synthetic Biology · doi:10.1021/acssynbio.6c00340
Challenges in AI-based structural modeling of host–pathogen protein interactions
Gilep, K., & Kosiński, J. (2026) · Current Opinion in Virology · doi:10.1016/j.coviro.2026.101587
Ho, N. H. E., Yang, C., Ng, I., & Chang, J. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c01844
Metadata
- Authors
- Chowdhury, R., Bouatta, N., Biswas, S., Floristean, C., Kharkar, A., Roy, K., Rochereau, C., Ahdritz, G., Zhang, J., Church, G. M., Sorger, P. K., & AlQuraishi, M.
- Affiliations
- Harvard University (US)
- Columbia University (US)
- Corresponding author
- Bouatta, Nazim
- Sorger, Peter K.
- AlQuraishi, Mohammed
- ORCID
- Venue
- Nature Biotechnology
- Published
- 2022-10-03
- Volume
- 40
- Issue
- 11
- Pages
- 1617-1623
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC10440047
- OpenAlex
- W4300861364
- Cited by
- 455
- References
- 56
- Citations by year
- 2026: 49 · 2025: 103 · 2024: 135 · 2023: 124 · 2022: 37
- FWCI
- 32.66
- Type
- journal article
- Language
- en
- Update notices
- correction (2022-10-17)
- Open access
- green
- doi.org
- Licence
- Locations
- Nature Biotechnology (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Nvidia
- Defense Advanced Research Projects Agency (HR0011, HR0011-19-2-0022)
- National Cancer Institute (U54CA225088)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Keywords
- protein structure prediction, protein language models, orphan proteins, protein design, computational efficiency
- MeSH terms
- Deep Learning, Language, Protein Conformation, Proteins, Sequence Alignment, Computational Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
