Ultrafast end-to-end protein structure prediction enables high-throughput exploration of uncharacterized proteins
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Significance: We present a deep learning-based predictor of protein tertiary structure that uses only a multiple sequence alignment (MSA) as input. To date, most emphasis has been on the accuracy of such deep learning methods, but here we show that accurate structure prediction is also possible in very short timeframes (a few hundred milliseconds). In our method, the backbone coordinates of the target protein are output directly from the neural network, which makes the predictor extremely fast. As a demonstration, we generated over 1.3 million models of uncharacterized proteins in the BFD, a large sequence database including many metagenomic sequences. Our results showcase the utility of ultrafast and accurate tertiary structure prediction in rapidly exploring the “dark space” of proteins.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Pfam: The protein families database in 2021
Mistry, J., Chuguransky, S., Williams, L., Qureshi, M., Salazar, G. A., Sonnhammer, E. L. L., Tosatto, S. C. E., Paladin, L., Raj, S., Richardson, L. J., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa913 · Cited by 7,452
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
TM-align: a protein structure alignment algorithm based on the TM-score
Zhang, Y. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki524 · Cited by 3,774
Improved protein structure prediction using potentials from deep learning
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1923-7 · Cited by 3,378
Self-citationRives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280
A Method to Identify Protein Sequences That Fold into a Known Three-Dimensional Structure
Bowie, J. U., Lüthy, R., & Eisenberg, D. (1991) · Science · doi:10.1126/science.1853201 · Cited by 2,851
Scoring function for automated assessment of protein structure template quality
Zhang, Y., & Skolnick, J. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20264 · Cited by 2,392
HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
Morcos, F., Pagnani, A., Lunt, B., Bertolino, A., Marks, D. S., Sander, C., Zecchina, R., Onuchic, J. N., Hwa, T., & Weigt, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1111471108 · Cited by 1,434
Improved protein structure prediction using predicted interresidue orientations
Yang, J., Anishchenko, I., Park, H., Peng, Z., Ovchinnikov, S., & Baker, D. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1914677117 · Cited by 1,421
Efficient transformers: A survey
Tay, Y., Dehghani, M., Bahri, D., & Metzler, D. (2023) · ACM Computing Surveys · doi:10.1145/3530811 · Cited by 1,267
Efficient Transformers: A Survey
Tay, Y., Dehghani, M., Bahri, D., & Metzler, D. (2020) · arXiv · doi:10.48550/arxiv.2009.06732 · Cited by 1,267
A new approach to protein fold recognition
Jones, D. T., Taylort, W. R., & Thornton, J. M. (1992) · Nature · doi:10.1038/358086a0 · Cited by 1,221
Self-citationUnified rational protein engineering with sequence-based deep representation learning
Alley, E. C., Khimulya, G., Biswas, S., AlQuraishi, M., & Church, G. M. (2019) · Nature Methods · doi:10.1038/s41592-019-0598-1 · Cited by 1,131
Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Wang, S., Sun, S., Li, Z., Zhang, R., & Xu, J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005324 · Cited by 931 · cited 1×
“The network makes use of just three recurrent networks and a stack of residual convolutional layers, making the predictor very fast to run, and easy to install and use.”
Clustering huge protein sequence sets in linear time
Steinegger, M., & Söding, J. (2018) · Nature Communications · doi:10.1038/s41467-018-04964-5 · Cited by 875
Improved contact prediction in proteins: using pseudolikelihoods to infer Potts models
Ekeberg, M., Lövkvist, C., Lan, Y., Weigt, M., & Aurell, E. (2013) · Physical Review E · doi:10.1103/physreve.87.012707 · Cited by 661
Protein structure determination using metagenome sequence data
Ovchinnikov, S., Park, H., Varghese, N., Huang, P.-S., Pavlopoulos, G. A., Kim, D. E., Kamisetty, H., Kyrpides, N. C., & Baker, D. (2017) · Science · doi:10.1126/science.aah4043 · Cited by 520
CATH: increased structural coverage of functional space
Sillitoe, I., Bordin, N., Dawson, N., Waman, V. P., Ashford, P., Scholes, H. M., Pang, C. S. M., Woodridge, L., Rauer, C., Sen, N., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa1079 · Cited by 509
Protein-level assembly increases protein sequence recovery from metagenomic samples manyfold
Steinegger, M., Mirdita, M., & Söding, J. (2019) · Nature Methods · doi:10.1038/s41592-019-0437-4 · Cited by 445
Distance-based protein folding powered by deep learning
Xu, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821309116 · Cited by 401
End-to-End Differentiable Learning of Protein Structure
AlQuraishi, M. (2019) · Cell Systems · doi:10.1016/j.cels.2019.03.006 · Cited by 371
Learning generative models for protein fold families
Balakrishnan, S., Kamisetty, H., Carbonell, J. G., Lee, S., & Langmead, C. J. (2011) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.22934 · Cited by 316
Greener, J. G., Kandathil, S. M., & Jones, D. T. (2019) · Nature Communications · doi:10.1038/s41467-019-11994-0 · Cited by 178
Self-citationrawMSA: End-to-end Deep Learning using raw Multiple Sequence Alignments
Mirabello, C., & Wallner, B. (2019) · PLOS ONE · doi:10.1371/journal.pone.0220182 · Cited by 105 · cited 1×
“…the original DMPfold paper. protein structure prediction j machine learning j bioinformatics A nalysis of amino acid residue covariation in deep multiple sequence alignments (MSAs) has revealed that covarying residues in proteins are frequently found to be close together in the tertiary structure.”
Li, Y., Zhang, C., Bell, E. W., Yu, D., & Zhang, Y. (2019) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25798 · Cited by 94
Environmental conditions shape the nature of a minimal bacterial genome
Antczak, M., Michaelis, M., & Wass, M. N. (2019) · Nature Communications · doi:10.1038/s41467-019-10837-2 · Cited by 55
CASP13 target classification into tertiary structure prediction categories
Kinch, L. N., Kryshtafovych, A., Monastyrskyy, B., & Grishin, N. V. (2019) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25775 · Cited by 36
Research works printed but not linked: 30
- 10.1002/prot.25779 · DOI · Paper page
- 10.1186/1471-2105-15-6 · DOI · Paper page
- 10.1186/s12859-021-03960-9 · DOI · Paper page
- 10.1038/s41598-020-70181-0 · DOI · Paper page
- S. M. Kandathil J. G. Greener A. M. Lau D. T. Jones Deep learning-based prediction of protein structure using learned representations of multiple sequence alignments. bioRxiv [Preprint] (2020). https://www.biorxiv.org/content/10.1101/2020.11.27.401232v1 (Accessed 20 August 2021). · doi:10.1101/2020.11.27.401232v1
- J. Ingraham, A. J. Riesselman, C. Sander, D. S. Marks, Learning Protein Structure with a Differentiable Simulator (ICLR, 2019).
- 10.1093/bioinformatics/btx239 · DOI · Paper page
- 10.1016/j.jmb.2019.01.047 · DOI · Paper page
- 10.1016/j.crmeth.2021.100014 · DOI · Paper page
- J. G. Greener N. Desai S. M. Kandathil D. T. Jones Near-complete protein structural modelling of the minimal genome. arXiv [Preprint] (2020) https://arxiv.org/abs/2007.06623 (Accessed 3 September 2021). · arXiv
- 10.1093/nar/gki408 · DOI · Paper page
- A. Vaswani Attention is all you need. arXiv [Preprint] (2017) https://arxiv.org/abs/1706.03762 (Accessed 13 November 2020). · arXiv
- A. Elnaggar ProtTrans: Towards cracking the language of life’s code through self-supervised deep learning and high performance computing. arXiv [Preprint] (2020) https://arxiv.org/abs/2007.06225 (Accessed 13 November 2020). · DOI · Paper page
- I. Goodfellow D. Warde-Farley M. Mirza A. Courville Y. Bengio “Maxout networks” in Proceedings of the 30th International Conference on Machine Learning S. Dasgupta D. McAllester Eds. (PMLR 2013) pp. 1319–1327.
- J. Hu L. Shen G. Sun “Squeeze-and-excitation networks” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE 2018) pp. 7132–7141. · DOI · Paper page
- 10.1007/BF02287916 · DOI · Paper page
- 10.1093/protein/7.5.633 · DOI
- A. Paszke , “PyTorch: An imperative style, high-performance deep learning library” in Advances in Neural Information Processing Systems, H. Wallach et al., Eds. (Curran Associates, Inc., 2019), pp. 8026–8037.
- D. P. Kingma J. Ba Adam: a method for stochastic optimization. arXiv [Preprint] (2014) https://arxiv.org/abs/1412.6980 (Accessed 13 November 2020). · arXiv
- 10.1093/bioinformatics/btl158 · DOI · Paper page
- 10.1093/bioinformatics/bty341 · DOI · Paper page
- 10.1093/nar/gkx1069 · DOI · Paper page
- 10.1371/journal.pcbi.1002195 · DOI · Paper page
- 10.1002/bip.360221211 · DOI · Paper page
- 10.1002/pro.3334 · DOI · Paper page
- 10.1093/bioinformatics/bti541 · DOI · Paper page
- 10.1093/bioinformatics/btaa502 · DOI
- 10.1016/0022-2836(89)90084-3 · DOI · Paper page
- C. A. Orengo, W. R. Taylor, “SSAP: Sequential structure alignment program for protein structure comparison” in Methods in Enzymology (Academic Press, 1996), pp. 617–635.
- S. M. Kandathil J. G. Greener A. M. Lau D. T. Jones Protein structures predicted using DMPfold2 plus training data. UCL Research Data Repository. 10.5522/04/14979990. Deposited 26 October 2021. · doi:10.5522/04/14979990
Cited by
Improved prediction of protein-protein interactions using AlphaFold2
Bryant, P., Pozzati, G., & Elofsson, A. (2021) · doi:10.1101/2021.09.15.460468 · Cited by 1,022
Single-sequence protein structure prediction using language models from deep learning
Chowdhury, R., Bouatta, N., Biswas, S., Rochereau, C., Church, G. M., Sorger, P. K., & AlQuraishi, M. (2021) · doi:10.1101/2021.08.02.454840 · Cited by 455
Single-sequence protein structure prediction using a language model and deep learning
Chowdhury, R., Bouatta, N., Biswas, S., Floristean, C., Kharkar, A., Roy, K., Rochereau, C., Ahdritz, G., Zhang, J., Church, G. M., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01432-w · Cited by 455
“We previously described an end-to-end differentiable, ML-based RGN (hereafter RGN1) 22 that predicts protein structure from position-specific scoring matrices (PSSMs) derived from MSAs; related end-to-end approaches have since been reported 23–25 .”
BackgroundAlphaFold2 models indicate that protein sequence determines both structure and dynamics
Guo, H.-B., Perminov, A., Bekele, S., Kedziora, G., Farajollahi, S., Varaljay, V., Hinkle, K., Molinero, V., Meister, K., Hung, C., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-14382-9 · Cited by 248
“It was also established that using MSA alone is sufficient for fast and effective protein structure predictions 34 .”
MethodStructure-based protein design with deep learning
Ovchinnikov, S., & Huang, P.-S. (2021) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2021.08.004 · Cited by 93
Metadata
- Authors
- Kandathil, S. M., Greener, J. G., Lau, A. M., & Jones, D. T.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2022-01-24
- Volume
- 119
- Issue
- 4
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W4210279159
- Cited by
- 38
- References
- 30
- FWCI
- 2.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.