The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
End-to-End Differentiable Learning of Protein Structure
Open accessPublished version of a preprint
Abstract
Predicting protein structure from sequence is a central challenge of biochemistry. Co-evolution methods show promise, but an explicit sequence-to-structure map remains elusive. Advances in deep learning that replace complex, human-designed pipelines with differentiable models optimized end to end suggest the potential benefits of similarly reformulating structure prediction. Here, we introduce an end-to-end differentiable model for protein structure learning. The model couples local and global protein structure via geometric units that optimize global geometry without violating local covalent chemistry. We test our model using two challenging tasks: predicting novel folds without co-evolutionary data and predicting known folds without structural templates. In the first task, the model achieves state-of-the-art accuracy, and in the second, it comes within 1-2 Å; competing methods using co-evolution and experimental templates have been refined over many years, and it is likely that the differentiable approach has substantial room for further improvement, with applications ranging from drug discovery to protein design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“significant work has been done in the opposite direction of machine learning-based structure prediction methods that explicitly incorporate constraints on protein geometries 3,5,26,87-89.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [87]
In the citing paper
“The process of end-to-end differentiable coordinate generation for protein structures, where atomic coordinates are produced as a direct output of a neural network, was first demonstrated in the Recurrent Geometric Network (18)”
From Ultrafast end-to-end protein structure prediction enables high-throughput exploration of uncharacterised proteins (2020) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
TensorFlow: A system for large-scale machine learningPreprint
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.5555/3026877.3026899 · Cited by 16,548
(2016) · Cited by 11,679
The protein data bank: A computer-based archival file for macromolecular structures
Bernstein, F. C., Koetzle, T. F., Williams, G. J. B., Meyer, E. F., Brice, M. D., Rodgers, J. R., Kennard, O., Shimanouchi, T., & Tasumi, M. (1977) · Journal of Molecular Biology · doi:10.1016/s0022-2836(77)80200-3 · Cited by 8,574
The I-TASSER Suite: protein structure and function prediction
Yang, J., Yan, R., Roy, A., Xu, D., Poisson, J., & Zhang, Y. (2015) · Nature Methods · doi:10.1038/nmeth.3213 · Cited by 5,596
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Dominant forces in protein folding
Dill, K. A. (1990) · Biochemistry · doi:10.1021/bi00483a001 · Cited by 3,829
Stereochemistry of polypeptide chain configurations
Ramachandran, G. N., Ramakrishnan, C., & Sasisekharan, V. (1963) · Journal of Molecular Biology · doi:10.1016/s0022-2836(63)80023-6 · Cited by 3,651
Learning Important Features Through Propagating Activation Differences
Shrikumar, A., Greenside, P., & Kundaje, A. (2017) · arXiv · doi:10.48550/arxiv.1704.02685 · Cited by 2,761
Introduction to Protein Structure
Brändén, C.-I., & Tooze, J. (2012) · Garland Science eBooks · doi:10.1201/9781136969898 · Cited by 2,398
Scoring function for automated assessment of protein structure template quality
Zhang, Y., & Skolnick, J. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20264 · Cited by 2,392
Leaver-Fay (2011) · doi:10.1016/b978-0-12-381270-4.00019-6 · Cited by 1,904
The Protein-Folding Problem, 50 Years On
Dill, K. A., & MacCallum, J. L. (2012) · Science · doi:10.1126/science.1219021 · Cited by 1,699
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Protein 3D Structure Computed from Evolutionary Sequence Variation
Marks, D. S., Colwell, L. J., Sheridan, R., Hopf, T. A., Pagnani, A., Zecchina, R., & Sander, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028766 · Cited by 1,144
How significant is a protein structure similarity with TM-score = 0.5?
Xu, J., & Zhang, Y. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq066 · Cited by 1,142
Introduction to Protein Structure
Banaszak, L. J. (2000) · Elsevier eBooks · doi:10.1016/b978-012077700-6/50001-8 · Cited by 1,063
Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Wang, S., Sun, S., Li, Z., Zhang, R., & Xu, J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005324 · Cited by 931
Xu, D. H., & Zhang, Y. (2012) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24065 · Cited by 876
Mutation effects predicted from sequence co-variation
Hopf, T. A., Ingraham, J. B., Poelwijk, F. J., Schärfe, C. P. I., Springer, M., Sander, C., & Marks, D. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3769 · Cited by 775
Bernstein, F. C., Koetzle, T. F., Williams, G. J. B., Meyer, E. F., Brice, M. D., RODGERS, J. R., Kennard, O., Shimanouchi, T., & Tasumi, M. (1977) · European Journal of Biochemistry · doi:10.1111/j.1432-1033.1977.tb11885.x · Cited by 763
Emerging methods in protein co-evolution
de Juan, D., Pazos, F., & Valencia, A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3414 · Cited by 607
Understanding intermediate layers using linear classifier probes
Alain, G., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1610.01644 · Cited by 581
A large‐scale experiment to assess protein structure prediction methods
Moult, J., Pedersen, J. T., Judson, R., & Fidelis, K. (1995) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.340230303 · Cited by 555
Protein structure determination using metagenome sequence data
Ovchinnikov, S., Park, H., Varghese, N., Huang, P.-S., Pavlopoulos, G. A., Kim, D. E., Kamisetty, H., Kyrpides, N. C., & Baker, D. (2017) · Science · doi:10.1126/science.aah4043 · Cited by 520
Sequence co-evolution gives 3D contacts and structures of protein complexes
Hopf, T. A., Schärfe, C. P. I., Rodrigues, J. P. G. L. M., Green, A. G., Kohlbacher, O., Sander, C., Bonvin, A. M. J. J., & Marks, D. S. (2014) · eLife · doi:10.7554/elife.03430 · Cited by 515
Ab Initio Molecular Dynamics: Basic Theory and Advanced Methods
Truhlar, D. G. (2010) · Physics Today · doi:10.1063/1.3366243 · Cited by 395
CATH: an expanded resource to predict protein function through structure and sequence
Dawson, N. L., Lewis, T. E., Das, S., Lees, J., Lee, D., Ashford, P., Orengo, C. A., & Sillitoe, I. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw1098 · Cited by 381
The Natural History of Protein Domains
Ponting, C. P., & Russell, R. R. (2002) · Annual Review of Biophysics and Biomolecular Structure · doi:10.1146/annurev.biophys.31.082901.134314 · Cited by 338
Critical assessment of methods of protein structure prediction (CASP)—Round XII
Moult, J., Fidelis, K. A., Kryshtafovych, A., Schwede, T. F., & Tramontano, A. L. (2017) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25415 · Cited by 325
Nguyen, A. M., Yosinski, J., & Clune, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03616 · Cited by 324
Singh, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7475259 · Cited by 262
A vocabulary of ancient peptides at the origin of folded proteins
Alva, V., Söding, J., & Lupas, A. N. (2015) · eLife · doi:10.7554/elife.09410 · Cited by 235
Assessment of contact predictions in CASP12: Co‐evolution and deep learning coming of age
Schaarschmidt, J., Monastyrskyy, B., Kryshtafovych, A., & Bonvin, A. M. J. J. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25407 · Cited by 177
ProteinNet: a standardized data set for machine learning of protein structure
AlQuraishi, M. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2932-0 · Cited by 147
Self-citationLyons, J., Dehzangi, A., Heffernan, R., Sharma, A. K., Paliwal, K. K., Sattar, A., Zhou, Y., & Yang, Y. (2014) · Journal of Computational Chemistry · doi:10.1002/jcc.23718 · Cited by 145
CONFOLD: Residue-residue contact-guidedab initioprotein folding
Adhikari, B., Bhattacharya, D., Cao, R., & Cheng, J. J. (2015) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24829 · Cited by 143
Enhancing Evolutionary Couplings with Deep Convolutional Neural Networks
Liu, Y., Palmedo, P., Ye, Q., Berger, B., & Peng, J. (2018) · Cell Systems · doi:10.1016/j.cels.2017.11.014 · Cited by 114
Ovchinnikov, S., Kim, D. E., Wang, R. Y., Liu, Y., DiMaio, F., & Baker, D. A. (2015) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24974 · Cited by 111
Practical conversion from torsion space to Cartesian space for in silico protein synthesis
Parsons, J., Holmes, J. B., Rojas, J. M., Tsai, J. W., & Strauss, C. E. M. (2005) · Journal of Computational Chemistry · doi:10.1002/jcc.20237 · Cited by 97
Zhang, C., Mortuza, S. M., He, B., Wang, Y., & Zhang, Y. (2017) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25414 · Cited by 93
Blind protein structure prediction using accelerated free-energy simulations
Pérez, A., Morrone, J. A., Brini, E., MacCallum, J. L., & Dill, K. A. (2016) · Science Advances · doi:10.1126/sciadv.1601274 · Cited by 67
Evaluation of the template‐based modeling in CASP12
Kryshtafovych, A., Monastyrskyy, B., Fidelis, K. A., Moult, J., Schwede, T. F., & Tramontano, A. L. (2017) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25425 · Cited by 67
Deep learning methods for protein torsion angle prediction
Li, H., Hou, J., Adhikari, B., Lyu, Q., & Cheng, J. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1834-2 · Cited by 60
Trends in template/fragment-free protein structure prediction
Zhou, Y., Duan, Y., Yang, Y., Faraggi, E., & Lei, H. (2010) · Theoretical Chemistry Accounts · doi:10.1007/s00214-010-0799-2 · Cited by 53
Gao, Y., Wang, S., Deng, M., & Xu, J. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2065-x · Cited by 52
Multiscale Approaches to Protein Modeling
Koliński, A. (2010) · Springer eBooks · doi:10.1007/978-1-4419-6889-0 · Cited by 43
CASP 11 statistics and the prediction center evaluation system
Kryshtafovych, A., Monastyrskyy, B., & Fidelis, K. A. (2016) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25005 · Cited by 43
Fragment-free approach to protein folding using conditional neural fields
Zhao, F., Peng, J., & Xu, J. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq193 · Cited by 38
Empirical limits for template‐based protein structure prediction: the CASP5 example
Contreras‐Moreira, B., Ezkurdia, I., Tress, M. L., & Valencia, A. (2005) · FEBS Letters · doi:10.1016/j.febslet.2005.01.014 · Cited by 21
AlQuraishi, M. (2019) · Journal of Computational Chemistry · doi:10.1002/jcc.25772 · Cited by 19
Self-citationBiological and functional relevance of CASP predictions
Liu, T., Ish‐Shalom, S., Torng, W., Lafita, A., Bock, C., Mort, M. E., Cooper, D. N., Bliven, S. E., Capitani, G., Mooney, S. D., et al. (2017) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25396 · Cited by 11
Gajda, M. J., Pawlowski, M., & Bujnicki, J. M. (2010) · Springer eBooks · doi:10.1007/978-1-4419-6889-0_10 · Cited by 5
Gao, Y., Wang, S., Deng, M., & Xu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07244 · Cited by 5
ProteinNet: a standardized data set for machine learning of protein structurePreprint
AlQuraishi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00249 · Cited by 2
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- Aydin, Z., Thompson, J., Bilmes, J., Baker, D., and Noble, W.S. (2012). Protein torsion angle class prediction by a hybrid architecture of Bayesian and neural networks. In 13th International Conference on Bioinformatics and Computational Biology, pp 2012–2018.
Cited by
Sorted by citations
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
Elnaggar, A., Heinzinger, M., Dallago, C., Rehawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., Steinegger, M., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3095381 · Cited by 2,329
Opportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
Metadata
- Authors
- AlQuraishi, M.
- Affiliations
- Harvard University (US)
- Corresponding author
- AlQuraishi, Mohammed
- ORCID
- AlQuraishi, Mohammed
- Venue
- Cell Systems
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 8
- Issue
- 4
- Pages
- 292-301.e3
- ISSN
- 2405-4712 (ISSN-L)
- PMC
- PMC6513320
- OpenAlex
- W2952317511
- Cited by
- 371
- References
- 55
- Citations by year
- 2026: 15 · 2025: 20 · 2024: 33 · 2023: 49 · 2022: 58 · 2021: 87 · 2020: 61 · 2019: 41
- FWCI
- 20.43
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Cell Systems (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- NVIDIA
- NIGMS (P50GM107618)
- NCI (U54-CA225088)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Keywords
- protein structure prediction, differentiable models, coevolution, protein design
- MeSH terms
- Machine Learning, Software, Protein Folding, Evolution, Molecular, Sequence Analysis, Protein
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review