A Deep SE(3)-Equivariant Model for Learning Inverse Protein Folding
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
In this work, we establish a framework to tackle the inverse protein design problem; the task of predicting a protein’s primary sequence given its backbone conformation. To this end, we develop a generative SE(3)-equivariant model which significantly improves upon existing autoregressive methods. Conditioned on backbone structure, and trained with our novel partial masking scheme and side-chain conformation loss, we achieve state-of-the-art native sequence recovery on structurally independent CASP13, CASP14, CATH4.2, and TS50 test sets. On top of accurately recovering native sequences, we demonstrate that our model captures functional aspects of the underlying protein by accurately predicting the effects of point mutations through testing on Deep Mutational Scanning datasets. We further verify the efficacy of our approach by comparing with recently proposed inverse protein folding methods and by rigorous ablation studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
TM-align: a protein structure alignment algorithm based on the TM-score
Zhang, Y. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki524 · Cited by 3,774
SchNet – A deep learning architecture for molecules and materials
Schütt, K. T., Sauceda, H. E., Kindermans, P.-J., Tkatchenko, A., & Müller, K.-R. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5019779 · Cited by 2,217 · cited 2×
“In terms of structural modelling, the recent advent of rotation-invariant (Schütt et al. 2018; Andrearczyk et al. 2020) and rotation-equivariant architectures (Thomas et al.”
BackgroundThe Rosetta All-Atom Energy Function for Macromolecular Modeling and Design
Alford, R. F., Leaver-Fay, A., Jeliazkov, J. R., O’Meara, M. J., DiMaio, F. P., Park, H., Shapovalov, M. V., Renfrew, P. D., Mulligan, V. K., Kappel, K., et al. (2017) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.7b00125 · Cited by 1,532
InterPro in 2019: improving coverage, classification and access to protein sequence annotations
Mitchell, A. L., Attwood, T. K., Babbitt, P. C., Blum, M., Bork, P., Bridge, A., Brown, S. D., Chang, H.-Y., El-Gebali, S., Fraser, M. I., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1100 · Cited by 1,426
Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
Thomas, N., Smidt, T., Kearnes, S., Yang, L., Li, L., Kohlhoff, K., & Riley, P. (2018) · arXiv · doi:10.48550/arxiv.1802.08219 · Cited by 1,303 · cited 1×
“…structural modelling, the recent advent of rotation-invariant (Schütt et al. 2018; Andrearczyk et al. 2020) and rotation-equivariant architectures (Thomas et al. 2018; Fuchs et al. 2020; Satorras et al. 2021; Jing et al. 2021; Weiler et al. 2018) for learning from 3D-coordinates has helped…”
BackgroundUnified rational protein engineering with sequence-based deep representation learning
Alley, E. C., Khimulya, G., Biswas, S., AlQuraishi, M., & Church, G. M. (2019) · Nature Methods · doi:10.1038/s41592-019-0598-1 · Cited by 1,131 · cited 1×
“Moreover, our model outperforms protein language models TAPE (Rao et al. 2019) UniRep (Alley et al. 2019) trained on large sequence databases across 12 DMS datasets in zero-shot protein mutation effect prediction regardless of sequence evolutionary information as shown in Figure 3(A).”
MethodMutation effects predicted from sequence co-variation
Hopf, T. A., Ingraham, J. B., Poelwijk, F. J., Schärfe, C. P. I., Springer, M., Sander, C., & Marks, D. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3769 · Cited by 775 · cited 3×
“…the most successful existing methods for protein mutation effect prediction rely on sequence and evolutionary information (Meier et al. 2021; Hopf et al. 2017; Riesselman et al. 2018), we hypothesized that a generative model, conditioned solely on structure and partial sequence, could be…”
MethodEvaluating Protein Transfer Learning with TAPE
Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, X., Canny, J., Abbeel, P., & Song, Y. S. (2019) · doi:10.1101/676825 · Cited by 719 · cited 1×
“Moreover, our model outperforms protein language models TAPE (Rao et al. 2019) UniRep (Alley et al. 2019) trained on large sequence databases across 12 DMS datasets in zero-shot protein mutation effect prediction regardless of sequence evolutionary information as shown in Figure 3(A).”
Method
Research works printed but not linked: 41
- 2013, Predicting functional effect of human missense mutations using PolyPhen-2, In: Current protocols in human genetics, 76, 7
- 2020, Local rotation invariance in 3D CNNs, In: Medical Image Analysis, 65, 101756
- 2010, PyRosetta: a script-based interface for implementing molecular modeling algorithms using Rosetta, In: Bioinformatics, 26, 689
- 2020, To Improve Protein Sequence Profile Prediction through Image Captioning on Pairwise Residue Distance Map, In: Journal of Chemical Information and Modeling, 60, 391
- 2017, Computational protein design: a review, In: Journal of Physics: Condensed Matter, 29, 143001, 10.1088/1361-648X/aa5c76 · DOI · Paper page
- 2017, CATH: an expanded resource to predict protein function through structure and sequence, In: Nucleic acids research, 45, D289
- 2021, Protein Design with Deep Learning, In: Int J Mol Sci, 22, 136
- 2020, In: Advances in Neural Information Processing Systems. Ed. by, 33, 1970
- 2021, Structure-based protein function prediction using graph convolutional networks, In: Nature communications, 12, 1
- 2019, EvoEF2: accurate and fast energy function for computational protein design, In: Bioinformatics, 36, 1135
- 2020, FASPR: an open-source tool for fast and accurate protein side-chain packing, In: Bioinformatics, 36, 3758
- Ingraham, John , Vikas Garg , Regina Barzilay , and Tommi Jaakkola (2019). “Generative Models for Graph-Based Protein Design”. In: Advances in Neural Information Processing Systems. Ed. by H. Wallach et al. Vol. 32. Curran Associates, Inc.
- 2018, A Parametric Rosetta Energy Function Analysis with LK Peptides on SAM Surfaces, In: Langmuir, 34, 5279
- Jin, Wengong , Jeremy Wohlwend , Regina Barzilay , and Tommi S. Jaakkola (2022). “Iterative Refinement Graph Neural Network for Antibody Sequence-Structure Co-design”. In: International Conference on Learning Representations.
- Kingma, Diederik P. and Jimmy Ba (2015). “Adam: A Method for Stochastic Optimization”. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings. Ed. by Yoshua Bengio and Yann LeCun.
- Lai, Boqiao and Jinbo Xu (2022). “Accurate protein function prediction via graph attention networks with predicted structure information”. In: Briefings in Bioinformatics 23.1, bbab502. · DOI · Paper page
- 2020, Macromolecular modeling and design in Rosetta: recent methods and frameworks, In: Nat Methods, 17, 665
- 2022, De Novo Peptide and Protein Design Using Generative Adversarial Networks: An Update, In: Journal of Chemical Information and Modeling, 62, 761
- Lucas, JE. and T. Kortemme (Oct. 2020). “New Computational Protein Design Methods for De Novo Small Molecule Binding Sites”. In: PLoS Comput Biol 16.10. · DOI
- McPartlon, Matthew and Jinbo Xu (2022). “AttnPacker: An end-to-end deep learning method for rotamer-free protein side-chain packing”. In: bioRxiv. · DOI
- Meier, Joshua et al. (2021). “Language models enable zero-shot prediction of the effects of mutations on protein function”. In: Advances in Neural Information Processing Systems 34. · DOI · Paper page
- 2021, Fast and sensitive taxonomic assignment to metagenomic contigs, In: Bioinformatics, 37, 3029
- 2003, SIFT: Predicting amino acid changes that affect protein function, In: Nucleic acids research, 31, 3812
- 2018, SPIN2: Predicting sequence profiles from protein structures using deep neural networks, In: Proteins, 86, 629
- 2021, Recent advances in de novo protein design: Principles, methods, and applications, In: Journal of Biological Chemistry, 296, 100558
- 10.1021/acs.jctc.6b00819 · DOI · Paper page
- 2020, DenseCPD: Improving the Accuracy of Neural-Network-Based Computational Protein Sequence Design with DenseNet, In: Journal of Chemical Information and Modeling, 60, 1245
- Satorras, Victor Garcia , Emiel Hoogeboom , and Max Welling (2021). “E(n) Equivariant Graph Neural Networks”. In: CoRR abs/2102.09844. · arXiv
- Shroff, Raghav et al. (2019). A structure-based deep learning framework for protein engineering. · DOI
- 2010, Computational design of an enzyme catalyst for a stereoselective bimolecular Diels-Alder reaction, In: Science, 329, 309
- 2020, Fast and Flexible Protein Design Using Deep Graph Neural Networks, In: Cell Systems, 11, 402
- 2022, Deep generative modeling for protein design, In: Current Opinion in Structural Biology, 72, 226
- 2013, Computational design of ligand-binding proteins with high affinity and selectivity, In: Nature, 501, 212
- Wang, Jue et al. (2021). “Deep learning methods for designing proteins scaffolding functional sites”. In: bioRxiv. · DOI · Paper page
- 2004, Development and testing of a general amber force field, In: Journal of computational chemistry, 25, 1157
- Weiler, Maurice , Mario Geiger , Max Welling , Wouter Boomsma , and Taco Cohen (2018). “3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data”. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. NIPS’18. Montréal, Canada: Curran Associates Inc., pp. 10402–10413.
- Xiong, Peng et al. (2014). “Protein design with a comprehensive statistical energy function and boosted by experimental selection for foldability.” In: Nature communications 5, p. 5330. · DOI
- 2020, Improved protein structure prediction using predicted interresidue orientations, In: Proceedings of the National Academy of Sciences, 117, 1496
- 2004, Accurate and efficient loop selections by the DFIRE-based all-atom statistical potential, In: Protein Sci, 13, 391
- 2019, ProDCoNN: Protein design using a convolutional neural network, In: Proteins: Structure, 88, 819
- 2020, A general-purpose protein design framework based on mining sequence-structure relationships in known protein structures, In: Proceedings of the National Academy of Sciences, 117, 1059
Cited by
Ahdritz, G., Bouatta, N., Floristean, C., Kadyan, S., Xia, Q., Gerecke, W., O’Donnell, T. J., Berenberg, D., Fisk, I., Zanichelli, N., et al. (2024) · Nature Methods · doi:10.1038/s41592-024-02272-z · Cited by 439
Computational and artificial intelligence-based methods for antibody development
Kim, J., McFee, M., Fang, Q., Abdin, O., & Kim, P. M. (2023) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2022.12.005 · Cited by 178
Convolutions are competitive with transformers for protein sequence pretraining
Yang, K. K., Fusi, N., & Lu, A. X. (2024) · Cell Systems · doi:10.1016/j.cels.2024.01.008 · Cited by 137
From sequence to function through structure: Deep learning for protein design
(2022) · doi:10.1016/j.csbj.2022.11.014 · Cited by 124
Masked inverse folding with sequence transfer for protein representation learning
(2022) · doi:10.1093/protein/gzad015 · Cited by 110
Metadata
- Authors
- McPartlon, M., Lai, B., & Xu, J.
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2022-04-16
- OpenAlex
- W4224066120
- Cited by
- 17
- References
- 18
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Deep SE(3)-Equivariant Model for Learning Inverse Protein Folding. https://app.cochat.ai/papers/10.1101/2022.04.15.488492
- The paper
- McPartlon, M., Lai, B., & Xu, J. (2022). A Deep SE(3)-Equivariant Model for Learning Inverse Protein Folding. bioRxiv (Cold Spring Harbor Laboratory). https://doi.org/10.1101/2022.04.15.488492
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.