Protein Design with Deep Learning
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Computational Protein Design (CPD) has produced impressive results for engineering new proteins, resulting in a wide variety of applications. In the past few years, various efforts have aimed at replacing or improving existing design methods using Deep Learning technology to leverage the amount of publicly available protein data. Deep Learning (DL) is a very powerful tool to extract patterns from raw data, provided that data are formatted as mathematical objects and the architecture processing them is well suited to the targeted problem. In the case of protein data, specific representations are needed for both the amino acid sequence and the protein structure in order to capture respectively 1D and 3D information. As no consensus has been reached about the most suitable representations, this review describes the representations used so far, discusses their strengths and weaknesses, and details their associated DL architecture for design and related tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
UniProt: the universal protein knowledgebase in 2021
The UniProt Consortium, Bateman, A., Martin, M.-J., Orchard, S., Magrane, M., Agivetova, R., Ahmad, S., Alpi, E., Bowler-Barnett, E. H., Britto, R., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa1100 · Cited by 6,372 · cited 1×
“…structure-based approaches, training data-sets can be extremely large: more than two-billion sequences have been clustered in the “Big Fantastic Database” [8]—a tiny fraction of them being associated with a reliable functional label (80,000 with Molecular Function Gene Ontology in SwissProt [76]).”
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549 · cited 3×
“Currently, top methods [8,26] can sometimes reach atomic accuracy on single chains, and can even deal with multimers [27].”
Protein complex prediction with AlphaFold-Multimer
Evans, R., O’Neill, M., Pritzel, A., Antropova, N., Senior, A., Green, T., Žídek, A., Bates, R., Blackwell, S., Yim, J., et al. (2021) · doi:10.1101/2021.10.04.463034 · Cited by 3,808 · cited 1×
“Currently, top methods [8,26] can sometimes reach atomic accuracy on single chains, and can even deal with multimers [27].”
Improved protein structure prediction using potentials from deep learning
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1923-7 · Cited by 3,378
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Research works printed but not linked: 68
- Hallen, 2019, Protein Design by Provable Algorithms, Commun. ACM, 62, 76, 10.1145/3338124 · doi:10.1145/3338124
- Teets, 2021, Toward complete rational control over protein structure and function through computational design, Curr. Opin. Struct. Biol., 66, 170, 10.1016/j.sbi.2020.10.015 · DOI
- Noguchi, 2019, Computational design of symmetrical eight-bladed β-propeller proteins, IUCrJ, 6, 46, 10.1107/S205225251801480X · DOI
- Hornik, 1989, Multilayer feedforward networks are universal approximators, Neural Netw., 2, 359, 10.1016/0893-6080(89)90020-8 · DOI · Paper page
- Frappier, 2021, Data-driven computational protein design, Curr. Opin. Struct. Biol., 69, 63, 10.1016/j.sbi.2021.03.009 · DOI
- Bouchiba, 2021, Molecular flexibility in computational protein design: An algorithmic perspective, Protein Eng. Des. Sel., 34, gzab011, 10.1093/protein/gzab011 · DOI
- Leman, 2020, Macromolecular modeling and design in Rosetta: Recent methods and frameworks, Nat. Methods, 17, 665, 10.1038/s41592-020-0848-2 · DOI · Paper page
- Pierce, 2002, Protein Design is NP-hard, Protein Eng. Des. Sel., 15, 779, 10.1093/protein/15.10.779 · DOI · Paper page
- Kuhlman, 2000, Native protein sequences are close to optimal for their structures, Proc. Natl. Acad. Sci. USA, 97, 10383, 10.1073/pnas.97.19.10383 · DOI · Paper page
- Hallen, 2018, OSPREY 3.0: Open-source protein redesign for you, with powerful new features, J. Comput. Chem., 39, 2494, 10.1002/jcc.25522 · DOI · Paper page
- Allouche, 2013, A new framework for computational protein design through cost function network optimization, Bioinformatics, 29, 2129, 10.1093/bioinformatics/btt374 · DOI
- Simoncini, 2015, Guaranteed discrete energy optimization on large protein design problems, J. Chem. Theory Comput., 11, 5980, 10.1021/acs.jctc.5b00594 · DOI
- Xu, 2019, Analysis of distance-based protein structure prediction by deep learning in CASP13, Proteins Struct. Funct. Bioinform., 87, 1069, 10.1002/prot.25810 · DOI · Paper page
- Anishchenko, I., Baek, M., Park, H., Hiranuma, N., Kim, D.E., Dauparas, J., Mansoor, S., Humphreys, I.R., and Baker, D. (2021). Protein tertiary structure prediction and refinement using deep learning and Rosetta in CASP14. Proteins Struct. Funct. Bioinform. · DOI · Paper page
- Zheng, W., Li, Y., Zhang, C., Zhou, X., Pearce, R., Bell, E.W., Huang, X., and Zhang, Y. (2021). Protein structure prediction using deep learning distance and hydrogen-bonding restraints in CASP14. Proteins Struct. Funct. Bioinform. · DOI · Paper page
- Torrisi, 2020, Deep learning methods in protein structure prediction, Comput. Struct. Biotechnol. J., 18, 1301, 10.1016/j.csbj.2019.12.011 · DOI · Paper page
- Anand, N., and Huang, P. (2018;, January 2–8). Generative modeling for protein structures. Proceedings of the ACM Conference on Advances in Neural Information Processing Systems, Montreal, QC, Canada.
- Anand, N., Eguchi, R., and Huang, P.S. (2019, January 6–9). Fully differentiable full-atom protein backbone generation. Proceedings of the International Conference on Learning Representations (ICLR) Workshops, New Orleans, LA, USA.
- Guo, X., Tadepalli, S., Zhao, L., and Shehu, A. (2020). Generating tertiary protein structures via an interpretative variational autoencoder. arXiv. · DOI · Paper page
- Li, Z., Nguyen, S.P., Xu, D., and Shang, Y. (2017, January 6–8). Protein loop modeling using deep generative adversarial network. Proceedings of the 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), Boston, MA, USA. · DOI · Paper page
- Tischer, D., Lisanza, S., Wang, J., Dong, R., Anishchenko, I., Milles, L.F., Ovchinnikov, S., and Baker, D. (2020). Design of proteins presenting discontinuous functional sites using deep learning. bioRxiv. · DOI · Paper page
- Yang, 2018, Learned protein embeddings for machine learning, Bioinformatics, 34, 2642, 10.1093/bioinformatics/bty178 · DOI · Paper page
- Elnaggar, A., Heinzinger, M., Dallago, C., Rihawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., and Steinegger, M. (2020). ProtTrans: Towards Cracking the Language of Life’s Code Through Self-Supervised Deep Learning and High Performance Computing. arXiv. · DOI · Paper page
- Trinquier, J., Uguzzoni, G., Pagnani, A., Zamponi, F., and Weigt, M. (2021). Efficient generative modeling of protein sequences using simple autoregressive models. arXiv Prepr. · DOI
- Karimi, 2020, De Novo Protein Design for Novel Folds Using Guided Conditional Wasserstein Generative Adversarial Networks, J. Chem. Inf. Model., 60, 5667, 10.1021/acs.jcim.0c00593 · DOI · Paper page
- Greener, 2018, Design of metalloproteins and novel protein folds using variational autoencoders, Sci. Rep., 8, 16189, 10.1038/s41598-018-34533-1 · DOI · Paper page
- Wu, 2020, Signal Peptides Generated by Attention-Based Neural Networks, ACS Synth. Biol., 9, 2154, 10.1021/acssynbio.0c00219 · DOI · Paper page
- Strokach, 2020, Fast and Flexible Protein Design Using Deep Graph Neural Networks, Cell Syst., 11, 402, 10.1016/j.cels.2020.08.016 · DOI · Paper page
- Wang, 2018, Computational Protein Design with Deep Learning Neural Networks, Sci. Rep., 8, 6349, 10.1038/s41598-018-24760-x · DOI · Paper page
- Ingraham, J., Garg, V.K., Barzilay, R., and Jaakkola, T. (2019, January 8–14). Generative models for graph-based protein design. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada.
- Eliasof, M., Boesen, T., Haber, E., Keasar, C., and Treister, E. (2021). Mimetic Neural Networks: A unified framework for Protein Design and Folding. arXiv. · DOI
- Jing, B., Eismann, S., Suriana, P., Townshend, R.J.L., and Dror, R. (2021). Learning from Protein Structure with Geometric Vector Perceptrons. arXiv.
- Chen, 2020, To Improve Protein Sequence Profile Prediction through Image Captioning on Pairwise Residue Distance Map, J. Chem. Inf. Model., 60, 391, 10.1021/acs.jcim.9b00438 · DOI · Paper page
- Li, 2018, SPIN2: Predicting sequence profiles from protein structures using deep neural networks, Proteins Struct. Funct. Bioinform., 86, 629, 10.1002/prot.25489 · DOI · Paper page
- Qi, 2020, DenseCPD: Improving the Accuracy of Neural-Network-Based Computational Protein Sequence Design with DenseNet, J. Chem. Inf. Model., 60, 1245, 10.1021/acs.jcim.0c00043 · DOI · Paper page
- Zhang, 2020, ProDCoNN: Protein design using a convolutional neural network, Proteins Struct. Funct. Bioinform., 88, 819, 10.1002/prot.25868 · DOI · Paper page
- Shroff, R., Cole, A.W., Morrow, B.R., Diaz, D.J., Donnell, I., Gollihar, J., Ellington, A.D., and Thyer, R. (2019). A structure-based deep learning framework for protein engineering. bioRxiv. · DOI
- Du, Y., Meier, J., Ma, J., Fergus, R., and Rives, A. (2020). Energy-based models for atomic-resolution protein conformations. arXiv.
- Chandonia, 2018, SCOPe: Classification of large macromolecular structures in the structural classification of proteins—Extended database, Nucleic Acids Res., 47, D475, 10.1093/nar/gky1134 · DOI · Paper page
- Dawson, 2016, CATH: An expanded resource to predict protein function through structure and sequence, Nucleic Acids Res., 45, D289, 10.1093/nar/gkw1098 · DOI · Paper page
- Castorina, L.V., Petrenas, R., Subr, K., and Wood, C.W. (2021). PDBench: Evaluating Computational Methods for Protein Sequence Design. arXiv.
- Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2018). Densely Connected Convolutional Networks. arXiv. · DOI · Paper page
- Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. arXiv.
- Xing, 2014, Distributed Representations of Sentences and Documents, Proceedings of the 31st International Conference on Machine Learning, Volume 32, 1188
- Vylomova, E., Rimell, L., Cohn, T., and Baldwin, T. (2016). Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learning. arXiv. · DOI
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). AttentionIs All You Need. Proceedings of the 1st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
- Kremer, S.C., and Kolen, J.F. (2001). Gradient Flow in Recurrent Nets: The Difficulty of Learning Long-Term Dependencies. A Field Guide to Dynamical Recurrent Networks, IEEE Press.
- Bhattacharya, N., Thomas, N., Rao, R., Daupras, J., Koo, P., Baker, D., Song, Y.S., and Ovchinnikov, S. (2020). Single Layers of Attention Suffice to Predict Protein Contacts. bioRxiv. · DOI · Paper page
- Kingma, D.P., and Welling, M. (2014). Auto-Encoding Variational Bayes. arXiv.
- Goodfellow, 2014, Generative adversarial nets, Adv. Neural Inf. Process. Syst., 3, 2672
- Precup, 2017, Wasserstein Generative Adversarial Networks, Proceedings of the 34th International Conference on Machine Learning, Volume 70, 214
- Tian, 2018, Co-Evolutionary Fitness Landscapes for Sequence Design, Angew. Chem. Int. Ed., 57, 5674, 10.1002/anie.201713220 · DOI · Paper page
- Cheung, 2019, Sibe: A computation tool to apply protein sequence statistics to predict folding and design in silico, BMC Bioinform., 20, 455, 10.1186/s12859-019-2984-1 · DOI
- Heckerman, D., and Mamdani, A. (1993). A generalization of the noisy-or model. Uncertainty in Artificial Intelligence, Morgan Kaufmann.
- Wu, 2021, Protein sequence design with deep generative models, Curr. Opin. Chem. Biol., 65, 18, 10.1016/j.cbpa.2021.04.004 · DOI · Paper page
- Ofer, 2021, The language of proteins: NLP, machine learning & protein sequences, Comput. Struct. Biotechnol. J., 19, 1750, 10.1016/j.csbj.2021.03.022 · DOI · Paper page
- Makrodimitris, 2020, Unsupervised protein embeddings outperform hand-crafted sequence and structure features at predicting molecular function, Bioinformatics, 37, 162
- Madani, A., McCann, B., Naik, N., Keskar, N.S., Anand, N., Eguchi, R.R., Huang, P.S., and Socher, R. (2020). ProGen: Language Modeling for Protein Generation. arXiv. · DOI · Paper page
- Jones, 1999, Protein secondary structure prediction based on position-specific scoring matrices, J. Mol. Biol., 292, 195, 10.1006/jmbi.1999.3091 · DOI · Paper page
- Henikoff, 1992, Amino acid substitution matrices from protein blocks, Proc. Natl. Acad. Sci. USA, 89, 10915, 10.1073/pnas.89.22.10915 · DOI · Paper page
- Li, 2014, Direct prediction of profiles of sequences compatible with a protein structure by neural networks with fragment-based local and energy-based nonlocal profiles, Proteins Struct. Funct. Bioinform., 82, 2565, 10.1002/prot.24620 · DOI · Paper page
- Eismann, 2021, Hierarchical, rotation-equivariant neural networks to select structural models of protein complexes, Proteins Struct. Funct. Bioinform., 89, 493, 10.1002/prot.26033 · DOI · Paper page
- Yang, 2020, Improved protein structure prediction using predicted interresidue orientations, Proc. Natl. Acad. Sci. USA, 117, 1496, 10.1073/pnas.1914677117 · DOI · Paper page
- Adhikari, 2018, CONFOLD2: Improved contact-driven ab initio protein structure modeling, BMC Bioinform., 19, 22, 10.1186/s12859-018-2032-6 · DOI · Paper page
- Precup, 2017, Neural Message Passing for Quantum Chemistry, Proceedings of the 34th International Conference on Machine Learning, Volume 70, 1263
- Wu, 2021, A Comprehensive Survey on Graph Neural Networks, IEEE Trans. Neural Netw. Learn. Syst., 32, 4, 10.1109/TNNLS.2020.2978386 · DOI · Paper page
- Fuchs, F.B., Worrall, D.E., Fischer, V., and Welling, M. (2020). SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networks. arXiv.
- Xu, 2018, A semantic loss function for deep learning with symbolic knowledge, Int. Conf. Mach. Learn., 80, 5502
Cited by
From sequence to function through structure: Deep learning for protein design
(2022) · doi:10.1016/j.csbj.2022.11.014 · Cited by 124
(2022) · doi:10.1002/pro.4554 · Cited by 25
A probabilistic view of protein stability, conformational specificity, and design
Stern, J. A., Free, T. J., Stern, K. L., Gardiner, S., Dalley, N. A., Bundy, B. C., Price, J. L., Wingate, D., & Della Corte, D. (2023) · Scientific Reports · doi:10.1038/s41598-023-42032-1 · Cited by 10
Komp, E., Alanzi, H. N., Francis, R., Vuong, C., Roberts, L., Mosallanejad, A., & Beck, D. A. C. (2023) · Scientific Data · doi:10.1038/s41597-023-02553-w · Cited by 7
(2024) · doi:10.1093/bib/bbae146 · Cited by 6
Metadata
- Authors
- Defresne, M., Barbe, S., & Schiex, T.
- Venue
- International Journal of Molecular Sciences
- Publisher
- MDPI AG
- Published
- 2021-10-29
- Volume
- 22
- Issue
- 21
- Pages
- 11741
- ISSN
- 1422-0067 (ISSN-L)
- OpenAlex
- W3211024740
- Cited by
- 44
- References
- 28
- FWCI
- 2.42
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Agence Nationale de la Recherche (ANR-18-EURE-0021)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Protein Design with Deep Learning. https://app.cochat.ai/papers/10.3390/ijms222111741
- The paper
- Defresne, M., Barbe, S., & Schiex, T. (2021). Protein Design with Deep Learning. International Journal of Molecular Sciences. https://doi.org/10.3390/ijms222111741
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.