CoChat

Protein Design with Deep Learning

Open access
Defresne, Marianne, Barbe, Sophie, Schiex, Thomas · 2021 · International Journal of Molecular Sciences
Cited by 44

The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.

Abstract

Computational Protein Design (CPD) has produced impressive results for engineering new proteins, resulting in a wide variety of applications. In the past few years, various efforts have aimed at replacing or improving existing design methods using Deep Learning technology to leverage the amount of publicly available protein data. Deep Learning (DL) is a very powerful tool to extract patterns from raw data, provided that data are formatted as mathematical objects and the architecture processing them is well suited to the targeted problem. In the case of protein data, specific representations are needed for both the amino acid sequence and the protein structure in order to capture respectively 1D and 3D information. As no consensus has been reached about the most suitable representations, this review describes the representations used so far, discusses their strengths and weaknesses, and details their associated DL architecture for design and related tasks.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/ijms222111741

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 66

  1. Hallen, 2019, Protein Design by Provable Algorithms, Commun. ACM, 62, 76, 10.1145/3338124 · DOI
  2. Teets, 2021, Toward complete rational control over protein structure and function through computational design, Curr. Opin. Struct. Biol., 66, 170, 10.1016/j.sbi.2020.10.015 · DOI
  3. Noguchi, 2019, Computational design of symmetrical eight-bladed β-propeller proteins, IUCrJ, 6, 46, 10.1107/S205225251801480X · DOI
  4. Hornik, 1989, Multilayer feedforward networks are universal approximators, Neural Netw., 2, 359, 10.1016/0893-6080(89)90020-8 · DOI · Paper page
  5. Frappier, 2021, Data-driven computational protein design, Curr. Opin. Struct. Biol., 69, 63, 10.1016/j.sbi.2021.03.009 · DOI
  6. Bouchiba, 2021, Molecular flexibility in computational protein design: An algorithmic perspective, Protein Eng. Des. Sel., 34, gzab011, 10.1093/protein/gzab011 · DOI
  7. Leman, 2020, Macromolecular modeling and design in Rosetta: Recent methods and frameworks, Nat. Methods, 17, 665, 10.1038/s41592-020-0848-2 · DOI · Paper page
  8. Pierce, 2002, Protein Design is NP-hard, Protein Eng. Des. Sel., 15, 779, 10.1093/protein/15.10.779 · DOI · Paper page
  9. Kuhlman, 2000, Native protein sequences are close to optimal for their structures, Proc. Natl. Acad. Sci. USA, 97, 10383, 10.1073/pnas.97.19.10383 · DOI · Paper page
  10. Allouche, 2013, A new framework for computational protein design through cost function network optimization, Bioinformatics, 29, 2129, 10.1093/bioinformatics/btt374 · DOI
  11. Simoncini, 2015, Guaranteed discrete energy optimization on large protein design problems, J. Chem. Theory Comput., 11, 5980, 10.1021/acs.jctc.5b00594 · DOI
  12. Xu, 2019, Analysis of distance-based protein structure prediction by deep learning in CASP13, Proteins Struct. Funct. Bioinform., 87, 1069, 10.1002/prot.25810 · DOI · Paper page
  13. Anishchenko, I., Baek, M., Park, H., Hiranuma, N., Kim, D.E., Dauparas, J., Mansoor, S., Humphreys, I.R., and Baker, D. (2021). Protein tertiary structure prediction and refinement using deep learning and Rosetta in CASP14. Proteins Struct. Funct. Bioinform. · DOI · Paper page
  14. Zheng, W., Li, Y., Zhang, C., Zhou, X., Pearce, R., Bell, E.W., Huang, X., and Zhang, Y. (2021). Protein structure prediction using deep learning distance and hydrogen-bonding restraints in CASP14. Proteins Struct. Funct. Bioinform. · DOI · Paper page
  15. Torrisi, 2020, Deep learning methods in protein structure prediction, Comput. Struct. Biotechnol. J., 18, 1301, 10.1016/j.csbj.2019.12.011 · DOI · Paper page
  16. Anand, N., and Huang, P. (2018;, January 2–8). Generative modeling for protein structures. Proceedings of the ACM Conference on Advances in Neural Information Processing Systems, Montreal, QC, Canada.
  17. Anand, N., Eguchi, R., and Huang, P.S. (2019, January 6–9). Fully differentiable full-atom protein backbone generation. Proceedings of the International Conference on Learning Representations (ICLR) Workshops, New Orleans, LA, USA.
  18. Guo, X., Tadepalli, S., Zhao, L., and Shehu, A. (2020). Generating tertiary protein structures via an interpretative variational autoencoder. arXiv. · DOI · Paper page
  19. Li, Z., Nguyen, S.P., Xu, D., and Shang, Y. (2017, January 6–8). Protein loop modeling using deep generative adversarial network. Proceedings of the 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), Boston, MA, USA. · DOI · Paper page
  20. Tischer, D., Lisanza, S., Wang, J., Dong, R., Anishchenko, I., Milles, L.F., Ovchinnikov, S., and Baker, D. (2020). Design of proteins presenting discontinuous functional sites using deep learning. bioRxiv. · DOI · Paper page
  21. Yang, 2018, Learned protein embeddings for machine learning, Bioinformatics, 34, 2642, 10.1093/bioinformatics/bty178 · DOI · Paper page
  22. Elnaggar, A., Heinzinger, M., Dallago, C., Rihawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., and Steinegger, M. (2020). ProtTrans: Towards Cracking the Language of Life’s Code Through Self-Supervised Deep Learning and High Performance Computing. arXiv. · DOI · Paper page
  23. Trinquier, J., Uguzzoni, G., Pagnani, A., Zamponi, F., and Weigt, M. (2021). Efficient generative modeling of protein sequences using simple autoregressive models. arXiv Prepr. · DOI
  24. Karimi, 2020, De Novo Protein Design for Novel Folds Using Guided Conditional Wasserstein Generative Adversarial Networks, J. Chem. Inf. Model., 60, 5667, 10.1021/acs.jcim.0c00593 · DOI · Paper page
  25. Greener, 2018, Design of metalloproteins and novel protein folds using variational autoencoders, Sci. Rep., 8, 16189, 10.1038/s41598-018-34533-1 · DOI · Paper page
  26. Wu, 2020, Signal Peptides Generated by Attention-Based Neural Networks, ACS Synth. Biol., 9, 2154, 10.1021/acssynbio.0c00219 · DOI · Paper page
  27. Strokach, 2020, Fast and Flexible Protein Design Using Deep Graph Neural Networks, Cell Syst., 11, 402, 10.1016/j.cels.2020.08.016 · DOI · Paper page
  28. Wang, 2018, Computational Protein Design with Deep Learning Neural Networks, Sci. Rep., 8, 6349, 10.1038/s41598-018-24760-x · DOI · Paper page
  29. Ingraham, J., Garg, V.K., Barzilay, R., and Jaakkola, T. (2019, January 8–14). Generative models for graph-based protein design. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada.
  30. Eliasof, M., Boesen, T., Haber, E., Keasar, C., and Treister, E. (2021). Mimetic Neural Networks: A unified framework for Protein Design and Folding. arXiv. · DOI
  31. Jing, B., Eismann, S., Suriana, P., Townshend, R.J.L., and Dror, R. (2021). Learning from Protein Structure with Geometric Vector Perceptrons. arXiv.
  32. Chen, 2020, To Improve Protein Sequence Profile Prediction through Image Captioning on Pairwise Residue Distance Map, J. Chem. Inf. Model., 60, 391, 10.1021/acs.jcim.9b00438 · DOI · Paper page
  33. Li, 2018, SPIN2: Predicting sequence profiles from protein structures using deep neural networks, Proteins Struct. Funct. Bioinform., 86, 629, 10.1002/prot.25489 · DOI · Paper page
  34. Qi, 2020, DenseCPD: Improving the Accuracy of Neural-Network-Based Computational Protein Sequence Design with DenseNet, J. Chem. Inf. Model., 60, 1245, 10.1021/acs.jcim.0c00043 · DOI · Paper page
  35. Zhang, 2020, ProDCoNN: Protein design using a convolutional neural network, Proteins Struct. Funct. Bioinform., 88, 819, 10.1002/prot.25868 · DOI · Paper page
  36. Shroff, R., Cole, A.W., Morrow, B.R., Diaz, D.J., Donnell, I., Gollihar, J., Ellington, A.D., and Thyer, R. (2019). A structure-based deep learning framework for protein engineering. bioRxiv. · DOI
  37. Du, Y., Meier, J., Ma, J., Fergus, R., and Rives, A. (2020). Energy-based models for atomic-resolution protein conformations. arXiv.
  38. Chandonia, 2018, SCOPe: Classification of large macromolecular structures in the structural classification of proteins—Extended database, Nucleic Acids Res., 47, D475, 10.1093/nar/gky1134 · DOI · Paper page
  39. Dawson, 2016, CATH: An expanded resource to predict protein function through structure and sequence, Nucleic Acids Res., 45, D289, 10.1093/nar/gkw1098 · DOI · Paper page
  40. Castorina, L.V., Petrenas, R., Subr, K., and Wood, C.W. (2021). PDBench: Evaluating Computational Methods for Protein Sequence Design. arXiv.
  41. Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2018). Densely Connected Convolutional Networks. arXiv. · DOI · Paper page
  42. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. arXiv.
  43. Xing, 2014, Distributed Representations of Sentences and Documents, Proceedings of the 31st International Conference on Machine Learning, Volume 32, 1188
  44. Vylomova, E., Rimell, L., Cohn, T., and Baldwin, T. (2016). Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learning. arXiv. · DOI
  45. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). AttentionIs All You Need. Proceedings of the 1st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
  46. Kremer, S.C., and Kolen, J.F. (2001). Gradient Flow in Recurrent Nets: The Difficulty of Learning Long-Term Dependencies. A Field Guide to Dynamical Recurrent Networks, IEEE Press.
  47. Bhattacharya, N., Thomas, N., Rao, R., Daupras, J., Koo, P., Baker, D., Song, Y.S., and Ovchinnikov, S. (2020). Single Layers of Attention Suffice to Predict Protein Contacts. bioRxiv. · DOI · Paper page
  48. Kingma, D.P., and Welling, M. (2014). Auto-Encoding Variational Bayes. arXiv.
  49. Goodfellow, 2014, Generative adversarial nets, Adv. Neural Inf. Process. Syst., 3, 2672
  50. Precup, 2017, Wasserstein Generative Adversarial Networks, Proceedings of the 34th International Conference on Machine Learning, Volume 70, 214
  51. Tian, 2018, Co-Evolutionary Fitness Landscapes for Sequence Design, Angew. Chem. Int. Ed., 57, 5674, 10.1002/anie.201713220 · DOI · Paper page
  52. Cheung, 2019, Sibe: A computation tool to apply protein sequence statistics to predict folding and design in silico, BMC Bioinform., 20, 455, 10.1186/s12859-019-2984-1 · DOI
  53. Heckerman, D., and Mamdani, A. (1993). A generalization of the noisy-or model. Uncertainty in Artificial Intelligence, Morgan Kaufmann.
  54. Wu, 2021, Protein sequence design with deep generative models, Curr. Opin. Chem. Biol., 65, 18, 10.1016/j.cbpa.2021.04.004 · DOI · Paper page
  55. Ofer, 2021, The language of proteins: NLP, machine learning & protein sequences, Comput. Struct. Biotechnol. J., 19, 1750, 10.1016/j.csbj.2021.03.022 · DOI · Paper page
  56. Makrodimitris, 2020, Unsupervised protein embeddings outperform hand-crafted sequence and structure features at predicting molecular function, Bioinformatics, 37, 162
  57. Madani, A., McCann, B., Naik, N., Keskar, N.S., Anand, N., Eguchi, R.R., Huang, P.S., and Socher, R. (2020). ProGen: Language Modeling for Protein Generation. arXiv. · DOI · Paper page
  58. Jones, 1999, Protein secondary structure prediction based on position-specific scoring matrices, J. Mol. Biol., 292, 195, 10.1006/jmbi.1999.3091 · DOI · Paper page
  59. Henikoff, 1992, Amino acid substitution matrices from protein blocks, Proc. Natl. Acad. Sci. USA, 89, 10915, 10.1073/pnas.89.22.10915 · DOI · Paper page
  60. Li, 2014, Direct prediction of profiles of sequences compatible with a protein structure by neural networks with fragment-based local and energy-based nonlocal profiles, Proteins Struct. Funct. Bioinform., 82, 2565, 10.1002/prot.24620 · DOI · Paper page
  61. Eismann, 2021, Hierarchical, rotation-equivariant neural networks to select structural models of protein complexes, Proteins Struct. Funct. Bioinform., 89, 493, 10.1002/prot.26033 · DOI · Paper page
  62. Adhikari, 2018, CONFOLD2: Improved contact-driven ab initio protein structure modeling, BMC Bioinform., 19, 22, 10.1186/s12859-018-2032-6 · DOI · Paper page
  63. Precup, 2017, Neural Message Passing for Quantum Chemistry, Proceedings of the 34th International Conference on Machine Learning, Volume 70, 1263
  64. Wu, 2021, A Comprehensive Survey on Graph Neural Networks, IEEE Trans. Neural Netw. Learn. Syst., 32, 4, 10.1109/TNNLS.2020.2978386 · DOI · Paper page
  65. Fuchs, F.B., Worrall, D.E., Fischer, V., and Welling, M. (2020). SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networks. arXiv.
  66. Xu, 2018, A semantic loss function for deep learning with symbolic knowledge, Int. Conf. Mach. Learn., 80, 5502

Cited by

See all 44

Metadata

Authors
Defresne, M., Barbe, S., & Schiex, T.
Venue
International Journal of Molecular Sciences
Publisher
MDPI AG
Published
2021-10-29
Volume
22
Issue
21
Pages
11741
ISSN
1422-0067 (ISSN-L)
OpenAlex
W3211024740
Cited by
44
References
30
FWCI
2.42
Type
journal article
Language
en
Open access
gold
Funders
Agence Nationale de la Recherche (ANR-18-EURE-0021)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.