Machine learning to navigate fitness landscapes for protein engineering
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Machine learning (ML) is revolutionizing our ability to understand and predict the complex relationships between protein sequence, structure, and function. Predictive sequence-function models are enabling protein engineers to efficiently search sequence space for useful proteins with broad applications in biotechnology. In this review, we highlight recent advances applying machine learning to protein engineering. We discuss supervised learning methods that infer the sequence-function mapping from experimental data and new sequence representation strategies for data-efficient modeling. We then describe the various ways ML can be incorporated into protein engineering workflows, including purely in silico searches, machine learning-assisted directed evolution, and generative models that learn the underlying distribution of protein function in sequence space. ML-driven protein engineering will become increasingly powerful with continued advances in high-throughput data generation, data science, and deep learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280
Unified rational protein engineering with sequence-based deep representation learning
Alley, E. C., Khimulya, G., Biswas, S., AlQuraishi, M., & Church, G. M. (2019) · Nature Methods · doi:10.1038/s41592-019-0598-1 · Cited by 1,131
Evaluating Protein Transfer Learning with TAPE
Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, X., Canny, J., Abbeel, P., & Song, Y. S. (2019) · doi:10.1101/676825 · Cited by 719 · cited 2×
“Variational autoencoders (VAEs), long short-term memory RNNs, and transformers trained on natural sequence information consistently show top performance in learning effective protein representations for supervised ML [19,23–26].”
BackgroundModeling the language of life – Deep Learning Protein Sequences
Heinzinger, M., Elnaggar, A., Wang, Y., Dallago, C., Nechaev, D., Matthes, F., & Rost, B. (2019) · doi:10.1101/614313 · Cited by 606
Modeling aspects of the language of life through transfer-learning protein sequences
Heinzinger, M., Elnaggar, A., Wang, Y., Dallago, C., Nechaev, D., Matthes, F., & Rost, B. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-3220-8 · Cited by 606
Directed evolution of adeno-associated virus yields enhanced gene delivery vectors
Maheshri, N., Koerber, J. T., Kaspar, B. K., & Schaffer, D. V. (2006) · Nature Biotechnology · doi:10.1038/nbt1182 · Cited by 538 · cited 1×
“Protein engineering aims to realize this potential by altering protein functions for applications in biotechnology, industry, and medicine [1–3].”
BackgroundGlobal analysis of protein folding using massively parallel design, synthesis, and testing
Rocklin, G. J., Chidyausiku, T. M., Goreshnik, I., Ford, A., Houliston, S., Lemak, A., Carter, L., Ravichandran, R., Mulligan, V. K., Chevalier, A., et al. (2017) · Science · doi:10.1126/science.aan0693 · Cited by 501 · cited 1×
“A carefully designed set of features can distill the essential aspects of protein function and enable learning with less data [15,16].”
BackgroundLearning the protein language: Evolution, structure, and function
Bepler, T., & Berger, B. (2021) · Cell Systems · doi:10.1016/j.cels.2021.05.017 · Cited by 483 · cited 1×
“One method to reduce the data requirement for training is to apply more informative protein representations to supervised learning tasks [14].”
MethodMassively parallel de novo protein design for targeted therapeutics
Chevalier, A., Silva, D.-A., Rocklin, G. J., Hicks, D. R., Vergara, R., Murapa, P., Bernard, S. M., Zhang, L., Lam, K.-H., Yao, G., et al. (2017) · Nature · doi:10.1038/nature23912 · Cited by 453 · cited 1×
“Protein engineering aims to realize this potential by altering protein functions for applications in biotechnology, industry, and medicine [1–3].”
BackgroundLow-N protein engineering with data-efficient deep learning
Biswas, S., Khimulya, G., Alley, E. C., Esvelt, K. M., & Church, G. M. (2021) · Nature Methods · doi:10.1038/s41592-021-01100-y · Cited by 422
Expanding functional protein sequence spaces using generative adversarial networks
Repecka, D., Jauniskis, V., Karpus, L., Rembeza, E., Rokaitis, I., Zrimec, J., Poviloniene, S., Laurynenas, A., Viknander, S., Abuajwa, W., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00310-5 · Cited by 388
Protein sequence design by conformational landscape optimization
Norn, C., Wicky, B. I. M., Juergens, D., Liu, S., Kim, D., Tischer, D., Koepnick, B., Anishchenko, I., Players, F., Baker, D., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2017228118 · Cited by 144
Ig-VAE: Generative modeling of protein structure by direct 3D coordinate generation
Eguchi, R. R., Choe, C. A., & Huang, P.-S. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010271 · Cited by 141
Ig-VAE: Generative Modeling of Protein Structure by Direct 3D Coordinate Generation
Eguchi, R. R., Choe, C. A., & Huang, P.-S. (2020) · doi:10.1101/2020.08.07.242347 · Cited by 141
Linder, J., Bogard, N., Rosenberg, A. B., & Seelig, G. (2020) · Cell Systems · doi:10.1016/j.cels.2020.05.007 · Cited by 107
Deciphering protein evolution and fitness landscapes with latent space models
Ding, X., Zou, Z., & Brooks III, C. L. (2019) · Nature Communications · doi:10.1038/s41467-019-13633-0 · Cited by 106 · cited 1×
“Variational autoencoders (VAEs), long short-term memory RNNs, and transformers trained on natural sequence information consistently show top performance in learning effective protein representations for supervised ML [19,23–26].”
Background
Research works printed but not linked: 35
- Wu, 2020, Signal peptides generated by attention-based neural networks, ACS Synth Biol, 9, 2154, 10.1021/acssynbio.0c00219 · DOI · Paper page
- Romero, 2009, Exploring protein fitness landscapes by directed evolution, Nat Rev Mol Cell Biol, 10, 866, 10.1038/nrm2805 · DOI · Paper page
- Wu, 2021, Protein sequence design with deep generative models, Curr Opin Chem Biol, 65, 18, 10.1016/j.cbpa.2021.04.004 · DOI · Paper page
- Wittmann, 2021, Advances in machine learning for directed evolution, Curr Opin Struct Biol, 69, 11, 10.1016/j.sbi.2021.01.008 · DOI · Paper page
- Yang, 2019, Machine-learning-guided directed evolution for protein engineering, Nat Methods, 16, 687, 10.1038/s41592-019-0496-6 · DOI · Paper page
- Wittmann, 2021, Informed training set design enables efficient machine learning-assisted directed protein evolution, Cell Syst, 12, 1026, 10.1016/j.cels.2021.07.008 · DOI · Paper page
- Gelman, 2021, Neural networks to learn protein sequence–function relationships from deep mutational scanning data, Proc Natl Acad Sci USA, 118, 10.1073/pnas.2104878118 · DOI · Paper page
- Xu, 2020, Deep dive into machine learning models for protein engineering, J Chem Inf Model, 60, 2773, 10.1021/acs.jcim.0c00073 · DOI · Paper page
- Griffith, 2021, PARROT is a flexible recurrent neural network framework for analysis of large protein datasets, eLife, 10, 10.7554/eLife.70576 · DOI
- Bryant, 2021, Deep diversification of an AAV capsid protein by machine learning, Nat Biotechnol, 39, 691, 10.1038/s41587-020-00793-4 · DOI · Paper page
- Mater, 2020, The NK landscape as a versatile benchmark for machine learning driven protein engineering, bioRxiv
- Carlin, 2016, Kinetic characterization of 100 glycoside hydrolase mutants enables the discovery of structural features correlated with kinetic constants, PLOS One, 11, 1, 10.1371/journal.pone.0147596 · DOI
- Luo, 2021, ECNet is an evolutionary context-integrated deep learning framework for protein engineering, Nat Commun, 12, 5743, 10.1038/s41467-021-25976-8 · DOI · Paper page
- Yang, 2018, Learned protein embeddings for machine learning, Bioinformatics, 34, 2642, 10.1093/bioinformatics/bty178 · DOI · Paper page
- The UniProt Consortium, 2007, The universal protein resource (UniProt), Nucl Acids Res, 36, D190, 10.1093/nar/gkm895 · DOI · Paper page
- Hsu, 2022, Learning protein fitness models from evolutionary and assay-labeled data, Nat Biotechnol, 10.1038/s41587-021-01146-5 · DOI · Paper page
- Siedhoff, 2021, PyPEF—an integrated framework for data-driven protein engineering, J Chem Inf Model, 61, 3463, 10.1021/acs.jcim.1c00099 · DOI
- Chen, 2019, Selene: a PyTorch-based deep learning library for sequence data, Nat Methods, 16, 315, 10.1038/s41592-019-0360-8 · DOI · Paper page
- Favor, 2020, Evaluating eUniRep and other protein feature representations for in silico directed evolution, Authorea, 1
- Zhu, 2021, Machine learning-based library design improves packaging and diversity of adeno-associated virus (AAV) libraries, bioRxiv
- Wu, 2019, Machine learning-assisted directed protein evolution with combinatorial libraries, Proc Natl Acad Sci USA, 116, 8852, 10.1073/pnas.1901979116 · DOI · Paper page
- Qiu, 2021, Cluster learning-assisted directed evolution, Nat Comput Sci, 1, 809, 10.1038/s43588-021-00168-y · DOI · Paper page
- Hie, 2022, Adaptive machine learning for protein engineering, Curr Opin Struct Biol, 72, 145, 10.1016/j.sbi.2021.11.002 · DOI · Paper page
- Romero, 2013, Navigating the protein fitness landscape with Gaussian processes, Proc Nat Acad Sci, 110, E193, 10.1073/pnas.1215251110 · DOI · Paper page
- Bedbrook, 2017, Machine learning to design integral membrane channelrhodopsins for efficient eukaryotic expression and plasma membrane localization, PLoS Comput Biol, 13, 10.1371/journal.pcbi.1005786 · DOI · Paper page
- Greenhalgh, 2021, Machine learning-guided acyl-ACP reductase engineering for improved in vivo fatty alcohol production, Nat Commun, 12, 5825, 10.1038/s41467-021-25831-w · DOI · Paper page
- Gruver N, Stanton S, Kirichenko P, Finzi M, Maffettone P, Myers V, Delaney E, Greenside P, Wilson AG: Effective Surrogate models for protein design with Bayesian optimization. In ICML 2021 Workshop on Computational Biology; 2021
- Madani, 2021, Deep neural language modeling enables functional protein generation across families, bioRxiv
- Hawkins-Hooker, 2021, Generating functional protein variants with variational autoencoders, PLoS Comput Biol, 17, 10.1371/journal.pcbi.1008736 · DOI · Paper page
- Brookes DH, Park H, Listgarten J: Conditioning by adaptive sampling for robust design. arXiv 2021. arXiv:1901.10060. · arXiv
- Chan, 2021, Deep extrapolation for attribute-enhanced generation, In Advances in Neural Information Processing Systems, 35, 1
- Karimi, 2020, De Novo protein design for novel folds using guided conditional wasserstein generative adversarial networks, J Chem Inf Model, 60, 5667, 10.1021/acs.jcim.0c00593 · DOI · Paper page
- Das, 2021, Accelerated antimicrobial discovery via deep generative models and molecular dynamics simulations, Nat Biomed Eng, 5, 613, 10.1038/s41551-021-00689-x · DOI · Paper page
- Amimeur, 2020, Designing feature-controlled humanoid antibody discovery libraries using generative adversarial networks, bioRxiv
- Gupta, 2019, Feedback GAN for DNA optimizes protein functions, Nat Mach Intell, 1, 105, 10.1038/s42256-019-0017-4 · DOI · Paper page
Cited by
Opportunities and Challenges for Machine Learning-Assisted Enzyme Engineering
Yang, J., Li, F.-Z., & Arnold, F. H. (2024) · ACS Central Science · doi:10.1021/acscentsci.3c01275 · Cited by 246
Harnessing generative AI to decode enzyme catalysis and evolution for enhanced engineering
Xie, W. J., & Warshel, A. (2023) · National Science Review · doi:10.1093/nsr/nwad331 · Cited by 69
Leander, M., Liu, Z., Cui, Q., & Raman, S. (2022) · eLife · doi:10.7554/elife.79932 · Cited by 54
Praljak, N., Lian, X., Ranganathan, R., & Ferguson, A. L. (2023) · ACS Synthetic Biology · doi:10.1021/acssynbio.3c00261 · Cited by 18
Tsishyn, M., Hermans, P., Rooman, M., & Pucci, F. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf322 · Cited by 15
Metadata
- Authors
- Freschlin, C. R., Fahlberg, S. A., & Romero, P. A.
- Venue
- Current Opinion in Biotechnology
- Publisher
- Elsevier BV
- Published
- 2022-06
- Volume
- 75
- Pages
- 102713
- ISSN
- 0958-1669 (ISSN-L)
- OpenAlex
- W4223602425
- Cited by
- 107
- References
- 18
- FWCI
- 1.67
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (am, 312 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.