Recent Advances in Machine Learning Variant Effect Prediction Tools for Protein Engineering
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Proteins are Nature's molecular machinery and comprise diverse roles while consisting of chemically similar building blocks. In recent years, protein engineering and design have become important research areas, with many applications in the pharmaceutical, energy, and biocatalysis fields, among others-where the aim is to ultimately create a protein given desired structural and functional properties. It is often critical to model the relationship between a protein's sequence, folded structure, and biological function to assist in such protein engineering pursuits. However, significant challenges remain in concretely mapping an amino acid sequence to specific protein properties and biological activities. Mutations may enhance or diminish molecular protein function, and the epistatic interactions between mutations result in an inherently complex mapping between genetic modifications and protein function. Therefore, estimating the quantitative effects of mutations on protein function(s) remains a grand challenge of biology, bioinformatics, and many related fields and would rapidly accelerate protein engineering tasks when successful. Such estimation is often known as variant effect prediction (VEP). However, progress has been demonstrated in recent years with the development of machine learning (ML) methods in modeling the relationship between mutations and protein function. In this Review, recent advances in variant effect prediction (VEP) are discussed as tools for protein engineering, focusing on techniques incorporating gains from the broader ML community and challenges in estimating biomolecular functional differences. Primary developments highlighted include convolutional neural networks, graph neural networks, and natural language embeddings for protein sequences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Predicting Functional Effect of Human Missense Mutations Using PolyPhen‐2
Adzhubei, I., Jordan, D. M., & Sunyaev, S. R. (2013) · Current Protocols in Human Genetics · doi:10.1002/0471142905.hg0720s76 · Cited by 3,705
REVEL: An Ensemble Method for Predicting the Pathogenicity of Rare Missense Variants
Ioannidis, N. M., Rothstein, J. H., Pejaver, V., Middha, S., McDonnell, S. K., Baheti, S., Musolf, A., Li, Q., Holzinger, E., Karyadi, D., et al. (2016) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2016.08.016 · Cited by 2,908
ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
Elnaggar, A., Heinzinger, M., Dallago, C., Rehawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., Steinegger, M., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3095381 · Cited by 2,329
SIFT missense predictions for genomes
Vaser, R., Adusumalli, S., Leng, S. N., Sikic, M., & Ng, P. C. (2016) · Nature Protocols · doi:10.1038/nprot.2015.123 · Cited by 1,510
The coming of age of de novo protein design
Huang, P.-S., Boyken, S. E., & Baker, D. (2016) · Nature · doi:10.1038/nature19946 · Cited by 1,478
Deep mutational scanning: a new style of protein science
Fowler, D. M., & Fields, S. (2014) · Nature Methods · doi:10.1038/nmeth.3027 · Cited by 1,287
Unified rational protein engineering with sequence-based deep representation learning
Alley, E. C., Khimulya, G., Biswas, S., AlQuraishi, M., & Church, G. M. (2019) · Nature Methods · doi:10.1038/s41592-019-0598-1 · Cited by 1,131
Personalized medicine: motivation, challenges, and progress
Goetz, L. H., & Schork, N. J. (2018) · Fertility and Sterility · doi:10.1016/j.fertnstert.2018.05.006 · Cited by 976
Meta-Learning in Neural Networks: A Survey
Hospedales, T., Antoniou, A., Micaelli, P., & Storkey, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05439 · Cited by 886
Meta-Learning in Neural Networks: A Survey
Hospedales, T. M., Antoniou, A., Micaelli, P., & Storkey, A. J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3079209 · Cited by 886
Mutation effects predicted from sequence co-variation
Hopf, T. A., Ingraham, J. B., Poelwijk, F. J., Schärfe, C. P. I., Springer, M., Sander, C., & Marks, D. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3769 · Cited by 775
Energy and Policy Considerations for Modern Deep Learning Research
Strubell, E., Ganesh, A., & McCallum, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i09.7123 · Cited by 774
Deep generative models of genetic variation capture the effects of mutations
Riesselman, A. J., Ingraham, J. B., & Marks, D. S. (2018) · Nature Methods · doi:10.1038/s41592-018-0138-4 · Cited by 601
Local fitness landscape of the green fluorescent protein
Sarkisyan, K. S., Bolotin, D. A., Meer, M. V., Usmanova, D. R., Mishin, A. S., Sharonov, G. V., Ivankov, D. N., Bozhanova, N. G., Baranov, M. S., Soylemez, O., et al. (2016) · Nature · doi:10.1038/nature17995 · Cited by 591
Learning the protein language: Evolution, structure, and function
Bepler, T., & Berger, B. (2021) · Cell Systems · doi:10.1016/j.cels.2021.05.017 · Cited by 483
Grimm, D. G., Azencott, C., Aicheler, F., Gieraths, U., MacArthur, D. G., Samocha, K. E., Cooper, D. N., Stenson, P. D., Daly, M. J., Smoller, J. W., et al. (2015) · Human Mutation · doi:10.1002/humu.22768 · Cited by 356
Protein design and variant prediction using autoregressive generative models
Shin, J.-E., Riesselman, A. J., Kollasch, A. W., McMahon, C., Simon, E., Sander, C., Manglik, A., Kruse, A. C., & Marks, D. S. (2021) · Nature Communications · doi:10.1038/s41467-021-22732-w · Cited by 320
Jones, E. M., Lubock, N. B., Venkatakrishnan, A., Wang, J., Tseng, A. M., Paggi, J. M., Latorraca, N. R., Cancilla, D., Satyadi, M., Davis, J. E., et al. (2020) · eLife · doi:10.7554/elife.54895 · Cited by 168
3D deep convolutional neural networks for amino acid environment similarity analysis
Torng, W., & Altman, R. B. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1702-0 · Cited by 142
Starita, L. M., & Fields, S. (2015) · Cold Spring Harbor Protocols · doi:10.1101/pdb.top077503 · Cited by 32
Research works printed but not linked: 74
- 10.1093/nar/gkh036 · DOI · Paper page
- Sinai, S.; Kelsic, E. D. A Primer on Model-Guided Exploration of Fitness Landscapes for Biological Sequence Design. arXiv.org, 2020 (accessed on Nov. 17, 2020).
- 10.1146/annurev.genom.7.080505.115630 · DOI · Paper page
- 10.1016/j.jmb.2021.167160 · DOI · Paper page
- Turanli-Yildiz B., 2012, Protein Engineering
- 10.1093/protein/gzaa025 · DOI
- 10.3389/fgene.2019.00049 · DOI · Paper page
- 10.1098/rsta.2017.0062 · DOI
- 10.1016/j.ijbiomac.2021.03.058 · DOI
- 10.1038/srep22284 · DOI
- 10.1080/10408398.2014.1000481 · doi:10.1080/10408398.2014.1000481
- Lutz, S.; Iamurri, S. M. In Protein Engineering: Methods and Protocols; Bornscheuer, U. T., Höhne, M., Eds. Methods in Molecular Biology; Springer: New York, 2017; pp 1–12. · DOI
- Siedhoff, N. E.; Schwaneberg, U.; Davari, M. D. In Methods in Enzymology; Tawfik, D. S., Ed. Enzyme Engineering and Evolution: General Methods, Vol. 643; Academic Press, 2020; pp 281–315. · DOI
- 10.1021/acscatal.9b04321 · DOI · Paper page
- 10.1016/j.bcab.2012.03.010 · DOI
- 10.1038/nrg3927 · DOI · Paper page
- 10.1016/B978-0-12-418687-3.00019-7 · DOI
- 10.1016/S1367-5931(00)00206-4 · DOI · Paper page
- 10.1016/j.tibtech.2011.04.003 · DOI · Paper page
- 10.1016/j.sbi.2018.02.006 · DOI
- 10.15252/msb.202110305 · DOI · Paper page
- 10.1021/acs.jpcb.0c00197 · DOI
- 10.1038/s41467-021-25976-8 · DOI · Paper page
- 10.1038/nprot.2014.153 · DOI · Paper page
- 10.1016/j.sbi.2016.11.001 · DOI · Paper page
- Young, H. J.; Chan, M.; Selvam, B.; Szymanski, S. K.; Shukla, D.; Procko, E. Deep Mutagenesis of a Transporter for Uptake of a Non-Native Substrate Identifies Conformationally Dynamic Regions. bioRxiv, Biochem. 2021, (accessed on Nov. 10, 2021). · DOI
- 10.1038/nrm2805 · DOI · Paper page
- 10.1016/j.cels.2021.07.008 · DOI · Paper page
- 10.1093/nar/gks539 · DOI · Paper page
- 10.1016/j.cels.2017.11.003 · DOI · Paper page
- 10.1021/acs.jcim.0c00073 · DOI · Paper page
- 10.1016/j.jmb.2021.166810 · DOI
- 10.1038/s41598-021-98693-3 · DOI
- 10.1002/prot.26184 · DOI
- 10.15252/msb.20199380 · DOI · Paper page
- 10.1073/pnas.89.22.10915 · DOI · Paper page
- 10.1093/bioinformatics/12.4.327 · DOI · Paper page
- 10.1002/humu.21047 · DOI · Paper page
- 10.1186/1471-2164-14-S3-S6 · DOI · Paper page
- 10.1016/S0022-2836(02)00813-6 · DOI · Paper page
- 10.1101/gr.091991.109 · DOI · Paper page
- 10.1021/acs.jcim.1c00201 · DOI
- 10.1016/j.cels.2020.10.007 · DOI
- 10.1038/s41576-021-00441-w · DOI
- 10.1038/nature11510 · DOI · Paper page
- Zhou, Z.H. In Machine Learning; Zhou, Z.H., Ed. Springer: Singapore, 2021; pp 181–210. · DOI · Paper page
- 10.1186/1471-2164-14-S3-S3 · DOI · Paper page
- 10.1002/humu.22225 · DOI · Paper page
- Polikar, R. In Ensemble Machine Learning: Methods and Applications; Zhang, C., Ma, Y., Eds. Springer US: Boston, MA, 2012; pp 1–34. · DOI · Paper page
- 10.1093/bioinformatics/btz873 · DOI
- 10.1016/j.jmgm.2019.107454 · DOI
- 10.1021/acs.jcim.9b00220 · DOI
- 10.1021/acs.jpcb.1c04913 · DOI
- 10.1073/pnas.2104878118 · DOI · Paper page
- 10.1109/MCI.2014.2307227 · DOI · Paper page
- 10.7490/f1000research.1118163.1 · doi:10.7490/f1000research.1118163.1
- 10.1007/s00439-021-02411-y · doi:10.1007/s00439-021-02411-y
- 10.1186/s13059-019-1845-6 · DOI · Paper page
- 10.1093/nar/30.1.207 · DOI · Paper page
- 10.1002/cctc.202100822 · DOI
- 10.1016/j.pisc.2014.02.012 · DOI
- 10.3389/fmolb.2021.636660 · DOI
- 10.1016/j.tibs.2019.01.003 · DOI · Paper page
- 10.1021/acs.jcim.0c00591 · DOI
- 10.1021/ar5002999 · DOI · Paper page
- 10.33011/livecoms.1.1.5957 · DOI · Paper page
- Molnar C., 2019, Interpretable Machine Learning
- Lundberg, S. M.; Lee, S.I. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems; Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R., Eds.; Curran Associates, Inc., 2017; Vol. 30. https://proceedings.neurips.cc/paper/2017/file/8a20a8621978632d76c43dfd28b67767-Paper.pdf
- 10.1074/jbc.RA118.006173 · DOI · Paper page
- 10.1016/j.bpj.2022.01.024 · DOI
- 10.1021/acschemneuro.1c00714 · DOI · Paper page
- 10.1038/s41467-021-23246-1 · DOI
- 10.1016/j.bpj.2019.12.016 · DOI · Paper page
- 10.1002/humu.23290 · DOI · Paper page
Cited by
Roche, R., Moussad, B., Shuvo, M. H., Tarafder, S., & Bhattacharya, D. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae039 · Cited by 85
Enzyme structure correlates with variant effect predictability
(2024) · doi:10.1016/j.csbj.2024.09.007 · Cited by 13
Pseudo-perplexity in one fell swoop for protein fitness estimation
Kantroo, P., Wagner, G. P., & Machta, B. B. (2025) · PRX Life · doi:10.1103/zhx7-hcmm · Cited by 8
(2025) · doi:10.1016/j.cels.2025.101400 · Cited by 4
Uncovering differential tolerance to deletions versus substitutions with a protein language model
Goldman, G., Chati, P., & Ntranos, V. (2025) · Cell Systems · doi:10.1016/j.cels.2025.101373
Metadata
- Authors
- Horne, J., & Shukla, D.
- Venue
- Industrial & Engineering Chemistry Research
- Publisher
- American Chemical Society (ACS)
- Published
- 2022-04-06
- Volume
- 61
- Issue
- 19
- Pages
- 6235-6245
- ISSN
- 0888-5885 (ISSN-L)
- 1520-5045
- OpenAlex
- W4225930681
- Cited by
- 45
- References
- 22
- FWCI
- 2.42
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Institute of General Medical Sciences (R35GM142745)
- University of Illinois
- Cancer Center at Illinois, University of Illinois at Urbana-Champaign
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.