PROSTATA: a framework for protein stability assessment using transformers
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Motivation: Accurate prediction of change in protein stability due to point mutations is an attractive goal that remains unachieved. Despite the high interest in this area, little consideration has been given to the transformer architecture, which is dominant in many fields of machine learning. Results: In this work, we introduce PROSTATA, a predictive model built in a knowledge-transfer fashion on a new curated dataset. PROSTATA demonstrates advantage over existing solutions based on neural networks. We show that the large improvement margin is due to both the architecture of the model and the quality of the new training dataset. This work opens up opportunities to develop new lightweight and accurate models for protein stability assessment. Availability and implementation: PROSTATA is available at https://github.com/AIRI-Institute/PROSTATA and https://prostata.airi.net.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets
Steinegger, M., & Söding, J. (2017) · Nature Biotechnology · doi:10.1038/nbt.3988 · Cited by 4,840
HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
UniRef clusters: a comprehensive and scalable alternative for improving sequence similarity searches
Suzek, B. E., Wang, Y., Huang, H., McGarvey, P. B., Wu, C. H., & the UniProt Consortium (2015) · Bioinformatics · doi:10.1093/bioinformatics/btu739 · Cited by 1,928
The Rosetta All-Atom Energy Function for Macromolecular Modeling and Design
Alford, R. F., Leaver-Fay, A., Jeliazkov, J. R., O’Meara, M. J., DiMaio, F. P., Park, H., Shapovalov, M. V., Renfrew, P. D., Mulligan, V. K., Kappel, K., et al. (2017) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.7b00125 · Cited by 1,532
DynaMut: predicting the impact of mutations on protein conformation, flexibility and stability
Rodrigues, C. H., Pires, D. E., & Ascher, D. B. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky300 · Cited by 1,086
Pires, D. E. V., Ascher, D. B., & Blundell, T. L. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku411 · Cited by 932
Mega-scale experimental analysis of protein folding stability in biology and design
Tsuboyama, K., Dauparas, J., Chen, J., Laine, E., Mohseni Behbahani, Y., Weinstein, J. J., Mangan, N. M., Ovchinnikov, S., & Rocklin, G. J. (2023) · Nature · doi:10.1038/s41586-023-06328-6 · Cited by 350
Research works printed but not linked: 36
- Bæk, 2022, Data set and fitting dependencies when estimating protein mutant stability: toward simple, balanced, and interpretable models, J Comput Chem, 43, 504, 10.1002/jcc.26810 · DOI
- Benevenuta, 2021, An antisymmetric neural network to predict free energy changes in protein variants, J Phys D: Appl Phys, 54, 245403, 10.1088/1361-6463/abedfb · DOI · Paper page
- Born, 2023, Regression transformer enables concurrent sequence regression and generation for molecular language modelling, Nat Mach Intell, 5, 432, 10.1038/s42256-023-00639-z · DOI
- Caldararu, 2021, Three simple properties explain protein stability change upon mutation, J Chem Inf Model, 61, 1981, 10.1021/acs.jcim.1c00201 · DOI
- Camacho, 2009, BLAST+: architecture and applications, BMC Bioinformatics, 10, 421, 10.1186/1471-2105-10-421 · DOI · Paper page
- Cao, 2019, DeepDDG: predicting the stability change of protein point mutations using neural networks, J Chem Inf Model, 59, 1508, 10.1021/acs.jcim.8b00697 · DOI · Paper page
- Chen, 2020, PremPS: predicting the impact of missense mutations on protein stability, PLoS Comput Biol, 16, e1008543, 10.1371/journal.pcbi.1008543 · DOI · Paper page
- Chen, 2018, iFeature: a python package and web server for features extraction and selection from protein and peptide sequences, Bioinformatics, 34, 2499, 10.1093/bioinformatics/bty140 · DOI · Paper page
- Dehouck, 2011, PoPMuSiC 2.1: a web server for the estimation of protein stability changes upon mutation and sequence optimality, BMC Bioinformatics, 12, 151, 10.1186/1471-2105-12-151 · DOI · Paper page
- Fang, 2020, A critical review of five machine learning-based algorithms for predicting protein stability changes upon mutation, Brief Bioinform, 21, 1285, 10.1093/bib/bbz071 · DOI · Paper page
- Hie, 2022, Evolutionary velocity with protein language models predicts evolutionary dynamics of diverse proteins, Cell Syst, 13, 274, 10.1016/j.cels.2022.01.003 · DOI · Paper page
- Horne, 2022, Recent advances in machine learning variant effect prediction tools for protein engineering, Ind Eng Chem Res, 61, 6235, 10.1021/acs.iecr.1c04943 · DOI · Paper page
- Iqbal, 2022, PROST: AlphaFold2-aware sequence-based predictor to estimate protein stability changes upon missense mutations, J Chem Inf Model, 62, 4270, 10.1021/acs.jcim.2c00799 · DOI · Paper page
- Jung, 2023, DeepSTABp: a deep learning approach for the prediction of thermal protein stability, Int J Mol Sci, 24, 7444, 10.3390/ijms24087444 · DOI · Paper page
- Kabsch, 1983, Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features, Biopolymers, 22, 2577, 10.1002/bip.360221211 · DOI · Paper page
- Kellogg, 2011, Role of conformational sampling in computing mutation-induced changes in protein structure and stability, Proteins, 79, 830, 10.1002/prot.22921 · DOI · Paper page
- Laimer, 2016, MAESTROweb: a web server for structure-based protein stability prediction, Bioinformatics, 32, 1414, 10.1093/bioinformatics/btv769 · DOI · Paper page
- Leman, 2020, Macromolecular modeling and design in Rosetta: recent methods and frameworks, Nat Methods, 17, 665, 10.1038/s41592-020-0848-2 · DOI · Paper page
- Li, 2020, Predicting changes in protein thermodynamic stability upon point mutation with deep 3D convolutional neural networks, PLoS Comput Biol, 16, e1008291, 10.1371/journal.pcbi.1008291 · DOI · Paper page
- Mirdita, 2017, Uniclust databases of clustered and deeply annotated protein sequences and alignments, Nucleic Acids Res, 45, D170, 10.1093/nar/gkw1081 · DOI · Paper page
- Montanucci, 2022, DDGun: an untrained predictor of protein stability changes upon amino acid variants, Nucleic Acids Res, 50, W222, 10.1093/nar/gkac325 · DOI · Paper page
- Nair, 2013, VariBench: a benchmark database for variations, Hum Mutat, 34, 42, 10.1002/humu.22204 · DOI · Paper page
- Nikam, 2021, ProThermDB: thermodynamic database for proteins and mutants revisited after 15 years, Nucleic Acids Res, 49, D420, 10.1093/nar/gkaa1035 · DOI · Paper page
- Pak, 2022, Best templates outperform homology models in predicting the impact of mutations on protein stability, Bioinformatics, 38, 4312, 10.1093/bioinformatics/btac515 · DOI · Paper page
- Pancotti, 2022, Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset, Brief Bioinform, 23, bbab555, 10.1093/bib/bbab555 · DOI · Paper page
- Pancotti, 2021, A deep-learning sequence-based method to predict protein stability changes upon genetic variations, Genes (Basel), 12, 911, 10.3390/genes12060911 · DOI · Paper page
- Pandurangan, 2017, SDM: a server for predicting effects of mutations on protein stability, Nucleic Acids Res, 45, W229, 10.1093/nar/gkx439 · DOI · Paper page
- Quan, 2016, STRUM: structure-based prediction of protein stability changes upon single-point mutation, Bioinformatics, 32, 2936, 10.1093/bioinformatics/btw361 · DOI · Paper page
- Rodrigues, 2021, DynaMut2: assessing changes in stability and flexibility upon single and multiple point missense mutations, Protein Sci, 30, 60, 10.1002/pro.3942 · DOI · Paper page
- Samaga, 2021, SCONES: self-consistent neural network for protein stability prediction upon mutation, J Phys Chem B, 125, 10657, 10.1021/acs.jpcb.1c04913 · DOI
- Savojardo, 2021, On the critical review of five machine learning-based algorithms for predicting protein stability changes upon mutation, Brief Bioinform, 22, 601, 10.1093/bib/bbz168 · DOI
- Shashkova, 2022, SEMA: antigen B-cell conformational epitope prediction using deep transfer learning, Front Immunol, 13, 960985, 10.3389/fimmu.2022.960985 · DOI · Paper page
- Wang, 2022, BayeStab: predicting effects of mutations on protein stability with uncertainty quantification, Protein Sci, 31, e4467, 10.1002/pro.4467 · DOI · Paper page
- Wang, 2023, ProS-GNN: predicting effects of mutations on protein stability using graph neural networks, Comput Biol Chem, 107, 107952, 10.1016/j.compbiolchem.2023.107952 · DOI
- Worth, 2011, SDM—a server for predicting effects of mutations on protein stability and malfunction, Nucleic Acids Res, 39, W215, 10.1093/nar/gkr363 · DOI · Paper page
- Zhou, 2023, DDMut: predicting effects of mutations on protein stability using deep learning, Nucleic Acids Res, 51, W122, 10.1093/nar/gkad472 · DOI · Paper page
Cited by
Transfer learning to leverage larger datasets for improved prediction of protein stability changes
Dieckhaus, H., Brocidiacono, M., Randolph, N. Z., & Kuhlman, B. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2314853121 · Cited by 205
An end-to-end framework for the prediction of protein structure and fitness from single sequence
Chen, Y., Xu, Y., Liu, D., Xing, Y., & Gong, H. (2024) · Nature Communications · doi:10.1038/s41467-024-51776-x · Cited by 45
ESM ‐scan—A tool to guide amino acid substitutions
Totaro, M. G., Vide, U., Zausinger, R., Winkler, A., & Oberdorfer, G. (2024) · Protein Science · doi:10.1002/pro.5221 · Cited by 19
Exploring Evolution to Uncover Insights Into Protein Mutational Stability
Hermans, P., Tsishyn, M., Schwersensky, M., Rooman, M., & Pucci, F. (2025) · Molecular Biology and Evolution · doi:10.1093/molbev/msae267 · Cited by 6
Metadata
- Authors
- Umerenkov, D., Nikolaev, F., Shashkova, T. I., Strashnov, P. V., Sindeeva, M., Shevtsov, A., Ivanisenko, N. V., & Kardymon, O. L.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-11-01
- Volume
- 39
- Issue
- 11
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W4388486442
- Cited by
- 35
- References
- 13
- FWCI
- 2.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.