The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Prediction of protein biophysical traits from limited data: a case study on nanobody thermostability through NanoMelt
Open accessPreprint — published as 10.1080/19420862.2024.2442750 · Paper page
Abstract
1 In-silico prediction of protein biophysical traits is often hindered by the limited availability of experimental data and their heterogeneity. Training on limited data can lead to overfitting and poor generalisability to sequences distant from those in the training set. Additionally, inadequate use of scarce and disparate data can introduce biases during evaluation, leading to unreliable model performances being reported. Here, we present a comprehensive study exploring various approaches for protein fitness prediction from limited data, leveraging pre-trained embeddings, repeated stratified nested cross-validation, and ensemble learning to ensure an unbiased assessment of the performances. We applied our framework to introduce NanoMelt, a predictor of nanobody thermostability trained with a dataset of 640 measurements of apparent melting temperature, obtained by integrating data from the literature with 129 new measurements from this study. We find that an ensemble model stacking multiple regression using diverse sequence embeddings achieves state-of-the-art accuracy in predicting nanobody thermostability. We further demonstrate NanoMelt’s potential to streamline nanobody development by guiding the selection of highly stable nanobodies. We make the curated dataset of nanobody thermostability freely available and NanoMelt accessible as a downloadable software and webserver. 2 Significance Statement: Rapidly predicting protein biophysical traits with accuracy is a key goal in protein engineering, yet efforts to develop reliable predictors are often hindered by limited and disparate experimental measurements. We introduce a framework to predict biophysical traits using few training data, leveraging diverse machine learning approaches via a semi-supervised framework combined with ensemble learning. We applied this framework to develop NanoMelt, a tool to predict nanobody thermostability trained on a new dataset of apparent melting temperatures. Nanobodies are increasingly important in research and therapeutics due to their ease of production and small size, which allows deeper tissue penetration and seamless combination into multi-specific compounds. NanoMelt outperforms available methods for protein thermostability prediction and can streamline nanobody development by guiding the design and selection of highly stable nanobodies during discovery and optimization campaigns.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Flagged first, then by citations
Research works printed but not linked: 69
- 10.1038/s43586-021-00093-4 · DOI
- 2019, In vivo Protein Evolution, Next Generation Protein Engineering Strategy: from Random Approach to Target-specific Approach, Biotechnol. Bioprocess Eng, 24, 85, 10.1007/s12257-018-0394-2 · DOI
- J. Meier , et al., Language models enable zero-shot prediction of the effects of mutations on protein function in Advances in Neural Information Processing Systems, (Curran Associates, Inc., 2021), pp. 29287–29303. · DOI · Paper page
- 10.1126/science.ade2574 · DOI · Paper page
- 10.1016/j.csbj.2018.01.002 · DOI
- 10.1093/bioinformatics/bti315 · DOI
- 2023, Automated optimisation of solubility and conformational stability of antibodies and proteins, Nat. Commun, 14, 1937, 10.1038/s41467-023-37668-6 · DOI
- J. A. Barbero-Aparicio , A. Olivares-Gil , J. J. Rodríguez , C. García-Osorio , J. F. Díez-Pastor , Addressing data scarcity in protein fitness landscape analysis: A study on semi-supervised and deep transfer learning techniques. Inf. Fusion 102, 102035 (2024). · DOI
- S. Varma , R. Simon , Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics 7, 91 (2006). · DOI · Paper page
- D. Krstajic , L. J. Buturovic , D. E. Leahy , S. Thomas , Cross-validation pitfalls when selecting and assessing regression and classification models. J. Cheminformatics 6 (2014). · DOI · Paper page
- A. Safonova , et al., Ten deep learning techniques to address small data problems with remote sensing. Int. J. Appl. Earth Obs. Geoinformation 125, 103569 (2023). · DOI
- 2023, Small data machine learning in materials science, Npj Comput. Mater, 9, 1
- 10.1038/s41587-021-01146-5 · DOI
- 2021, Few-shot learning creates predictive models of drug response that translate from high-throughput screens to individual patients. Nat, Cancer, 2, 233
- 10.3390/PHARMACEUTICS15051337/S1 · DOI
- M. Shahhosseini , G. Hu , H. Pham , Optimizing Ensemble Weights and Hyperparameters of Machine Learning Models for Regression Problems. [Preprint] (2019). Available at: http://arxiv.org/abs/1908.05287 [Accessed 4 September 2024]. · arXiv
- 10.1093/protein/13.3.179 · DOI
- 2023, Glycosylation Contributes to Thermostability and Proteolytic Resistance of rFIP-nha (Nectria haematococca), Mol. Basel Switz, 28, 6386
- 10.1177/1087057106297984 · DOI
- 10.1016/S0006-3495(00)76602-1 · DOI
- 10.1093/protein/9.12.1197 · DOI
- S. Timr , D. Madern , F. Sterpone , “Chapter Six - Protein thermal stability” in Progress in Molecular Biology and Translational Science, Computational Approaches for Understanding Dynamical Systems: Protein Folding and Assembly., B. Strodel , B. Barz , Eds. (Academic Press, 2020), pp. 239–272. · DOI
- 10.1093/nar/gkaa1035 · DOI
- Z. A. Rollins , T. Widatalla , A. C. Cheng , E. Metwally , AbMelt: Learning antibody thermostability from molecular dynamics. Biophys. J. 0 (2024). · DOI
- 2023, DeepSTABp: A Deep Learning Approach for the Prediction of Thermal Protein Stability, Int. J. Mol. Sci, 24, 7444, 10.3390/ijms24087444 · DOI
- Y. Yang , J. Zhao , L. Zeng , M. Vihinen , ProTstab2 for Prediction of Protein Thermal Stabilities. Int. J. Mol. Sci. 23, 10798 (2022). · DOI
- 10.3390/ijms24032217 · DOI
- A. Harmalkar , et al., Toward generalizable prediction of antibody thermostability using machine learning on sequence and structure features. mAbs 15 (2023). · DOI
- 10.1146/annurev-biochem-063011-092449 · DOI · Paper page
- 10.1038/363446a0 · DOI · Paper page
- 10.1038/nprot.2014.039 · DOI
- 10.1038/s41467-018-02974-x · DOI · Paper page
- 10.1016/j.cell.2022.05.029 · DOI
- M. S. Valdés-Tresanco , M. E. Valdés-Tresanco , E. Molina-Abad , E. Moreno , NbThermo: a new thermostability database for nanobodies. Database 2023 (2023). · DOI
- 10.1016/j.jmb.2014.09.026 · DOI · Paper page
- 10.1002/bip.20296 · DOI
- A. Rives , et al., Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proc. Natl. Acad. Sci. U. S. A. 118 (2021). · DOI · Paper page
- 10.1101/2024.01.31.578143 · DOI
- B. Abanades , et al., ImmuneBuilder: Deep-Learning models for predicting the structures of immune proteins. Commun Biol 6 (2023). · DOI
- 10.1038/s41592-021-01100-y · DOI · Paper page
- 10.1038/s41598-018-23276-8 · DOI
- 2017, The fluorescence intensities ratio is not a reliable parameter for evaluation of protein unfolding transitions, Protein Sci, 26, 1236, 10.1002/pro.3170 · DOI
- P. J. Huber , “Robust Estimation of a Location Parameter” in Breakthroughs in Statistics: Methodology and Distribution, S. Kotz , N. L. Johnson , Eds. (Springer, 1992), pp. 492–518. · DOI
- 10.1111/j.1467-9868.2005.00503.x · DOI · Paper page
- 10.1023/A:1010933404324 · DOI · Paper page
- G. Ke , et al., LightGBM: A Highly Efficient Gradient Boosting Decision Tree in Advances in Neural Information Processing Systems, (Curran Associates, Inc., 2017).
- 10.1007/BF00994018 · DOI · Paper page
- C. Williams , C. Rasmussen , Gaussian Processes for Regression in Advances in Neural Information Processing Systems, (MIT Press, 1995).
- R. Kohavi , A study of cross-validation and bootstrap for accuracy estimation and model selection in Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2, IJCAI’95., (Morgan Kaufmann Publishers Inc., 1995), pp. 1137–1143.
- 10.1007/BF00117832 · DOI
- Application of Assisted Design of Antibody and Protein Therapeutics (ADAPT) improves efficacy of a Clostridium difficile toxin A single-domain antibody - PubMed. Available at: https://pubmed.ncbi.nlm.nih.gov/29396522/ [Accessed 16 May 2024].
- 10.1093/nar/gki387 · DOI · Paper page
- 10.1093/protein/gzp030 · DOI · Paper page
- 10.1038/s42256-023-00778-3 · DOI
- M. Oeller , et al., Sequence-based prediction of pH-dependent protein solubility using CamSol. Brief. Bioinform. 24, bbad004 (2023). · DOI
- A. M. Wolf Pérez , N. Lorenzen , M. Vendruscolo , P. Sormanni, Assessment of Therapeutic Antibody Developability by Combinations of In Vitro and In Silico Methods (2022). · DOI
- J. Hoffmann , et al., Training Compute-Optimal Large Language Models. [Preprint] (2022). Available at: http://arxiv.org/abs/2203.15556 [Accessed 16 May 2024]. · arXiv
- 2019, An Overview of Overfitting and its Solutions, J. Phys. Conf. Ser, 1168, 022022, 10.1088/1742-6596/1168/2/022022 · DOI · Paper page
- A. M. Hummer , C. Schneider , L. Chinery , C. M. Deane , Investigating the Volume and Diversity of Data Needed for Generalizable Antibody-Antigen ΔΔG Prediction. [Preprint] (2023). Available at: https://www.biorxiv.org/content/10.1101/2023.05.17.541222v1 [Accessed 28 July 2024]. · DOI
- 10.1006/jmbi.2001.4662 · DOI
- J. Dunbar , C. M. Deane , ANARCI: antigen receptor numbering and receptor classification. Bioinformatics 32, 298 (2016). · DOI
- 10.1093/NAR/GKAC1052 · DOI · Paper page
- 10.1002/PRO.4205 · DOI · Paper page
- INDI—integrated nanobody database for immunoinformatics | Nucleic Acids Research | Oxford Academic. Available at: https://academic.oup.com/nar/article/50/D1/D1273/6423188 [Accessed 8 May 2024]. · DOI
- 10.1093/nar/gkt1043 · DOI · Paper page
- F. Pedregosa , et al., Scikit-learn: Machine Learning in Python. [Preprint] (2018). Available at: http://arxiv.org/abs/1201.0490 [Accessed 9 May 2024]. · arXiv
- Protein Data Bank | Nucleic Acids Research | Oxford Academic. Available at: https://academic.oup.com/nar/article/28/1/235/2384399?login=false [Accessed 9 May 2024].
- 10.2307/3948866 · DOI
- V. Satopaa , J. Albrecht , D. Irwin , B. Raghavan , Finding a “Kneedle” in a Haystack: Detecting Knee Points in System Behavior in 2011 31st International Conference on Distributed Computing Systems Workshops, (2011), pp. 166–171. · DOI
Metadata
- Authors
- Ramon, A., Ni, M., Predeina, O., Gaffey, R., Kunz, P., Onuoha, S., & Sormanni, P.
- Affiliations
- University of Cambridge (GB)
- German Cancer Research Center (DE)
- Corresponding author
- Sormanni, Pietro
- Venue
- mAbs
- Publisher
- openRxiv
- Published
- 2024-09-19
- Volume
- 17
- Issue
- 1
- Pages
- 2442750-2442750
- ISSN
- 1942-0862 (ISSN-L)
- PMC
- PMC11730357
- OpenAlex
- W4406176392
- Cited by
- 13
- References
- 1
- Citations by year
- 2026: 6 · 2025: 7
- FWCI
- 3.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- mAbs (publishedVersion, public-domain)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- UK Research and Innovation
- Royal Society (URF\R1\201461)
- Medical Research Council
- Engineering and Physical Sciences Research Council (EP/X024733/1)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Immunology and Microbiology › Immunology › Monoclonal and Polyclonal Antibodies Research
- Keywords
- protein stability prediction, limited training data, sequence embeddings, nested cross-validation
- MeSH terms
- Computer Simulation, Humans, Software, Protein Stability, Single-Domain Antibodies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review