PreprintCited by 13Machine Learning in BioinformaticsProtein Structure and DynamicsMonoclonal and Polyclonal Antibodies Research

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Prediction of protein biophysical traits from limited data: a case study on nanobody thermostability through NanoMelt

Open access

Preprint — published as 10.1080/19420862.2024.2442750 · Paper page

Abstract

1 In-silico prediction of protein biophysical traits is often hindered by the limited availability of experimental data and their heterogeneity. Training on limited data can lead to overfitting and poor generalisability to sequences distant from those in the training set. Additionally, inadequate use of scarce and disparate data can introduce biases during evaluation, leading to unreliable model performances being reported. Here, we present a comprehensive study exploring various approaches for protein fitness prediction from limited data, leveraging pre-trained embeddings, repeated stratified nested cross-validation, and ensemble learning to ensure an unbiased assessment of the performances. We applied our framework to introduce NanoMelt, a predictor of nanobody thermostability trained with a dataset of 640 measurements of apparent melting temperature, obtained by integrating data from the literature with 129 new measurements from this study. We find that an ensemble model stacking multiple regression using diverse sequence embeddings achieves state-of-the-art accuracy in predicting nanobody thermostability. We further demonstrate NanoMelt’s potential to streamline nanobody development by guiding the selection of highly stable nanobodies. We make the curated dataset of nanobody thermostability freely available and NanoMelt accessible as a downloadable software and webserver. 2 Significance Statement: Rapidly predicting protein biophysical traits with accuracy is a key goal in protein engineering, yet efforts to develop reliable predictors are often hindered by limited and disparate experimental measurements. We introduce a framework to predict biophysical traits using few training data, leveraging diverse machine learning approaches via a semi-supervised framework combined with ensemble learning. We applied this framework to develop NanoMelt, a tool to predict nanobody thermostability trained on a new dataset of apparent melting temperatures. Nanobodies are increasingly important in research and therapeutics due to their ease of production and small size, which allows deeper tissue penetration and seamless combination into multi-specific compounds. NanoMelt outperforms available methods for protein thermostability prediction and can streamline nanobody development by guiding the design and selection of highly stable nanobodies during discovery and optimization campaigns.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2024.09.13.612907

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 69

  1. 10.1038/s43586-021-00093-4 · DOI
  2. 2019, In vivo Protein Evolution, Next Generation Protein Engineering Strategy: from Random Approach to Target-specific Approach, Biotechnol. Bioprocess Eng, 24, 85, 10.1007/s12257-018-0394-2 · DOI
  3. J. Meier , et al., Language models enable zero-shot prediction of the effects of mutations on protein function in Advances in Neural Information Processing Systems, (Curran Associates, Inc., 2021), pp. 29287–29303. · DOI · Paper page
  4. 10.1126/science.ade2574 · DOI · Paper page
  5. 10.1016/j.csbj.2018.01.002 · DOI
  6. 10.1093/bioinformatics/bti315 · DOI
  7. 2023, Automated optimisation of solubility and conformational stability of antibodies and proteins, Nat. Commun, 14, 1937, 10.1038/s41467-023-37668-6 · DOI
  8. J. A. Barbero-Aparicio , A. Olivares-Gil , J. J. Rodríguez , C. García-Osorio , J. F. Díez-Pastor , Addressing data scarcity in protein fitness landscape analysis: A study on semi-supervised and deep transfer learning techniques. Inf. Fusion 102, 102035 (2024). · DOI
  9. S. Varma , R. Simon , Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics 7, 91 (2006). · DOI · Paper page
  10. D. Krstajic , L. J. Buturovic , D. E. Leahy , S. Thomas , Cross-validation pitfalls when selecting and assessing regression and classification models. J. Cheminformatics 6 (2014). · DOI · Paper page
  11. A. Safonova , et al., Ten deep learning techniques to address small data problems with remote sensing. Int. J. Appl. Earth Obs. Geoinformation 125, 103569 (2023). · DOI
  12. 2023, Small data machine learning in materials science, Npj Comput. Mater, 9, 1
  13. 10.1038/s41587-021-01146-5 · DOI
  14. 2021, Few-shot learning creates predictive models of drug response that translate from high-throughput screens to individual patients. Nat, Cancer, 2, 233
  15. 10.3390/PHARMACEUTICS15051337/S1 · DOI
  16. M. Shahhosseini , G. Hu , H. Pham , Optimizing Ensemble Weights and Hyperparameters of Machine Learning Models for Regression Problems. [Preprint] (2019). Available at: http://arxiv.org/abs/1908.05287 [Accessed 4 September 2024]. · arXiv
  17. 10.1093/protein/13.3.179 · DOI
  18. 2023, Glycosylation Contributes to Thermostability and Proteolytic Resistance of rFIP-nha (Nectria haematococca), Mol. Basel Switz, 28, 6386
  19. 10.1177/1087057106297984 · DOI
  20. 10.1016/S0006-3495(00)76602-1 · DOI
  21. 10.1093/protein/9.12.1197 · DOI
  22. S. Timr , D. Madern , F. Sterpone , “Chapter Six - Protein thermal stability” in Progress in Molecular Biology and Translational Science, Computational Approaches for Understanding Dynamical Systems: Protein Folding and Assembly., B. Strodel , B. Barz , Eds. (Academic Press, 2020), pp. 239–272. · DOI
  23. 10.1093/nar/gkaa1035 · DOI
  24. Z. A. Rollins , T. Widatalla , A. C. Cheng , E. Metwally , AbMelt: Learning antibody thermostability from molecular dynamics. Biophys. J. 0 (2024). · DOI
  25. 2023, DeepSTABp: A Deep Learning Approach for the Prediction of Thermal Protein Stability, Int. J. Mol. Sci, 24, 7444, 10.3390/ijms24087444 · DOI
  26. Y. Yang , J. Zhao , L. Zeng , M. Vihinen , ProTstab2 for Prediction of Protein Thermal Stabilities. Int. J. Mol. Sci. 23, 10798 (2022). · DOI
  27. 10.3390/ijms24032217 · DOI
  28. A. Harmalkar , et al., Toward generalizable prediction of antibody thermostability using machine learning on sequence and structure features. mAbs 15 (2023). · DOI
  29. 10.1146/annurev-biochem-063011-092449 · DOI · Paper page
  30. 10.1038/363446a0 · DOI · Paper page
  31. 10.1038/nprot.2014.039 · DOI
  32. 10.1038/s41467-018-02974-x · DOI · Paper page
  33. 10.1016/j.cell.2022.05.029 · DOI
  34. M. S. Valdés-Tresanco , M. E. Valdés-Tresanco , E. Molina-Abad , E. Moreno , NbThermo: a new thermostability database for nanobodies. Database 2023 (2023). · DOI
  35. 10.1016/j.jmb.2014.09.026 · DOI · Paper page
  36. 10.1002/bip.20296 · DOI
  37. A. Rives , et al., Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proc. Natl. Acad. Sci. U. S. A. 118 (2021). · DOI · Paper page
  38. 10.1101/2024.01.31.578143 · DOI
  39. B. Abanades , et al., ImmuneBuilder: Deep-Learning models for predicting the structures of immune proteins. Commun Biol 6 (2023). · DOI
  40. 10.1038/s41592-021-01100-y · DOI · Paper page
  41. 10.1038/s41598-018-23276-8 · DOI
  42. 2017, The fluorescence intensities ratio is not a reliable parameter for evaluation of protein unfolding transitions, Protein Sci, 26, 1236, 10.1002/pro.3170 · DOI
  43. P. J. Huber , “Robust Estimation of a Location Parameter” in Breakthroughs in Statistics: Methodology and Distribution, S. Kotz , N. L. Johnson , Eds. (Springer, 1992), pp. 492–518. · DOI
  44. 10.1111/j.1467-9868.2005.00503.x · DOI · Paper page
  45. 10.1023/A:1010933404324 · DOI · Paper page
  46. G. Ke , et al., LightGBM: A Highly Efficient Gradient Boosting Decision Tree in Advances in Neural Information Processing Systems, (Curran Associates, Inc., 2017).
  47. 10.1007/BF00994018 · DOI · Paper page
  48. C. Williams , C. Rasmussen , Gaussian Processes for Regression in Advances in Neural Information Processing Systems, (MIT Press, 1995).
  49. R. Kohavi , A study of cross-validation and bootstrap for accuracy estimation and model selection in Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2, IJCAI’95., (Morgan Kaufmann Publishers Inc., 1995), pp. 1137–1143.
  50. 10.1007/BF00117832 · DOI
  51. Application of Assisted Design of Antibody and Protein Therapeutics (ADAPT) improves efficacy of a Clostridium difficile toxin A single-domain antibody - PubMed. Available at: https://pubmed.ncbi.nlm.nih.gov/29396522/ [Accessed 16 May 2024].
  52. 10.1093/nar/gki387 · DOI · Paper page
  53. 10.1093/protein/gzp030 · DOI · Paper page
  54. 10.1038/s42256-023-00778-3 · DOI
  55. M. Oeller , et al., Sequence-based prediction of pH-dependent protein solubility using CamSol. Brief. Bioinform. 24, bbad004 (2023). · DOI
  56. A. M. Wolf Pérez , N. Lorenzen , M. Vendruscolo , P. Sormanni, Assessment of Therapeutic Antibody Developability by Combinations of In Vitro and In Silico Methods (2022). · DOI
  57. J. Hoffmann , et al., Training Compute-Optimal Large Language Models. [Preprint] (2022). Available at: http://arxiv.org/abs/2203.15556 [Accessed 16 May 2024]. · arXiv
  58. 2019, An Overview of Overfitting and its Solutions, J. Phys. Conf. Ser, 1168, 022022, 10.1088/1742-6596/1168/2/022022 · DOI · Paper page
  59. A. M. Hummer , C. Schneider , L. Chinery , C. M. Deane , Investigating the Volume and Diversity of Data Needed for Generalizable Antibody-Antigen ΔΔG Prediction. [Preprint] (2023). Available at: https://www.biorxiv.org/content/10.1101/2023.05.17.541222v1 [Accessed 28 July 2024]. · DOI
  60. 10.1006/jmbi.2001.4662 · DOI
  61. J. Dunbar , C. M. Deane , ANARCI: antigen receptor numbering and receptor classification. Bioinformatics 32, 298 (2016). · DOI
  62. 10.1093/NAR/GKAC1052 · DOI · Paper page
  63. 10.1002/PRO.4205 · DOI · Paper page
  64. INDI—integrated nanobody database for immunoinformatics | Nucleic Acids Research | Oxford Academic. Available at: https://academic.oup.com/nar/article/50/D1/D1273/6423188 [Accessed 8 May 2024]. · DOI
  65. 10.1093/nar/gkt1043 · DOI · Paper page
  66. F. Pedregosa , et al., Scikit-learn: Machine Learning in Python. [Preprint] (2018). Available at: http://arxiv.org/abs/1201.0490 [Accessed 9 May 2024]. · arXiv
  67. Protein Data Bank | Nucleic Acids Research | Oxford Academic. Available at: https://academic.oup.com/nar/article/28/1/235/2384399?login=false [Accessed 9 May 2024].
  68. 10.2307/3948866 · DOI
  69. V. Satopaa , J. Albrecht , D. Irwin , B. Raghavan , Finding a “Kneedle” in a Haystack: Detecting Knee Points in System Behavior in 2011 31st International Conference on Distributed Computing Systems Workshops, (2011), pp. 166–171. · DOI

Metadata

Authors
Ramon, A., Ni, M., Predeina, O., Gaffey, R., Kunz, P., Onuoha, S., & Sormanni, P.
Affiliations
  • University of Cambridge (GB)
  • German Cancer Research Center (DE)
Corresponding author
Sormanni, Pietro
Venue
mAbs
Publisher
openRxiv
Published
2024-09-19
Volume
17
Issue
1
Pages
2442750-2442750
ISSN
1942-0862 (ISSN-L)
OpenAlex
W4406176392
Cited by
13
References
1
Citations by year
2026: 6 · 2025: 7
FWCI
3.88
Type
journal article
Language
en
Open access
Locations
  • mAbs (publishedVersion, public-domain)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Apollo (University of Cambridge) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • UK Research and Innovation
  • Royal Society (URF\R1\201461)
  • Medical Research Council
  • Engineering and Physical Sciences Research Council (EP/X024733/1)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Life Sciences › Immunology and Microbiology › Immunology › Monoclonal and Polyclonal Antibodies Research
Keywords
protein stability prediction, limited training data, sequence embeddings, nested cross-validation
MeSH terms
Computer Simulation, Humans, Software, Protein Stability, Single-Domain Antibodies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review