Prediction of protein biophysical traits from limited data: a case study on nanobody thermostability through NanoMelt
Open accessPublished version of a preprint
Abstract
1 Abstract In-silico prediction of protein biophysical traits is often hindered by the limited availability of experimental data and their heterogeneity. Training on limited data can lead to overfitting and poor generalisability to sequences distant from those in the training set. Additionally, inadequate use of scarce and disparate data can introduce biases during evaluation, leading to unreliable model performances being reported. Here, we present a comprehensive study exploring various approaches for protein fitness prediction from limited data, leveraging pre-trained embeddings, repeated stratified nested cross-validation, and ensemble learning to ensure an unbiased assessment of the performances. We applied our framework to introduce NanoMelt, a predictor of nanobody thermostability trained with a dataset of 640 measurements of apparent melting temperature, obtained by integrating data from the literature with 129 new measurements from this study. We find that an ensemble model stacking multiple regression using diverse sequence embeddings achieves state-of-the-art accuracy in predicting nanobody thermostability. We further demonstrate NanoMelt’s potential to streamline nanobody development by guiding the selection of highly stable nanobodies. We make the curated dataset of nanobody thermostability freely available and NanoMelt accessible as a downloadable software and webserver. 2 Significance Statement Rapidly predicting protein biophysical traits with accuracy is a key goal in protein engineering, yet efforts to develop reliable predictors are often hindered by limited and disparate experimental measurements. We introduce a framework to predict biophysical traits using few training data, leveraging diverse machine learning approaches via a semi-supervised framework combined with ensemble learning. We applied this framework to develop NanoMelt, a tool to predict nanobody thermostability trained on a new dataset of apparent melting temperatures. Nanobodies are increasingly important in research and therapeutics due to their ease of production and small size, which allows deeper tissue penetration and seamless combination into multi-specific compounds. NanoMelt outperforms available methods for protein thermostability prediction and can streamline nanobody development by guiding the design and selection of highly stable nanobodies during discovery and optimization campaigns.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764 · see citing works
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,523 · see citing works
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286 · see citing works
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280 · cited 1× · see citing works
“…sequences aligned with the AHo numbering scheme to a fixed length of 149 positions, as well as pre-trained embeddings derived from protein (ESM-1b 38 and ESM-2 4 ), antibody-specific (AbLang 39 and AntiBERTy 40 ), and nanobody-specific (nanoBERT 41 ) large language models, and from a…”
Bias in error estimation when using cross-validation for model selection
Varma, S., & Simon, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-91 · Cited by 2,485 · cited 2× · see citing works
“10 Our analysis with artificial data highlighted the importance of input representation in protein fitness prediction.”
The CamSol method of rational design of protein mutants with enhanced solubility
Sormanni, P., Aprile, F. A., & Vendruscolo, M. (2015) · Journal of Molecular Biology · doi:10.1016/j.jmb.2014.09.026 · Cited by 494 · see citing works
Self-citationMa, J., Fong, S. H., Luo, Y., Bakkenist, C. J., Shen, J. P., Mourragui, S., Wessels, L. F. A., Hafner, M., Sharan, R., Peng, J., et al. (2021) · Nature Cancer · doi:10.1038/s43018-020-00169-2 · Cited by 180 · see citing works
Flagged first, then by citations
- Authors
- Ramon, A., Ni, M., Predeina, O., Gaffey, R., Kunz, P., Onuoha, S., & Sormanni, P.
- Affiliations
- University of Cambridge (GB)
- German Cancer Research Center (DE)
- Chimeris UK, The Works
- Corresponding author
- Sormanni, Pietro
- Venue
- mAbs
- Publisher
- Informa UK Limited
- Published
- 2025-01-08
- Volume
- 17
- Issue
- 1
- Pages
- 2442750-2442750
- ISSN
- 1942-0862 (ISSN-L)
- 1942-0870
- PMC
- PMC11730357
- OpenAlex
- W4406176392
- Cited by
- 13
- References
- 7
- Citations by year
- 2026: 6 · 2025: 7
- FWCI
- 3.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- mAbs (publishedVersion, public-domain)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Engineering and Physical Sciences Research Council (EP/X024733/1)
- Royal Society (URF\R1\201461)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Monoclonal and Polyclonal Antibodies Research
- Keywords
- protein stability prediction, limited training data, sequence embeddings, nested cross-validation
- MeSH terms
- Computer Simulation, Humans, Software, Protein Stability, Single-Domain Antibodies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review