Enhancing efficiency of protein language models with minimal wet-lab data through few-shot learning
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Accurately modeling the protein fitness landscapes holds great importance for protein engineering. Pre-trained protein language models have achieved state-of-the-art performance in predicting protein fitness without wet-lab experimental data, but their accuracy and interpretability remain limited. On the other hand, traditional supervised deep learning models require abundant labeled training examples for performance improvements, posing a practical barrier. In this work, we introduce FSFP, a training strategy that can effectively optimize protein language models under extreme data scarcity for fitness prediction. By combining meta-transfer learning, learning to rank, and parameter-efficient fine-tuning, FSFP can significantly boost the performance of various protein language models using merely tens of labeled single-site mutants from the target protein. In silico benchmarks across 87 deep mutational scanning datasets demonstrate FSFP’s superiority over both unsupervised and supervised baselines. Furthermore, we successfully apply FSFP to engineer the Phi29 DNA polymerase through wet-lab experiments, achieving a 25% increase in the positive rate. These results underscore the potential of our approach in aiding AI-guided protein engineering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets
Steinegger, M., & Söding, J. (2017) · Nature Biotechnology · doi:10.1038/nbt.3988 · Cited by 4,840 · cited 1×
“Tosearch forrelated proteins, FSFPoriginally computesthecosine similarities between the protein embeddings yielded by PLMs, while other methods can also be adopted such as MMseqs2 52 and Foldseek 53 (Supplementary Fig.”
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280 · cited 2×
“ESM-1v 12 is a transformer language model for variant effects prediction, which employs the ESM-1b architecture and masked language modeling approach of Rives et al. 40 .”
BackgroundMethodFast and accurate protein structure search with Foldseek
van Kempen, M., Kim, S. S., Tumescheit, C., Mirdita, M., Lee, J., Gilchrist, C. L. M., Söding, J., & Steinegger, M. (2022) · doi:10.1101/2022.02.07.479398 · Cited by 2,598
Fast and accurate protein structure search with Foldseek
van Kempen, M., Kim, S. S., Tumescheit, C., Mirdita, M., Lee, J., Gilchrist, C. L. M., Söding, J., & Steinegger, M. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-01773-0 · Cited by 2,596 · cited 2×
“Tosearch forrelated proteins, FSFPoriginally computesthecosine similarities between the protein embeddings yielded by PLMs, while other methods can also be adopted such as MMseqs2 52 and Foldseek 53 (Supplementary Fig.”
MethodProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
Elnaggar, A., Heinzinger, M., Dallago, C., Rehawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., Steinegger, M., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3095381 · Cited by 2,329
RoFormer: Enhanced transformer with rotary position embedding
Su, J., Ahmed, M., Lu, Y., Pan, S., Bo, W., & Liu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2023.127063 · Cited by 1,957
RoFormer: Enhanced Transformer with Rotary Position Embedding
Su, J., Lu, Y., Pan, S., Murtadha, A., Wen, B., & Liu, Y. (2021) · arXiv · doi:10.48550/arxiv.2104.09864 · Cited by 1,952
Cited by
Democratizing protein language model training, sharing and collaboration
Su, J., Li, Z., Tao, T., Han, C., He, Y., Dai, F., Yuan, Q., Gao, Y., Si, T., Zhang, X., et al. (2026) · Nature Biotechnology · doi:10.1038/s41587-025-02859-7 · Cited by 35
Self-citationIntegrating Computational Design and Experimental Approaches for Next-Generation Biologics
Son, A., Park, J., Kim, W., Lee, W., Yoon, Y., Ji, J., & Kim, H. (2024) · Biomolecules · doi:10.3390/biom14091073 · Cited by 29
Discovery of highly active kynureninases for cancer immunotherapy through protein language model
Eom, H., Park, S., Cho, K. S., Lee, J., Kim, H., Kim, S., Yang, J., Han, Y.-H., Lee, J., Seok, C., et al. (2025) · Nucleic Acids Research · doi:10.1093/nar/gkae1245 · Cited by 10
AI-enabled alkaline-resistant evolution of protein to apply in mass production
Kang, L., Wu, B., Zhou, B., Tan, P., Kang, Y. (., Yan, Y., Zong, Y., Li, S., Liu, Z., & Hong, L. (2025) · eLife · doi:10.7554/elife.102788 · Cited by 7
Self-citationAI-enabled alkaline-resistant evolution of protein to apply in mass production
Kang, L., Wu, B., Zhou, B., Tan, P., Kang, Y. (., Yan, Y., Zong, Y., Li, S., Liu, Z., & Hong, L. (2025) · eLife · doi:10.7554/elife.102788.3
Self-citation
Metadata
- Authors
- Zhou, Z., Zhang, L., Yu, Y., Wu, B., Li, M., Hong, L., & Tan, P.
- Venue
- Nature Communications
- Published
- 2024-07-02
- Volume
- 15
- Issue
- 1
- Pages
- 5566-5566
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W4400227417
- Cited by
- 81
- References
- 24
- FWCI
- 9.41
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Enhancing efficiency of protein language models with minimal wet-lab data through few-shot learning. https://app.cochat.ai/papers/10.1038/s41467-024-49798-6
- The paper
- Zhou, Z., Zhang, L., Yu, Y., Wu, B., Li, M., Hong, L., & Tan, P. (2024). Enhancing efficiency of protein language models with minimal wet-lab data through few-shot learning. Nature Communications. https://doi.org/10.1038/s41467-024-49798-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.