CoChat

Evaluating the advancements in protein language models for encoding strategies in protein function prediction: a comprehensive review

Open access
Chen, Jia-Ying, Wang, Jing-Fu, Hu, Yue, Li, Xin-Hui, Qian, Yu-Rong, Song, Chao-Lin · 2025 · Frontiers in Bioengineering and Biotechnology
Cited by 49

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

Protein function prediction is crucial in several key areas such as bioinformatics and drug design. With the rapid progress of deep learning technology, applying protein language models has become a research focus. These models utilize the increasing amount of large-scale protein sequence data to deeply mine its intrinsic semantic information, which can effectively improve the accuracy of protein function prediction. This review comprehensively combines the current status of applying the latest protein language models in protein function prediction. It provides an exhaustive performance comparison with traditional prediction methods. Through the in-depth analysis of experimental results, the significant advantages of protein language models in enhancing the accuracy and depth of protein function prediction tasks are fully demonstrated.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fbioe.2025.1506508

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Research works printed but not linked: 67

  1. Aggarwal, 2022, A review of deep learning techniques for protein function prediction, arXiv Prepr. arXiv:2211.09705, 10.48550/arXiv.2211.09705 · DOI
  2. Aleksander, 2023, The gene ontology knowledgebase in 2023, Genetics, 224, iyad031, 10.1093/genetics/iyad031 · DOI · Paper page
  3. Altschul, 1990, Basic local alignment search tool, J. Mol. Biol., 215, 403, 10.1006/jmbi.1990.9999 · doi:10.1006/jmbi.1990.9999 · Paper page
  4. Altschul, 1997, Gapped blast and psi-blast: a new generation of protein database search programs, Nucleic acids Res., 25, 3389, 10.1093/nar/25.17.3389 · DOI · Paper page
  5. Ashburner, 2000, Gene ontology: tool for the unification of biology, Nat. Genet., 25, 25, 10.1038/75556 · DOI · Paper page
  6. Avery, 2022, Protein function analysis through machine learning, Biomolecules, 12, 1246, 10.3390/biom12091246 · DOI
  7. Berman, 2000, The protein data bank, Nucleic acids Res., 28, 235, 10.1093/nar/28.1.235 · DOI · Paper page
  8. Bernardes, 2013, A review of protein function prediction under machine learning perspective, Recent Pat. Biotechnol., 7, 122, 10.2174/18722083113079990006 · DOI
  9. Bonetta, 2020, Machine learning techniques for protein function prediction, Proteins Struct. Funct. Bioinforma., 88, 397, 10.1002/prot.25832 · DOI · Paper page
  10. Boutet, 2016, Uniprotkb/swiss-prot, the manually annotated section of the uniprot knowledgebase: how to use the entry view, Plant Bioinforma. methods Protoc., 1374, 23, 10.1007/978-1-4939-3167-5_2 · DOI · Paper page
  11. Cao, 2021, Tale: transformer-based protein function annotation with joint sequence–label embedding, Bioinformatics, 37, 2825, 10.1093/bioinformatics/btab198 · DOI · Paper page
  12. Chagneau, 2024, Quantum algorithm for bioinformatics to compute the similarity between proteins, IET Quantum Commun., 5, 417, 10.1049/qtc2.12098 · DOI
  13. Chen, 2024, xtrimopglm: unified 100b-scale pre-trained transformer for deciphering the language of protein, arXiv Prepr. arXiv:2401.06199, 10.48550/arXiv.2401.06199 · arXiv · doi:10.48550/arxiv.2401.06199
  14. Colin, 2015, Ultrahigh-throughput discovery of promiscuous enzymes by picodroplet functional metagenomics, Nat. Commun., 6, 10008, 10.1038/ncomms10008 · DOI · Paper page
  15. Cruz, 2017, Protein function prediction, Funct. Genomics Methods Protoc., 1654, 55, 10.1007/978-1-4939-7231-9_5 · DOI
  16. Cui, 2019, Dtl promotes cancer progression by pdcd4 ubiquitin-dependent degradation, J. Exp. and Clin. Cancer Res., 38, 350, 10.1186/s13046-019-1358-x · DOI
  17. Devos, 2000, Practical limits of function prediction, Proteins Struct. Funct. Bioinforma., 41, 98, 10.1002/1097-0134(20001001)41:1<98::aid-prot120>3.0.co;2-s · DOI · Paper page
  18. Devos, 2001, Intrinsic errors in genome annotation, TRENDS Genet., 17, 429, 10.1016/s0168-9525(01)02348-4 · DOI · Paper page
  19. Doğan, 2021, Crossbar: comprehensive resource of biomedical relations with knowledge graph representations, Nucleic acids Res., 49, e96, 10.1093/nar/gkab543 · DOI
  20. Elhaj-Abdou, 2021, Deep_cnn_lstm_go: protein function prediction from amino-acid sequences, Comput. Biol. Chem., 95, 107584, 10.1016/j.compbiolchem.2021.107584 · DOI
  21. Elnaggar, 2023, Ankh: optimized protein language model unlocks general-purpose modelling, 10.1101/2023.01.16.524265 · DOI · Paper page
  22. Gligorijević, 2018, deepnf: deep network fusion for protein function prediction, Bioinformatics, 34, 3873, 10.1093/bioinformatics/bty440 · DOI · Paper page
  23. Gligorijević, 2021, Structure-based protein function prediction using graph convolutional networks, Nat. Commun., 12, 3168, 10.1038/s41467-021-23303-9 · DOI · Paper page
  24. He, 2024, Protein language models-assisted optimization of a uracil-n-glycosylase variant enables programmable t-to-g and t-to-c base editing, Mol. Cell, 84, 1257, 10.1016/j.molcel.2024.01.021 · DOI · Paper page
  25. Heinzinger, 2023, Prostt5: bilingual language model for protein sequence and structure, bioRxiv, 10.1093/nargab/lqae150 · DOI · Paper page
  26. Huang, 2015, Bidirectional lstm-crf models for sequence tagging, arXiv Prepr. arXiv:1508.01991, 10.48550/arXiv.1508.01991 · DOI
  27. Jensen, 2002, Prediction of human protein function from post-translational modifications and localization features, J. Mol. Biol., 319, 1257, 10.1016/s0022-2836(02)00379-0 · DOI · Paper page
  28. Kihara, 2017, Protein function prediction, 10.1007/978-1-4939-7015-5 · doi:10.1007/978-1-4939-7015-5
  29. Kissa, 2015, Prediction of drug gene associations via ontological profile similarity with application to drug repositioning, Methods, 74, 71, 10.1016/j.ymeth.2014.11.017 · DOI
  30. Kulmanov, 2024, Protein function prediction as approximate semantic entailment, Nat. Mach. Intell., 6, 220, 10.1038/s42256-024-00795-w · DOI · Paper page
  31. Kulmanov, 2020, Deepgoplus: improved protein function prediction from sequence, Bioinformatics, 36, 422, 10.1093/bioinformatics/btz595 · DOI · Paper page
  32. LeCun, 1989, Backpropagation applied to handwritten zip code recognition, Neural Comput., 1, 541, 10.1162/neco.1989.1.4.541 · DOI · Paper page
  33. Li, 2020, Gonet: a deep network to annotate proteins via recurrent convolution networks, 29, 10.1109/BIBM49941.2020.9313235 · DOI
  34. Li, 2024, Msf-pfp: a novel multisource feature fusion model for protein function prediction, J. Chem. Inf. Model., 64, 1502, 10.1021/acs.jcim.3c01794 · DOI
  35. Li, 2023, Deepgatgo: a hierarchical pretraining-based graph-attention model for automatic protein function prediction, arXiv Prepr. arXiv:2307, 10.48550/arXiv.2307.13004 · arXiv · doi:10.48550/arxiv.2307.13004
  36. Liu, 2019, Roberta: a robustly optimized bert pretraining approach, arXiv Prepr. arXiv:1907.11692, 10.48550/arXiv.1907.11692 · DOI · Paper page
  37. Liu, 2020, Godoc: high-throughput protein function prediction using novel k-nearest-neighbor and voting algorithms, BMC Bioinforma., 21, 276, 10.1186/s12859-020-03556-9 · DOI
  38. Ma, 2007, Protein function studies: history, current status and future trends, Chin. Bull. Life Sci., 19, 294
  39. Ma, 2022, Enhancing protein function prediction performance by utilizing alphafold-predicted protein structures, J. Chem. Inf. Model., 62, 4008, 10.1021/acs.jcim.2c00885 · DOI · Paper page
  40. Madani, 2020, Progen: language modeling for protein generation, arXiv Prepr. arXiv:2004.03497, 10.1101/2020.03.07.982272 · DOI · Paper page
  41. Manchester, 2004, The crystallization of enzymes and virus proteins: laying to rest the colloidal concept of living systems, Endeavour, 28, 25, 10.1016/j.endeavour.2004.01.010 · doi:10.1016/j.endeavour.2004.01.010
  42. Munsamy, 2022, Zymctrl: a conditional language model for the controllable generation of artificial enzymes
  43. Needleman, 1970, A general method applicable to the search for similarities in the amino acid sequence of two proteins, J. Mol. Biol., 48, 443, 10.1016/0022-2836(70)90057-4 · DOI · Paper page
  44. Ofer, 2021, The language of proteins: nlp, machine learning and protein sequences, Comput. Struct. Biotechnol. J., 19, 1750, 10.1016/j.csbj.2021.03.022 · DOI · Paper page
  45. Öztürk, 2019, Widedta: prediction of drug-target binding affinity, arXiv Prepr. arXiv:1902.04166, 10.48550/arXiv.1902.04166 · arXiv · doi:10.48550/arxiv.1902.04166 · Paper page
  46. Pan, 2023, Pfresgo: an attention mechanism-based deep-learning approach for protein annotation by integrating gene ontology inter-relationships, Bioinformatics, 39, btad094, 10.1093/bioinformatics/btad094 · DOI · Paper page
  47. Pearson, 2016, Finding protein and nucleotide similarities with fasta, Curr. Protoc. Bioinforma., 53, 3.9.1, 10.1002/0471250953.bi0309s53 · DOI · Paper page
  48. Radford, 2019, Language models are unsupervised multitask learners, OpenAI blog, 1, 9
  49. Shehu, 2016, A survey of computational methods for protein function prediction, Big data Anal. genomics, 225, 10.1007/978-3-319-41279-5_7 · DOI
  50. Shuai, 2021, Generative language modeling for antibody design, bioRxiv, 2021, 10.1101/2021.12.13.472419 · DOI
  51. Simoni, 2002, Urease, the first crystalline enzyme and the proof that enzymes are proteins: the work of james b. sumner, J. Biol. Chem., 277, e1, 10.1016/s0021-9258(20)69970-7 · doi:10.1016/s0021-9258(20)69970-7
  52. Thein, 2011, Milestones in the history of hemoglobin research (in memory of professor titus hj huisman), Hemoglobin, 35, 450, 10.3109/03630269.2011.613506 · DOI
  53. Törönen, 2022, Pannzer—a practical tool for protein function prediction, Protein Sci., 31, 118, 10.1002/pro.4193 · DOI · Paper page
  54. Torres, 2021, Protein function prediction for newly sequenced organisms, Nat. Mach. Intell., 3, 1050, 10.1038/s42256-021-00419-7 · DOI
  55. Unsal, 2022, Learning functional properties of proteins with language models, Nat. Mach. Intell., 4, 227, 10.1038/s42256-022-00457-9 · DOI · Paper page
  56. Vaswani, 2017, Attention is all you need, Adv. neural Inf. Process. Syst., 30, 10.48550/arXiv.1706.03762 · DOI · Paper page
  57. Wang, Netgo 3.0: protein language model improves large-scale functional annotations, Genomics, Proteomics and Bioinforma., 21, 349, 10.1016/j.gpb.2023.04.001 · DOI · Paper page
  58. Wang, Mmsmaplus: a multi-view multi-scale multi-attention embedding model for protein function prediction, Briefings Bioinforma., 24, bbad201, 10.1093/bib/bbad201 · DOI
  59. Yao, 2021, Netgo 2.0: improving large-scale protein function prediction with massive sequence, text, domain, family and network information, Nucleic acids Res., 49, W469, 10.1093/nar/gkab398 · DOI · Paper page
  60. You, 2019, Netgo: improving large-scale protein function prediction with massive network information, Nucleic acids Res., 47, W379, 10.1093/nar/gkz388 · DOI · Paper page
  61. You, 2018, Golabeler: improving sequence-based large-scale protein function prediction by learning to rank, Bioinformatics, 34, 2465, 10.1093/bioinformatics/bty130 · DOI · Paper page
  62. Yuan, 2023, Fast and accurate protein function prediction from sequence through pretrained language model and homology-based label diffusion, Briefings Bioinforma., 24, bbad117, 10.1093/bib/bbad117 · DOI · Paper page
  63. Zeng, 2016, Integrative approaches for predicting microrna function and prioritizing disease-related microrna using biological interaction networks, Briefings Bioinforma., 17, 193, 10.1093/bib/bbv033 · DOI · Paper page
  64. Zhang, 2023, Hnetgo: protein function prediction via heterogeneous network transformer, Briefings Bioinforma., 24, bbab556, 10.1093/bib/bbab556 · DOI
  65. Zhang, 2015, Character-level convolutional networks for text classification, Adv. neural Inf. Process. Syst., 28, 10.48550/arXiv.1509.01626 · arXiv · doi:10.48550/arxiv.1509.01626 · Paper page
  66. Zhou, Deepgoa: predicting gene ontology annotations of proteins via graph convolutional network, 1836
  67. Zhu, 2022, Integrating unsupervised language model with triplet neural networks for protein gene ontology prediction, PLOS Comput. Biol., 18, e1010793, 10.1371/journal.pcbi.1010793 · DOI · Paper page

Cited by

See all 49

Metadata

Authors
Chen, J.-Y., Wang, J.-F., Hu, Y., Li, X.-H., Qian, Y.-R., & Song, C.-L.
Venue
Frontiers in Bioengineering and Biotechnology
Published
2025-01-21
Volume
13
Pages
1506508-1506508
ISSN
2296-4185 (ISSN-L)
OpenAlex
W4406682058
Cited by
49
References
28
FWCI
12.53
Type
journal article
Language
en
Open access
gold
Funders
National Natural Science Foundation of China (62266043)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evaluating the advancements in protein language models for encoding strategies in protein function prediction: a comprehensive review. https://app.cochat.ai/papers/10.3389/fbioe.2025.1506508
The paper
Chen, J.-Y., Wang, J.-F., Hu, Y., Li, X.-H., Qian, Y.-R., & Song, C.-L. (2025). Evaluating the advancements in protein language models for encoding strategies in protein function prediction: a comprehensive review. Frontiers in Bioengineering and Biotechnology. https://doi.org/10.3389/fbioe.2025.1506508

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.