Evaluating the advancements in protein language models for encoding strategies in protein function prediction: a comprehensive review
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Protein function prediction is crucial in several key areas such as bioinformatics and drug design. With the rapid progress of deep learning technology, applying protein language models has become a research focus. These models utilize the increasing amount of large-scale protein sequence data to deeply mine its intrinsic semantic information, which can effectively improve the accuracy of protein function prediction. This review comprehensively combines the current status of applying the latest protein language models in protein function prediction. It provides an exhaustive performance comparison with traditional prediction methods. Through the in-depth analysis of experimental results, the significant advantages of protein language models in enhancing the accuracy and depth of protein function prediction tasks are fully demonstrated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate structure prediction of biomolecular interactions with AlphaFold 3
Abramson, J., Adler, J., Dunger, J., Evans, R., Green, T., Pritzel, A., Ronneberger, O., Willmore, L., Ballard, A. J., Bambrick, J., et al. (2024) · Nature · doi:10.1038/s41586-024-07487-w · Cited by 15,861
Fast and sensitive protein alignment using DIAMOND
Buchfink, B., Xie, C., & Huson, D. H. (2015) · Nature Methods · doi:10.1038/nmeth.3176 · Cited by 14,201 · cited 3×
“DIAMOND rapidly retrieves and matches query sequences during the alignment phase by converting protein sequences from reference databases into a compressed index format.”
InfluentialExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
UniProt: the Universal Protein Knowledgebase in 2023
The UniProt Consortium, Bateman, A., Martin, M.-J., Orchard, S., Magrane, M., Ahmad, S., Alpi, E., Bowler-Barnett, E. H., Britto, R., Bye-A-Jee, H., et al. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkac1052 · Cited by 7,210
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549 · cited 1×
“The breakthroughs in 3D structure prediction made by models such as AlphaFold and RosettaFold have made it possible to obtain a large number of protein structures from sequence data (Jumper et al., 2021; Baek et al., 2021).”
Self-citationNetwork medicine: a network-based approach to human disease
Barabási, A.-L., Gulbahce, N., & Loscalzo, J. (2011) · Nature Reviews Genetics · doi:10.1038/nrg2918 · Cited by 5,034 · cited 1×
“Accurate characterization of protein function is of vital importance for disease research (Barabási et al., 2011; Xuan et al., 2019), drug discovery (Kissa et al., 2015; Zeng et al., 2016), and biotechnology advancement (Shehu et al., 2016).”
Research works printed but not linked: 67
- Aggarwal, 2022, A review of deep learning techniques for protein function prediction, arXiv Prepr. arXiv:2211.09705, 10.48550/arXiv.2211.09705 · DOI
- Aleksander, 2023, The gene ontology knowledgebase in 2023, Genetics, 224, iyad031, 10.1093/genetics/iyad031 · DOI · Paper page
- Altschul, 1990, Basic local alignment search tool, J. Mol. Biol., 215, 403, 10.1006/jmbi.1990.9999 · doi:10.1006/jmbi.1990.9999 · Paper page
- Altschul, 1997, Gapped blast and psi-blast: a new generation of protein database search programs, Nucleic acids Res., 25, 3389, 10.1093/nar/25.17.3389 · DOI · Paper page
- Ashburner, 2000, Gene ontology: tool for the unification of biology, Nat. Genet., 25, 25, 10.1038/75556 · DOI · Paper page
- Avery, 2022, Protein function analysis through machine learning, Biomolecules, 12, 1246, 10.3390/biom12091246 · DOI
- Berman, 2000, The protein data bank, Nucleic acids Res., 28, 235, 10.1093/nar/28.1.235 · DOI · Paper page
- Bernardes, 2013, A review of protein function prediction under machine learning perspective, Recent Pat. Biotechnol., 7, 122, 10.2174/18722083113079990006 · DOI
- Bonetta, 2020, Machine learning techniques for protein function prediction, Proteins Struct. Funct. Bioinforma., 88, 397, 10.1002/prot.25832 · DOI · Paper page
- Boutet, 2016, Uniprotkb/swiss-prot, the manually annotated section of the uniprot knowledgebase: how to use the entry view, Plant Bioinforma. methods Protoc., 1374, 23, 10.1007/978-1-4939-3167-5_2 · DOI · Paper page
- Cao, 2021, Tale: transformer-based protein function annotation with joint sequence–label embedding, Bioinformatics, 37, 2825, 10.1093/bioinformatics/btab198 · DOI · Paper page
- Chagneau, 2024, Quantum algorithm for bioinformatics to compute the similarity between proteins, IET Quantum Commun., 5, 417, 10.1049/qtc2.12098 · DOI
- Chen, 2024, xtrimopglm: unified 100b-scale pre-trained transformer for deciphering the language of protein, arXiv Prepr. arXiv:2401.06199, 10.48550/arXiv.2401.06199 · arXiv · doi:10.48550/arxiv.2401.06199
- Colin, 2015, Ultrahigh-throughput discovery of promiscuous enzymes by picodroplet functional metagenomics, Nat. Commun., 6, 10008, 10.1038/ncomms10008 · DOI · Paper page
- Cruz, 2017, Protein function prediction, Funct. Genomics Methods Protoc., 1654, 55, 10.1007/978-1-4939-7231-9_5 · DOI
- Cui, 2019, Dtl promotes cancer progression by pdcd4 ubiquitin-dependent degradation, J. Exp. and Clin. Cancer Res., 38, 350, 10.1186/s13046-019-1358-x · DOI
- Devos, 2000, Practical limits of function prediction, Proteins Struct. Funct. Bioinforma., 41, 98, 10.1002/1097-0134(20001001)41:1<98::aid-prot120>3.0.co;2-s · DOI · Paper page
- Devos, 2001, Intrinsic errors in genome annotation, TRENDS Genet., 17, 429, 10.1016/s0168-9525(01)02348-4 · DOI · Paper page
- Doğan, 2021, Crossbar: comprehensive resource of biomedical relations with knowledge graph representations, Nucleic acids Res., 49, e96, 10.1093/nar/gkab543 · DOI
- Elhaj-Abdou, 2021, Deep_cnn_lstm_go: protein function prediction from amino-acid sequences, Comput. Biol. Chem., 95, 107584, 10.1016/j.compbiolchem.2021.107584 · DOI
- Elnaggar, 2023, Ankh: optimized protein language model unlocks general-purpose modelling, 10.1101/2023.01.16.524265 · DOI · Paper page
- Gligorijević, 2018, deepnf: deep network fusion for protein function prediction, Bioinformatics, 34, 3873, 10.1093/bioinformatics/bty440 · DOI · Paper page
- Gligorijević, 2021, Structure-based protein function prediction using graph convolutional networks, Nat. Commun., 12, 3168, 10.1038/s41467-021-23303-9 · DOI · Paper page
- He, 2024, Protein language models-assisted optimization of a uracil-n-glycosylase variant enables programmable t-to-g and t-to-c base editing, Mol. Cell, 84, 1257, 10.1016/j.molcel.2024.01.021 · DOI · Paper page
- Heinzinger, 2023, Prostt5: bilingual language model for protein sequence and structure, bioRxiv, 10.1093/nargab/lqae150 · DOI · Paper page
- Huang, 2015, Bidirectional lstm-crf models for sequence tagging, arXiv Prepr. arXiv:1508.01991, 10.48550/arXiv.1508.01991 · DOI
- Jensen, 2002, Prediction of human protein function from post-translational modifications and localization features, J. Mol. Biol., 319, 1257, 10.1016/s0022-2836(02)00379-0 · DOI · Paper page
- Kihara, 2017, Protein function prediction, 10.1007/978-1-4939-7015-5 · doi:10.1007/978-1-4939-7015-5
- Kissa, 2015, Prediction of drug gene associations via ontological profile similarity with application to drug repositioning, Methods, 74, 71, 10.1016/j.ymeth.2014.11.017 · DOI
- Kulmanov, 2024, Protein function prediction as approximate semantic entailment, Nat. Mach. Intell., 6, 220, 10.1038/s42256-024-00795-w · DOI · Paper page
- Kulmanov, 2020, Deepgoplus: improved protein function prediction from sequence, Bioinformatics, 36, 422, 10.1093/bioinformatics/btz595 · DOI · Paper page
- LeCun, 1989, Backpropagation applied to handwritten zip code recognition, Neural Comput., 1, 541, 10.1162/neco.1989.1.4.541 · DOI · Paper page
- Li, 2020, Gonet: a deep network to annotate proteins via recurrent convolution networks, 29, 10.1109/BIBM49941.2020.9313235 · DOI
- Li, 2024, Msf-pfp: a novel multisource feature fusion model for protein function prediction, J. Chem. Inf. Model., 64, 1502, 10.1021/acs.jcim.3c01794 · DOI
- Li, 2023, Deepgatgo: a hierarchical pretraining-based graph-attention model for automatic protein function prediction, arXiv Prepr. arXiv:2307, 10.48550/arXiv.2307.13004 · arXiv · doi:10.48550/arxiv.2307.13004
- Liu, 2019, Roberta: a robustly optimized bert pretraining approach, arXiv Prepr. arXiv:1907.11692, 10.48550/arXiv.1907.11692 · DOI · Paper page
- Liu, 2020, Godoc: high-throughput protein function prediction using novel k-nearest-neighbor and voting algorithms, BMC Bioinforma., 21, 276, 10.1186/s12859-020-03556-9 · DOI
- Ma, 2007, Protein function studies: history, current status and future trends, Chin. Bull. Life Sci., 19, 294
- Ma, 2022, Enhancing protein function prediction performance by utilizing alphafold-predicted protein structures, J. Chem. Inf. Model., 62, 4008, 10.1021/acs.jcim.2c00885 · DOI · Paper page
- Madani, 2020, Progen: language modeling for protein generation, arXiv Prepr. arXiv:2004.03497, 10.1101/2020.03.07.982272 · DOI · Paper page
- Manchester, 2004, The crystallization of enzymes and virus proteins: laying to rest the colloidal concept of living systems, Endeavour, 28, 25, 10.1016/j.endeavour.2004.01.010 · doi:10.1016/j.endeavour.2004.01.010
- Munsamy, 2022, Zymctrl: a conditional language model for the controllable generation of artificial enzymes
- Needleman, 1970, A general method applicable to the search for similarities in the amino acid sequence of two proteins, J. Mol. Biol., 48, 443, 10.1016/0022-2836(70)90057-4 · DOI · Paper page
- Ofer, 2021, The language of proteins: nlp, machine learning and protein sequences, Comput. Struct. Biotechnol. J., 19, 1750, 10.1016/j.csbj.2021.03.022 · DOI · Paper page
- Öztürk, 2019, Widedta: prediction of drug-target binding affinity, arXiv Prepr. arXiv:1902.04166, 10.48550/arXiv.1902.04166 · arXiv · doi:10.48550/arxiv.1902.04166 · Paper page
- Pan, 2023, Pfresgo: an attention mechanism-based deep-learning approach for protein annotation by integrating gene ontology inter-relationships, Bioinformatics, 39, btad094, 10.1093/bioinformatics/btad094 · DOI · Paper page
- Pearson, 2016, Finding protein and nucleotide similarities with fasta, Curr. Protoc. Bioinforma., 53, 3.9.1, 10.1002/0471250953.bi0309s53 · DOI · Paper page
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI blog, 1, 9
- Shehu, 2016, A survey of computational methods for protein function prediction, Big data Anal. genomics, 225, 10.1007/978-3-319-41279-5_7 · DOI
- Shuai, 2021, Generative language modeling for antibody design, bioRxiv, 2021, 10.1101/2021.12.13.472419 · DOI
- Simoni, 2002, Urease, the first crystalline enzyme and the proof that enzymes are proteins: the work of james b. sumner, J. Biol. Chem., 277, e1, 10.1016/s0021-9258(20)69970-7 · doi:10.1016/s0021-9258(20)69970-7
- Thein, 2011, Milestones in the history of hemoglobin research (in memory of professor titus hj huisman), Hemoglobin, 35, 450, 10.3109/03630269.2011.613506 · DOI
- Törönen, 2022, Pannzer—a practical tool for protein function prediction, Protein Sci., 31, 118, 10.1002/pro.4193 · DOI · Paper page
- Torres, 2021, Protein function prediction for newly sequenced organisms, Nat. Mach. Intell., 3, 1050, 10.1038/s42256-021-00419-7 · DOI
- Unsal, 2022, Learning functional properties of proteins with language models, Nat. Mach. Intell., 4, 227, 10.1038/s42256-022-00457-9 · DOI · Paper page
- Vaswani, 2017, Attention is all you need, Adv. neural Inf. Process. Syst., 30, 10.48550/arXiv.1706.03762 · DOI · Paper page
- Wang, Netgo 3.0: protein language model improves large-scale functional annotations, Genomics, Proteomics and Bioinforma., 21, 349, 10.1016/j.gpb.2023.04.001 · DOI · Paper page
- Wang, Mmsmaplus: a multi-view multi-scale multi-attention embedding model for protein function prediction, Briefings Bioinforma., 24, bbad201, 10.1093/bib/bbad201 · DOI
- Yao, 2021, Netgo 2.0: improving large-scale protein function prediction with massive sequence, text, domain, family and network information, Nucleic acids Res., 49, W469, 10.1093/nar/gkab398 · DOI · Paper page
- You, 2019, Netgo: improving large-scale protein function prediction with massive network information, Nucleic acids Res., 47, W379, 10.1093/nar/gkz388 · DOI · Paper page
- You, 2018, Golabeler: improving sequence-based large-scale protein function prediction by learning to rank, Bioinformatics, 34, 2465, 10.1093/bioinformatics/bty130 · DOI · Paper page
- Yuan, 2023, Fast and accurate protein function prediction from sequence through pretrained language model and homology-based label diffusion, Briefings Bioinforma., 24, bbad117, 10.1093/bib/bbad117 · DOI · Paper page
- Zeng, 2016, Integrative approaches for predicting microrna function and prioritizing disease-related microrna using biological interaction networks, Briefings Bioinforma., 17, 193, 10.1093/bib/bbv033 · DOI · Paper page
- Zhang, 2023, Hnetgo: protein function prediction via heterogeneous network transformer, Briefings Bioinforma., 24, bbab556, 10.1093/bib/bbab556 · DOI
- Zhang, 2015, Character-level convolutional networks for text classification, Adv. neural Inf. Process. Syst., 28, 10.48550/arXiv.1509.01626 · arXiv · doi:10.48550/arxiv.1509.01626 · Paper page
- Zhou, Deepgoa: predicting gene ontology annotations of proteins via graph convolutional network, 1836
- Zhu, 2022, Integrating unsupervised language model with triplet neural networks for protein gene ontology prediction, PLOS Comput. Biol., 18, e1010793, 10.1371/journal.pcbi.1010793 · DOI · Paper page
Cited by
Learning the language of protein-protein interactions
(2026) · doi:10.1038/s41467-025-67971-3 · Cited by 26
From Signal to Symphony: Exploring 2D Sequence Representations for Protein Function Prediction
Wang, Y., Cai, M., Dong, Y., Ma, Y., & Wei, K. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c01768 · Cited by 3
CATHe2: Enhanced CATH superfamily detection using ProstT5 and structural alphabets
(2025) · doi:10.1093/biomethods/bpaf080 · Cited by 1
Metadata
- Authors
- Chen, J.-Y., Wang, J.-F., Hu, Y., Li, X.-H., Qian, Y.-R., & Song, C.-L.
- Venue
- Frontiers in Bioengineering and Biotechnology
- Publisher
- Frontiers Media SA
- Published
- 2025-01-21
- Volume
- 13
- Pages
- 1506508-1506508
- ISSN
- 2296-4185 (ISSN-L)
- OpenAlex
- W4406682058
- Cited by
- 49
- References
- 28
- FWCI
- 12.53
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- National Natural Science Foundation of China (62266043)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating the advancements in protein language models for encoding strategies in protein function prediction: a comprehensive review. https://app.cochat.ai/papers/10.3389/fbioe.2025.1506508
- The paper
- Chen, J.-Y., Wang, J.-F., Hu, Y., Li, X.-H., Qian, Y.-R., & Song, C.-L. (2025). Evaluating the advancements in protein language models for encoding strategies in protein function prediction: a comprehensive review. Frontiers in Bioengineering and Biotechnology. https://doi.org/10.3389/fbioe.2025.1506508
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.