ProteinBERT: a universal deep-learning model of protein sequence and function
Open accessPublished version of a preprint
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Summary: Self-supervised deep language modeling has shown unprecedented success across natural language tasks, and has recently been repurposed to biological sequences. However, existing models and pretraining methods are designed and optimized for text analysis. We introduce ProteinBERT, a deep language model specifically designed for proteins. Our pretraining scheme combines language modeling with a novel task of Gene Ontology (GO) annotation prediction. We introduce novel architectural elements that make the model highly efficient and flexible to long sequences. The architecture of ProteinBERT consists of both local and global representations, allowing end-to-end processing of these types of inputs and outputs. ProteinBERT obtains near state-of-the-art performance, and sometimes exceeds it, on multiple benchmarks covering diverse protein properties (including protein structure, post-translational modifications and biophysical attributes), despite using a far smaller and faster model than competing deep-learning methods. Overall, ProteinBERT provides an efficient framework for rapidly training protein predictors, even with limited labeled data. Availability and implementation: Code and pretrained model weights are available at https://github.com/nadavbra/protein_bert. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In biology applications, deep learning has been employed to learn the structure of DNA and protein sequences [6,7]”
From Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis (2025) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
Gapped BLAST and PSI-BLAST: a new generation of protein database search programs
Altschul, S. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.17.3389 · Cited by 73,302
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“According to the transfer-learning paradigm, a model is first pre-trained on one task, and then fine-tuned on other downstream tasks of interest [7–9].”
MethodLanguage Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Pfam: the protein families database
Finn, R. D., Bateman, A., Clements, J., Coggill, P., Eberhardt, R. Y., Eddy, S. R., Heger, A., Hetherington, K., Holm, L., Mistry, J., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1223 · Cited by 6,148 · cited 1×
“To this day, protein research is still dominated by classical sequence-similarity methods (such as BLAST [18] and hidden Markov models [19]), in contrast to domains such as computer vision which have become dominated by deep learning.”
Method
Research works printed but not linked: 2
- Abadi, 2016, 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI16), 265
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1, 9
Cited by
Items 501–600 of 1,005
Secondary Structure-Guided Novel Protein Sequence Generation with Latent Graph Diffusion
Hu, Y., Tan, Y., Han, A., Zheng, L., Hong, L., & Zhong, B. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822117 · Cited by 7
Zhang, L., & Liu, T. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00016 · Cited by 7
O impacto da inteligência artificial nas ciências da vida através da bioinformática
dos Santos, L. M., Mariano, D., & de Melo-Minardi, R. C. (2023) · Revista da Universidade Federal de Minas Gerais · doi:10.35699/2965-6931.2023.47996 · Cited by 7
Current Computational Methods for Protein-peptide Complex Structure Prediction
Yang, C., Xu, X., & Xiang, C. (2023) · Current Medicinal Chemistry · doi:10.2174/0109298673263447230920151524 · Cited by 7
Circular Arc Length-Based Kernel Matrix For Protein Sequence Classification
Murad, T., Ali, S., Chourasia, P., Mansoor, H., & Patterson, M. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386477 · Cited by 7
Dubourg-Felonneau, G., Abbasi, A., Akiva, E., & Lee, L. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.29.518403 · Cited by 7
Seber, P. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.17131 · Cited by 7
Wang, L., Fu, X., Yang, J., Zhang, X., Ye, X., Liu, Y., Sakurai, T., & Zeng, X. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.02610 · Cited by 7
A distributional simplicity bias in the learning dynamics of transformersPreprint
Rende, R., Gerace, F., Laio, A., & Goldt, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.19637 · Cited by 7
Zhang, C., & Duc, K. D. (2025) · Qeios · doi:10.32388/adif5a · Cited by 7
FusionProt: Fusing Sequence and Structural Information for Unified Protein Representation LearningPreprint
Kalifa, D., Singer, U., & Radinsky, K. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.08.06.668973 · Cited by 7
Rewriting protein alphabets with language modelsPreprint
Pantolini, L., Studer, G., Engist, L., Pudžiuvelytė, I., Pommerening, F., Waterhouse, A. M., Bienert, S., Tauriello, G., Steinegger, M., Schwede, T. F., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.11.27.690975 · Cited by 7
Graph-GRPO: Training Graph Flow Models with Reinforcement LearningPreprint
Zhu, B., Bo, D., Zhang, D. C., & Wang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.10395 · Cited by 7
(2024) · doi:10.1093/bib/bbae146 · Cited by 6
Hu, G., Moon, J., & Hayashi, T. (2024) · The Journal of Physical Chemistry B · doi:10.1021/acs.jpcb.4c02461 · Cited by 6
Generative language models on nucleotide sequences of human genes
İhtiyar, M. N., & Özgür, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-72512-x · Cited by 6
DeepPFP: a multi-task-aware architecture for protein function prediction
Wang, H., Ren, Z., Sun, J., Chen, Y., Bo, X., Xue, J., Gao, J., & Ni, M. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae579 · Cited by 6
LPBERT: A Protein–Protein Interaction Prediction Method Based on a Pre-Trained Language Model
Hu, A., Kuang, L., & Yang, D. (2025) · Applied Sciences · doi:10.3390/app15063283 · Cited by 6
Barkan, E., Siddiqui, I., Cheng, K. J., Golts, A., Shoshan, Y., Weber, J. K., Mota, Y. C., Ozery-Flato, M., & Sautto, G. A. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.03.038 · Cited by 6
Neural Networks Perform Sufficient Dimension Reduction
Xu, S., & Yu, Z. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i20.35486 · Cited by 6
Anticancer Peptides: Unveiling the Next Frontier in Cancer Treatment
Jaret, A., Baghel, V., & Bisht, G. S. (2025) · International Journal of Peptide Research and Therapeutics · doi:10.1007/s10989-025-10724-z · Cited by 6
Yadalam, P. K., Natarajan, P. M., Shetty, N., Marrapodi, M. M., Uzunçıbuk, H., Russo, D., Cicciù, M., & Minervini, G. (2025) · Dental and Medical Problems · doi:10.17219/dmp/186143 · Cited by 6
Rational protein engineering using an omni-directional multipoint mutagenesis generation pipeline
Fan, L., Wang, H., Gao, H., Ding, Y., Zhao, J., Luo, H., Tu, T., Wu, N., Yao, B., Guan, F., et al. (2025) · iScience · doi:10.1016/j.isci.2025.113273 · Cited by 6
Genomic heterogeneity inflates the performance of variant pathogenicity predictions
Lu, B., Liu, X., Lin, P., & Brandes, N. (2026) · Nature Communications · doi:10.1101/2025.09.05.674459 · Cited by 6
Self-citationHu, F., Zeng, W., & Peng, S. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf524 · Cited by 6
Wang, Y., Ye, X., Feng, Y. J., Wang, H., Lin, X., Ma, X., & Zhang, Y. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf593 · Cited by 6
Chen, Q., Nie, G., Li, X., Xu, Y., & Tan, C. S. H. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c02283 · Cited by 6
Song, Z., & Zhen, X.-C. (2026) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2026.111467 · Cited by 6
Jusko, N. M., Karekar, N., Cao, A., & Sun, D. (2026) · Acta Pharmaceutica Sinica B · doi:10.1016/j.apsb.2026.05.028 · Cited by 7
Sampling protein language models for functional protein design
Darmawan, J. T., Gal, Y., & Notin, P. (2026) · Cell Systems · doi:10.1016/j.cels.2026.101714 · Cited by 6
PLMC: Language Model of Protein Sequences Enhances Protein Crystallization Prediction
Xiong, D., Kaicheng, U., Sun, J., & Cribbs, A. P. (2024) · Interdisciplinary Sciences Computational Life Sciences · doi:10.1007/s12539-024-00639-6 · Cited by 6
Matsuzaka, Y., & Yashiro, R. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4030101 · Cited by 6
Li, Y., Jiao, W., Liu, R., Deng, X., Zhu, F., & Xue, W. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-31060-3 · Cited by 6
Validation of an LLM-based Multi-Agent Framework for Protein Engineering in Dry Lab and Wet Lab
Chen, Z., Liu, Y., Wang, Y. G., & Shen, Y. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822562 · Cited by 6
Prabakaran, R., & Bromberg, Y. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf035 · Cited by 6
Xie, J., Jin, X., Wei, H., Sun, S., & Liu, Y. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf182 · Cited by 6
Language Modelling Techniques for Analysing the Impact of Human Genetic Variation
Hegde, M., Nebel, J.-C., & Rahman, F. (2025) · Bioinformatics and Biology Insights · doi:10.1177/11779322251358314 · Cited by 6
Tamir, A., & Yuan, J. S. (2025) · Electronics · doi:10.3390/electronics14193944 · Cited by 6
Ghazikhani, H., & Butler, G. (2022) · International Conference on Bioinformatics Research and Applications (ICBRA) · doi:10.1145/3569192.3569196 · Cited by 6
Bioactive Peptide Recognition Based on NLP Pre-Train Algorithm
Jiang, L., Sun, N., Zhang, Y., Yu, X., & Liu, X. (2023) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2023.3323295 · Cited by 6
CAB: Comprehensive Attention Benchmarking on Long Sequence ModelingPreprint
Zhang, J., Jiang, S., Feng, J., Lin, Z., & Kong, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.07661 · Cited by 7
Zhou, B., Lv, O., Yi, K., Xiong, X., Tan, P., Hong, L., & Wang, Y. (2023) · arXiv.org · doi:10.48550/arxiv.2304.08299 · Cited by 5
Wang, L., Fu, X., Yang, J., Zhang, X., Ye, X., Sakurai, T., Zeng, X., & Liu, Y. (2024) · Research Square · doi:10.21203/rs.3.rs-4990322/v1 · Cited by 6
Protein-Mamba: Biological Mamba Models for Protein Function PredictionPreprint
Xu, B., Lu, Y., Inoue, Y., Lee, N., Fu, T., & Chen, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.14617 · Cited by 7
Guan, C., Wan, F., Torres, M. D. T., & de la Fuente‐Núñez, C. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.07.631724 · Cited by 6
Cao, H., Zhang, H., Xu, J., Zhang, Z., Shen, L., Sun, M., Liu, G., Xu, J., Li, W.-J., Ni, J., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.01571 · Cited by 6
StackDPP: a stacking ensemble based DNA-binding protein prediction model
Ahmed, S. H., Bose, D. B., Khandoker, R., & Rahman, M. S. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05714-9 · Cited by 5
HiTaxon: a hierarchical ensemble framework for taxonomic classification of short reads
Verma, B., & Parkinson, J. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbae016 · Cited by 5
Wang, R., Liang, X. H., Zhao, Y., Xue, W., & Liang, G. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c01599 · Cited by 5
Imam, I. A., Bailey, S., Wang, D., Zeng, S., Xu, D. H., & Shao, Q. (2024) · Langmuir · doi:10.1021/acs.langmuir.4c04140 · Cited by 5
Machine and deep learning to predict viral fusion peptides
Sequeira, A. M., Rocha, M., & Lousa, D. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.02.011 · Cited by 5
Fine-Tuned Deep Transfer Learning Models for Large Screenings of Safer Drugs Targeting Class A GPCRs
Provasi, D., & Filizola, M. (2025) · Biochemistry · doi:10.1021/acs.biochem.4c00832 · Cited by 5
NEAR: neural embeddings for amino acid relationships
Olson, D. R., Colligan, T. H., Demekas, D., Roddy, J. W., Youens‐Clark, K., & Wheeler, T. J. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf198 · Cited by 5
Wang, F., Chu, J., Shen, L., & Chang, S. (2025) · BMC Biology · doi:10.1186/s12915-025-02356-y · Cited by 5
Liu, Y., Bao, T., Yin, P., Wang, S., & Wang, Y. (2025) · PLoS ONE · doi:10.1371/journal.pone.0329174 · Cited by 5
Nasiri, F., & Hooshmand, M. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf192 · Cited by 5
MTPNet: Multi-Grained Target Perception for Unified Activity Cliff Prediction
Shu, Z., Deng, Y., Zhang, H., Nie, Z., & Chen, J. (2025) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2025/860 · Cited by 5
Yue, C., Chen, B., Chen, L., Xiong, L., Gong, C., Wang, Z., Liu, G., Li, W., Wang, R., & Tang, Y. (2025) · Chinese Journal of Natural Medicines · doi:10.1016/s1875-5364(25)60980-0 · Cited by 5
Kennedy, L. S., Harper, M., & Čuperlović‐Culf, M. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf635 · Cited by 6
UGT708 glycosyltransferases: Nature's architects of C-glycosides
Verma, B., Arora, P., Hussain, S., Devi, R. M., & Gupta, S. (2025) · Biotechnology Advances · doi:10.1016/j.biotechadv.2025.108787 · Cited by 5
Yan, K., Yu, H., Chen, S., Shaytan, A. К., Yan, K., & Wang, Y. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013836 · Cited by 5
AggrescanAI: Prediction of Aggregation-Prone Regions Using Contextualized Embeddings
Navarro, A. M., Palacios, S., Galmarini, T., Bárcenas, O., Ventura, S., & Marino‐Buslje, C. (2026) · Journal of Molecular Biology · doi:10.1016/j.jmb.2026.169643 · Cited by 5
Imam, I. A., Morey, T., Jiang, Y., Wang, D., (21616), D. X., & Shao, Q. (2026) · Journal of Materials Chemistry B · doi:10.1039/d5tb02758f · Cited by 5
GeNLP: a web tool for NLP-based exploration and prediction of microbial gene function
Miller, D., Arias, O., & Burstein, D. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae034 · Cited by 5
Ran, Z., Wang, C., Sun, H., Pan, S., & Li, F. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3413146 · Cited by 5
Phogat, A., Krishnan, S. R., Pandey, M., & Gromiha, M. M. (2025) · Methods · doi:10.1016/j.ymeth.2025.01.020 · Cited by 5
Yuan, C., Wang, B., Wang, H., Wang, F., Li, X., & Zhen, Y. (2025) · Frontiers in Immunology · doi:10.3389/fimmu.2025.1556165 · Cited by 5
Lin, X., Chen, Z., Li, Y. G., Ma, Z., Fan, C., Cao, Z., Feng, S., Zhang, J., & Gao, Y. Q. (2025) · Chemical Science · doi:10.1039/d5sc02055g · Cited by 5
Zhang, Y., Qin, Y., Pourmirzaei, M., Shao, Q., Wang, D., & Xu, D. H. (2025) · Methods in molecular biology · doi:10.1007/978-1-0716-4623-6_2 · Cited by 5
EnsDTI: Predicting Drug-Target Interaction With Mixture-of-Experts and Confidence Assessment
Lu, Y., Lee, S., Kang, S., & Kim, S. (2026) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbbio.2026.3653990 · Cited by 5
Gaussian Beltrami-Klein Model for Protein Sequence Classification: A Hyperbolic Approach
Ali, S., Mansoor, H., Chourasia, P., Ali, Y., & Patterson, M. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5128-0_5 · Cited by 5
Ou, Y., Ho, Q., & Chang, H. (2023) · PROTEOMICS · doi:10.1002/pmic.202200494 · Cited by 5
Navarez, A. M., & Roxas, R. R. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4178244 · Cited by 5
Context-Aware Amino Acid Embedding Advances Analysis of TCR-Epitope InteractionsPreprint
Zhang, P., Bang, S., Cai, M., & Lee, H. (2023) · eLife · doi:10.7554/elife.88837 · Cited by 5
Conformational sampling and interpolation using language-based protein folding neural networksPreprint
del Alamo, D., Jeliazkov, J. R., Truan, D., & Karpiak, J. D. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.12.16.571997 · Cited by 5
ProtHyena: A fast and efficient foundation protein language model at single amino acid ResolutionPreprint
Zhang, Y., & Okumura, M. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.01.18.576206 · Cited by 5
Beyond ESM2: Graph-Enhanced Protein Sequence Modeling with Efficient ClusteringPreprint
Jiao, S., Li, B., Wang, L., Zhang, X., Chen, W., Peng, J., & Wei, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.15805 · Cited by 5
Context-Aware Amino Acid Embedding Advances Analysis of TCR-Epitope InteractionsPreprint
Zhang, P., Bang, S., Cai, M., & Lee, H. (2024) · eLife · doi:10.7554/elife.88837.2 · Cited by 5
Text2Protein: A Generative Model for Designated Protein Design on Given DescriptionPreprint
Hosseini, R., Zhang, S., & Xie, P. (2024) · Research Square · doi:10.21203/rs.3.rs-4868665/v1 · Cited by 5
Sicherman, A., & Radinsky, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.18278 · Cited by 5
Urbanowicz, M., Guziński, A., & Szulc, Z. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.09.02.673651 · Cited by 5
A Comparative Review of RNA Language ModelsPreprint
Wang, H., Zhang, Y., Chen, J., Zhan, J., & Zhou, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.09087 · Cited by 5
EvoFlows: Evolutionary Edit-Based Flow-Matching for Protein EngineeringPreprint
Deutschmann, N., Ferragu, C., Ziegler, J. D., Aziznejad, S., & Bixby, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.11703 · Cited by 5
Towards A Generative Protein Evolution Machine with DPLM-EvoPreprint
Wang, X., Hong, L., Ye, J., Zheng, Z., Li, Y., Huang, S., & Gu, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.00182 · Cited by 5
Protein language model identifies disordered, conserved motifs implicated in phase separation
Zhang, Y., Zheng, J., & Zhang, B. (2025) · eLife · doi:10.7554/elife.105309 · Cited by 4
“Substantial research has focused on linking protein sequences to the phase behaviors of conden-sates ( Brangwynne et al., 2015 ; Pappu et al., 2023 ; Zeng and Pappu, 2023 ; Schmit et al., 2020 ; Mittag and Pappu, 2022 ; Dzuricky et al., 2018 ; Flory, 1942 ; Huggins, 1942 ; Dignon et al., 2018 ;…”
Thomas, D. P. G., Garcia Fernandez, C. M., Haydarlou, R., & Feenstra, K. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-88445-y · Cited by 4
(2025) · doi:10.1016/j.cels.2025.101400 · Cited by 4
RIscoper 2.0: A deep learning tool to extract RNA biomedical relation sentences from literature
Zheng, H., Xu, L., Xie, H., Xie, J., Ma, Y., Hu, Y., Wu, L., Chen, J., Wang, M., Yi, Y., et al. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.03.017 · Cited by 4
Pre-trained Language Models for Decoding Protein Language: a Survey
Amjad, M., Munir, A., Zia, U., & Paracha, R. Z. (2024) · International Conference on Digital Futures and Transformative Technologies (ICoDT2) · doi:10.1109/icodt262145.2024.10740205 · Cited by 4
Al-Shameri, Y. N. H., Kösesoy, İ., Gündüz, H., & Yılmaz, Ö. F. (2025) · Applied Sciences · doi:10.3390/app15137112 · Cited by 4
Environmental adaptations in metagenomes revealed by deep learning
Winder, J. C., Poulton, S., Wu, T., Möck, T., & van Oosterhout, C. (2025) · BMC Biology · doi:10.1186/s12915-025-02361-1 · Cited by 4
TCR representation learning with protein language models: a comprehensive review
Kinoshita, K., & Kobayashi, T. J. (2025) · International Immunology · doi:10.1093/intimm/dxaf048 · Cited by 4
Multi-feature enhanced protein language models for accurate protein-RNA binding residue prediction
Feng, Z., Yu, H., Guan, X., Gu, L., Li, K., & Zhou, X. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-025-02065-7 · Cited by 4
Survey on phylogenetic tree construction using machine learning
Buch, N., & Gambhava, B. M. (2025) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2025.108751 · Cited by 4
PepTriX: A framework for explainable peptide analysis through protein language models
Schilling, V., Dubey, A., Anžel, A., & Hattab, G. (2026) · Next research. · doi:10.1016/j.nexres.2026.102151 · Cited by 4
Ye, Y., Duan, H., Mu, Y., Wu, L., & Guo, J. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf607 · Cited by 4
Yang, C., Zhao, Y., Wang, R., Li, H., Liao, X., & Ma, H. (2025) · Synthetic and Systems Biotechnology · doi:10.1016/j.synbio.2025.11.012 · Cited by 4
Impact of intrinsically disordered regions and functional disorder hotspots in the human kinome
Thomas, S. D., Rajan, A., Mahin, A., Ahmed, M., Pavithra, S., Vignesh, U., Joy, N., John, L., Varghese, L., Sambreena, A., et al. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf662 · Cited by 4
Biotechnology meets AI: Accelerating next-generation of microbial breeding for food biomanufacturing
Tan, Y., Ni, H., Wu, T., Li, W., Zeng, H., & Wang, Y. (2025) · Food Research International · doi:10.1016/j.foodres.2025.118152 · Cited by 4
AI-driven computational methods and benchmarking for T-cell antigen identification
Deng, Y., Que, J., Xue, G., Cai, Y., Yang, W., Wang, Y., Yi, H., Wang, Z., Lin, Y., Zhou, W., et al. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag123 · Cited by 4
Metadata
- Authors
- Brandes, N., Ofer, D., Peleg, Y., Rappoport, N., & Linial, M.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Deep Trading Ltd. , Haifa 3508401, Israel
- Ben-Gurion University of the Negev (IL)
- Department of Biological Chemistry, The Alexander Silberman Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Corresponding author
- Brandes, Nadav
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-02-10
- Volume
- 38
- Issue
- 8
- Pages
- 2102-2110
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC9386727
- OpenAlex
- W4205773061
- Cited by
- 1,009
- References
- 44
- Citations by year
- 2026: 248 · 2025: 355 · 2024: 241 · 2023: 127 · 2022: 34
- FWCI
- 62.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Israel Science Foundation (2753/20)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- protein sequence representation, protein function prediction, protein structure prediction, long sequence modeling
- MeSH terms
- Deep Learning, Amino Acid Sequence, Language, Natural Language Processing, Proteins
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.