ProteinBERT: a universal deep-learning model of protein sequence and function
Open accessPublished version of a preprint
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Summary: Self-supervised deep language modeling has shown unprecedented success across natural language tasks, and has recently been repurposed to biological sequences. However, existing models and pretraining methods are designed and optimized for text analysis. We introduce ProteinBERT, a deep language model specifically designed for proteins. Our pretraining scheme combines language modeling with a novel task of Gene Ontology (GO) annotation prediction. We introduce novel architectural elements that make the model highly efficient and flexible to long sequences. The architecture of ProteinBERT consists of both local and global representations, allowing end-to-end processing of these types of inputs and outputs. ProteinBERT obtains near state-of-the-art performance, and sometimes exceeds it, on multiple benchmarks covering diverse protein properties (including protein structure, post-translational modifications and biophysical attributes), despite using a far smaller and faster model than competing deep-learning methods. Overall, ProteinBERT provides an efficient framework for rapidly training protein predictors, even with limited labeled data. Availability and implementation: Code and pretrained model weights are available at https://github.com/nadavbra/protein_bert. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In biology applications, deep learning has been employed to learn the structure of DNA and protein sequences [6,7]”
From Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis (2025) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
Gapped BLAST and PSI-BLAST: a new generation of protein database search programs
Altschul, S. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.17.3389 · Cited by 73,302
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“According to the transfer-learning paradigm, a model is first pre-trained on one task, and then fine-tuned on other downstream tasks of interest [7–9].”
MethodLanguage Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Pfam: the protein families database
Finn, R. D., Bateman, A., Clements, J., Coggill, P., Eberhardt, R. Y., Eddy, S. R., Heger, A., Hetherington, K., Holm, L., Mistry, J., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1223 · Cited by 6,148 · cited 1×
“To this day, protein research is still dominated by classical sequence-similarity methods (such as BLAST [18] and hidden Markov models [19]), in contrast to domains such as computer vision which have become dominated by deep learning.”
Method
Research works printed but not linked: 2
- Abadi, 2016, 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI16), 265
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1, 9
Cited by
Items 401–500 of 1,005
MIST: A Co-Design Framework for Heterogeneous, Multi-Stage LLM InferencePreprint
Bambhaniya, A. R., Wu, H., Subramanian, S., Srinivasan, S., Kundu, S., Yazdanbakhsh, A., Elavazhagan, M., Kumar, M., Yu, M., Raychowdhury, A., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.09775 · Cited by 11
Transformers in Protein: A SurveyPreprint
Ling, X., Li, Z., Wang, Y., & You, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.20098 · Cited by 11
learnMSA2: deep protein multiple alignments with large language and hidden Markov models
Becker, F., & Stanke, M. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae381 · Cited by 10
Nguyen, V. T. D., Nguyen, N. D., & Hy, T. S. (2024) · Structural Dynamics · doi:10.1063/4.0000271 · Cited by 10
Zhang, B. X., Quan, L., Zhang, Z., Cao, L., Chen, Q., Peng, L., Wang, J., Jiang, Y., Nie, L., Li, G., et al. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c02073 · Cited by 10
Murad, T., Chourasia, P., Ali, S., & Patterson, M. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6960-8_25 · Cited by 10
Nguyen, T.-T., Zheng, W., Nguyen, V., Le, N. Q. K., & Chua, M. C. H. (2025) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2025.108609 · Cited by 10
Li, X. B., Sun, C., Huang, W., Wang, Y., & Ma, B. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf496 · Cited by 10
Lu, S., Fang, C., Zeng, H., Hu, R., Wei, C., Miao, R., Gan, X., Guo, B., Yao, M., & He, S. (2025) · Science China Life Sciences · doi:10.1007/s11427-025-3074-8 · Cited by 10
del Río, J. S., Talavera, A., Fernández‐Pozo, N., Veredas, F. J., & Claros, M. G. (2025) · Journal of Experimental Botany · doi:10.1093/jxb/eraf498 · Cited by 11
Artificial intelligence in protein-based detection and inhibition of AMR pathways
Sadhukhan, S., Bhattacharya, R., Bhattcharya, D., Sahana, S., Pradhan, B., Pandit, S., Gill, H. S., Rajeev, M., Nag, M., & Lahiri, D. (2025) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-025-00710-4 · Cited by 10
A Comprehensive Review of Transformer-Based Language Models for Protein Sequence Analysis and Design
Ghosh, N., Santoni, D., Nawn, D., Ottaviani, E., & Felici, G. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3631454 · Cited by 10
Protein foundation models: a comprehensive survey
Xu, H., Li, L., Pan, S., Cheng, P., Wang, Y., Rong, Z., Feng, L., Huang, X., Wang, S., & Shu, W. (2026) · Science China Life Sciences · doi:10.1007/s11427-025-3147-2 · Cited by 10
Wang, Y., Lv, J., Xia, Y., Xu, J., Meng, Y., Cui, F., Wei, L., Zou, Q., & Zhang, Z. (2026) · Biotechnology Advances · doi:10.1016/j.biotechadv.2026.108843 · Cited by 10
ePlatypus: an ecosystem for computational analysis of immunogenomics data
Cotet, T., Agrafiotis, A., Kreiner, V., Kuhn, R., Shlesinger, D., Manero-Carranza, M., Khodaverdi, K., Kladis, E., Perea, A. D., Maassen-Veeters, D., et al. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad553 · Cited by 10
EmbedCaps-DBP: Predicting DNA-Binding Proteins Using Protein Sequence Embedding and Capsule Network
Mursalim, M. K. N., Mengko, T. L., Hertadi, R., Purwarianti, A., & Susanty, M. (2023) · IEEE Access · doi:10.1109/access.2023.3328960 · Cited by 10
Wang, Y., Lv, H., Lei, R., Yeung, Y.-H., Shen, I. R., Choi, D., Teo, Q. W., Tan, T. J. C., Gopal, A. B., Chen, X., et al. (2024) · Biophysical Journal · doi:10.1016/j.bpj.2023.11.3334 · Cited by 10
A deep learning model for predicting systemic lupus erythematosus-associated epitopes
He, J., Liu, Z., & Tang, X. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03056-x · Cited by 10
Zhang, R., Wu, H., Liu, C., Li, H., Wu, Y., Li, K., Wang, Y., Deng, Y., Chen, J., Zhou, F., et al. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108148 · Cited by 10
Anteghini, M., dos Santos, V. A. P. M., & Saccenti, E. (2023) · Journal of Cellular Biochemistry · doi:10.1002/jcb.30490 · Cited by 10
Utilizing Semi-supervised Method in Predicting BRCA1 Pathogenicity Variants
Hidayat, A. A., Trinugroho, J., Nirwantono, R., Sudigyo, D., & Pardamean, B. (2023) · International Conference on Computer Science and Computational Intelligence · doi:10.1016/j.procs.2023.10.500 · Cited by 9
Efficient Classification of SARS-CoV-2 Spike Sequences Using Federated Learning
Chourasia, P., Murad, T., Tayebi, Z., Ali, S., Khan, I., & Patterson, M. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63616-5_6 · Cited by 10
Wang, X., Wang, Y., Huang, T.-Y., Dong, Y., Deng, J., Xu, L., Li, X., & He, R. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356718 · Cited by 10
Ghazikhani, H., & Butler, G. (2022) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb55180.2022.9863026 · Cited by 10
Efficient and accurate sequence generation with small-scale protein language modelsPreprint
Serrano, Y., Rodà, S., Guallar, V., & Molina, A. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.08.04.551626 · Cited by 10
Natural Language Prompts Guide the Design of Novel Functional Protein SequencesPreprint
Praljak, N., Yeh, H., Moore, M., Socolich, M., Ranganathan, R., & Ferguson, A. L. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.11.11.622734 · Cited by 10
Antibody affinity engineering using antibody repertoire data and machine learningPreprint
Erlach, L., Friedensohn, S., Neumeier, D., Mason, D. M., & Reddy, S. T. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.10.632313 · Cited by 10
Biological Sequence with Language Model Prompting: A SurveyPreprint
Jiang, J., Wang, Z., Shan, Y., Chai, H., Li, J., Ma, Z., Zhang, X., & Li, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.04135 · Cited by 10
Protein Language Model Identifies Disordered, Conserved Motifs Implicated in Phase Separation
Zhang, Y., Zheng, J., & Zhang, B. (2024) · doi:10.1101/2024.12.12.628175 · Cited by 10
Large language models for biological sequence analysis in infectious disease research
Luo, J., Cai, X., & Li, Y. (2025) · Biosafety and Health · doi:10.1016/j.bsheal.2025.09.007 · Cited by 9
General Intelligence Framework to Predict Virus Adaptation Based on a Genome Language Model
Jiang, S., Zhao, S., Wei, J., Zhang, S., Zhao, Z., Tong, Y., Liu, W., Wang, J., Jiang, T., & Li, J. (2025) · Research · doi:10.34133/research.0871 · Cited by 9
A protein dynamics–based deep learning model enhances predictions of fitness and epistasis
Huynh, N., Kazan, I. C., Lu, J., Kolbaba‐Kartchner, B., Mills, J. H., & Ozkan, S. B. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2502444122 · Cited by 9
Sangster, A. G., Dufault, C., Qu, H., Le, D., Forman-Kay, J. D., & Moses, A. M. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012929 · Cited by 9
AI-Designed Peptides as Tools for Biochemistry
Hong, L., Vincoff, S., & Chatterjee, P. (2026) · Biochemistry · doi:10.1021/acs.biochem.6c00138 · Cited by 9
Artificial intelligence in antibiotic discovery: Applications, challenges, and future outlook
Xu, J. B., Li, C., Wang, X., Peleg, A. Y., LI, F., Song, J., & de la Fuente‐Núñez, C. (2026) · Cell Biomaterials · doi:10.1016/j.celbio.2026.100445 · Cited by 9
Translating functional molecular knowledge into crop-breeding success
Ramstein, G. P., Zhai, J., Buckler, E. S., Tenaillon, M. I., & Jannink, J. (2026) · Nature Reviews Genetics · doi:10.1038/s41576-026-00968-w · Cited by 9
Leveraging Large Language Models for Metagenomic Analysis
Refahi, M. S., Sokhansanj, B. A., & ROSEN, G. L. (2023) · IEEE Signal Processing in Medicine and Biology Symposium · doi:10.1109/spmb59478.2023.10372773 · Cited by 9
Chomicz, D., Kończak, J., Wróbel, S., Satława, T., Dudzic, P., Janusz, B., Tarkowski, M., Deszyński, P., Gawłowski, T., Kostyn, A., et al. (2024) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2024.1352508 · Cited by 9
Advancing Drug-Target Interaction prediction with BERT and subsequence embedding
Yang, Z., Liu, J., Yang, F., Zhang, X., Zhang, Q., Zhu, X., & Jiang, P. (2024) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2024.108058 · Cited by 9
Zhang, J., Zhao, L., Wang, W. J., Zhang, Q., Wang, X., Xing, D., Ren, N., Lee, D., & Chen, C. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.172466 · Cited by 9
Computational tools for plant genomics and breeding
Wang, H., Chen, M., Wei, X., Xia, R., Pei, D., Huang, X., & Han, B. (2024) · Science China Life Sciences · doi:10.1007/s11427-024-2578-6 · Cited by 9
Internet of Things and Machine Learning for Smart Healthcare
da Costa, C. A., Zeiser, F. A., Righi, R. D. R., Antunes, R. S., Alegretti, A. P., Bertoni, A. P. S., Ramos, G. D. O., de Mello, B. H., Vanin, F. N. D. S., Bertoletti, O. A., et al. (2024) · Studies in computational intelligence · doi:10.1007/978-981-97-5624-7_3 · Cited by 9
Tan, Y., Zheng, L., Zhong, B., Hong, L., & Zhou, B. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822035 · Cited by 9
How did we get there? AI applications to biological networks and sequences
Anteghini, M., Gualdi, F., & Oliva, B. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110064 · Cited by 9
LassoESM a tailored language model for enhanced lasso peptide property prediction
Mi, X., Barrett, S. E., Mitchell, D. A., & Shukla, D. (2025) · Nature Communications · doi:10.1038/s41467-025-63412-3 · Cited by 9
MutaPLM: Protein Language Modeling for Mutation Explanation and Engineering
Luo, Y., Nie, Z., Hong, M., Zhao, S., Zhou, H., & Nie, Z. (2024) · neural information processing systems · doi:10.52202/079017-2534 · Cited by 9
Mapping Data to Deep Understanding: Making the Most of the Deluge of SARS-CoV-2 Genome Sequences
Sokhansanj, B. A., & ROSEN, G. L. (2022) · mSystems · doi:10.1128/msystems.00035-22 · Cited by 9
PeTriBERT : Augmenting BERT with tridimensional encoding for inverse protein folding and designPreprint
Dumortier, B., Liutkus, A., Carré, C., & Krouk, G. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.08.10.503344 · Cited by 9
Virus2Vec: Viral Sequence Classification Using Machine LearningPreprint
Ali, S., Bello, B., Chourasia, P., Punathil, R. T., Chen, P., Khan, I., & Patterson, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.12328 · Cited by 9
Multi-purpose enzyme-substrate interaction prediction with progressive conditional deep learningPreprint
Nie, Z., Zhang, H., Jiang, H., Liu, Y., Huang, X., Xu, F., Tian, Y., Chen, J., & Zhang, W. (2024) · Research Square · doi:10.21203/rs.3.rs-5516445/v1 · Cited by 9
The Vendiscope: An Algorithmic Microscope For Data CollectionsPreprint
Pasarkar, A. P., & Dieng, A. B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.10828 · Cited by 9
Schmidinger, N., Schneckenreiter, L., Seidl, P., Schimunek, J., Hoedt, P.-J., Brandstetter, J., Mayr, A., Luukkonen, S., Hochreiter, S., & Klambauer, G. (2024) · arXiv · doi:10.48550/arxiv.2411.04165 · Cited by 8
“Additionally, models like ProtGPT2 (Ferruz et al., 2022) and ProteinBERT (Brandes et al., 2022) utilized the power of Transformer architectures in generating novel protein sequences and functional predictions.”
Fine-tuning of conditional Transformers improves in silico enzyme prediction and generation
Nicolini, M., Saitto, E., Franco, R. E. J., Cavalleri, E., Galeano, A., Malchiodi, D., Paccanaro, A., Robinson, P. N., Casiraghi, E., & Valentini, G. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.03.037 · Cited by 8
MambaPhase: deep learning for liquid–liquid phase separation protein classification
Huang, J., Zhang, Y., Ren, S., Wang, Z., Jin, X., Lu, X., Zhang, Y., Min, X., Ge, S., Zhang, J., et al. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf230 · Cited by 8
Protein Language Models Expose Viral Immune Mimicry
Ofer, D., & Linial, M. (2025) · Viruses · doi:10.3390/v17091199 · Cited by 8
Self-citationAdvancements in breast cancer therapy: Integrating AI tools for drug discovery and clinical trials
Pandey, V., Verma, P., Natesan, G., & Chaube, U. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.111067 · Cited by 8
Zhu, A., Ye, T., Tan, M., & Xu, J. (2025) · International Journal of Biological Macromolecules · doi:10.1016/j.ijbiomac.2025.147964 · Cited by 8
AFPDeepPred: A Deep Learning Framework for Accurate Identification of Antifreeze Proteins
Lin, X., Guan, J., Wang, F., Xie, P., Zhao, Y., Zhao, Z., Xiang, M., Wei, L., Liu, X., Lee, T.-Y., et al. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c02024 · Cited by 8
Chen, Y., Guo, X., & Xue, W. (2026) · Drug Discovery Today · doi:10.1016/j.drudis.2026.104634 · Cited by 8
Functional genomics in inborn errors of immunity
Hurabielle, C., LaFlam, T. N., Gearing, M., & Ye, C. (2024) · Immunological Reviews · doi:10.1111/imr.13309 · Cited by 8
Rethinking the Masking Strategy for Pretraining Molecular Graphs from a Data-Centric View
Lin, W. R., & Fung, C. C. A. (2024) · ACS Omega · doi:10.1021/acsomega.3c09512 · Cited by 8
Zhao, Z., Wang, Y.-H., Li, Q., Zhao, H., Duan, Y., Wu, X., Huang, Z., Li, H., Zhou, J., & Chen, X. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e34797 · Cited by 8
Design Proteins Using Large Language Models: Enhancements and Comparative Analyses
Zeinalipour, K., Jamshidi, N., Bianchini, M., Maggini, M., & Gori, M. (2024) · doi:10.18653/v1/2024.langmol-1.5 · Cited by 8
Bringing bioactive peptides into drug discovery: Challenges and opportunities for medicinal plants
Thakur, S., Punia, A., Satyakam, Acharya, V., Kumar, B., Prasad, A., Yadav, S. K., & Kumar, R. (2024) · Industrial Crops and Products · doi:10.1016/j.indcrop.2024.119855 · Cited by 8
ProteinF3S: boosting enzyme function prediction by fusing protein sequence, structure, and surface
Yuan, M., Shen, A., Ma, Y., Du, J., An, B., & Wang, M. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae695 · Cited by 8
Chen, S., Zheng, P., Zheng, L., Yao, Q., Meng, Z., Lin, L., Chen, X., & Liu, R. (2025) · iScience · doi:10.1016/j.isci.2025.112077 · Cited by 8
HVSeeker: a deep-learning-based method for identification of host and viral DNA sequences
Alnajim, A., Hauns, S., Dinh, T. V., Backofen, R., & Alkhnbashi, O. S. (2025) · GigaScience · doi:10.1093/gigascience/giaf037 · Cited by 8
Yadalam, P. K., Anegundi, R. V., Natarajan, P. M., & Ardila, C. M. (2025) · International Dental Journal · doi:10.1016/j.identj.2025.100890 · Cited by 8
GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learning
Kalifa, D., Singer, U., & Radinsky, K. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761500 · Cited by 8
A tri-modal contrastive learning framework for protein representation learning
Zhang, L., Guo, H., Schaffer, L. V., Ko, Y. S., Singh, D., Rahmani, H., Grotjahn, D. A., Villa, E., Gilson, M., Wang, W., et al. (2026) · Cell Reports Methods · doi:10.1016/j.crmeth.2026.101407 · Cited by 8
SIPF: Sampling Method for Inverse Protein Folding
Fu, T., & Sun, J. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539284 · Cited by 8
Zeng, X., Wang, T., Kang, Y., Bai, G., & Ma, B. (2023) · Antibodies · doi:10.3390/antib12030058 · Cited by 8
Intriguing Equivalence Structures of the Embedding Space of Vision Transformers
Salman, S., Shams, M. M. B., Islam, C. M., Nishino, M., & Liu, X. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729551 · Cited by 8
A DNABERT based deep learning framework for predicting transcription factor binding sites
Dutta, P., Ghosh, N., & Santoni, D. (2026) · Scientific Reports · doi:10.1038/s41598-026-37483-1 · Cited by 8
Qabel, A., Ennadir, S., Nikolentzos, G., Lutzeyer, J. F., Chatzianastasis, M., Boström, H., & Vazirgiannis, M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.10.06.511103 · Cited by 8
Efficient inference, training, and fine-tuning of protein language models
Çelik, M. H., & Xie, X. (2025) · iScience · doi:10.1016/j.isci.2025.113495 · Cited by 7
(2025) · doi:10.1016/j.jhazmat.2025.139625 · Cited by 7
Pratyush, P., Pokharel, S., Schulze, S., Bramer, L., Newman, R. H., & KC, D. B. (2025) · Methods in molecular biology · doi:10.1007/978-1-0716-4623-6_19 · Cited by 7
Karim, W., Alvi, R., Zaman, S. B., Abian, A. I., Raiaan, M. A. K., Mukta, S. H., Rashid, M. R. U., Islam, R., Sebastian, Y., & Azam, S. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10743-z · Cited by 7
DCGAT-DTI: dynamic cross-graph attention network for drug–target interaction prediction
Abir, A. R., Alif, M. N., Zhang, W. C., Ahmed, K. T., & Zhang, W. (2025) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf306 · Cited by 7
Ji, Y., Chen, Z., Liu, Z., Man, X., Du, J., & Yu, B. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131485 · Cited by 7
Zhang, R., Ren, Y., Zhao, Y., Zheng, H., Luo, Y., Liu, Y., Wang, L., & Zhang, L. (2026) · Journal of Integrative Plant Biology · doi:10.1111/jipb.70235 · Cited by 7
A comprehensive benchmark of sequence-based subcellular localization predictors for human proteins
Wefers, Z., Gupta, A., Ahmed, N., Zhang, X., & Lundberg, E. K. (2026) · Nature Methods · doi:10.1038/s41592-026-03142-6 · Cited by 7
Tamir, A., Salem, M., & Yuan, J. S. (2023) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2023.3311427 · Cited by 7
PseAAC2Vec protein encoding for TCR protein sequence classification
Tayebi, Z., Ali, S., Murad, T., Khan, I., & Patterson, M. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.107956 · Cited by 7
Drug-Target Binding Affinity Prediction in a Continuous Latent Space Using Variational Autoencoders
Zhao, L., Zhu, Y. L., Wen, N., Wang, C., Wang, J., & Yuan, Y. (2024) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2024.3402661 · Cited by 7
Changiarath, A., Arya, A., Xenidis, V. A., Padeken, J., & Stelzl, L. S. (2025) · Faraday Discussions · doi:10.1039/d4fd00099d · Cited by 7
Wen, J., Ding, Z., Wei, Z., Xia, H., Zhang, Y., & Zhu, X. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109048 · Cited by 7
Elliptic geometry-based kernel matrix for improved biological sequence classification
Ali, S., Shabbir, M., Mansoor, H., Chourasia, P., & Patterson, M. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112479 · Cited by 7
Wang, Y., & Fang, C. (2024) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2024.108240 · Cited by 7
Chen, L., Nasif, K. F. A., Deng, B., Niu, S., & Xie, C. Y. (2024) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai62512.2024.00083 · Cited by 7
UniZyme: A Unified Protein Cleavage Site Predictor Enhanced with Enzyme Active-Site Knowledge
Li, C., Yan, S., & Dai, E. (2025) · neural information processing systems · doi:10.52202/085713-0624 · Cited by 7
UniESA: a unified data-driven framework for enzyme stereoselectivity and activity prediction
Weng, C., Li, J., Chen, Q., Han, J., Dong, Z.-T., Liu, Z., & Zheng, Y. (2025) · Green Chemistry · doi:10.1039/d4gc06253a · Cited by 7
Chen, Q., Zhang, Y., Gao, J., & Zhang, J. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00199 · Cited by 7
AlloPED: Leveraging Protein Language Models and Structure Features for Allosteric Site Prediction
Chen, X., Zheng, J., Huang, Z., Xu, Z., Huang, J., Tan, Y., Wei, Y., & Zhang, H. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0695-8_31 · Cited by 7
An interaction-derived graph learning framework for scoring protein–peptide complexes
Tao, H., Wang, X., & Huang, S. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01136-1 · Cited by 7
Chen, H., Zhong, J., Zhang, X., Chen, J., Guo, L., Xiong, X., Zhang, X., Liu, X., Xiao, B., & Tian, B. (2026) · Advanced Science · doi:10.1002/advs.202521970 · Cited by 7
Li, H., Meng, J., Wang, Z., Tang, Y., Xia, S., Wang, Y., Qin, Z., & Luan, Y. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01020 · Cited by 7
Qu, Y., Niu, Z.-T., Ding, Q., Zhao, T., Kong, T., Bai, B., Ma, J.-W., Zhao, Y., & Zheng, J. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms242216496 · Cited by 5
Transformer-based tool recommendation system in Galaxy
Kumar, A., Grüning, B. A., & Backofen, R. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05573-w · Cited by 7
Metadata
- Authors
- Brandes, N., Ofer, D., Peleg, Y., Rappoport, N., & Linial, M.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Deep Trading Ltd. , Haifa 3508401, Israel
- Ben-Gurion University of the Negev (IL)
- Department of Biological Chemistry, The Alexander Silberman Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Corresponding author
- Brandes, Nadav
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-02-10
- Volume
- 38
- Issue
- 8
- Pages
- 2102-2110
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC9386727
- OpenAlex
- W4205773061
- Cited by
- 1,009
- References
- 44
- Citations by year
- 2026: 248 · 2025: 355 · 2024: 241 · 2023: 127 · 2022: 34
- FWCI
- 62.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Israel Science Foundation (2753/20)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- protein sequence representation, protein function prediction, protein structure prediction, long sequence modeling
- MeSH terms
- Deep Learning, Amino Acid Sequence, Language, Natural Language Processing, Proteins
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.