ProteinBERT: a universal deep-learning model of protein sequence and function
Open accessPublished version of a preprint
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Summary: Self-supervised deep language modeling has shown unprecedented success across natural language tasks, and has recently been repurposed to biological sequences. However, existing models and pretraining methods are designed and optimized for text analysis. We introduce ProteinBERT, a deep language model specifically designed for proteins. Our pretraining scheme combines language modeling with a novel task of Gene Ontology (GO) annotation prediction. We introduce novel architectural elements that make the model highly efficient and flexible to long sequences. The architecture of ProteinBERT consists of both local and global representations, allowing end-to-end processing of these types of inputs and outputs. ProteinBERT obtains near state-of-the-art performance, and sometimes exceeds it, on multiple benchmarks covering diverse protein properties (including protein structure, post-translational modifications and biophysical attributes), despite using a far smaller and faster model than competing deep-learning methods. Overall, ProteinBERT provides an efficient framework for rapidly training protein predictors, even with limited labeled data. Availability and implementation: Code and pretrained model weights are available at https://github.com/nadavbra/protein_bert. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In biology applications, deep learning has been employed to learn the structure of DNA and protein sequences [6,7]”
From Challenges in AI-driven Biomedical Multimodal Data Fusion and Analysis (2025) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
Gapped BLAST and PSI-BLAST: a new generation of protein database search programs
Altschul, S. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.17.3389 · Cited by 73,302
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“According to the transfer-learning paradigm, a model is first pre-trained on one task, and then fine-tuned on other downstream tasks of interest [7–9].”
MethodLanguage Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Pfam: the protein families database
Finn, R. D., Bateman, A., Clements, J., Coggill, P., Eberhardt, R. Y., Eddy, S. R., Heger, A., Hetherington, K., Holm, L., Mistry, J., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1223 · Cited by 6,148 · cited 1×
“To this day, protein research is still dominated by classical sequence-similarity methods (such as BLAST [18] and hidden Markov models [19]), in contrast to domains such as computer vision which have become dominated by deep learning.”
Method
Research works printed but not linked: 2
- Abadi, 2016, 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI16), 265
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1, 9
Cited by
Items 101–200 of 1,005
Raman, K., Kumar, R., Musante, C. J., & Madhavan, S. (2025) · Clinical and Translational Science · doi:10.1111/cts.70124 · Cited by 53
Jin, W., Brannan, K. W., Kapeli, K., Park, S. S., Tan, H. Q., Gosztyla, M. L., Mujumdar, M., Ahdout, J., Henroid, B., Rothamel, K., et al. (2023) · Molecular Cell · doi:10.1016/j.molcel.2023.06.019 · Cited by 52
Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models
Li, F.-Z., Amini, A. P., Yue, Y., Yang, K. K., & Lu, A. X. (2024) · doi:10.1101/2024.02.05.578959 · Cited by 51
Li, P., & Liu, Z.-P. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad288 · Cited by 50
Deciphering 3'UTR Mediated Gene Regulation Using Interpretable Deep Representation Learning
Yang, Y., Li, G. L., Pang, K., Cao, W., Zhang, Z., & Li, X. (2024) · Advanced Science · doi:10.1002/advs.202407013 · Cited by 52
Soylu, N. N., & Sefer, E. (2024) · Current Bioinformatics · doi:10.2174/0115748936283134240109054157 · Cited by 51
Genomics enters the deep learning era
Routhier, E., & Mozziconacci, J. (2022) · PeerJ · doi:10.7717/peerj.13613 · Cited by 51
Effect of tokenization on transformers for biological sequences
Dotan, E., Jaschek, G., Pupko, T., & Belinkov, Y. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae196 · Cited by 49
Wei, L., Li, Q., Song, Y., Stefanov, S., Dong, R., Fu, N., Siriwardane, E. M. D., Chen, F., & Hu, J. (2024) · Advanced Science · doi:10.1002/advs.202304305 · Cited by 49
Protein Large Language Models: A Comprehensive SurveyPreprint
Xiao, Y., Zhao, W.-J., Zhang, J., Jin, Y.-Q., Zhang, H., Ren, Z.-C., Sun, R.-L., Wang, H.-X., Wan, G.-C., Lu, P., et al. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2502.17504 · Cited by 56
The promises of large language models for protein design and modeling
Valentini, G., Malchiodi, D., Gliozzo, J., Mesiti, M., Soto-Gomez, M., Cabri, A., Reese, J., Casiraghi, E., & Robinson, P. N. (2023) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2023.1304099 · Cited by 48
Knowledge Graphs for the Life Sciences: Recent Developments, Challenges and Opportunities
Chen, J., Dong, H., Hastings, J., Jiménez-Ruiz, E., López, V., Monnin, P., Pesquita, C., Škoda, P., & Tamma, V. A. M. (2023) · Transactions on Graph Data and Knowledge · doi:10.4230/tgdk.1.1.5 · Cited by 48
Jin, S., Zeng, Z., Xiong, X., Huang, B., Tang, L., Wang, H., Ma, X., Tang, X., Shao, G., Huang, X., et al. (2025) · Communications Biology · doi:10.1038/s42003-025-08282-7 · Cited by 48
LLMs4All: A Review of Large Language Models Across Academic DisciplinesPreprint
Ye, Y., Zhang, Z., Ma, T., Wang, Z., Li, Y., Hou, S., Sun, W., Shi, K., Ma, Y., Song, W., et al. (2025) · Preprints.org · doi:10.20944/preprints202510.1383.v1 · Cited by 48
Karlsen, S. T., Rau, M. H., Sánchez, B. J., Jensen, K. L., & Zeidan, A. A. (2023) · FEMS Microbiology Reviews · doi:10.1093/femsre/fuad030 · Cited by 47
Applications of artificial intelligence to lipid nanoparticle delivery
Yuan, Y., Wu, Y., Cheng, J., Yang, K., Xia, Y., Wu, H., & Pan, X. (2023) · Particuology · doi:10.1016/j.partic.2023.11.014 · Cited by 47
Wang, Y., Lv, H., Teo, Q. W., Lei, R., Gopal, A. B., Ouyang, W. O., Yeung, Y.-H., Tan, T. J. C., Choi, D., Shen, I. R., et al. (2024) · Immunity · doi:10.1016/j.immuni.2024.07.022 · Cited by 47
Large language models for bioinformatics
Ruan, W., Lyu, Y., Zhang, J., Cai, J., Shu, P., Yang, G., Lu, Y., Gao, S., Wang, Y., Wang, P., et al. (2025) · Quantitative Biology · doi:10.1002/qub2.70014 · Cited by 48
Wang, D., Pourmirzaei, M., Abbas, U. L., Zeng, S., Manshour, N., Esmaili, F., Poudel, B., Jiang, Y., Shao, Q., Chen, J., et al. (2025) · Advanced Science · doi:10.1002/advs.202404212 · Cited by 46
Li, M., Kang, L., Xiong, Y., Wang, Y. G., Fan, G., Tan, P., & Hong, L. (2023) · Journal of Cheminformatics · doi:10.1186/s13321-023-00688-x · Cited by 35
AI for organic and polymer synthesis
Hong, X., Yang, Q., Liao, K., Pei, J., Chen, M., Mo, F., Lu, H., Zhang, W.-B., Zhou, H., Chen, J., et al. (2024) · Science China Chemistry · doi:10.1007/s11426-024-2072-4 · Cited by 45
Yu, Q., Zhang, Z., Liu, G., Li, W., & Tang, Y. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae583 · Cited by 46
Machine learning enables prediction of metabolic system evolution in bacteria
Konno, N., & Iwasaki, W. (2023) · Science Advances · doi:10.1126/sciadv.adc9130 · Cited by 40
Design and sustainability of polypeptide material systems
Yorke, S. K., Yang, Z., Wiita, E. G., Kamada, A., Knowles, T. P. J., & Buehler, M. J. (2025) · Nature Reviews Materials · doi:10.1038/s41578-025-00793-3 · Cited by 44
Artificial intelligence for microbiology and microbiome research
Wang, X.-W., Wang, T. D., & Liu, Y. (2026) · Cell Systems · doi:10.1016/j.cels.2026.101531 · Cited by 44
Lin, P., Yan, Y., & Huang, S.-Y. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbac499 · Cited by 40
Protein Engineering with Lightweight Graph Denoising Neural Networks
Zhou, B., Zheng, L., Wu, B., Tan, Y., Lv, O., Yi, K., Fan, G., & Hong, L. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c00036 · Cited by 38
A Comprehensive Survey of Deep Learning Techniques in Protein Function Prediction
Dhanuka, R., Singh, J. P., & Tripathi, A. (2023) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2023.3247634 · Cited by 43
Malbranke, C., Bikard, D., Cocco, S., Monasson, R., & Tubiana, J. (2023) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2023.102571 · Cited by 35
Aparicio, J. A. B., Olivares‐Gil, A., Rodríguez, J. J., García‐Osorio, C., & Díez-Pastor, J.-F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102035 · Cited by 43
A Comprehensive Review of Protein Language ModelsPreprint
Wang, L., Li, X., Zhang, H., Wang, J., Jiang, D., Xue, Z., & Wang, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.06881 · Cited by 44
Molecular insights fast-tracked: AI in biosynthetic pathway research
Liao, L., Xie, M., Zheng, X., Zhou, Z., Deng, Z., & Gao, J. (2025) · Natural Product Reports · doi:10.1039/d4np00003j · Cited by 42
Pakhrin, S. C., Pokharel, S., Aoki-Kinoshita, K. F., Beck, M. R., Dam, T. K., Caragea, D., & KC, D. B. (2023) · Glycobiology · doi:10.1093/glycob/cwad033 · Cited by 42
FLAb: Benchmarking deep learning methods for antibody fitness predictionPreprint
Chungyoun, M., Ruffolo, J. A., & Gray, J. J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.01.13.575504 · Cited by 42
Ren, Z., Jiang, L., Di, Y., Zhang, D., Gong, J., Gong, J., Jiang, Q., Fu, Z., Sun, P., Zhou, B., et al. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae330 · Cited by 41
The Application of Machine Learning on Antibody Discovery and Optimization
Zheng, J., Wang, Y., Liang, Q., Cui, L., & Wang, L. (2024) · Molecules · doi:10.3390/molecules29245923 · Cited by 41
Learning a deep language model for microbiomes: The power of large scale unlabeled microbiome data
Pope, Q., Varma, R., Tataru, C. A., David, M. M., & Fern, X. Z. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011353 · Cited by 43
Geffen, Y., Ofran, Y., & Unger, R. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac474 · Cited by 40
Zhang, X. J., Hu, X., Zhang, T., Yang, L., Liu, C., Xu, N., Wang, H., & Sun, W. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae404 · Cited by 41
Hu, F., Hu, Y., Zhang, W., Huang, H., Pan, Y. F., & Yin, P. (2023) · Advanced Science · doi:10.1002/advs.202301223 · Cited by 40
Pakhrin, S. C., Pokharel, S., Pratyush, P., Chaudhari, M., Ismail, H. D., & KC, D. B. (2023) · Journal of Proteome Research · doi:10.1021/acs.jproteome.2c00667 · Cited by 40
Survey of Protein Sequence Embedding Models
Tran, C. T. T., Khadkikar, S., & Porollo, A. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24043775 · Cited by 39
Kim, D. N., McNaughton, A. D., & Kumar, N. (2024) · Bioengineering · doi:10.3390/bioengineering11020185 · Cited by 39
Classification of bioactive peptides: A systematic benchmark of models and encodings
Bizzotto, E., Zampieri, G., Treu, L., Filannino, P., Cagno, R. D., & Campanaro, S. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.05.040 · Cited by 39
SSEmb: A joint embedding of protein sequence and structure enables robust variant effect predictions
Blaabjerg, L. M., Jonsson, N., Boomsma, W., Stein, A., & Lindorff‐Larsen, K. (2024) · Nature Communications · doi:10.1038/s41467-024-53982-z · Cited by 39
Recent advances in deep learning for protein-protein interaction: a review
Cui, J., Yang, S., Yi, L., Xi, Q., Yang, D., & Zuo, Y. (2025) · BioData Mining · doi:10.1186/s13040-025-00457-6 · Cited by 39
Protein Language Models: Applications and Perspectives
Leclercq, M., & Droit, A. (2025) · Journal of Proteome Research · doi:10.1021/acs.jproteome.5c00506 · Cited by 40
Predicting plant Rubisco kinetics from RbcL sequence data using machine learning
Iqbal, W. A., Lisitsa, A., & Kapralov, M. V. (2022) · Journal of Experimental Botany · doi:10.1093/jxb/erac368 · Cited by 39
Self-Supervised Learning with Lie Symmetries for Partial Differential Equations
Mialon, G., Garrido, Q., Lawrence, H., Rehman, D., LeCun, Y., & Kiani, B. T. (2023) · neural information processing systems · doi:10.52202/075280-1262 · Cited by 39
Protein representations: Encoding biological information for machine learning in biocatalysis
Harding-Larsen, D., Funk, J., Madsen, N. G., Gharabli, H., Acevedo-Rocha, C. G., Mazurenko, S., & Welner, D. H. (2024) · Biotechnology Advances · doi:10.1016/j.biotechadv.2024.108459 · Cited by 38
What’s next? Forecasting scientific research trends
Ofer, D., Kaufman, H., & Linial, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2023.e23781 · Cited by 22
Self-citationMultimodal pretraining for unsupervised protein representation learning
Nguyen, V. T. D., & Hy, T. S. (2024) · Biology Methods and Protocols · doi:10.1093/biomethods/bpae043 · Cited by 38
DrugFormer: Graph‐Enhanced Language Model to Predict Drug Sensitivity
Liu, X., Wang, Q., Zhou, M., Wang, Y., Wang, X., Zhou, X., & Song, Q. (2024) · Advanced Science · doi:10.1002/advs.202405861 · Cited by 38
Natural Language Processing Methods for the Study of Protein–Ligand Interactions
Michels, J., Bandarupalli, R., Akbari, A. A., Le, T., Xiao, H. Y., Li, J., & Hom, E. F. Y. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c01907 · Cited by 38
Imre, A., Balogh, B., & Mándity, I. M. (2024) · British Journal of Pharmacology · doi:10.1111/bph.17388 · Cited by 39
Zhang, C., Wang, Q., Li, Y., Teng, A., Hu, G., Wuyun, Q., & Zheng, W. H. (2024) · Biomolecules · doi:10.3390/biom14121531 · Cited by 38
Biomaterials in cellular agriculture and plant-based foods for the future
Gordon, E. B., Choi, I., Amanipour, A., Hu, Y., Nikkhah, A., Koysuren, B., Jones, C., Nitin, N., Ovissipour, R., Buehler, M. J., et al. (2025) · Nature Reviews Materials · doi:10.1038/s41578-025-00800-7 · Cited by 38
Protein Representation Learning via Knowledge Enhanced Primary Structure ModelingPreprint
Zhou, H.-Y., Fu, Y., Zhang, Z., Bian, C., & Yu, Y. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.26.525795 · Cited by 38
Machine Learning Approaches to TCR Repertoire Analysis
Katayama, Y., Yokota, R., Akiyama, T., & Kobayashi, T. (2022) · Frontiers in Immunology · doi:10.3389/fimmu.2022.858057 · Cited by 37
Superior protein thermophilicity prediction with protein language model embeddings
Haselbeck, F., John, M., Zhang, Y., Pirnay, J., Werner, J., Costa, R. D., & Grimm, D. G. (2023) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqad087 · Cited by 37
Computational Protein Science in the Era of Large Language Models (LLMs)Preprint
Fan, W., Zhou, Y., Wang, S., Yan, Y., Liu, H., Zhao, Q., Song, L., & Li, Q. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.10282 · Cited by 37
Breaking the barriers of data scarcity in drug–target affinity prediction
Pei, Q., Wu, L., Zhu, J., Xia, Y., Xie, S., Qin, T., Liu, H., Liu, T.-Y., & Yan, R. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad386 · Cited by 36
T-cell receptor binding prediction: A machine learning revolution
Weber, A., Pélissier, A., & Martínez, M. R. (2024) · ImmunoInformatics · doi:10.1016/j.immuno.2024.100040 · Cited by 36
Wang, L., Liu, Y., Fu, X., Ye, X., Shi, J., Yen, G. G., Zou, Q., Zeng, X., & Cao, D. (2025) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.4c03073 · Cited by 36
Zhou, J., Chen, Q., Braun, P., Mandell, K. A. P., Jaffe, A. E., Tan, H. Y., Hyde, T. M., Kleinman, J. E., Potash, J. B., Shinozaki, G., et al. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2206069119 · Cited by 36
Semantic design of functional de novo genes from a genomic language model
(2025) · doi:10.1038/s41586-025-09749-7 · Cited by 35
VISH-Pred: an ensemble of fine-tuned ESM models for protein toxicity prediction
Mall, R., Singh, A., Patel, C., Guirimand, G. G. Y., & Castiglione, F. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae270 · Cited by 35
Beneath the surface: Unsolved questions in soil virus ecology
Hazard, C., Anantharaman, K., Hillary, L. S., Neri, U., Roux, S., Trubl, G., Williamson, K., Pett‐Ridge, J., Nicol, G. W., & Emerson, J. (2025) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2025.109780 · Cited by 35
Yadalam, P. K., Arumuganainar, D., Natarajan, P. M., & Ardila, C. M. (2025) · Scientific Reports · doi:10.1038/s41598-025-93409-3 · Cited by 35
Tan, Y., Li, M.-C., Zhou, Z.-Y., Tan, P., Yu, H.-Q., Fan, G.-S., & Hong, L. (2024) · Journal of Cheminformatics · doi:10.1186/s13321-024-00884-3 · Cited by 27
Zhang, M., Cheng, Q., Wei, Z., Xu, J., Wu, S., Xu, N., Zhao, C., Yu, L., & Feng, W. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae420 · Cited by 33
Protein Structural Phylogenetics
Puente-Lelièvre, C., Malik, A. J., & Douglas, J. (2025) · Genome Biology and Evolution · doi:10.1093/gbe/evaf139 · Cited by 33
Artificial intelligence in bioinformatics: a survey
Jiang, J., Li, Y., Cao, S., Shan, Y., Liu, Y., Fei, T., Yu, Y., Feng, Y., Li, Y., Li, Y., et al. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf576 · Cited by 33
Training Compute-Optimal Protein Language ModelsPreprint
Cheng, X., Chen, B., Li, P., Gong, J., Tang, J., & Song, L. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.06.06.597716 · Cited by 32
Large Language Models in Bioinformatics: A Survey
Wang, Z., Wang, Z., Jiang, J., Chen, P., Shi, X., & Li, Y. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.184 · Cited by 32
How artificial intelligence is reengineering protein engineering
Listgarten, J., & Jiang, H. (2026) · Science · doi:10.1126/science.aec8444 · Cited by 31
Pratyush, P., Pokharel, S., Saigo, H., & KC, D. B. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05164-9 · Cited by 31
Transferring a Molecular Foundation Model for Polymer Property Predictions
Zhang, P., Kearney, L. T., Bhowmik, D., Fox, Z., Naskar, A. K., & Gounley, J. P. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01650 · Cited by 31
Best practices for machine learning in antibody discovery and development
Wossnig, L., Furtmann, N., Buchanan, A. G., Kumar, S., & Greiff, V. (2024) · Drug Discovery Today · doi:10.1016/j.drudis.2024.104025 · Cited by 31
Structure-informed protein language models are robust predictors for variant effects
(2024) · doi:10.1007/s00439-024-02695-w · Cited by 30
Zhang, R., Wu, H., Liu, C., Yang, Q., Xiu, Y., Li, K., Chen, N., Wang, Y., Wang, Y., Gao, X., et al. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf367 · Cited by 30
Application of artificial intelligence large language models in drug target discovery
Liu, X., Zhang, J., Wang, X., Teng, M., Wang, G., & Zhou, X. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1597351 · Cited by 29
A Robust Drug–Target Interaction Prediction Framework with Capsule Network and Transfer Learning
Huang, Y., Huang, H., Chen, Y.-G., Lin, Y.-C.-D., Yao, L., Lin, T., Leng, J., Chang, Y., Zhang, Y., Zhu, Z., et al. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms241814061 · Cited by 29
Explaining protein–protein interactions with knowledge graph-based semantic similarity
Sousa, R. T., Silva, S., & Pesquita, C. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108076 · Cited by 29
MIND: Multi-Task Incremental Network Distillation
Bonato, J., Pelosin, F., Sabetta, L., & Nicolosi, A. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.28987 · Cited by 29
Zhang, F., Chang, S., Wang, B., & Zhang, X. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108669 · Cited by 29
Large Language Models in Genomics—A Perspective on Personalized Medicine
Ali, S. M., Qadri, Y. A., Ahmad, K., Lin, Z., Leung, M.-F., Kim, S. W., Vasilakos, A. V., & Zhou, T. (2025) · Bioengineering · doi:10.3390/bioengineering12050440 · Cited by 30
An integrative approach to protein sequence design through multiobjective optimization
Hong, L., & Kortemme, T. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011953 · Cited by 28
Enhancing foundation models for scientific discovery via multimodal knowledge graph representations
López, V., Hoang, L. T., Galindo, M. M., Fernández-Díaz, R., Sbodio, M. L., Ordóñez-Hurtado, R., Zayats, M., Mulligan, N., & Bettencourt‐Silva, J. H. (2024) · Journal of Web Semantics · doi:10.1016/j.websem.2024.100845 · Cited by 28
ToxDL 2.0: Protein toxicity prediction using a pretrained language model and graph neural networks
Zhu, L., Fang, Y., Liu, S., Shen, H., Neve, W. D., & Pan, X. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.04.002 · Cited by 28
PlantCAD2: A DNA foundation model for interpreting genomes across flowering plants
Zhai, J., Gokaslan, A., Hsu, S.-K., Chen, S.-P., Liu, Z.-Y., Marroquin, E., Czech, E., Cannon, B. R., Berthel, A., Romay, M. C., et al. (2026) · Cell Genomics · doi:10.1016/j.xgen.2026.101329 · Cited by 31
In silico protein function prediction: the rise of machine learning-based approaches
Chen, J., Gu, Z., Lai, L., & Pei, J. (2023) · Medical Review · doi:10.1515/mr-2023-0038 · Cited by 28
Artificial Intelligence for Microbiology and Microbiome ResearchPreprint
Wang, X., Wang, T., & Liu, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.01098 · Cited by 29
Siwek, J. C., Omelchenko, A. A., Chhibbar, P., Arshad, S., Rosengart, A., Nazarali, I., Patel, A., Nazarali, K., Rahimikollu, J., Tilstra, J. S., et al. (2025) · Nature Methods · doi:10.1038/s41592-025-02723-1 · Cited by 27
Zhang, Y., Li, J., Lin, S., Zhao, J., Xiong, Y., & Wei, D.-Q. (2024) · Journal of Cheminformatics · doi:10.1186/s13321-024-00862-9 · Cited by 27
Advances in Machine Learning Models for Predicting Enzyme Kinetic Parameters
Malli, A., Vasyutyn, D., & Kim, J. R. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c02428 · Cited by 28
A Review for Artificial Intelligence Based Protein Subcellular Localization
Xiao, H., Zou, Y., Wang, J., & Wan, S. (2024) · Biomolecules · doi:10.3390/biom14040409 · Cited by 27
ESMFold Hallucinates Native-Like Protein SequencesPreprint
Jeliazkov, J. R., del Alamo, D., & Karpiak, J. D. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.05.23.541774 · Cited by 27
LncRNA–Protein Interactions: A Key to Deciphering LncRNA Mechanisms
Wang, Z., Aftab, M., Dong, Z., Jiang, Y., & Liu, K. (2025) · Biomolecules · doi:10.3390/biom15060881 · Cited by 26
Zheng, J., Xiao, X., & Qiu, W. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.859188 · Cited by 26
Metadata
- Authors
- Brandes, N., Ofer, D., Peleg, Y., Rappoport, N., & Linial, M.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Deep Trading Ltd. , Haifa 3508401, Israel
- Ben-Gurion University of the Negev (IL)
- Department of Biological Chemistry, The Alexander Silberman Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Corresponding author
- Brandes, Nadav
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-02-10
- Volume
- 38
- Issue
- 8
- Pages
- 2102-2110
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC9386727
- OpenAlex
- W4205773061
- Cited by
- 1,009
- References
- 44
- Citations by year
- 2026: 248 · 2025: 355 · 2024: 241 · 2023: 127 · 2022: 34
- FWCI
- 62.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Israel Science Foundation (2753/20)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- protein sequence representation, protein function prediction, protein structure prediction, long sequence modeling
- MeSH terms
- Deep Learning, Amino Acid Sequence, Language, Natural Language Processing, Proteins
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.