Evaluating Protein Transfer Learning with TAPE

Rao, Roshan, Bhattacharya, Nicholas, Thomas, Neil, Duan, Yan, Chen, Xi, Canny, John, Abbeel, Pieter, Song, Yun S.·2019·bioRxiv (Cold Spring Harbor Laboratory)
DOI 10.1101/676825

Cited by (723)

Items 401–500 of 723

  1. LassoESM a tailored language model for enhanced lasso peptide property prediction
    Xuenan Mi, Susanna E. Barrett, Douglas A. Mitchell, Diwakar Shukla · 2025 · Nature Communications
  2. Predicting and Interpreting Protein Developability Via Transfer of Convolutional Sequence Representation
    Alexander W. Golinski, Zachary D. Schmitz, Gregory H. Nielsen, Bryce Johnson, Diya Saha, Sandhya Appiah, Benjamin J. Hackel, Stefano Martiniani · 2023 · ACS Synthetic Biology
  3. Knowledge Enhanced Representation Learning for Drug Discovery
    Thanh Lam Hoang, Marco Luca Sbodio, Marcos Martínez Galindo, Mykhaylo Zayats, Raúl Fernández-Díaz, Víctor Valls, Gabriele Picco, Cèsar Berrospi, Vanessa López · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  4. Classifying alkaliphilic proteins using embeddings from protein language model
    Meredita Susanty, Muhammad Khaerul Naim Mursalim, Rukman Hertadi, Ayu Purwarianti, Tati Latifah Mengko · 2024 · Computers in Biology and Medicine
  5. Prediction of antibody binding to SARS-CoV-2 RBDs
    Eric Ji Da Wang · 2022 · Bioinformatics Advances
  6. Deep learning enables the design of functional de novo antimicrobial proteins
    Javier Caceres‐Delpiano, Roberto Ibañez, Patricio Alegre, Cynthia Sanhueza, Romualdo Paz-Fiblas, Simon Correa, Pedro A. Retamal, Juan Cristóbal Jiménez, Leonardo Álvarez · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
  7. X-DPI: A structure-aware multi-modal deep learning model for drug-protein interactions prediction
    Penglei Wang, Shuangjia Zheng, Yize Jiang, Chengtao Li, Junhong Liu, Chang Wen, Atanas Patronov, Dahong Qian, Hongming Chen, Yuedong Yang · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  8. solPredict: Antibody Apparent Solubility Prediction from Sequence by Transfer Learning
    Jiangyan Feng, Min Jiang, James Shih, Qing Chai · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  9. Improved the Protein Complex Prediction with Protein Language Models
    Bo Chen, Ziwei Xie, Jiezhong Qiu, Zhaofeng Ye, Jinbo Xu, Jie Tang · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
  10. Language Models Can Identify Enzymatic Active Sites in Protein Sequences
    Yves Gaëtan Nana Teukam, Loıc Kwate Dassi, Matteo Manica, Philippe Schwaller, Daniel Probst, Teodoro Laino · 2023 · SSRN Electronic Journal
  11. De novo generation of T-cell receptors with desired epitope-binding property by leveraging a pre-trained large language model
    Jiannan Yang, Bing He, Yu Zhao, Feng Jiang, Zhonghuang Wang, Yixin Guo, Zhimeng Xu, Bo Yuan, Jiangning Song, Qingpeng Zhang et al. · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  12. Multi-Modal CLIP-Informed Protein Editing
    Mingze Yin, Hanjing Zhou, Yiheng Zhu, Miao Lin, Yixuan Wu, Jialu Wu, Hongxia Xu, Chang‐Yu Hsieh, Tingjun Hou, Jintai Chen et al. · 2024 · Health Data Science
  13. BioStructNet: Structure-Based Network with Transfer Learning for Predicting Biocatalyst Functions
    Wang, Xiangwen, Zhou, Jiahui, Mueller, Jane, Quinn, Derek, Carvalho, Alexandra, Moody, Thomas S., Huang, Meilan · 2025 · Journal of Chemical Theory and Computation
  14. Relational similarity-based graph contrastive learning for DTI prediction
    Jilong Bian, Hao Lu, Limin Wei, Yang Li, Guohua Wang · 2025 · Briefings in Bioinformatics
  15. EnsemPred-ACP: Combining machine and deep learning to improve anticancer peptide prediction
    Minjun Kwon, Yong Eun Jang, Ji Su Hwang, Seok Gi Kim, Nimisha Pradeep George, Shaherin Basith, Gwang Lee · 2025 · Computers in Biology and Medicine
  16. Kinase–inhibitor binding affinity prediction with pretrained graph encoder and language model
    Xudong Guo, Zixu Ran, Fuyi Li · 2025 · Briefings in Bioinformatics
  17. Rapid identification of metal resistance genes using an enhanced ResNet deep learning model trained on a largely expanded BacMet-based database
    2025
  18. Genotype sampling for deep-learning assisted experimental mapping of a combinatorially complete fitness landscape
    Andreas Wagner · 2024 · Bioinformatics
  19. Advances in the Application of Protein Language Modeling for Nucleic Acid Protein Binding Site Prediction
    Bo Wang, Wen-Jin Li · 2024 · Genes
  20. Combining GCN and Bi-LSTM for Protein Secondary Structure Prediction
    Hailong Jin, Wei Du, Jiawei Gu, Tianhao Zhang, Xiaohu Shi · 2021 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
  21. The Power of Universal Contextualized Protein Embeddings in Cross-species Protein Function Prediction
    Irene van den Bent, Stavros Makrodimitris, Marcel J. T. Reinders · 2021 · Evolutionary Bioinformatics
  22. Prediction Of O-Glycosylation Site Using Pre-Trained Language Model And Machine Learning
    Alhasan Alkuhlani, Walaa Khaled Gad, Mohamed Ismail Roushdy, Abdel-Badeeh Mohamed Salem · 2023 · International journal of intelligent computing and information sciences/International Journal of Intelligent Computing and Information Sciences
  23. Evaluation of Methods for Protein Representation Learning: A Quantitative Analysis
    Serbülent Ünsal, Heval Ataş, Muammer Albayrak, Kemal Turhan, Aybar C. Acar, Tunca Doğan · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
  24. When Geometric Deep Learning Meets Pretrained Protein Language Models
    Fang Wu, Yu Tao, Dragomir Radev, Jinbo Xu · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  25. Discovery of novel multi-functional peptides by using protein language models and graph-based deep learning
    Jiawei Luo, Kejuan Zhao, Junjie Chen, Caihua Yang, Fuchuan Qu, Ke Yan, Yang Zhang, Bin Liu · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  26. Learning Complete Protein Representation by Deep Coupling of Sequence and Structure
    Bozhen Hu, Cheng Tan, Jun Xia, Jiangbin Zheng, Yufei Huang, Lirong Wu, Yue Liu, Yongjie Xu, Stan Ziqing Li · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  27. Elliptic geometry-based kernel matrix for improved biological sequence classification
    Sarwan Ali, Madiha Shabbir, Haris Mansoor, Prakash Chourasia, Murray Patterson · 2024 · Knowledge-Based Systems
  28. Bio-Inspired Mamba for Antibody–Antigen Interaction Prediction
    Xuan Liu, Haitao Fu, Yuqing Yang, Jian Zhang · 2025 · Biomolecules
  29. TPpred-CMvL: prediction of multi-functional therapeutic peptide using contrast multi-view learning
    Ke Yan, Kangrui Xiang, Zixu Chen, Shutao Chen, Siyan Lu, Bin Liu, Youyu Wang · 2025 · BMC Biology
  30. Exploring Machine Learning Algorithms and Protein Language Models Strategies to Develop Enzyme Classification Systems
    Diego Fernández, Álvaro Olivera‐Nappa, Roberto Uribe-Paredes, David Medina-Ortiz · 2023 · Lecture notes in computer science
  31. Cross-view contrastive representation learning approach to predicting DTIs via integrating multi-source information
    Chengxin He, Yuening Qu, Jin Yin, Zhenjiang Zhao, Runze Ma, Lei Duan · 2023 · Methods
  32. Ensemble Learning with Supervised Methods Based on Large-Scale Protein Language Models for Protein Mutation Effects Prediction
    Yang Qu, Zitong Niu, Qiaojiao Ding, Taowa Zhao, Tong Kong, Bing Bai, Jianwei Ma, Yitian Zhao, Jianping Zheng · 2023 · International Journal of Molecular Sciences
  33. Offline Model-Based Optimization via Policy-Guided Gradient Search
    Yassine Chemingui, Aryan Deshwal, Trong Nghia Hoang, Janardhan Rao Doppa · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
  34. ProSol-multi: Protein solubility prediction via amino acids multi-level correlation and discriminative distribution
    Hina Ghafoor, Muhammad Nabeel Asim, Muhammad Ali Ibrahim, Andreas Dengel · 2024 · Heliyon
  35. Paying attention to the SARS-CoV-2 dialect : a deep neural network approach to predicting novel protein mutations
    Magdalyn E. Elkin, Xingquan Zhu A · 2025 · Communications Biology
  36. LSTM-GRU Based Deep Learning Model with Word2Vec for Transcription Factors in Primates
    Ali Burak Öncül · 2023 · Balkan Journal of Electrical and Computer Engineering
  37. A novel data augmentation approach for influenza A subtype prediction based on HA proteins
    Mohammad Amin Sohrabi, Fatemeh Zare‐Mirakabad, Saeed Shiry Ghidary, Mahsa Saadat, Seyed‐Ali Sadegh‐Zadeh · 2024 · Computers in Biology and Medicine
  38. SPDesign: protein sequence designer based on structural sequence profile using ultrafast shape recognition
    2024
  39. Genotypic–phenotypic landscape computation based on first principle and deep learning
    Yuexing Liu, Yao Luo, Xin Lu, Hao Gao, Ruikun He, Xin Zhang, Xuguang Zhang, Yixue Li · 2024 · Briefings in Bioinformatics
  40. APEX-pHLA: A novel method for accurate prediction of the binding between exogenous short peptides and HLA class I molecules
    Zhihao Su, Yejian Wu, Kaiqiang Cao, Jie Du, Lujing Cao, Zhipeng Wu, Xinyi Wu, Xinqiao Wang, Ying Song, Xudong Wang et al. · 2024 · Methods
  41. TooT-BERT-T: A BERT Approach on Discriminating Transport Proteins from Non-transport Proteins
    Hamed Ghazikhani, Gregory Butler · 2022 · Lecture notes in networks and systems
  42. Regression Transformer enables concurrent sequence regression and generation for molecular language modelling
    Jannis Born, Matteo Manica · 2022 · arXiv (Cornell University)
  43. Learning the shape of protein micro-environments with a holographic convolutional neural network
    Michael Neal Pun, Andrew Ivanov, Quinn Bellamy, Zachary Montague, Colin LaMont, Philip H Bradley, Jakub Otwinowski, Armita Nourmohammad · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
  44. PRO-LDM: Protein Sequence Generation with a Conditional Latent Diffusion Model
    Sitao Zhang, Zixuan Jiang, Rundong Huang, Shaoxun Mo, Le-Tao Zhu, Peiheng Li, Ziyi Zhang, Emily Pan, Xi Chen, Yun-Fei Long et al. · 2024 · bioRxiv
  45. Accurate Prediction of Antibody Function and Structure Using Bio-Inspired Antibody Language Model
    Hongtai Jing, Zhengtao Gao, Sheng Yong Xu, Tao Shen, Zhangzhi Peng, Shwai He, Tao You, Shuang Ye, Wei Lin, Siqi Sun · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  46. Likelihood-based Fine-tuning of Protein Language Models for Few-shot Fitness Prediction and Design
    Alex Hawkins-Hooker, Shikha Surana, J. Simons, J. Kmec, Oliver Bent, Paul Duckworth · 2026 · bioRxiv
  47. Benchmarking gene embeddings from sequence, expression, network, and text models for functional prediction tasks
    Jeffrey Zhong, Lechuan Li, Ruth Dannenfelser, Vicky Yao · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
  48. Deconvolving mutation effects on protein stability and function with disentangled protein language models
    Kerr Ding, Ziang Li, Tony Tu, Jiaqi Luo, Yu-Nan Luo · 2026 · bioRxiv
  49. Transformers meets neoantigen detection: a systematic literature review
    Machaca, Vicente, Goyzueta, Valeria, Cruz, María Graciel, Sejje, Erika, Pilco, Luz Marina, López, Julio, Túpac, Yván · 2024 · Journal of Integrative Bioinformatics
  50. Biological Sequence Representation Methods and Recent Advances: A Review
    Hongwei Zhang, Yan Shi, Yapeng Wang, Yang Xu, Kefeng Li, Sio‐Kei Im, Yu Du Han · 2025 · Biology
  51. VotePLMs-AFP: Identification of antifreeze proteins using transformer-embedding features and ensemble learning
    Dawei Qi, Taigang Liu · 2024 · Biochimica et Biophysica Acta (BBA) - General Subjects
  52. ATP_mCNN: Predicting ATP binding sites through pretrained language models and multi-window neural networks
    Van‐The Le, Muhammad Shahid Malik, Yi-Jing Lin, Yuchen Liu, Yan‐Yun Chang, Yu‐Yen Ou · 2024 · Computers in Biology and Medicine
  53. Benchmarking recent computational tools for DNA-binding protein identification
    Xizi Luo, Amadeus Song Yi, Andre Lin HuiKai, Tze Jet Ong, Limsoon Wong, Chowdhury Rafeed Rahman · 2024 · Briefings in Bioinformatics
  54. PTSP-BERT: Predict the thermal stability of proteins using sequence-based bidirectional representations from transformer-embedded features
    Zhibin Lv, Mingxuan Wei, Hongdi Pei, Shiyu Peng, Mingxin Li, Liangzhen Jiang · 2024 · Computers in Biology and Medicine
  55. SST-ResNet: A Sequence and Structure Information Integration Model for Protein Property Prediction
    Guowei Zhou, Yanpeng Zhao, Song He, Xiaochen Bo · 2025 · International Journal of Molecular Sciences
  56. Enhancing Structure-Aware Protein Language Models with Efficient Fine-Tuning for Various Protein Prediction Tasks
    Yichuan Zhang, Yongfang Qin, Mahdi Pourmirzaei, Qing Shao, Duolin Wang, Dong He Xu · 2025 · Methods in molecular biology
  57. Scalable embedding fusion with protein language models: insights from benchmarking text-integrated representations
    Young Su Ko, J. Parkinson, Wei Wang · 2026 · Briefings in Bioinformatics
  58. Deep Learning-Based microRNA Target Prediction Using Experimental Negative Data
    Byunghan Lee · 2020 · IEEE Access
  59. Prediction of hot spots towards drug discovery by protein sequence embedding with 1D convolutional neural network
    Youzhi Zhang, Sijie Yao, Peng Chen · 2023 · PLoS ONE
  60. Foundation models in molecular biology
    Yunda Si, Jiawei Zou, Yicheng Gao, Guohui Chuai, Qi Liu, Luonan Chen · 2024 · Biophysics Reports
  61. iNP_ESM: Neuropeptide Identification Based on Evolutionary Scale Modeling and Unified Representation Embedding Features
    Honghao Li, Liangzhen Jiang, Kai-Xiang Yang, Shu-Lin Shang, Mingxin Li, Zhi-Bin Lv · 2024 · International Journal of Molecular Sciences
  62. PLM‐T3SE: Accurate Prediction of Type III Secretion Effectors Using Protein Language Model Embeddings
    Mengru Gao, Chen Song, Taigang Liu · 2024 · Journal of Cellular Biochemistry
  63. Transfer Learning‐Based Vehicle Collision Prediction
    Yang Li, Zonggao Wang, Lijun Ma, Wei Dai · 2022 · Wireless Communications and Mobile Computing
  64. Identifying promising sequences for protein engineering using a deep transformer protein language model
    Trevor S. Frisby, CHRISTOPHER JAMES LANGMEAD · 2023 · Proteins Structure Function and Bioinformatics
  65. Ensemble of Template-Free and Template-Based Classifiers for Protein Secondary Structure Prediction
    Gabriel Bianchin de Oliveira, Hélio Pedrini, Zanoni Dias · 2021 · International Journal of Molecular Sciences
  66. Contact-Distil: Boosting Low Homologous Protein Contact Map Prediction by Self-Supervised Distillation
    Qin Wang, Jiayang Chen, Yuzhe Zhou, Yu Li, Liangzhen Zheng, Sheng Wang, Zhen Li, Shuguang Robert Cui · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  67. Deep Scaffold Hopping with Multi-modal Transformer Neural Networks
    Shuangjia Zheng, Zengrong Lei, Haitao Ai, Hongming Chen, Daiguo Deng, Yuedong Yang · 2020 · ChemRxiv
  68. PeTriBERT : Augmenting BERT with tridimensional encoding for inverse protein folding and design
    Baldwin Dumortier, Antoine Liutkus A, Clément Carré, Gabriel Krouk · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
  69. So ManyFolds, So Little Time: Efficient Protein Structure Prediction With pLMs and MSAs
    Thomas D. Barrett, Amelia Villegas-Morcillo, Louis Robinson, Benoit Gaujac, David Adméte, Elia Saquand, Karim Beguir, Arthur Flajolet · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
  70. Tuned Fitness Landscapes for Benchmarking Model-Guided Protein Design
    Neil Thomas, Atish Agarwala, David Belanger, Yun S. Song, Lucy J. Colwell · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
  71. LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain
    Joel Niklaus, Veton Matoshi, Pooja Rani, Galassi, Andrea, Matthias Stuermer, Ilias Chalkidis · 2023 · arXiv (Cornell University)
  72. Retrieved Sequence Augmentation for Protein Representation Learning
    Chang Ma, Haiteng Zhao, Linjin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Lu Yang, Qi Liu, Lingpeng Kong · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  73. Assessing the performance of protein regression models
    Michaël Richard, Jacob Kæstel‐Hansen, Peter Mørch Groth, Simon Bartels, Jesper Salomon, Pengfei Tian, Nikos S. Hatzakis, Wouter Boomsma · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
  74. TransMEP: Transfer learning on large protein language models to predict mutation effects of proteins from a small known dataset
    Tilman Hoffbauer, Birgit Strodel · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  75. ProtHyena: A fast and efficient foundation protein language model at single amino acid Resolution
    Yiming Zhang, Manabu Okumura · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  76. A new framework for evaluating model out-of-distribution generalisation for the biochemical domain
    Raúl Fernández-Díaz, Denis C. Shields, Thanh Lam Hoang, Vanessa López · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  77. Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central Dogma
    Yihui Wang, Zhiyuan Cai, Qian Zeng, Yihang Gao, Jiarui Ouyang, Yingxue Xu, Shu Yang, Sunan He, Yuxiang Nie, Yu Cai et al. · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
  78. A Generative Foundation Model for Antibody Design
    Rubo Wang, Fandi Wu, Jiale Shi, Yidong Song, Yu Kong, Jianhua Ma, Bing He, Qihong Yan, Tianlei Ying, Peilin Zhao et al. · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
  79. Vector-clustering Multiple Sequence Alignment: Aligning into the twilight zone of protein sequence similarity with protein language models
    McWhite, Claire D., Singh, Mona · 2022
  80. ARNLE model identifies prevalence potential of SARS-CoV-2 variants
    Yuqi Liu, Jing Li, Peihan Li, Kaiying Wang, Kaiying Wang, Jinhui Li, Lang Yang, Jiangfeng Liu, Leili Jia, Aiping Wu et al. · 2024 · Nature Machine Intelligence
  81. A Benchmarking Platform for Assessing Protein Language Models on Function-Related Prediction Tasks
    Elif Çevrim, Melih Gökay Yiğit, Erva Ulusoy, Ardan Yılmaz, Tunca Doğan · 2025 · Methods in molecular biology
  82. Next-generation antiviral peptides: AI-driven design, translational delivery platforms, and future therapeutic directions
    Maryam Mashhadi Abolghasem Shirazi, Setareh Haghighat, Zahra Nikbakht, Elaheh Salimkia, Armity Kiumarsy · 2025 · Virus Research
  83. AI- and ML-Driven Strategies for Drug Repurposing: Techniques, Applications, and Challenges
    Yi Cong, So Nakagawa, Atsushi Ogura, Katsuhiko Mineta, Takashi Gojobori, Toshinori Endo · 2026 · Springer eBooks
  84. GASIDN: identification of sub-Golgi proteins with multi-scale feature fusion
    Jianan Sui, Jiazi Chen, Yuehui Chen, Naoki Iwamori, Jin Sun · 2024 · BMC Genomics
  85. Hierarchical progressive learning for zero-shot peptide-HLA binding prediction and automated antigenic peptide design
    Xinyuan Zhu, Jiadong Lu, Xinting Hu, Tengchuan Jin, Shan Lu, Fuli Feng · 2025 · Cell Reports
  86. RTK_RAG: Leveraging Retrieval Augmented Generation with Multi-Window Convolutional Neural Networks for Superior ATP Binding Site Prediction in Receptor Tyrosine Kinases
    Sin-Siang Wei, Wei-En Jhang, Yu-Chen Liu, Cheng-Che Chuang, Yu‐Yen Ou · 2025 · Journal of Chemical Information and Modeling
  87. An equivariant pretrained transformer for unified 3D molecular representation learning
    Rui Jiao, Xiangzhe Kong, Li Zhang, Ziyang Yu, Fangyuan Ren, Wenjuan Tan, Wenbing Huang, Yang Liu · 2026 · Nature Communications
  88. Compression and k -Mer Based Approach for Anticancer Peptide Analysis
    Sarwan Ali, Tamkanat E. Ali, Prakash Chourasia, Murray Patterson · 2026 · IEEE Transactions on Computational Biology and Bioinformatics
  89. A Transferability-Based Method for Evaluating the Protein Representation Learning
    Fan Hu, Weihong Zhang, Huazhen Huang, Li Wang, Yang Li, Peng Yin · 2024 · IEEE Journal of Biomedical and Health Informatics
  90. CCPL: Cross-Modal Contrastive Protein Learning
    Jiangbin Zheng, Stan Ziqing Li · 2024 · Lecture notes in computer science
  91. CBKG-DTI: Multi-Level Knowledge Distillation and Biomedical Knowledge Graph for Drug-Target Interaction Prediction
    Xiaosa Zhao, Qixian Wang, Ye Zhang, Chenglong He, Minghao Yin, Xiaowei Zhao · 2024 · IEEE Journal of Biomedical and Health Informatics
  92. ProteinF3S: boosting enzyme function prediction by fusing protein sequence, structure, and surface
    Mingzhi Yuan, Ao Shen, Yingfan Ma, Jie Du, Bohan An, Manning Wang · 2024 · Briefings in Bioinformatics
  93. LatentDE: latent-based directed evolution for protein sequence design
    Thanh Phuoc Tran, Nhat Khang Ngo, Viet Thanh Duy Nguyen, Truong Son Hy · 2025 · Machine Learning Science and Technology
  94. Deep Learning Proteins using a Triplet-BERT network
    Mark Lennox, Neil M. Robertson, Barry J. Devereux · 2021 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  95. Navigating the amino acid sequence space between functional proteins using a deep learning framework
    Tristan Bitard-Feildel · 2021 · PeerJ Computer Science
  96. Identification of efflux proteins based on contextual representations with deep bidirectional transformer encoders
    Semmy Wellem Taju, Syed Muazzam Ali Shah, Yu‐Yen Ou · 2021 · Analytical Biochemistry
  97. BERT2DAb: a pre-trained model for antibody representation based on amino acid sequences and 2D-structure
    Xiaowei Luo, Fan Tong, Wenbin Zhao, Xiangwen Zheng, Jiangyu Li, Jing Li, Dongsheng Zhao · 2023 · mAbs
  98. Prediction of Protein Tertiary Structure Using Pre-Trained Self-Supervised Learning Based on Transformer
    Alif Kurniawan, Wisnu Jatmiko, Rukman Hertadi, Novian Habibie · 2020 · International Workshop on Big Data and Information Security (IWBIS)
  99. SPOT-Contact-Single: Improving Single-Sequence-Based Prediction of Protein Contact Map using a Transformer Language Model
    Jaspreet Singh, Thomas Litfin, Jaswinder Singh, Kuldip K. Paliwal, Yaoqi Zhou · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
  100. SPOT-1D-LM: Reaching Alignment-profile-based Accuracy in Predicting Protein Secondary and Tertiary Structural Properties without Alignment
    Jaspreet Singh, Kuldip K. Paliwal, Jaswinder Singh, Yaoqi Zhou · 2021 · bioRxiv (Cold Spring Harbor Laboratory)