Evaluating Protein Transfer Learning with TAPE
Rao, Roshan, Bhattacharya, Nicholas, Thomas, Neil, Duan, Yan, Chen, Xi, Canny, John, Abbeel, Pieter, Song, Yun S.·2019·bioRxiv (Cold Spring Harbor Laboratory)
DOI 10.1101/676825
Cited by (723)
Items 601–700 of 723
- CELL-E: A Text-to-Image Transformer for Protein Image PredictionEmaad Khwaja, Yun S. Song, Bo Huang · 2024 · Lecture notes in computer science
- SCOP: A Sequence-Structure Contrast-Aware Framework for Protein Function PredictionRunze Ma, Chengxin He, Huiru Zheng, Xinye Wang, Haiying Wang, Yidan Zhang, Lei Duan · 2024 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- LMDTA: Molecular Pre-trained and Interaction Fine-tuned Attention Neural Network for Drug-Target Affinity PredictionMinjie Hu, Kuo Yang, Kuan Xu, Xuezhong Zhou · 2024 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- Boost Protein Language Model with Injected Structure Information Through Parameter Efficient Fine-tuningZixun Zhang, Yuzhe Zhou, J. X. Zheng, Chun-Mei Feng, Shuguang Robert Cui, Sheng Wang, Zhen Li · 2025 · Computers in Biology and Medicine
- Position Specific Scoring Is All You Need? Revisiting Protein Sequence Classification TasksSarwan Ali, Taslim Murad, Prakash Chourasia, Haris Mansoor, Imdadullah Khan, Pin‐Yu Chen, Murray Patterson · 2025 · Lecture notes in computer science
- Can Deep Learning Solve the Cas9 Dilemma?Aashutosh Girish Boob, Huimin Zhao · 2021 · The CRISPR Journal
- Adaptive Residue-wise Profile Fusion for Low Homologous Protein Secondary Structure Prediction Using External KnowledgeQin Wang, Jun Wei, Boyuan Wang, Zhen Li, Sheng Wang, Shuguang Robert Cui · 2021 · International Joint Conference on Artificial Intelligence
- A Review of Protein Structure Prediction using Deep LearningMeredita Susanty, Tati Latifah Erawati Rajab, Rukman Hertadi · 2021 · BIO Web of Conferences
- PENSAMIENTO CRÍTICO EN LA INVESTIGACIÓN CIENTÍFICA Y ACADÉMICACamilo Mauricio Grillo Torres, Jordan Piero Borda Colque, Juan Reynaldo Paredes-Quispe, Jordan Piero Borda Colque, Jordan Piero Borda Colque, Hugo Ticona Salluca, Wilber Pastor, Juan Carlos Buendía Pastrana, José Antonio Ogosi Auqui, José Antonio et al. · 2023
- DeepPSC (protein structure camera): computer vision-based protein backbone structure reconstruction from alpha carbon trace as a case studyXing Zhang, Junwen Luo, Yi Cai, Wei Zhu, Xiaofeng Yang, Hongmin Cai, Zhanglin Lin · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
- WITHDRAWN: ToxVec: Deep Language Model-Based Representation Learning for Venom Peptide ClassificationMeisam Ahmadi, Mohammad Reza Jahed‐Motlagh, Ehsaneddin Asgari, Adel Torkaman Rahmani, Alice Carolyn McHardy · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
- Opportunities and Challenges for Interpreting Rare Variation in Clinically Important GenesGregory McInnes, Andrew G. Sharo, Megan L. Koleske, Julia E. H. Brown, Matthew Norstad, Aashish N. Adhikari, Sheng Wang, Steven E. Brenner, Jodi Halpern, Barbara Ann Koenig et al. · 2020 · Preprints.org
- Deep learning model for the prediction and classification of protein toxins across all domains of lifeJavier Caceres‐Delpiano, Roberto Ibañez, Simon Correa, Michael P. Dunne, Pedro A. Retamal, Leonardo Álvarez · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
- In silico protein science: from sequence to networkMiguel Correa Marrero · 2021
- Identification of Enzymatic Active Sites with Unsupervised Language ModelingLoıc Kwate Dassi, Matteo Manica, Daniel Probst, Philippe Schwaller, Yves Gaëtan Nana Teukam, Teodoro Laino · 2022 · ChemRxiv
- Predicting SARS-CoV-2 epitope-specific TCR recognition using pre-trained protein embeddingsYoungmahn Han, Aeri Lee · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
- Fast and Accurate Prediction of Intrinsically Disordered Protein by Protein Language ModelShijie Xu, Akira Onoda · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- A robust deep learning platform to predict CD8+ T-cell epitopesChloe Hyun-Jung Lee, Jaesung Huh, Paul R. Buckley, Myeongjun Jang, Mariana Pereira Pinho, Ricardo A. Fernandes, Agne Antanaviciute, Alison Simmons, Hashem Koohy · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Discriminating Ion Channels from Non-Ion Channel Membrane Proteins Using Machine Learning and Deep Learning Classifiers with Protein Language Model RepresentationsHamed Ghazikhani, Gregory Butler · 2023 · Preprints.org
- Co-evolution integrated deep learning framework for variants generation and fitness predictionXiaoqin Tan · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- SENSE-PPI reconstructs protein-protein interactions of various complexities, within, across, and between species, with sequence-based evolutionary scale modeling and deep learningKonstantin Volzhenin, Lucie Bittner, Alessandra Carbone · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- A cross-attention transformer encoder for paired sequence dataCeder Dens, Kris Laukens, Pieter Meysman, Wout Bittremieux · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- Protein Language Models in Directed EvolutionRussell G. Maguire, Kotryna Bloznelyte, Fikayo Adepoju, Matthew Armean-Jones, Shafiat Dewan, Stella Fozzard, Sophie E. Goddard, Akash Kumar Gupta, Ece Ibrahimi, Frances Patricia Jones et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- TooT-PLM-P2S: Incorporating Secondary Structure Information into Protein Language ModelsHamed Ghazikhani, Gregory Butler · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Integration of protein and coding sequences enables mutual augmentation of the language modelHeng-Rui Zhao, Meng‐Ting Cheng, Zhu Jinhua, Hao Wang, Xiang-Rui Yang, Bo Wang, Yuanxin Sun, Ming-Hao Fang, Enhong Chen, Houqiang Li et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- ProtHGT: Heterogeneous Graph Transformers for Automated Protein Function Prediction Using Biological Knowledge Graphs and Language ModelsErva Ulusoy, Tunca Doğan · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- Sequence-aware Prediction of Point Mutation-induced Effects on Protein-Protein Binding Affinity using Deep LearningJian Zhuang, Zonghui Li, Suhui Wang, Ren‐Chao Zheng, Guijun Zhang · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- Quantitative mapping of antigen specificity in adaptive immune repertoire embedding spacesMarina Frolenkova, Niccolò Cardente, Jahn Zhong, Evgeniy S. Egorov, Giulio Isacchini, Julien P. Limenitakis, Philipp Fleig, Puneet Rawat, Milena Pavlović, Caterina Sanetti et al. · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- Fast, accurate construction of multiple sequence alignments from protein language embeddingsMinh Hoang, Isabel Armour-Garb, Mona Singh · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- RF_Bert: A Classification Model of Golgi Apparatus Based on TAPE_BERT Extraction FeaturesQingyu Cui, Wenzheng Bao, Yi Cao, Bin Yang, Yuehui Chen · 2021 · Lecture notes in computer science
- Computational approaches to discover novel enzymes for fragrance and flavourJanani Durairaj · 2021
- Peer Review #1 of "Navigating the amino acid sequence space between functional proteins using a deep learning framework (v0.1)"2021 · PeerJ Computer Science
- Identification of Enzymatic Active Sites with Unsupervised Language ModelingLoıc Kwate Dassi, Matteo Manica, Daniel Probst, Philippe Schwaller, Yves Gaëtan Nana Teukam, Teodoro Laino · 2021
- Learning representations for molecular sequencesDhananjay Kimothi · 2021 · Queensland University of Technology
- Peer Review #2 of "Navigating the amino acid sequence space between functional proteins using a deep learning framework (v0.1)"2021 · PeerJ Computer Science
- Faculty Opinions recommendation of Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences.Patrice Koehl · 2021 · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature
- BiRDS - Binding Residue Detection from Protein Sequences using Deep ResNetsVineeth Chelur, U. Deva Priyakumar · 2021
- Identification of Enzymatic Active Sites with Unsupervised Language ModelingLoıc Kwate Dassi, Matteo Manica, Daniel Probst, Philippe Schwaller, Yves Gaëtan Nana Teukam, Teodoro Laino · 2021 · ChemRxiv
- ZeroFold-Understanding Mutations of SARS-CoV-2 Spike Protein base on Secondary Structure Event Extracting for guiding Vaccine developmentWeibin Chen, Zhiyuan Xu · 2020
- Identification of Enzymatic Active Sites with Unsupervised Language ModelingLoıc Kwate Dassi, Matteo Manica, Daniel Probst, Philippe Schwaller, Yves Gaëtan Nana Teukam, Teodoro Laino · 2022
- Pre-training Protein Models with Molecular Dynamics Simulations for Drug BindingFang Wu, Qiang Zhang, Dragomir Radev, Yuyang Wang, Xurui Jin, Yinghui Jiang, Stan Ziqing Li, Zhangming Niu · 2022 · Research Square
- COVID-19 and SARS Virus Function Sites Classification with Machine Learning MethodsHongdong Wang, Zizhou Feng, Baitong Chen, Wenhao Shao, Zijun Shao, Yumeng Zhu, Zhuo Wang · 2022 · Lecture notes in computer science
- Deep Learning Methods For Prediction of HLA-Peptide Interactions in IDBZubaida Said Ameen, Abdullahi Umar Ibrahim, Auwalu Saleh Mubarak, Fadi M. Al-Turjman, Umar Muhammad Ghali · 2022 · International Conference on Artificial Intelligence in Everything (AIE)
- Automated Detection of Sockpuppet Accounts in WikipediaMostofa Najmus Sakib · 2022
- Source Identification for Exosomal Communication via Protein Language ModelsXinbo Wu, Alexandru Hanganu, Ayuko Hoshino, Lav R. Varshney · 2022 · Machine learning for signal processing ...
- APIP: Attention-based Protein Representation Learning for Protein-Ligand Interface PredictionTian Xia, Bo Hui, Wei‐Shinn Ku · 2022 · IEEE International Conference on Big Data (BigData)
- CELL-E: zero-shot sequence-to-image synthesis for protein localization predictionEmaad Khwaja, Yun S. Song, Bo Huang · 2023 · Research Square
- T4SEpp: a pipeline integrated with protein language models effectively predicting bacterial type IV secreted effectorsYueming Hu, Yejun Wang, Xiaotian Hu, Haoyu Chao, Sida Li, Qinyang Ni, Yanyan Zhu, Yixue Hu, Ziyi Zhao, Ming Chen · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- TAPE-Pero: Using Deep Representation Learning Model to Identify and Localize Peroxisomal ProteinsJianan Sui, Yuehui Chen, Yi Cao, Yaou Zhao · 2023 · Lecture notes in computer science
- Domain-PFP: Protein Function Prediction Using Function-Aware Domain Embedding RepresentationsNabil Ibtehaz, Yuki Kagaya, Daisuke Kihara · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- Hist2Vec: Kernel-Based Embeddings for Biological Sequence ClassificationSarwan Ali, Haris Mansoor, Prakash Chourasia, Murray Patterson · 2023 · Lecture notes in computer science
- Attention Based Approach for Molecular Property PredictionTuan Tran, Chinwe Ekenna · 2023 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- Deep-USIpred: identifying substrates of ubiquitin protein ligases E3 and deubiquitinases with pretrained protein embedding and bayesian neural networkJia Wang, Gui-Qing Pan, Jianqiang Li, Xuequn Shang, Zhu‐Hong You, Yu‐An Huang · 2023 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- Genotype sampling for deep-learning assisted experimental mapping of fitness landscapesAndreas Wagner · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Deep Manifold Transformation for Protein Representation LearningBozhen Hu, Zelin Zang, Cheng Tan, Stan Ziqing Li · 2024 · IEEE International Conference on Acoustics Speech and Signal Processing
- Deep Learning-Driven Protein DesignAo You, Xiaobing Xu · 2024 · Advances in Computer Signals and Systems
- Latent-based Directed Evolution accelerated by Gradient Ascent for Protein Sequence DesignNhat Khang Ngo, Thanh V. T. Tran, Viet Thanh Duy Nguyen, Truong Son Hy · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Protein DesignL. Ramya, Preethi T. Ragunathan, Ragothaman M. Yennamalli · 2024 · Elsevier eBooks
- Novel Fine-Tuning Strategy on Pre-trained Protein Model Enhances ACP Functional Type ClassificationShaokai Wang, Bin Ma · 2024 · Lecture notes in computer science
- F-CPI: Prediction of activity changes induced by fluorine substitution using multimodal deep learningQian Zhang, Wenhai Yin, Xinyao Chen, Aimin Zhou, Guixu Zhang, Zhi Qing Zhao, Zhiqiang Li, Yan Zhang, Jingshan Shen, Weiliang Zhu et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Boosting Protein Language Models with Negative Sample MiningYaoyao Xu, Xinjian Zhao, Xiaozhuang Song, Benyou Wang, Tianshu Yu · 2024 · Lecture notes in computer science
- ProTeM: Unifying Protein Function Prediction via Text MatchingMing Qin, Xun Li, Yuhao Wang, Zhenping Li, Hongbin Ye, Zongbing Wang, Weihao Gao, Shangsong Liang, Qiang Zhang, Keyan Ding · 2024 · Lecture notes in computer science
- Recursive Cleaning for Large-scale Protein Data via Multimodal LearningZixuan Jiang, Sitao Zhang, Jiahang Cao, Qiang Zhang, Shiyi Liu, Yuetong Fang, Lingfeng Zhang, Rui Qing, Renjing Xu · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- VIEPred: Predicting Viral Immune Evasion with Multimodal Representation LearningBanqing Liang, Na Wang, Hao Huang, Yijie Hou, Xiaoli Qiang · 2024 · Journal of Physics Conference Series
- A novel HLA Class II presentation prediction algorithm deciphers immunogenic CD4 epitopes specific to KRAS G12CDaniel Sprague, Meghan G. Hart, Joshua S. Klein, Sonia Kounlavouth, Rahulsimham Vegesna, Melissa Rotunno, Lauren D. Kraemer, Rita Zhou, Lindsey Kemp, Adrienne C. Greene et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- MTTSCL: protein subcellular localization prediction using multi-task learningLiang Yu, Xiang Wu, Yan Li, Zhaoyang Huang, Ziqi Liu · 2024 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- GP-nano: a geometric graph network for nanobody polyreactivity predictionXiaolong Zhou, Qianmu Yuan, Shuangjia Zheng, Yu Wang, Yuedong Yang · 2024 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- Molecular structure and role of microbial proteins: a delimitation employing bioinformatics techniquesDebanjan Saha, Nayan Jyoti Borah, Afrin Mamud · 2025 · Elsevier eBooks
- Multiscale Motif-Aware Relation Graph Structure for Drug-Target Binding Affinity PredictionCheng Cheng, Xiaohong Zhang, Mianyang Yu, Yuqin Xia, Weiwei Xue · 2025 · IEEE Transactions on Computational Biology and Bioinformatics
- Hash-binding: DNA-protein binding prediction using hashing-based embeddingSarwan Ali, Tamkanat E. Ali, Murray Patterson · 2025 · Neural Computing and Applications
- CellSpliceNet: Interpretable Multimodal Modeling of Alternative Splicing Across Neurons in C. elegansArman Afrasiyabi, Jake Kovalic, Chen Liu, Egbert Castro, Alexis Weinreb, Erdem Varol, David M. Miller, Marc Hammarlund, Smita Krishnaswamy · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- Learning molecular machines by machine learningRumeysa Hilal Çelik, Haci Aslan Onur Iscil, Ecem Bulut, Saliha Ece Acuner · 2025 · Eurasian Journal of Science Engineering and Technology
- Bag-of-words is competitive with sum-of-embeddings language-inspired representations on protein inferenceFrixos Papadopoulos, Tilman Sánchez-Elsner, Mahesan Niranjan, Ashley Heinson · 2025 · PLoS ONE
- Predicting Viral Escape: A Contrastive Learning Framework with Lightweight Protein Language ModelsSamet Tenekeci, Efe Sezgin, Selma Tekır · 2025 · SSRN Electronic Journal
- ProtSEC: Ultrafast Protein Sequence Embedding in Complex Space Using Fast Fourier TransformRajan Saha Raju, Rashedul Islam · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- Do Protein Transformers Have Biological Intelligence?Fudong Lin, Wenzhang Du, Jinchan Liu, Tarikul I. Milon, Shelby Meche, Wu Xu, Xiaoqi Qin, Xu Yuan · 2025 · Lecture notes in computer science
- Heterogeneous Network With Multiview Path Aggregation: Drug–Target Interaction Prediction Study DesignHaixue Zhao, Kui Yao, Yunjiong Liu, Chao Che, Lin Tang · 2025 · JMIR Medical Informatics
- Efficient Protein Engineering via Integrated Language Models and Bayesian OptimizationJoshua Meehl, Prasad Siddavatam · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- Macon: Enhance Protein Mutation Representation using Contrastive Learning with Effect Prediction on Protein–protein InteractionsWeihao Li, Zhe Liu, Guan Ning Lin · 2025 · Research Square
- PEPE: scalable extraction of multi-modal protein language model representationsJahn Zhong, Niccolò Cardente, Geir Kjetil Sandve, Habib Bashour, Maria Francesca Abbate, Victor Greiff · 2026 · Bioinformatics
- Using Convolutional Neural Networks with Image-Based Representations of Amino Acid Sequences for Predicting the Effects of Genetic VariantsGülbahar Merve Şilbir, Burçin Kurt · 2025 · The EuroBiotech Journal
- Integrating Millions of Years of Evolutionary Information into Protein Structure Models for Function PredictionRunze Ma, Chengxin He, Zhongyue Zhang, Huiru Zheng, Lei Duan · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- A RBP binding site recognition model integrating convolution and transformer structures: based on sequence and structure dual-channel learningLulu Wang · 2025 · International Conference on Biomedicine and Intelligent Technology (ICBIT)
- Language Model–Based Representation Learning for Venom Protein Identification and Therapeutic Target Discovery in CancerMeisam Ahmadi, Mohammad Reza Jahed‐Motlagh, Ehsaneddin Asgari, Adel Torkaman Rahmani · 2025 · Multidisciplinary Cancer Investigation
- Hierarchical clustering-based coarse-to-fine classification framework for microbial protein function predictionShengyang Chen, Xinyue Gao, Congmin Zhu, Honglei Liu, Yuqing Yang · 2025 · BMC Bioinformatics
- AI-Driven Insights into Protein Sequence Analysis LandscapeMuhammad Nabeel Asim, Sheraz Ahmed, Andreas Dengel · 2025 · Springer eBooks
- Fine-Tuning Protein Language Models: pMHC Binding Prediction Case StudyVicente Enrique Machaca Arceda, J. Grados, K. Lazarte, Richart Smith Escobedo-Quispe, C. Lopez · 2026 · Smart innovation, systems and technologies
- Relativistic triangle–curvature computing for federated HIV-1 protein-sequence monitoringJavier Villalba-Díez, Ana González-Marcos · 2026 · Scientific Reports
- Accurate prediction of enzymatic degradation of plastics by language modelsShijie Xu, Ke Xu, Akira Onoda · 2026 · Chemistry Letters
- Pragmatic analysis with knowledge-guided for unraveling peptide-protein pairwise non-covalent mechanismsShutao Chen, Ke Yan, Jiangyi Shao, Xiangxiang Zeng, Bin Liu · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- What Do Biological Foundation Models Compute? Sparse Autoencoders from Feature Recovery to Mechanistic InterpretabilityAlexey V. Orlov, Yulia V. Makus, German A. Ashniev, Natalia N. Orlova, Petr Ivanovich Nikitin · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- PCTPS: Accurate prediction of phase-separated proteins using protein language model embeddings and a CTN-KAN frameworkTaigang Liu, Yuxin Xia, Xuqi Sun, Shuxin Song, Xiang Hu, Lingrong Zhang · 2026 · Journal of Molecular Graphics and Modelling
- LID-Drug: A Localized Interactive Domain-Aggregated (LID) Framework for Protein Drug EditingMingshuo Liu, Yunduan Lou, Shiyi Luo, Yifeng Yu, Shangping Ren, Yu Dong Bai · 2026 · Lecture notes in computer science
- Kernel Matrix Completion with Topological and Spectral Features for Multi-Modal ClassificationEla Mae Riñon, Maria Vivien Visaya, Rachelle Sambayan · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- TxConformal: Controlling False Discoveries in AI-Driven Therapeutic DiscoveryYing Jin, Kexin Huang, Nathaniel Diamant, Kerry R. Buchholz, Steven T. Rutherford, Nicholas J. Skelton, Tommaso Biancalani, Gabriele Scalia, Jure Leskovec, Emmanuel J. Candès · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- Structure tokens sharpen the feature vocabulary of protein language modelsJacob Lucas Steenwyk · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- ABUS: A Framework for Evaluating Protein Language Models with Multimodal CapabilitiesFatemeh Ensafitakaldani, Nurit Haspel, Daniel Haehn · 2026 · Communications in computer and information science
- Just Add Structure: Protein Language Models Combined with Structural Equivariance Excel at Protein TasksQurat-ul-ain, Carlos Outeiral, Matteo Cagiada, Yee Whye Teh, Charlotte Mary Deane · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- Mechanistic Interpretability for Protein Language Models: A Validation FrameworkPaul Chon, William Andreopoulos · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
- ProtDML: label-aware representation learning for broad-spectrum protein function predictionYejin Kan, Gangman Yi · 2026 · Briefings in Bioinformatics