Evaluating Protein Transfer Learning with TAPE
Rao, Roshan, Bhattacharya, Nicholas, Thomas, Neil, Duan, Yan, Chen, Xi, Canny, John, Abbeel, Pieter, Song, Yun S.·2019·bioRxiv (Cold Spring Harbor Laboratory)
DOI 10.1101/676825
Cited by (723)
Items 301–400 of 723
- Deciphering the protein landscape with ProtFlash, a lightweight language modelLei Wang, Hui Zhang, Wei Min Xu, Zhidong Xue, Yan Wang · 2023 · Cell Reports Physical Science
- Learning the shape of protein microenvironments with a holographic convolutional neural networkMichael Neal Pun, Andrew Ivanov, Quinn Bellamy, Zachary Montague, Colin LaMont, Philip H Bradley, Jakub Otwinowski, Armita Nourmohammad · 2024 · Proceedings of the National Academy of Sciences
- Language modelling for biological sequences – curated datasets and baselinesJosé Juan Almagro Armenteros, Alexander Rosenberg Johansen, Ole Winther, Henrik Nielsen · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
- Protein Structural Alignments From SequenceJames T. Morton, Charlie E. M. Strauss, Robert Blackwell, Daniel Berenberg, Vladimir Gligorijević, Richard Bonneau · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
- A Deep SE(3)-Equivariant Model for Learning Inverse Protein FoldingMatt McPartlon, Ben Lai, Jinbo Xu · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- TM-Vec: template modeling vectors for fast homology detection and alignmentTymor Hamamsy, James T. Morton, Daniel Berenberg, Nicholas John Carriero, Vladimir Gligorijević, Robert Blackwell, Charlie E. M. Strauss, Julia Koehler Leman, Kyunghyun Cho, Richard Bonneau · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Protein sequence profile prediction using ProtAlbert transformerArmin Behjati, Fatemeh Zare‐Mirakabad, Seyed Shahriar Arab, Abbas Nowzari-Dalini · 2022 · Computational Biology and Chemistry
- Protein Fitness Prediction Is Impacted by the Interplay of Language Models, Ensemble Learning, and Sampling MethodsMehrsa Mardikoraem, Daniel Woldring · 2023 · Pharmaceutics
- RPPSP: A Robust and Precise Protein Solubility Predictor by Utilizing Novel Protein Sequence EncoderFaiza Mehmood, Shazia Arshad, Muhammad Shoaib · 2023 · IEEE Access
- Group Activity Recognition in Basketball Tracking Data – Neural Embeddings in Team Sports (NETS)Sandro Hauri, Slobodan Vučetić · 2023 · Frontiers in artificial intelligence and applications
- Protein engineering in the deep learning eraBingxin Zhou, Yang Tan, Yutong Hu, Lirong Zheng, Bozitao Zhong, Liang Hong · 2024 · mLife
- A novel framework integrating AI model and enzymological experiments promotes identification of SARS-CoV-2 3CL protease inhibitors and activity-based probeFan Hu, Lei Wang, Yishen Hu, Dongqi Wang, Weijie Wang, Jianbing Jiang, Nan Li, Peng Yin · 2021 · Briefings in Bioinformatics
- Fast and accurate modeling and design of antibody-antigen complex using tFoldFandi Wu, Yu Shan Zhao, Jiaxiang Wu, Biaobin Jiang, Bing He, Long-Kai Huang, Chenchen Qin, Fan Yang, Ningqiao Huang, Yang Xiao et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- PLMFit: benchmarking transfer learning with protein language models for protein engineeringThomas Bikias, Evangelos Stamkopoulos, Sai T. Reddy · 2025 · Briefings in Bioinformatics
- PreMode predicts mode-of-action of missense variants by deep graph representation learning of protein sequence and structural contextZhong, Guojie, Zhao, Yige, Zhuang, Demi, Chung, Wendy K., Shen, Yufeng · 2025 · Nature Communications
- Evotuning protocols for Transformer-based variant effect prediction on multi-domain proteinsHideki Yamaguchi, Yutaka Saitō · 2021 · Briefings in Bioinformatics
- Protein–protein interaction and site prediction using transfer learningTuoyu Liu, Han Gao, Xiaopu Ren, Guoshun Xu, Bo Liu, Ningfeng Wu, Huiying Luo, Yuan Wang, Tao Tu, Bin Yao et al. · 2023 · Briefings in Bioinformatics
- Machine learning for predicting protein properties: A comprehensive reviewYizhen Wang, Yanyun Zhang, Xuhui Zhan, Yuhao He, Yongfu Yang, Li Cheng, Daniyal Alghazzawi · 2024 · Neurocomputing
- Protein language models for predicting drug–target interactions: Novel approaches, emerging methods, and future directionsAtabey Ünlü, Erva Ulusoy, Melih Gökay Yiğit, Melih Darcan, Tunca Doğan · 2025 · Current Opinion in Structural Biology
- Convolutional neural networks with image representation of amino acid sequences for protein function predictionSamia Tasnim Sara, Md Mehedi Hasan, Ahsan Ahmad, Swakkhar Shatabda · 2021 · Computational Biology and Chemistry
- PSSM-Distil: Protein Secondary Structure Prediction (PSSP) on Low-Quality PSSM by Knowledge Distillation with Contrastive LearningQin Wang, Boyuan Wang, Zhenlei Xu, Jiaxiang Wu, Peilin Zhao, Zhen Li, Sheng Wang, Junzhou Huang, Shuguang Robert Cui · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
- Generating novel protein sequences using Gibbs sampling of masked language modelsSean R. Johnson, Sarah Monaco, Kenneth Massie, Zaid Syed · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
- Improving Generalizability of Protein Sequence Models with Data AugmentationsHongyu Shen, Layne C. Price, Mohammad Taha Bahadori, Franziska Seeger · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
- Learning the Language of Antibody HypervariabilityRohit Singh, Chiho Im, Yu Qiu, Brian C. Mackness, Abhinav Gupta, Taylor Sorenson, Samuel Sledzieski, Lena Erlach, Maria Wendt, Yves Fomekong‐Nanfack et al. · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- Multi-dimensional metagenomicsHaoran Peng, Angel Jonathan Ruiz-Moreno, Jingyuan Fu · 2025 · Nature Reviews Bioengineering
- Fine-tuning protein language models unlocks the potential of underrepresented viral proteomesSawhney, Rajan, Ferrell, Barbra D., Dejean, Thibaut, Schreiber, Zachary, Harrigan, William, Polson, Shawn W., Wommack, K. Eric, Belcaid, Mahdi · 2025 · PeerJ
- Evolutionary Context-Integrated Deep Sequence Modeling for Protein EngineeringYunan Luo, Lam Tung Vo, Hantian Ding, Yufeng Su, Yang Liu, Wesley Wei Qian, Huimin Zhao, Jian Peng · 2020 · Lecture notes in computer science
- DeepNeoAG: Neoantigen epitope prediction from melanoma antigens using a synergistic deep learning model combining protein language models and multi-window scanning convolutional neural networksCheng-Che Chuang, Yuchen Liu, Yu‐Yen Ou · 2024 · International Journal of Biological Macromolecules
- Beyond digital twins: the role of foundation models in enhancing the interpretability of multiomics modalities in precision medicineSakhaa Alsaedi, Xin Gao, Takashi Gojobori · 2025 · FEBS Open Bio
- Knowledge-augmented Graph Machine Learning for Drug Discovery: A SurveyZhiqiang Zhong, Anastasia Barkova, Davide Mottin · 2025 · ACM Computing Surveys
- Large language models transform biological research: from architecture to utilizationWang, Tao, Luo, Zeyu · 2025 · Science China Information Sciences
- TripletProt: Deep Representation Learning of Proteins Based On Siamese NetworksEsmaeil Nouranı, Ehsaneddin Asgari, Alice Carolyn McHardy, Mohammad R. K. Mofrad · 2021 · IEEE Transactions on Computational Biology and Bioinformatics
- Generalized Property-Based Encoders and Digital Signal Processing Facilitate Predictive Tasks in Protein EngineeringDavid Medina-Ortiz, Sebastián Contreras, Juan Amado-Hinojosa, Jorge Torres-Almonacid, Juan A. Asenjo, Marcelo A. Navarrete, Álvaro Olivera‐Nappa · 2022 · Frontiers in Molecular Biosciences
- ChatNT: A Multimodal Conversational Agent for DNA, RNA and Protein TasksGuillaume Richard, Bernardo P. de Almeida, Hugo Dalla-Torre, Christopher Frederik Blum, Lorenz Hexemer, Priyanka Pandey, Stefan Laurent, M. Lopez, Alexandre Laterre, Maren Lang et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- ProteinGLUE multi-task benchmark suite for self-supervised protein modelingCapel, Henriette, Weiler, Robin, Dijkstra, Maurits, Vleugels, Reinier, Bloem, Peter, Feenstra, K. Anton · 2022 · Scientific Reports
- Enzyme catalytic efficiency prediction: employing convolutional neural networks and XGBoostMeshari Alazmi · 2024 · Frontiers in Artificial Intelligence
- iMFP-LG: Identify Novel Multi-functional Peptides Using Protein Language Models and Graph-based Deep LearningJiawei Luo, K. Zhao, Jun-Jie Chen, Caihua Yang, Fuchuan Qu, Yumeng Liu, Xiaopeng Jin, Ke Yan, Yang Zhang, Bin Liu · 2024 · Genomics, Proteomics & Bioinformatics
- Protein transfer learning improves identification of heat shock protein familiesSeonwoo Min, HyunGi Kim, Byunghan Lee, Sungroh Yoon · 2021 · PLoS ONE
- Deep representation learning improves prediction of LacI-mediated transcriptional repressionAlexander S. Garruss, Katherine M. Collins, George McDonald Church · 2021 · Proceedings of the National Academy of Sciences
- Development, validation, and evaluation of a deep learning model to screen cyclin-dependent kinase 12 inhibitors in cancersTingyu Wen, Jun Wang, Ruiqiang Lu, Shuoyan Tan, Pengyong Li, Xiaojun Yao, Huanxiang Liu, Zongbi Yi, Lixi Li, Shuning Liu et al. · 2023 · European Journal of Medicinal Chemistry
- Risk Assessment of the Possible Intermediate Host Role of Pigs for Coronaviruses with a Deep Learning PredictorShuyang Jiang, Sen Zhang, Xiaoping Kang, Ye Feng, Yadan Li, Maoshun Nie, Yuchang Li, Yuehong Chen, Shishun Zhao, Tao Jiang et al. · 2023 · Viruses
- DeepDRP: Prediction of intrinsically disordered regions based on integrated view deep learning architecture from transformer-enhanced and protein informationZexi Yang, Yan Wang, Xinye Ni, Sen Yang · 2023 · International Journal of Biological Macromolecules
- DeepPLM_mCNN: An approach for enhancing ion channel and ion transporter recognition by multi-window CNN based on features from pre-trained language modelsVan‐The Le, Muhammad Shahid Malik, Yi-Hsuan Tseng, Yu‐Cheng Lee, Cheng-I Huang, Yu‐Yen Ou · 2024 · Computational Biology and Chemistry
- Exploring the sequence-function space of microbial fucosidasesAna Martínez Gascueña, Haiyang Wu, Rui Wang, Callum D. Owen, Pedro J. Hernando, Serena Monaco, Matthew Penner, Ke Xing, Gwénaëlle Le Gall, Richard A. Gardner et al. · 2024 · Communications Chemistry
- Amino acid sequence encodes protein abundance shaped by protein stability at reduced synthesis cost2024
- EnDM-CPP: A Multi-view Explainable Framework Based on Deep Learning and Machine Learning for Identifying Cell-Penetrating Peptides with Transformers and Analyzing Sequence InformationLun Zhu, Zehua Chen, Sen Yang · 2024 · Interdisciplinary Sciences Computational Life Sciences
- TAPE_selection: Organelle Proteins Classification With TAPE Feature SelectionWenzheng Bao, Bin Yang, Baitong Chen · 2025 · IEEE Transactions on Computational Biology and Bioinformatics
- MULAN: multimodal protein language model for sequence and structure encodingFrolova, Daria, Pak, Marina, Litvin, Anna, Sharov, Ilya, Ivankov, Dmitry, Oseledets, Ivan · 2024 · Bioinformatics Advances
- SPRoBERTa: protein embedding learning with local fragment modelingLijun Wu, Chengcan Yin, Jinhua Zhu, Zhen Wu, Liang He, Yingce Xia, Shufang Xie, Tao Qin, Tie‐Yan Liu · 2022 · Briefings in Bioinformatics
- Nucleotide augmentation for machine learning-guided protein engineeringMason Minot, Sai T. Reddy · 2022 · Bioinformatics Advances
- Codon language embeddings provide strong signals for protein engineeringCarlos Outeiral, Charlotte Mary Deane · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- ESM All-Atom: Multi-scale Protein Language Model for Unified Molecular ModelingKang-Jie Zheng, Siyu Long, Tian-Yu Lu, Jun-Wei Yang, Xinyu Dai, Ming Zhang, Zai-Qing Nie, Wei-Ying Ma, Hao Zhou · 2024 · bioRxiv
- Boosting the Predictive Power of Protein Representations with a Corpus of Text AnnotationsHaonan Duan, Marta Skreta, Leonardo Cotta, Ella M. Rajaonson, Nikita Dhawan, Alán Aspuru-Guzik, Chris J. Maddison · 2024 · bioRxiv
- Graph neural network integrated with pretrained protein language model for predicting human–virus protein–protein interactionsLinyang Jiang, Xiaodi Yang, Xiaokun Guo, Dianke Li, Jiajun Li, Stefan Wuchty, Wenyu Shi, Ziding Zhang · 2025 · Briefings in Bioinformatics
- Collectively encoding protein properties enriches protein language modelsJingmin An, Xiaogang Weng · 2022 · BMC Bioinformatics
- Disto-TRP: An approach for identifying transient receptor potential (TRP) channels using structural information generated by AlphaFoldSyed Muazzam Ali Shah, Yu‐Yen Ou · 2023 · Gene
- PreDBP-PLMs: Prediction of DNA-binding proteins based on pre-trained protein language models and convolutional neural networksDawei Qi, Song Chen, Taigang Liu · 2024 · Analytical Biochemistry
- Deep learning methods for protein representation and function prediction: A comprehensive overviewMingqing Wang, Zhiwei Nie, Yonghong He, Athanasios V. Vasilakos, Qiang Shawn Cheng, Zhixiang Ren · 2025 · Engineering Applications of Artificial Intelligence
- Predictive and therapeutic applications of protein language modelsKairi Furui, Koh Sakano, Masahito Ohue · 2025 · Allergology International
- Computational protein design with data‐driven approaches: Recent developments and perspectivesHaiyan Liu, Quan Chen · 2022 · Wiley Interdisciplinary Reviews Computational Molecular Science
- Improving molecular representation learning with metric learning-enhanced optimal transportFang Wu, Nicolas Courty, Shuting Jin, Stan Ziqing Li · 2023 · Patterns
- Does protein pretrained language model facilitate the prediction of protein–ligand interaction?Weihong Zhang, Fan Hu, Li Wang, Peng Yin · 2023 · Methods
- Protein language models meet reduced amino acid alphabetsIoan Ieremie, Rob M. Ewing, Mahesan Niranjan · 2024 · Bioinformatics
- Multi-task learning to leverage partially annotated data for PPI interface predictionHenriette Capel, K. Anton Feenstra, Sanne Abeln · 2022 · Scientific Reports
- The applications of machine learning in HIV neutralizing antibodies research—A systematic reviewVlad-Rareş Dănăilă, Speranța Avram, Cătălin Buiu · 2022 · Artificial Intelligence in Medicine
- UDSMProt: Universal Deep Sequence Models for Protein ClassificationNils Strodthoff, Patrick Wagner, Markus Wenzel, Wojciech Samek · 2019 · bioRxiv (Cold Spring Harbor Laboratory)
- DataSAIL: Data Splitting Against Information LeakageRoman Joeres, David B. Blumenthal, Olga V. Kalinina · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- Protein Sequence Analysis landscape: A Systematic Review of Task Types, Databases, Datasets, Word Embeddings Methods, and Language ModelsMuhammad Nabeel Asim, Tayyaba Asif, Faiza Hassan, Andreas Dengel · 2025 · Database
- In silico prediction of variant effects: promises and limitations for precision plant breedingJanek Sendrowski, Thomas M Bataillon, Guillaume P. Ramstein · 2025 · Theoretical and Applied Genetics
- Transfer learning on protein language models improves antimicrobial peptide classificationElias Georgoulis, Michaela Areti Zervou, Yannis Pantazis · 2025 · Scientific Reports
- PROVAL: A framework for comparison of protein sequence embeddingsPhilipp Väth, Maximilian Münch, Christoph Raab, Frank-Michael Schleif · 2022 · Journal of Computational Mathematics and Data Science
- Identification of plant vacuole proteins by exploiting deep representation learning featuresShihu Jiao, Quan Zou · 2022 · Computational and Structural Biotechnology Journal
- learnMSA: learning and aligning large protein familiesFelix Becker, Mario Stanke · 2022 · GigaScience
- Simultaneous Prediction of Interaction Sites on the Protein and Peptide Sides of Complexes through Multilayer Graph Convolutional NetworksKailong Li, Lijun Quan, Yelu Jiang, Hongjie Wu, Jian Wu, Yan Li, Yiting Zhou, Tingfang Wu, Qiang Lyu · 2023 · Journal of Chemical Information and Modeling
- Investigating Pre-trained Language Models on Cross-Domain Datasets, a Step Closer to General AIMohamad Ballout, Ulf Krumnack, Gunther Heidemann, Kai‐Uwe Kühnberger · 2023 · Procedia Computer Science
- Transfer learning improves pMHC kinetic stability and immunogenicity predictionsRomanos Fasoulis, Maurício Rigo, Dinler A. Antunes, Γεώργιος Παλιούρας, Lydia E. Kavraki · 2023 · ImmunoInformatics
- Exploiting protein language models for the precise classification of ion channels and ion transportersHamed Ghazikhani, Gregory Butler · 2024 · Proteins Structure Function and Bioinformatics
- Improving Protein Function Annotation via Unsupervised Pre-training: Robustness, Efficiency, and InsightsDavid Dohan, Andreea Gane, Maxwell L. Bileschi, David Belanger, Lucy J. Colwell · 2021 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
- Linear-Scaling Kernels for Protein Sequences and Small Molecules Outperform Deep Learning While Providing Uncertainty Quantitation and Improved InterpretabilityJonathan Parkinson, Wei Wang · 2023 · Journal of Chemical Information and Modeling
- A hybrid model combining evolutionary probability and machine learning leverages data-driven protein engineeringAlexander-Maurice Illig, Niklas E. Siedhoff, Ulrich Schwaneberg, Mehdi D. Davari · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Distilling Structural Representations into Protein Sequence ModelsJeffrey Ouyang-Zhang, Chengyue Gong, Yue Zhao, Philipp Krähenbühl, Adam R. Klivans, Daniel J. Diaz · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Review of predicting protein stability changes upon variationsYiling Qiu, Tao Huang, Yu‐Dong Cai · 2024 · PROTEOMICS
- Predicting purification process fit of monoclonal antibodies using machine learningAndrew J. Maier, Minjeong Cha, Sean Burgess, Amy Wang, Carlos Cuellar, Soo Young Kim, Neeraja Sundar Rajan, Josephine Neyyan, R. SENGUPTA, Kelly O’Connor et al. · 2025 · mAbs
- Protein sequence classification using natural language processing techniquesHuma Perveen, Julie Weeds · 2025 · Discover Artificial Intelligence
- DrugTar improves druggability prediction by integrating large language models and gene ontologiesNiloofar Borhani, Iman Izadi, Ali Motahharynia, Mahsa Sheikholeslami, Yousof Gheisari · 2025 · Bioinformatics
- Deep Learning for Drug–Target Interaction Prediction: A Comprehensive ReviewYingjun Chen, Ding Luo, Weiwei Xue · 2025 · Chemical Biology & Drug Design
- RP3Net: a deep learning model for predicting recombinant protein production in Escherichia coliEvgeny Tankhilevich, Sergio Martínez Cuesta, Ian P. Barrett, Carolina Berg, Lovisa Holmberg Schiavone, Andrew R. Leach · 2026 · Bioinformatics
- Connecting the Dots in Self-Supervised Learning: A Brief Survey for BeginnersPengfei Fang, Xian Li, Yan Yang, Shuai Zhang, Qi-Yue Kang, Xiaofei Li, Zhenzhong Lan · 2022 · Journal of Computer Science and Technology
- Molecule generation toward target protein (SARS-CoV-2) using reinforcement learning-based graph neural network via knowledge graphAmit Ranjan, Hritik Kumar, Deepshikha Kumari, Archit Anand, Rajiv Misra · 2023 · Network Modeling Analysis in Health Informatics and Bioinformatics
- Transfer learning improves antibiotic resistance class predictionMd-Nafiz Hamid, Iddo Friedberg · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
- The geometry of hidden representations of protein language modelsValeriani Lucrezia, Francesca Cuturello, Alessio Ansuini, Alberto Cazzaniga · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Turnover number predictions for kinetically uncharacterized enzymes using machine and deep learningAlexander Kroll, Xiao-Pan Hu, Nina A. Liebrand, Martin J. Lercher · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Uni-Fold MuSSe: De Novo Protein Complex Prediction with Protein Language ModelsJinhua Zhu, Zhen‐Yu He, Ziyao Li, Guolin Ke, Linfeng Zhang · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- TCR2vec: a deep representation learning framework of T-cell receptor sequence and functionYuepeng Jiang, Miaozhe Huo, Pingping Zhang, Yiping Zou, Shuai Cheng Li · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- SEQUENCE VS. STRUCTURE: DELVING DEEP INTO DATA-DRIVEN PROTEIN FUNCTION PREDICTIONXiaochen Tian, Ziyin Wang, Kevin Yang, Jin Su, Hanwen Du, Qiuguo Zheng, Guibing Guo, Min Yang, Fei Yang, Fajie Yuan · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- Prot2Token: A multi-task framework for protein language processing using autoregressive language modelingMahdi Pourmirzaei, Farzaneh Esmaili, Mohammadreza Pourmirzaei, Duo-Lin Wang, Dong Xu · 2024 · bioRxiv
- LC-PLM: Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection LayersYingheng Wang, Zichen Wang, Gil Sadeh, Luca Zancato, Alessandro Achille, George Karypis, Huzefa Rangwala · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Using deep learning and large protein language models to predict protein–membrane interfaces of peripheral membrane proteinsDimitra Paranou, Alexios Chatzigoulas, Zoe Cournia · 2024 · Bioinformatics Advances
- Advancements in one-dimensional protein structure prediction using machine learning and deep learningWafa T Alanazi, Di Meng, Gianluca Pollastri · 2025 · Computational and Structural Biotechnology Journal
- Kernelized Hypergraph Neural NetworksYifan Feng, Yifan Zhang, Shihui Ying, Shaoyi Du, Yue Gao · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence