Modeling the language of life – Deep Learning Protein Sequences
Heinzinger, Michael, Elnaggar, Ahmed, Wang, Yu, Dallago, Christian, Nechaev, Dmitrii, Matthes, Florian, Rost, Burkhard·2019·BMC Bioinformatics
DOI 10.1101/614313
Cited by (599)
Items 101–200 of 599
- Pre-Training of Deep Bidirectional Protein Sequence Representations With Structural InformationSeonwoo Min, Seunghyun Park, Siwon Kim, Hyun-Soo Choi, Byunghan Lee, Sungroh Yoon · 2021 · IEEE Access
- nhKcr: a new bioinformatics tool for predicting crotonylation sites on human nonhistone proteins based on deep learningYongzi Chen, Zhuozhi Wang, Yanan Wang, Guoguang Ying, Zhen Chen, Jiangning Song · 2021 · Briefings in Bioinformatics
- Deep learning methods for protein function predictionBoadu, Frimpong, Lee, Ahhyun, Cheng, Jianlin · 2025 · PROTEOMICS
- The generative capacity of probabilistic protein sequence modelsFrancisco A. McGee, Sandro Hauri, Quentin Novinger, Slobodan Vučetić, Ronald M. Levy, Vincenzo Carnevale, Allan Haldane · 2021 · Nature Communications
- Deep learning for protein secondary structure prediction: Pre and post-AlphaFoldDewi Pramudi Ismi, Reza Pulungan, Afiahayati · 2022 · Computational and Structural Biotechnology Journal
- Revolutionizing protein–protein interaction prediction with deep learningJing Zhang, Jesse Durham, Qian Cong · 2024 · Current Opinion in Structural Biology
- Protein subcellular localization prediction toolsMaryam Gillani, Gianluca Pollastri · 2024 · Computational and Structural Biotechnology Journal
- PANDA2: protein function prediction using graph neural networksChenguang Zhao, Tong Liu, Zheng Wang · 2022 · NAR Genomics and Bioinformatics
- Discovering molecular features of intrinsically disordered regions by using evolution for contrastive learningAlex Xijie Lu, Amy X. Lu, Iva Pritišanac, Taraneh Zarin, Julie Deborah Forman-Kay, Alan M Moses · 2022 · PLoS Computational Biology
- SETH predicts nuances of residue disorder from protein embeddingsDagmar Ilzhöfer, Michael Heinzinger, Burkhard Rost · 2022 · Frontiers in Bioinformatics
- Are protein language models the new universal key?Konstantin Weißenow, Burkhard Rost · 2025 · Current Opinion in Structural Biology
- pNPs-CapsNet: Predicting Neuropeptides Using Protein Language Models and FastText Encoding-Based Weighted Multi-View Feature Integration with Deep Capsule Neural NetworkShahid Akbar, Ali Raza, Hamid Hussain Awan, Quan Zou, Wajdi Alghamdi, Aamir Saeed · 2025 · ACS Omega
- SonicParanoid2: fast, accurate, and comprehensive orthology inference with machine learning and language models2024
- Deep learning for protein complex structure predictionPatrick Bryant · 2023 · Current Opinion in Structural Biology
- ULDNA: integrating unsupervised multi-source language models with LSTM-attention network for high-accuracy protein–DNA binding site predictionYi-Heng Zhu, Zi Liu, Yan Liu, Zhi-Wei Ji, Dong-Jun Yu · 2024 · Briefings Bioinform.
- Artificial intelligence and neoantigens: paving the path for precision cancer immunotherapyAlla Bulashevska, Zsófia Nacsa, Franziska Lang, Markus Braun, Martin Machyna, Mustafa Diken, Liam Harold Childs, Renate König · 2024 · Frontiers in Immunology
- SPOT-Contact-LM: improving single-sequence-based prediction of protein contact map using a transformer language modelJaspreet Singh, Thomas Litfin, Jaswinder Singh, Kuldip K. Paliwal, Yaoqi Zhou · 2022 · Bioinformatics
- Factorbook: an updated catalog of transcription factor motifs and candidate regulatory motif sitesHenry Pratt, Gregory Andrews, Nishigandha N. Phalke, Jack D. Huey, Michael J. Purcaro, Arjan van der Velde, Jill E. Moore, Zhiping Weng · 2021 · Nucleic Acids Research
- SPOT-1D-Single: improving the single-sequence-based prediction of protein secondary structure, backbone angles, solvent accessibility and half-sphere exposures using a large training set and ensembled deep learningJaspreet Singh, Thomas Litfin, Kuldip K. Paliwal, Jaswinder Singh, Anil Kumar Hanumanthappa, Yaoqi Zhou · 2021 · Bioinformatics
- An analysis of protein language model embeddings for fold predictionVillegas-Morcillo, Amelia, Gomez, Angel M, Sanchez, Victoria · 2022 · Briefings in Bioinformatics
- E-SNPs&GO: embedding of protein sequence and function improves the annotation of human pathogenic variantsMatteo Manfredi, Castrense Savojardo, Pier Luigi Martelli, Rita Casadio · 2022 · Bioinformatics
- How to approach machine learning-based prediction of drug/compound–target interactionsHeval Ataş, Tunca Doğan · 2023 · Journal of Cheminformatics
- DeepPTM: Protein Post-translational Modification Prediction from Protein Sequences by Combining Deep Protein Language Model with Vision TransformersNecla Nisa Soylu, Emre Sefer · 2024 · Current Bioinformatics
- Practical Applications of Language Models in Protein Sorting Prediction: SignalP 6.0, DeepLoc 2.1, and DeepLocPro 1.0Henrik Nielsen · 2025 · Methods in molecular biology
- Association Analysis: Basic Concepts and AlgorithmsQingfeng Chen · 2024 · Springer eBooks
- Transfer learning in proteins: evaluating novel protein learned representations for bioinformatics tasksEmilio Fenoy, Alejando A Edera, Georgina S. Stegmayer · 2022 · Briefings in Bioinformatics
- BERT2OME: Prediction of 2′-O-Methylation Modifications From RNA Sequence by Transformer Architecture Based on BERTNecla Nisa Soylu, Emre Sefer · 2023 · IEEE Transactions on Computational Biology and Bioinformatics
- Protein Design with Deep LearningMarianne Defresne, Sophie Barbe, Thomas Schiex · 2021 · International Journal of Molecular Sciences
- Fast, sensitive detection of protein homologs using deep dense retrievalLiang Hong, Zhigang Hu, Siqi Sun, Xiangru Tang, Jiuming Wang, Qingxiong Tan, Liangzhen Zheng, Sheng Wang, Sheng Yong Xu, Irwin King et al. · 2024 · Nature Biotechnology
- Computational methods for protein localization predictionYuexu Jiang, Duolin Wang, Weiwei Wang, Dong He Xu · 2021 · Computational and Structural Biotechnology Journal
- Synthetic molecular evolution of antimicrobial peptidesCharles H. Chen, Tristan Bepler, Karen Pepper, Debbie Fu, Timothy K. Lu · 2022 · Current Opinion in Biotechnology
- Context-aware sentiment analysis with attention-enhanced features from bidirectional transformersSurindernath Sivakumar, R. Rajalakshmi · 2022 · Social Network Analysis and Mining
- Medium-sized protein language models perform well at transfer learning on realistic datasetsVieira, Luiz C., Handojo, Morgan L., Wilke, Claus O. · 2025 · Scientific Reports
- Learning deep representations of enzyme thermal adaptationGang Li, Filip Buric, Jan Zrimec, Sandra Viknander, Jens Nielsen, Aleksej Zelezniak, Martin K. M. Engqvist · 2022 · Protein Science
- Protein–DNA/RNA interactions: Machine intelligence tools and approaches in the era of artificial intelligence and big dataFeifei Cui, Zilong Zhang, Chen Cao, Quan Zou, Dong Chen, Xi Su · 2022 · PROTEOMICS
- Bridging artificial intelligence and biological sciences: a comprehensive review of large language models in bioinformaticsAn-Qi Lin, Junpu Ye, Chang Qi, Lingxuan Zhu, Wei-Ming Mou, Wen-Yi Gan, Dong-Qiang Zeng, Bu-Fu Tang, Ming-Jia Xiao, G. Chu et al. · 2025 · Briefings Bioinform.
- Nearest neighbor search on embeddings rapidly identifies distant protein relationsKonstantin Schütze, Michael Heinzinger, Martin Steinegger, Burkhard Rost · 2022 · Frontiers in Bioinformatics
- DeepHomo2.0: improved protein–protein contact prediction of homodimers by transformer-enhanced deep learningPeicong Lin, Yumeng Yan, Sheng‐You Huang · 2022 · Briefings in Bioinformatics
- Therapeutic enzyme engineering using a generative neural networkAndrew J. Giessel, Athanasios D. Dousis, Kanchana R. Ravichandran, Kevin Smith, Sreyoshi Sur, Iain J. McFadyen, Wei Zheng, Stuart Licht · 2022 · Scientific Reports
- Domain loss enabled evolution of novel functions in the snake three-finger toxin gene superfamilyIvan Koludarov, Tobias Senoner, Timothy Jackson, Daniel Dashevsky, Michael Heinzinger, Steven Douglas Aird, Burkhard Rost · 2023 · Nature Communications
- Accelerating the discovery of antifungal peptides using deep temporal convolutional networksVishakha Singh, Sameer Shrivastava, Sanjay Kumar Singh, Abhinav Kumar, Sonal Saxena · 2022 · Briefings in Bioinformatics
- Deep Learning for Antimicrobial Peptides: Computational Models and DatabasesXiangrun Zhou, Guixia Liu, Shuyuan Cao, Ji Lv · 2025 · Journal of Chemical Information and Modeling
- Omics Data and Data Representations for Deep Learning-Based Predictive ModelingStefanos Tsimenidis, Εleni Vrochidou, George A. Papakostas · 2022 · International Journal of Molecular Sciences
- Pretraining model for biological sequence dataBosheng Song, Zimeng Li, Xuan Lin, Jianmin Wang, Tian Wang, Xiangzheng Fu · 2021 · Briefings in Functional Genomics
- Accurate prediction of virus-host protein-protein interactions via a Siamese neural network using deep protein sequence embeddingsSumit Madan, Victoria Demina, Marcus Stapf, Oliver Ernst, Holger Fröhlich · 2022 · Patterns
- Automatic Gene Function Prediction in the 2020’sStavros Makrodimitris, Roeland C. H. J. van Ham, Marcel J. T. Reinders · 2020 · Genes
- PyPEF—An Integrated Framework for Data-Driven Protein EngineeringNiklas E. Siedhoff, Alexander-Maurice Illig, Ulrich Schwaneberg, Mehdi D. Davari · 2021 · Journal of Chemical Information and Modeling
- MM-StackEns: A new deep multimodal stacked generalization approach for protein–protein interaction predictionAlexandra-Ioana Albu, Maria-Iuliana Bocicor, Gabriela Czibula · 2023 · Computers in Biology and Medicine
- Variant effect predictions capture some aspects of deep mutational scanning experimentsJonas Reeb, Theresa Wirth, Burkhard Rost · 2020 · BMC Bioinformatics
- Accurate and efficient protein sequence design through learning concise local environment of residuesHuang, Bin, Fan, Tingwen, Wang, Kaiyue, Zhang, Haicang, Yu, Chungong, Nie, Shuyu, Qi, Yangshuo, Zheng, Wei-Mou, Han, Jian, Fan, Zheng et al. · 2023 · Bioinformatics
- Natural Language Processing Methods for the Study of Protein–Ligand InteractionsJames Michels, Ramya Bandarupalli, Amin Ahangar Akbari, Thai Le, Hong Yu Xiao, Jing Li, Erik F. Y. Hom · 2025 · Journal of Chemical Information and Modeling
- Deepro-Glu: combination of convolutional neural network and Bi-LSTM models using ProtBert and handcrafted features to identify lysine glutarylation sitesXiao Rui Wang, Zhaoyuan Ding, Rong Wang, Xi Lin · 2023 · Briefings in Bioinformatics
- TP-LMMSG: a peptide prediction graph neural network incorporating flexible amino acid property representationNanjun Chen, Jixiang Yu, Zhe Liu, Fuzhou Wang, Xiangtao Li, Ka‐Chun Wong · 2024 · Briefings in Bioinformatics
- From Code to Life: The AI‐Driven Revolution in Genome EditingZhidong Li, Wasi Ullah Khan, Genxiang Bai, Dong Chao, Jungang Wang, Youpeng Zhang, Chong Wang, Hongbin Zhang, Wenyi Wang, Ming Luo et al. · 2025 · Advanced Science
- Beyond sequence: Structure-based machine learningJanani Durairaj, Dick de Ridder, Aalt D. J. van Dijk · 2022 · Computational and Structural Biotechnology Journal
- HNetGO: protein function prediction via heterogeneous network transformerXiaoshuai Zhang, Huannan Guo, Fan Zhang, Xuan Wang, Kaitao Wu, Shizheng Qiu, Bo Liu, Yadong Wang, Yang Hu, Junyi Li · 2021 · Briefings in Bioinformatics
- Domain-PFP allows protein function prediction using function-aware domain embedding representationsNabil Ibtehaz, Yuki Kagaya, Daisuke Kihara · 2023 · Communications Biology
- FANTASIA leverages language models to decode the functional dark proteome across the animal tree of lifeGemma I. Martinez Redondo, Francisco M Pérez-Canales, Belén Carbonetto, José M. Fernández, Israel Barrios-Núñez, Marçal Vázquez-Valls, Ildefonso Cases, Ana Maria Rojas, Rosa Fernández · 2025 · Communications Biology
- In-Pero: Exploiting Deep Learning Embeddings of Protein Sequences to Predict the Localisation of Peroxisomal ProteinsMarco Anteghini, Vítor A. P. Martins dos Santos, Edoardo Saccenti · 2021 · International Journal of Molecular Sciences
- ac4C-AFL: A high-precision identification of human mRNA N4-acetylcytidine sites based on adaptive feature representation learningNhat Truong Pham, Annie Terrina Terrance, Young-Jun Jeon, Rajan Rakkiyappan, Balachandran Manavalan · 2024 · Molecular Therapy — Nucleic Acids
- Structure-informed protein language models are robust predictors for variant effects2024
- Finding functional motifs in protein sequences with deep learning and natural language modelsCastrense Savojardo, Pier Luigi Martelli, Rita Casadio · 2023 · Current Opinion in Structural Biology
- Approaching Optimal pH Enzyme Prediction with Large Language ModelsMark Zaretckii, Pavel Buslaev, Igor Kozlovskii, Alexander Morozov, Petr A. Popov · 2024 · ACS Synthetic Biology
- ProteinNPT: Improving Protein Property Prediction and Design with Non-Parametric TransformersPascal Notin, Ruben Weitzman, Debora S. Marks, Yarin Gal · 2023 · neural information processing systems
- OUP accepted manuscriptRyan Feehan, Daniel Montezano, Joanna S.G. Slusky · 2021 · Protein Engineering Design and Selection
- GOProFormer: A Multi-Modal Transformer Method for Gene Ontology Protein Function PredictionAnowarul Kabir, Amarda Shehu · 2022 · Biomolecules
- Survey of Protein Sequence Embedding ModelsChau Thi Thuy Tran, Siddharth Khadkikar, Aleksey Porollo · 2023 · International Journal of Molecular Sciences
- Protein embeddings improve phage-host interaction predictionMark Edward M. Gonzales, Jennifer C. Ureta, Anish Man Singh Shrestha · 2023 · PLoS ONE
- Structure-Based Approaches for Protein–Protein Interaction Prediction Using Machine Learning and Deep LearningDespoina P. Kiouri, Georgios Batsis, Christos T. Chasapis · 2025 · Biomolecules
- Learning a deep language model for microbiomes: The power of large scale unlabeled microbiome dataQuintin Pope, Rohan Varma, Christine A. Tataru, Maude M. David, Xiaoli Z. Fern · 2025 · PLoS Computational Biology
- Deep Learning Concepts and Applications for Synthetic BiologyWilliam Beardall, Guy-Bart V. Stan, Mary J. Dunlop · 2022 · GEN Biotechnology
- Modeling Protein Using Large-scale Pretrain Language ModelYijia Xiao, Jiezhong Qiu, Ziang Li, Chang‐Yu Hsieh, Jie Tang · 2021 · arXiv (Cornell University)
- Ultra-fast protein structure prediction to capture effects of sequence variation in mutation moviesKonstantin Weißenow, Michael Heinzinger, Martin Steinegger, Burkhard Rost · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Protein embeddings predict binding residues in disordered regions2024
- Clustering FunFams using sequence embeddings improves EC purityMaria Littmann, Nicola Bordin, Michael Heinzinger, Konstantin Schütze, Christian Dallago, Christine Anne Orengo, Burkhard Rost · 2021 · Bioinformatics
- HemoNet: Predicting hemolytic activity of peptides with integrated feature learningAdiba Yaseen, Sadaf Gull, Naeem Akhtar, Imran Ul Amin, Fayyaz Minhas · 2021 · Journal of Bioinformatics and Computational Biology
- Predicting synergistic anticancer drug combination based on low-rank global attention mechanism and bilinear predictorYanglan Gan, Xingyu Huang, Wenjing Guo, Cairong Yan, Guobing Zou · 2023 · Bioinformatics
- Seq-InSite: sequence supersedes structure for protein interaction site predictionHosseini, SeyedMohsen, Golding, G Brian, Ilie, Lucian · 2024 · Bioinformatics
- Accurate and Fast Prediction of Intrinsically Disordered Protein by Multiple Protein Language Models and Ensemble LearningShijie Xu, Akira Onoda · 2023 · Journal of Chemical Information and Modeling
- Protein Condensate Atlas from predictive models of heteromolecular condensate compositionKadi Liis Saar, Rob M. Scrutton, Kotryna Bloznelyte, Alexey S. Morgunov, Lydia L. Good, Alpha A. Lee, Sarah Amalia Teichmann, Tuomas P. J. Knowles · 2024 · Nature Communications
- Comprehensive benchmarking of large language models for RNA secondary structure predictionLuciano I Zablocki, Leandro A. Bugnon, Matias F. Gerard, Leandro Ezequiel Di Persia, Georgina S. Stegmayer, Diego Humberto Milone · 2025 · Briefings in Bioinformatics
- Prediction of Antifungal Activity of Antimicrobial Peptides by Transfer Learning from Protein Pretrained ModelsFernando Lobo, Maily Selena González, Alicia Boto, José Manuel Pérez de la Lastra · 2023 · International Journal of Molecular Sciences
- PROTSOLM: Protein Solubility Prediction with Multi-modal FeaturesYang Tan, Jia Zheng, Hong Liang, Bozitao Zhong · 2024 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- Artificial Intelligence-Based Model for Predicting the Minimum Inhibitory Concentration of Antibacterial Peptides Against ESKAPEE PathogensRitesh Sharma, Sameer Shrivastava, Sanjay Kumar Singh, Abhinav Kumar, Amit Kumar Singh, Sonal Saxena · 2023 · IEEE Journal of Biomedical and Health Informatics
- Using protein language models for protein interaction hot spot prediction with limited dataK. Sargsyan, C. Lim · 2024 · BMC Bioinformatics
- Large-scale genomic survey with deep learning-based method reveals strain-level phage specificity determinantsYi‐Yan Yang, Keith Dufault‐Thompson, Wei Yan, Tian Cai, Lei Xie, Xiaofang Jiang · 2024 · GigaScience
- Rank-ordering of known enzymes as starting points for re-engineering novel substrate activity using a convolutional neural networkVikas Upadhyay, Veda Sheersh Boorla, Costas D. Maranas · 2023 · Metabolic Engineering
- Deep learning in preclinical antibody drug discovery and developmentYuwei Zhou, Ziru Huang, Wenzhen Li, Jinyi Wei, Qianhu Jiang, Wei Yang, Jian Hua Huang · 2023 · Methods
- Best practices for machine learning in antibody discovery and developmentLeonard Wossnig, Norbert Furtmann, Andrew G. Buchanan, Sandeep Kumar, Victor Greiff · 2024 · Drug Discovery Today
- HybridGCN for protein solubility prediction with adaptive weighting of multiple featuresChen, Long, Wu, Rining, Zhou, Feixiang, Zhang, Huifeng, Liu, Jian K. · 2023 · Journal of Cheminformatics
- A unified evolution-driven deep learning framework for virus variation driver predictionZhiwei Nie, Xudong Liu, Jie Chen, Zhennan Wang, Yutian Liu, Hao-Rui Si, Tianyi Dong, Fan Xu, Guoli Song, Yu Wang et al. · 2025 · Nature Machine Intelligence
- Teaching AI to speak proteinMichael Heinzinger, Burkhard Rost · 2025 · Current Opinion in Structural Biology
- RBP-TSTL is a two-stage transfer learning framework for genome-scale prediction of RNA-binding proteinsXinxin Peng, Xiaoyu Wang, Yuming Guo, Zongyuan Ge, Fuyi Li, Xin Gao, Jiangning Song · 2022 · Briefings in Bioinformatics
- Benchmarking machine learning robustness in Covid-19 genome sequence classificationSarwan Ali, Bikram Sahoo, Alex Zelikovsky, Pin‐Yu Chen, Murray Patterson · 2023 · Scientific Reports
- A Review for Artificial Intelligence Based Protein Subcellular LocalizationHanyu Xiao, Yijin Zou, Jieqiong Wang, Shibiao Wan · 2024 · Biomolecules
- PHIStruct: improving phage–host interaction prediction at low sequence similarity settings using structure-aware protein embeddingsGonzales, Mark Edward M, Ureta, Jennifer C, Shrestha, Anish M S · 2024 · Bioinformatics
- Computational drug design in the artificial intelligence era: A systematic review of molecular representations, generative architectures, and performance assessmentKarim Abbasi, Parvin Razzaghi, Ali Gharizadeh, Amin Ghareyazi, Abbas Dehnad, Hamid Reza Rabiee, Mohammad R. K. Mofrad · 2025 · Pharmacological Reviews
- Machine learning methods for predicting protein structure from single sequencesShaun M. Kandathil, Andy M C Lau, David T. Jones · 2023 · Current Opinion in Structural Biology
- Hybrid protein–ligand binding residue prediction with protein language models: does the structure matter?Gamouh, Hamza, Novotný, Marian, Hoksza, David · 2025 · Bioinformatics
- Deep Local Analysis deconstructs protein–protein interfaces and accurately estimates binding affinity changes upon mutationMohseni Behbahani, Yasser, Laine, Elodie, Carbone, Alessandra · 2023 · Bioinformatics