Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences
Rives, Alexander, Meier, Joshua, Sercu, Tom, Goyal, Siddharth, Lin, Zeming, Liu, Jason, Guo, Demi, Ott, Myle +3 more·2019·Proceedings of the National Academy of Sciences
DOI 10.1101/622803
Cited by (1,005)
Items 301–400 of 1,005
- DPFunc: accurately predicting protein function via deep learning with domain-guided structure informationWen-Kang Wang, Yunyan Shuai, Min Zeng, Wei Fan, Min Li · 2025 · Nature Communications
- Deep embedding and alignment of protein sequencesLlinares-López, Felipe, Berthet, Quentin, Blondel, Mathieu, Teboul, Olivier, Vert, Jean-Philippe · 2023 · Nature Methods
- Artificial intelligence in cancer immunotherapy: Applications in neoantigen recognition, antibody design and immunotherapy response predictionTong Li, Yupeng Li, Xiaoyi Zhu, Yao He, Yanling Wu, Tianlei Ying, Zhi Xie · 2023 · Seminars in Cancer Biology
- Accelerating drug target inhibitor discovery with a deep generative foundation modelVijil Chenthamarakshan, Samuel C. Hoffman, Callum D. Owen, Petra Lukacik, Claire M. Strain-Damerell, D. Fearon, Tika R. Malla, Anthony Tumber, Christopher John Schofield, Helen M. E. Duyvesteyn et al. · 2023 · Science Advances
- Dual-view Molecular Pre-trainingJinhua Zhu, Yingce Xia, Lijun Wu, Shufang Xie, Wengang Zhou, Tao Qin, Houqiang Li, Tie‐Yan Liu · 2023 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
- Integration of pre-trained protein language models into geometric deep learning networksFang Wu, Lirong Wu, Dragomir Radev, Jinbo Xu, Stan Ziqing Li · 2023 · Communications Biology
- Deep Learning for Genomics: From Early Neural Nets to Modern Large Language ModelsTianwei Yue, Yuanxin Wang, Longxiang Zhang, Chunming Gu, Haoru Xue, Wenping Wang, Qi Lyu, Yujie Dun · 2023 · International Journal of Molecular Sciences
- Large language models in plant biologyHilbert Yuen In Lam, Xing Er Ong, Marek Mutwil · 2024 · Trends in Plant Science
- Evaluating generalizability of artificial intelligence models for molecular datasetsYasha Ektefaie, Andrew Shen, Daria Bykova, Maximillian G. Marin, M. Zitnik, M. Farhat · 2024 · bioRxiv
- A high-level programming language for generative protein designBrian Hie, Salvatore Candido, Zeming Lin, Ori Kabeli, Roshan Rao, Nikita Smetanin, Tom Sercu, Alexander W. Rives · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Deciphering microbial gene function using natural language processingDanielle Miller, Adi Stern, David Burstein · 2022 · Nature Communications
- In vitro continuous protein evolution empowered by machine learning and automationTianhao Yu, Aashutosh Girish Boob, Nilmani Singh, Yufeng Su, Huimin Zhao · 2023 · Cell Systems
- Generative models for protein sequence modeling: recent advances and future directionsMehrsa Mardikoraem, Zirui Wang, Nathaniel Pascual, Daniel Woldring · 2023 · Briefings in Bioinformatics
- Next generation of multispecific antibody engineeringDániel Kéri, Matt Walker, Isha Singh, Kyle K. Nishikawa, Fernando Garcés · 2023 · Antibody Therapeutics
- TranceptEVE: Combining Family-specific and Family-agnostic Models of Protein Sequences for Improved Fitness PredictionPascal Notin, Lood van Niekerk, Aaron W. Kollasch, Daniel Ritter, Yarin Gal, Debora S. Marks · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Embedding-based alignment: combining protein language models with dynamic programming alignment to detect structural similarities in the twilight-zonePantolini, Lorenzo, Studer, Gabriel, Pereira, Joana, Durairaj, Janani, Tauriello, Gerardo, Schwede, Torsten · 2024 · Bioinformatics
- Deep contrastive learning enables genome-wide virtual screeningJia, Yinjun, Gao, Bowen, Tan, Jiaxin, Zheng, Jiqing, Hong, Xin, Zhu, Wenyu, Tan, Haichuan, Xiao, Yuan, Tan, Liping, Cai, Hongyi et al. · 2026 · Science
- Sequence-based peptide identification, generation, and property prediction with deep learning: a reviewXumin Chen, Chen Li, Matthew T. Bernards, Yao Shi, Qing Shao, Yi He · 2021 · Molecular Systems Design & Engineering
- xTrimoPGLM: unified 100-billion-parameter pretrained transformer for deciphering the language of proteinsBo Chen, Xingyi Cheng, Pan Li, Yangli‐ao Geng, Jing Gong, Shen Li, Zhilei Bei, Xu Tan, Boyan Wang, Xin Zeng et al. · 2025 · Nature Methods
- The Virtual Lab: AI Agents Design New SARS-CoV-2 Nanobodies with Experimental ValidationSwanson, Kyle, Wu, Wesley, Bulaong, Nash L., Pak, John E., Zou, James · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Methods to Discover and Validate Biofluid-Based Biomarkers in Neurodegenerative DementiasCharlotte Elisabeth Teunissen, Leighann Eileithyia Kimble, Sherif Bayoumy, Katharina Bolsewig, Felicia Burtscher, Salomé Coppens, Shreyasee Das, Dea Gogishvili, Bárbara Fernandes Gomes, Nerea Gómez de San José et al. · 2023 · Molecular & Cellular Proteomics
- BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language AssociationsQizhi Pei, Wei Zhang, Jinhua Zhu, Kehan Wu, Kaiyuan Gao, Lijun Wu, Yingce Xia, Rui Yan · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Data science opportunities of large language models for neuroscience and biomedicineDanilo Bzdok, Andrew Thieme, Oleksiy Levkovskyy, Paul B. Wren, Thomas S. Ray, Siva Reddy · 2024 · Neuron
- Large language models for science and medicineAmalio Telenti, Michael Auli, Brian Hie, Cyrus Maher, Suchi Saria, John P. A. Ioannidis · 2024 · European Journal of Clinical Investigation
- A comprehensive review of the recent advances on predicting drug-target affinity based on deep learningXin Zeng, Shujuan Li, Shuang‐Qing Lv, Meng‐Liang Wen, Yi Li · 2024 · Frontiers in Pharmacology
- MPEK: a multitask deep learning framework based on pretrained language models for enzymatic reaction kinetic parameters predictionJingjing Wang, Zhijiang Yang, Chang Chen, Yao Ge, Xiukun Wan, Shaoheng Bao, Junjie Ding, Liangliang Wang, Hui Jiang · 2024 · Briefings in Bioinformatics
- Revolutionizing oncology: the role of Artificial Intelligence (AI) as an antibody design, and optimization toolsVarun Dewaker, Vivek Kumar Morya, Yoo Hee Kim, Sung Taek Park, Hyeong Su Kim, Young Ho Koh · 2025 · Biomarker Research
- Fast and effective protein model refinement using deep graph neural networksXiaoyang Jing, Jinbo Xu · 2021 · Nature Computational Science
- Mapping the glycosyltransferase fold landscape using interpretable deep learningRahil Taujale, Zhongliang Zhou, Wayland Yeung, Kelley W. Moremen, Sheng Li, Natarajan Kannan · 2021 · Nature Communications
- De novo mass spectrometry peptide sequencing with a transformer modelMelih Yilmaz, William E. Fondrie, Wout Bittremieux, Sewoong Oh, William Stafford Noble · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Generative power of a protein language model trained on multiple sequence alignments2023
- The generative capacity of probabilistic protein sequence modelsFrancisco A. McGee, Sandro Hauri, Quentin Novinger, Slobodan Vučetić, Ronald M. Levy, Vincenzo Carnevale, Allan Haldane · 2021 · Nature Communications
- Linguistically inspired roadmap for building biologically reliable protein language modelsMai Ha Vu, Rahmad Akbar, Philippe Auguste Robert, Bartłomiej Świątczak, Geir Kjetil Sandve, Victor Greiff, Dag Trygve Truslew Haug · 2023 · Nature Machine Intelligence
- Machine Learning-Enabled Genome Mining and Bioactivity Prediction of Natural ProductsYujie Yuan, Chengyou Shi, Huimin Zhao · 2023 · ACS Synthetic Biology
- A Perspective on Protein Structure Prediction Using Quantum ComputersHakan Doğa, Bryan A. Raubenolt, Fabio Cumbo, Jayadev Joshi, Frank P. DiFilippo, Jun Qin, Daniel J Blankenberg, Omar Shehab · 2024 · Journal of Chemical Theory and Computation
- Large language models for drug discovery and developmentYizhen Zheng, Huan Yee Koh, Jiaxin Ju, Madeleine Yang, Lauren Therese May, Geoffrey I. Webb, Li Li, Shirui Pan, George McDonald Church · 2025 · Patterns
- ProT-VAE: Protein Transformer Variational AutoEncoder for functional protein designEmre Sevgen, Joshua Moller, Adrian Lange, John Parker, Sean D. Quigley, Jeff Mayer, Poonam Srivastava, Sitaram Gayatri, David J. Hosfield, Clayton M. Dilks et al. · 2025 · Proceedings of the National Academy of Sciences
- Pre-Training of Deep Bidirectional Protein Sequence Representations With Structural InformationSeonwoo Min, Seunghyun Park, Siwon Kim, Hyun-Soo Choi, Byunghan Lee, Sungroh Yoon · 2021 · IEEE Access
- Transforming the Language of Life: Transformer Neural Networks for Protein Prediction TasksAnanthan Nambiar, Simon Liu, Mark Hopkins, Maeve Heflin, Sergei Maslov, Anna Ritz · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
- SETH predicts nuances of residue disorder from protein embeddingsDagmar Ilzhöfer, Michael Heinzinger, Burkhard Rost · 2022 · Frontiers in Bioinformatics
- Interpretable and explainable predictive machine learning models for data-driven protein engineeringDavid Medina-Ortiz, Ashkan Khalifeh, Hoda Anvari-Kazemabad, Mehdi D. Davari · 2024 · Biotechnology Advances
- GraphBAN: An inductive graph-based approach for enhanced prediction of compound-protein interactionsHamid Hadipour, Yan Yi Li, Yan Sun, Chutong Deng, Leann Lac, Rebecca L. Davis, Silvia T. Cardona, Pingzhao Hu · 2025 · Nature Communications
- Protein tertiary structure prediction and refinement using deep learning and Rosetta in CASP14Ivan V. Anishchenko, Minkyung Baek, Hahnbeom Park, Naozumi Hiranuma, David E. Kim, Justas Dauparas, Sanaa Mansoor, Ian R. Humphreys, David A. Baker · 2021 · Proteins Structure Function and Bioinformatics
- MolRoPE-BERT: An enhanced molecular representation with Rotary Position Embedding for molecular property predictionYunwu Liu, Ruisheng Zhang, Tongfeng Li, Jing Jiang, Jun Ma, Ping Wang · 2022 · Journal of Molecular Graphics and Modelling
- Using machine learning to predict the effects and consequences of mutations in proteinsDaniel J. Diaz, Anastasiya V. Kulikova, Andrew D. Ellington, Claus O. Wilke · 2023 · Current Opinion in Structural Biology
- Deep learning for protein complex structure predictionPatrick Bryant · 2023 · Current Opinion in Structural Biology
- Antibody design using deep learning: from sequence and structure design to affinity maturationSara Joubbi, Alessio Micheli, Paolo Milazzo, Giuseppe Maccari, Giorgio Ciano, Dario Cardamone, Duccio Medini · 2024 · Briefings in Bioinformatics
- Evaluating the advancements in protein language models for encoding strategies in protein function prediction: a comprehensive reviewJiaying Chen, Jingfu Wang, Yue Hu, Xia Li, Yurong Qian, Chao-Lin Song · 2025 · Frontiers in Bioengineering and Biotechnology
- PANDA2: protein function prediction using graph neural networksChenguang Zhao, Tong Liu, Zheng Wang · 2022 · NAR Genomics and Bioinformatics
- Improved global protein homolog detection with major gains in function identificationMesih Kilinc, Kejue Jia, Robert L. Jernigan · 2023 · Proceedings of the National Academy of Sciences
- Structure-aware protein self-supervised learningCan Chen, Jingbo Zhou, Fan Wang, Xue Liu, Dejing Dou · 2023 · Bioinformatics
- Learning protein fitness landscapes with deep mutational scanning data from multiple sourcesLin Chen, Zehong Zhang, Zhenghao Li, Rui Li, Ruifeng Huo, Lifan Chen, Dingyan Wang, Xiaomin Luo, Kaixian Chen, Cangsong Liao et al. · 2023 · Cell Systems
- Deep mutational scanning for therapeutic antibody engineeringKyrin R. Hanning, Mason Minot, Annmaree K. Warrender, William Kelton, Sai T. Reddy · 2021 · Trends in Pharmacological Sciences
- An analysis of protein language model embeddings for fold predictionVillegas-Morcillo, Amelia, Gomez, Angel M, Sanchez, Victoria · 2022 · Briefings in Bioinformatics
- Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language ModelsLi, Francesca-Zhoufan, Amini, Ava P., Yue, Yisong, Yang, Kevin K., Lu, Alex X. · 2024
- DeepNOG: fast and accurate protein orthologous group assignmentRoman Feldbauer, Lukas Gosch, Lukas Lüftinger, Patrick Hyden, Arthur Flexer, Thomas Rattei · 2020 · Bioinformatics
- LectinOracle: A Generalizable Deep Learning Model for Lectin–Glycan Binding Prediction2021
- Integrating convolution and self-attention improves language model of human genome for interpreting non-coding regions at base-resolutionMeng Yang, Lichao Huang, Haiping Huang, Hui Tang, Nan Zhang, Huanming Yang, Jihong Wu, Feng Mu · 2022 · Nucleic Acids Research
- Deep learning for protein secondary structure prediction: Pre and post-AlphaFoldDewi Pramudi Ismi, Reza Pulungan, Afiahayati · 2022 · Computational and Structural Biotechnology Journal
- The RESP AI model accelerates the identification of tight-binding antibodiesJonathan Parkinson, Ryan L. Hard, Wei Wang · 2023 · Nature Communications
- GeoBind: segmentation of nucleic acid binding interface on protein surface with geometric deep learningPengpai Li, Zhi‐Ping Liu · 2023 · Nucleic Acids Research
- Addressing epistasis in the design of protein functionRosalie Lipsh‐Sokolik, Sarel Jacob Fleishman · 2024 · Proceedings of the National Academy of Sciences
- Comparative evaluation of methods for the prediction of protein–ligand binding sitesJavier S. Utgés, Geoffrey J. Barton · 2024 · Journal of Cheminformatics
- pNPs-CapsNet: Predicting Neuropeptides Using Protein Language Models and FastText Encoding-Based Weighted Multi-View Feature Integration with Deep Capsule Neural NetworkShahid Akbar, Ali Raza, Hamid Hussain Awan, Quan Zou, Wajdi Alghamdi, Aamir Saeed · 2025 · ACS Omega
- Deep learning methods for protein function predictionBoadu, Frimpong, Lee, Ahhyun, Cheng, Jianlin · 2025 · PROTEOMICS
- Discovering molecular features of intrinsically disordered regions by using evolution for contrastive learningAlex Xijie Lu, Amy X. Lu, Iva Pritišanac, Taraneh Zarin, Julie Deborah Forman-Kay, Alan M Moses · 2022 · PLoS Computational Biology
- Harnessing the power of artificial intelligence to advance cell therapySara Capponi, Kyle G. Daniels · 2023 · Immunological Reviews
- Neural network extrapolation to distant regions of the protein fitness landscapeChase R. Freschlin, Sarah A. Fahlberg, Pete Heinzelman, Philip A. Romero · 2024 · Nature Communications
- Improving prediction performance of general protein language model by domain-adaptive pretraining on DNA-binding proteinZeng, Wenwu, Dou, Yutao, Pan, Liangrui, Xu, Liwen, Peng, Shaoliang · 2024 · Nature Communications
- <scp>DLPacker</scp>
: Deep learning for prediction of amino acid side chain conformations in proteinsMisiura, Mikita, Shroff, Raghav, Thyer, Ross, Kolomeisky, Anatoly B. · 2022 · Proteins: Structure, Function, and Bioinformatics
- Advancing Targeted Protein Degradation via Multiomics Profiling and Artificial IntelligenceDuran-Frigola, Miquel, Cigler, Marko, Winter, Georg E. · 2023 · Journal of the American Chemical Society
- Target and source modality co-reinforcement for emotion understanding from asynchronous multimodal sequencesDingkang Yang, Yang Liu, Can Huang, Mingcheng Li, Xiao Zhao, Yuzheng Wang, Kun Yang, Yan Wang, Peng Zhai, Lihua Zhang · 2023 · Knowledge-Based Systems
- pLM4Alg: Protein Language Model-Based Predictors for Allergenic Proteins and PeptidesZhenjiao Du, Yixiang Xu, Changqi Liu, Yonghui Li · 2023 · Journal of Agricultural and Food Chemistry
- TargetCLP: clathrin proteins prediction combining transformed and evolutionary scale modeling-based multi-view features via weighted feature integration approachMatee Ullah, Shahid Akbar, Ali Raza, Kashif Ahmad Khan, Quan Zou · 2024 · Briefings in Bioinformatics
- Are protein language models the new universal key?Konstantin Weißenow, Burkhard Rost · 2025 · Current Opinion in Structural Biology
- SPOT-1D-Single: improving the single-sequence-based prediction of protein secondary structure, backbone angles, solvent accessibility and half-sphere exposures using a large training set and ensembled deep learningJaspreet Singh, Thomas Litfin, Kuldip K. Paliwal, Jaswinder Singh, Anil Kumar Hanumanthappa, Yaoqi Zhou · 2021 · Bioinformatics
- Deep self-supervised learning for biosynthetic gene cluster detection and product classificationCarolina Rios-Martinez, Nicholas Bhattacharya, Ava P. Amini, Lorin A. Crawford, Kevin Yang · 2023 · PLoS Computational Biology
- Tutorial: a guide for the selection of fast and accurate computational tools for the prediction of intrinsic disorder in proteinsLukasz Kurgan, Gang Hu, Kui Wang, Sina Ghadermarzi, Bi Zhao, Nawar Malhis, Gábor Erdős, Jörg A. Gsponer, Vladimir Nikolaevich Uversky, Zsuzsanna Dosztányi · 2023 · Nature Protocols
- Artificial intelligence tools for the identification of antibiotic resistance genesIsaac Olatunji, Danae Kala Rodríguez Bardají, Renata Rezende Miranda, Michael A. Savka, André O. Hudson · 2024 · Frontiers in Microbiology
- De novo protein design with a denoising diffusion network independent of pretrained structure prediction modelsYufeng Liu, Sheng Wang, Jixin Dong, Ling-Hui Chen, Xinyu Wang, Lei Wang, Fudong Li, Chenchen Wang, Jiahai Zhang, Yuzhu Wang et al. · 2024 · Nature Methods
- ProSST: Protein Language Modeling with Quantized Structure and Disentangled AttentionMingchen Li, Yang Tan, Xinzhu Ma, Bozitao Zhong, Huiqun Yu, Ziyi Zhou, Wanli Ouyang, Bozitao Zhong, Liang Hong, Yang Tan · 2024 · neural information processing systems
- Conditional language models enable the efficient design of proficient enzymesGeraldene Munsamy, R. Illanes, Silvia Fruncillo, Ioanna T. Nakou, Sebastian Lindner, Gavin Ayres, Lesley S. Sheehan, Steven J. Moss, Ulrich Eckhard, Philipp Lorenz et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- An end-to-end framework for the prediction of protein structure and fitness from single sequenceChen, Yinghui, Xu, Yunxin, Liu, Di, Xing, Yaoguang, Gong, Haipeng · 2024 · Nature Communications
- A combinatorially complete epistatic fitness landscape in an enzyme active siteJohnston, Kadina E., Almhjell, Patrick J., Watkins-Dulaney, Ella J., Liu, Grace, Porter, Nicholas J., Yang, Jason, Arnold, Frances H. · 2024 · Proceedings of the National Academy of Sciences
- Machine learning applications for therapeutic tasks with genomics dataKexin Huang, Cao Xiao, Lucas M. Glass, Cathy W. Critchlow, Greg C. Gibson, Jimeng Sun · 2021 · Patterns
- Systematic prediction of degrons and E3 ubiquitin ligase binding via deep learningChao Hou, Yuxuan Li, Mengyao Wang, Hong Wu, Tingting Li · 2022 · BMC Biology
- Toward generalizable prediction of antibody thermostability using machine learning on sequence and structure featuresAmeya Harmalkar, Roshan Rao, Yuxuan Richard Xie, Jonas Honer, Wibke Deisting, Jonas Anlahr, Anja Hoenig, Julia Czwikla, Eva Sienz-Widmann, Doris Rau et al. · 2023 · mAbs
- AI-Driven Enzyme Engineering: Emerging Models and Next-Generation Biotechnological ApplicationsMohd Faheem Khan, Mohd. Tasleem Khan · 2025 · Molecules
- Early computational detection of potential high-risk SARS-CoV-2 variants2023
- Do deep learning models make a difference in the identification of antimicrobial peptides?César R. García‐Jacas, Sergio A. Pinacho-Castellanos, Luis A. García‐González, Carlos A. Brizuela · 2022 · Briefings in Bioinformatics
- Transfer learning in proteins: evaluating novel protein learned representations for bioinformatics tasksEmilio Fenoy, Alejando A Edera, Georgina S. Stegmayer · 2022 · Briefings in Bioinformatics
- E-SNPs&GO: embedding of protein sequence and function improves the annotation of human pathogenic variantsMatteo Manfredi, Castrense Savojardo, Pier Luigi Martelli, Rita Casadio · 2022 · Bioinformatics
- ULDNA: integrating unsupervised multi-source language models with LSTM-attention network for high-accuracy protein–DNA binding site predictionYi-Heng Zhu, Zi Liu, Yan Liu, Zhi-Wei Ji, Dong-Jun Yu · 2024 · Briefings Bioinform.
- SEMA 2.0: web-platform for B-cell conformational epitopes prediction using artificial intelligenceNikita V. Ivanisenko, Tatiana Shashkova, Andrey Shevtsov, Maria Sindeeva, Dmitriy Umerenkov, Olga L. Kardymon · 2024 · Nucleic Acids Research
- Multi-modal deep learning enables efficient and accurate annotation of enzymatic active sitesXiaorui Wang, Xiaodan Yin, Dejun Jiang, Huifeng Zhao, Zhenxing Wu, Odin Zhang, Jike Wang, Yuquan Li, Yafeng Deng, Huanxiang Liu et al. · 2024 · Nature Communications
- ProLLaMA: A Protein Large Language Model for Multitask Protein Language ProcessingLiuzhenghao Lv, Zong-Ying Lin, Hao Li, Yu-Yang Liu, Jia-Xi Cui, C. Chen, Li Yuan, Yong-Hong Tian · 2024 · IEEE Transactions on Artificial Intelligence
- DefensePredictor: A machine learning model to discover prokaryotic immune systemsPeter C. DeWeirdt, Emily M. Mahoney, Michael T. Laub · 2026 · Science
- Ten quick tips for deep learning in biologyBenjamin D. Lee, Anthony Gitter, Casey S. Greene, Sebastian Raschka, Finlay Maguire, Alexander Titus, Michael D. Kessler, Alexandra J. Lee, Marc G. Chevrette, Paul A. Stewart et al. · 2022 · PLoS Computational Biology
- GraphiT: Encoding Graph Structure in TransformersGrégoire Mialon, Dexiong Chen, Margot Selosse, Julien Mairal · 2021 · arXiv (Cornell University)
- Artificial intelligence and machine learning in cell-free-DNA-based diagnosticsWY Tsui, Spencer C Ding, Peiyong Jiang, Yuk Ming Dennis Lo · 2025 · Genome Research