Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences
Rives, Alexander, Meier, Joshua, Sercu, Tom, Goyal, Siddharth, Lin, Zeming, Liu, Jason, Guo, Demi, Ott, Myle +3 more·2019·Proceedings of the National Academy of Sciences
DOI 10.1101/622803
Cited by (1,005)
Items 601–700 of 1,005
- Ultra-fast protein structure prediction to capture effects of sequence variation in mutation moviesKonstantin Weißenow, Michael Heinzinger, Martin Steinegger, Burkhard Rost · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Rotamer Density Estimator is an Unsupervised Learner of the Effect of Mutations on Protein-Protein InteractionShitong Luo, Yufeng Su, Zuofan Wu, Chenpeng Su, Jian Peng, Jianzhu Ma · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- IgDesign: In vitro validated antibody design against multiple therapeutic antigens using inverse foldingAmir Shanehsazzadeh, Julian Alverio, George W. Kasun, Simon Levine, Ido Calman, Jibran Ahmad Khan, Chelsea Chung, Nicolas Diaz, Breanna K. Luton, Ysis Tarter et al. · 2023 · bioRxiv (Cold Spring Harbor Laboratory)
- Designing DNA With Tunable Regulatory Activity Using Discrete DiffusionAnirban Sarkar, Alejandra Durán, Yiyang Yu, Da-Wei Lin, Yijie Kang, Nirali Somia, Pablo Mantilla, Jessica Zhou, Masayuki Nagai, Ziqi Tang et al. · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Protein Language Models: Is Scaling Necessary?Quentin Fournier, Robert McCoy Vernon, Almer M. van der Sloot, Benjamin Schulz, Sarath Chandar, CHRISTOPHER JAMES LANGMEAD · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- Lab-in-the-loop therapeutic antibody design with deep learningNathan C. Frey, I. Hötzel, S. Stanton, Ryan L Kelly, R. Alberstein, Emily K. Makowski, Karolis Martinkus, Daniel Berenberg, J. Bevers, Tyler Bryson et al. · 2025 · bioRxiv
- Efficient generation of protein pockets with PocketGenZhang, Zaixi, Shen, Wan Xiang, Liu, Qi, Zitnik, Marinka · 2024 · Nature Machine Intelligence
- Protein embeddings improve phage-host interaction predictionMark Edward M. Gonzales, Jennifer C. Ureta, Anish Man Singh Shrestha · 2023 · PLoS ONE
- Toward Unified AI Drug Discovery with Multimodal KnowledgeYizhen Luo, Xing Yi Liu, Kai Yang, Kui Huang, Massimo Hong, Jiahuan Zhang, Yushuai Wu, Zaiqing Nie · 2024 · Health Data Science
- GATSol, an enhanced predictor of protein solubility through the synergy of 3D structure graph and large language modelingBin Li, Dengming Ming · 2024 · BMC Bioinformatics
- T-cell receptor binding prediction: A machine learning revolutionAnna Weber, Aurélien Pélissier, María Rodríguez Martínez · 2024 · ImmunoInformatics
- Development of a deep learning model for cancer diagnosis by inspecting cell-free DNA end-motifsHongru Shen, Meng Yang, Jilei Liu, Kexin Chen, Xiangchun Li · 2024 · npj Precision Oncology
- AcrNET: predicting anti-CRISPR with deep learningYunxiang Li, Yumeng Wei, Sheng Yong Xu, Qingxiong Tan, Licheng Zong, Jiuming Wang, Yixuan Wang, Jiayang Chen, Liang Hong, Yu Li · 2023 · Bioinformatics
- ECOD domain classification of 48 whole proteomes from AlphaFold Structure Database using DPAM2Schaeffer, R. Dustin, Zhang, Jing, Medvedev, Kirill E., Kinch, Lisa N., Cong, Qian, Grishin, Nick V. · 2024 · PLOS Computational Biology
- Enhancing missense variant pathogenicity prediction with protein language models using VariPredLin, Weining, Wells, Jude, Wang, Zeyuan, Orengo, Christine, Martin, Andrew C. R. · 2024 · Scientific Reports
- TransEFVP: A Two-Stage Approach for the Prediction of Human Pathogenic Variants Based on Protein Sequence Embedding FusionZihao Yan, Fang Ge, Yan Liu, Yumeng Zhang, Fuyi Li, Jiangning Song, Dong‐Jun Yu · 2024 · Journal of Chemical Information and Modeling
- Benchmarking uncertainty quantification for protein engineeringKevin P. Greenman, Ava P. Amini, Kevin Yang · 2025 · PLoS Computational Biology
- Contrastive learning of T cell receptor representationsYuta Nagano, Andrew G. T. Pyo, Martina Milighetti, James Henderson, John S. Shawe-Taylor, Benny Chain, Andreas Tiffeau-Mayer · 2025 · Cell Systems
- Token-Mol 1.0: tokenized drug design with large language modelsJike Wang, Rui Qin, Mingyang Wang, Meijing Fang, Yangyang Zhang, Yuchen Zhu, Qun Su, Qiaolin Gou, Chao Shen, Odin Zhang et al. · 2025 · Nature Communications
- From traditional to AI-driven: The evolution of intelligent enzyme engineering for biocatalysisFeifei Lv, Jiaxing Zhang, Shengping You, Wei Qi · 2025 · Biotechnology Advances
- Machine learning for drug-target interaction prediction: A comprehensive review of models, challenges, and computational strategiesBilal Ahmad, Khmaies Ouahada, Habib Hamam · 2026 · Computational and Structural Biotechnology Journal
- Learning the language of protein-protein interactions2026
- Clustering FunFams using sequence embeddings improves EC purityMaria Littmann, Nicola Bordin, Michael Heinzinger, Konstantin Schütze, Christian Dallago, Christine Anne Orengo, Burkhard Rost · 2021 · Bioinformatics
- A switchable Cas12a enabling CRISPR-based direct histone deacetylase activity detectionWenyuan Kang, Lin Liu, Peihang Yu, Tianyi Zhang, Chunyang Lei, Zhou Nie · 2022 · Biosensors and Bioelectronics
- DrugormerDTI: Drug Graphormer for drug–target interaction predictionJiayue Hu, Wang Yu, Chao Pang, Junru Jin, Nhat Truong Pham, Balachandran Manavalan, Leyi Wei · 2023 · Computers in Biology and Medicine
- Deorphanizing Peptides Using Structure PredictionFelix Teufel, Jan C. Refsgaard, Marina A. Kasimova, Kristine Deibler, Christian T. Madsen, Carsten Stahlhut, Mads Grønborg, Ole Winther, Dennis Madsen · 2023 · Journal of Chemical Information and Modeling
- MultiGML: Multimodal graph machine learning for prediction of adverse drug eventsSophia Krix, Lauren Nicole DeLong, Sumit Madan, Daniel Domingo‐Fernándéz, Ashar Ahmad, Sheraz Gul, Andrea Zaliani, Holger Fröhlich · 2023 · Heliyon
- tFold-Ab: Fast and Accurate Antibody Structure Prediction without Sequence HomologsJiaxiang Wu, Fandi Wu, Biaobin Jiang, Wei Liu, Peilin Zhao · 2022 · bioRxiv (Cold Spring Harbor Laboratory)
- Deeper evaluation of a single-cell foundation modelBoiarsky, Rebecca, Singh, Nalini M., Buendia, Alejandro, Amini, Ava P., Getz, Gad, Sontag, David · 2024 · Nature Machine Intelligence
- Accurate and Fast Prediction of Intrinsically Disordered Protein by Multiple Protein Language Models and Ensemble LearningShijie Xu, Akira Onoda · 2023 · Journal of Chemical Information and Modeling
- ACPScanner: Prediction of Anticancer Peptides by Integrated Machine Learning MethodologiesGuolun Zhong, Lei Deng · 2024 · Journal of Chemical Information and Modeling
- Using protein language models for protein interaction hot spot prediction with limited dataK. Sargsyan, C. Lim · 2024 · BMC Bioinformatics
- Teaching AI to speak proteinMichael Heinzinger, Burkhard Rost · 2025 · Current Opinion in Structural Biology
- Exploring the repository of de novo-designed bifunctional antimicrobial peptides through deep learningRuihan Dong, Rongrong Liu, Ziyu Liu, Yangang Liu, Gaomei Zhao, Honglei Li, Shiyuan Hou, Xiaohan Ma, Huarui Kang, Jing Liu et al. · 2024 · eLife
- Computationally designed proteins mimic antibody immune evasion in viral evolutionNoor Youssef, Sarah F. Gurev, Fadi Ghantous, Kelly P. Brock, Javier A. Jaimes, Nicole N. Thadani, Ann Dauphin, Amy C Sherman, Leonid Yurkovetskiy, Daria Soto et al. · 2025 · Immunity
- FragNet, a Contrastive Learning-Based Transformer Model for Clustering, Interpreting, Visualizing, and Navigating Chemical SpaceShrivastava, Aditya Divyakant, Kell, Douglas B. · 2021 · Molecules
- BERT-Kgly: A Bidirectional Encoder Representations From Transformers (BERT)-Based Model for Predicting Lysine Glycation Site for Homo sapiensYinbo Liu, Yufeng Liu, Gang-Ao Wang, Yinchu Cheng, Shoudong Bi, Xiaolei Zhu · 2022 · Frontiers in Bioinformatics
- RBP-TSTL is a two-stage transfer learning framework for genome-scale prediction of RNA-binding proteinsXinxin Peng, Xiaoyu Wang, Yuming Guo, Zongyuan Ge, Fuyi Li, Xin Gao, Jiangning Song · 2022 · Briefings in Bioinformatics
- Improved inter-protein contact prediction using dimensional hybrid residual networks and protein language modelsSi, Yunda, Yan, Chengfei · 2023 · Briefings in Bioinformatics
- ArkDTA: attention regularization guided by non-covalent interactions for explainable drug–target binding affinity predictionMogan Gim, Junseok Choe, Seungheun Baek, Jueon Park, Chaeeun Lee, Minjae Ju, Sumin Lee, Jaewoo Kang · 2023 · Bioinformatics
- Steering and controlling evolution — from bioengineering to fighting pathogensMichael Lässig, Ville Mustonen, Armita Nourmohammad · 2023 · Nature Reviews Genetics
- Structure-based prediction of nucleic acid binding residues by merging deep learning- and template-based approachesZheng Jiang, Yue-Yue Shen, Rong Liu · 2023 · PLoS Computational Biology
- Language models can identify enzymatic binding sites in protein sequencesYves Gaëtan Nana Teukam, Loıc Kwate Dassi, Matteo Manica, Daniel Probst, Philippe Schwaller, Teodoro Laino · 2024 · Computational and Structural Biotechnology Journal
- DR-BERT: A protein language model to annotate disordered regionsAnanthan Nambiar, John Malcolm Forsyth, Simon Liu, Sergei Maslov · 2024 · Structure
- Decoding biology with massively parallel reporter assays and machine learningAlyssa La Fleur, Yongsheng Shi, Georg Seelig · 2024 · Genes & Development
- Protein Language Model Fitness Is a Matter of PreferenceCade Gordon, Amy X. Lu, Pieter Abbeel · 2024 · bioRxiv
- Improved prediction of MHC-peptide binding using protein language modelsHashemi, Nasser, Hao, Boran, Ignatov, Mikhail, Paschalidis, Ioannis Ch., Vakili, Pirooz, Vajda, Sandor, Kozakov, Dima · 2023 · Frontiers in Bioinformatics
- Computational Prediction of Protein Intrinsically Disordered Region Related Interactions and FunctionsBingqing Han, Chongjiao Ren, Wenda Wang, Jiashan Li, Xinqi Gong · 2023 · Genes
- Genetic control over biogenic crystal morphogenesis in zebrafishDeis, Rachael, Lerer-Goldshtein, Tali, Baiko, Olha, Eyal, Zohar, Brenman-Begin, Dolev, Goldsmith, Moshe, Kaufmann, Sylvia, Heinig, Uwe, Dong, Yonghui, Lushchekina, Sofya et al. · 2025 · Nature Chemical Biology
- Improved enzyme functional annotation prediction using contrastive learning with structural inferenceYang, Yuxin, Jerger, Abby, Feng, Song, Wang, Zixu, Brasfield, Christina, Cheung, Margaret S., Zucker, Jeremy, Guan, Qiang · 2024 · Communications Biology
- UAPT: an underwater acoustic target recognition method based on pre-trained TransformerJun Tang, Enxue Ma, Yang Qu, Wenbo Gao, Yuchen Zhang, Lin Gan · 2025 · Multimedia Systems
- Contrastive-learning of language embedding and biological features for cross modality encoding and effector predictionPeng Yue, Junze Wu, Yi Sun, Yuanxing Zhang, Qiyao Wang, Shuai Shao · 2025 · Nature Communications
- Artificial intelligence in bioinformatics: a surveyJiyue Jiang, Yunke Li, Shiwei Cao, Yuheng Shan, Yuexing Liu, Tianyi Fei, Yule Yu, Yi Feng, Yu Li, Yixue Li et al. · 2025 · Briefings in Bioinformatics
- Ligand Binding Prediction Using Protein Structure Graphs and Residual Graph Attention NetworksMohit Kumar Pandey, Mariia Radaeva, Hazem Mslati, Olivia Garland, Michael Fernández, Martin Ester, Artem R Cherkasov · 2022 · Molecules
- PTG-PLM: Predicting Post-Translational Glycosylation and Glycation Sites Using Protein Language Models and Deep LearningAlhasan Alkuhlani, Walaa Khaled Gad, Mohamed Ismail Roushdy, Michael Gr. Voskoglou, Abdel-Badeeh Mohamed Salem · 2022 · Axioms
- CLADE 2.0: Evolution-Driven Cluster Learning-Assisted Directed EvolutionYuchi Qiu, Guo‐Wei Wei · 2022 · Journal of Chemical Information and Modeling
- Handcrafted versus non-handcrafted (self-supervised) features for the classification of antimicrobial peptides: complementary or redundant?César R. García‐Jacas, Luis A. García‐González, Félix Martínez-Rios, Issac P Tapia-Contreras, Carlos A. Brizuela · 2022 · Briefings in Bioinformatics
- Machine learning methods for predicting protein structure from single sequencesShaun M. Kandathil, Andy M C Lau, David T. Jones · 2023 · Current Opinion in Structural Biology
- Prediction of Antifungal Activity of Antimicrobial Peptides by Transfer Learning from Protein Pretrained ModelsFernando Lobo, Maily Selena González, Alicia Boto, José Manuel Pérez de la Lastra · 2023 · International Journal of Molecular Sciences
- MaTPIP: A deep-learning architecture with eXplainable AI for sequence-driven, feature mixed protein-protein interaction predictionShubhrangshu Ghosh, Pralay Mitra · 2023 · Computer Methods and Programs in Biomedicine
- KinomeMETA: meta-learning enhanced kinome-wide polypharmacology profilingQun Ren, Ning Qu, Jingjing Sun, Jingyi Zhou, Jin Liu, Lin Ni, Xiaochu Tong, Zimei Zhang, Xiangtai Kong, Yiming Wen et al. · 2023 · Briefings in Bioinformatics
- Best practices for machine learning in antibody discovery and developmentLeonard Wossnig, Norbert Furtmann, Andrew G. Buchanan, Sandeep Kumar, Victor Greiff · 2024 · Drug Discovery Today
- Rationally seeded computational protein design of ɑ-helical barrelsKatherine I. Albanese, Rokas Petrenas, Fabio Pirro, Elise A. Naudin, Ufuk Borucu, William Dawson, D. Arne Scott, Graham J. Leggett, Orion David Weiner, Thomas A. A. Oliver et al. · 2024 · Nature Chemical Biology
- Combining evolutionary and assay-labelled data for protein fitness predictionChloe Hsu, Hunter M. Nisonoff, Clara Fannjiang, Jennifer Listgarten · 2021 · bioRxiv (Cold Spring Harbor Laboratory)
- DIPS-Plus: The enhanced database of interacting protein structures for interface predictionAlex Morehead, Chen Chen, Ada Sedova, Jianlin Cheng · 2023 · Scientific Data
- Advanced Research Directions on AI for Science, Energy, and Security: Report on Summer 2022 WorkshopsJonathan T. Carter, John Feddema, D.B. Kothe, Rob Neely, J Pruet, Rick L. Stevens, Prasanna Balaprakash, Pete Beckman, Ian T Foster, Kamil A. Iskra et al. · 2023
- Can Protein Structure Prediction Methods Capture Alternative Conformations of Membrane Transporters?Xie, Tengyu, Huang, Jing · 2024 · Journal of Chemical Information and Modeling
- RNA language models predict mutations that improve RNA functionShulgina, Yekaterina, Trinidad, Marena I., Langeberg, Conner J., Nisonoff, Hunter, Chithrananda, Seyone, Skopintsev, Petr, Nissley, Amos J., Patel, Jaymin, Boger, Ron S., Shi, Honglue et al. · 2024 · Nature Communications
- Genome-wide prediction of disease variants with a deep protein language modelBrandes, Nadav, Goldman, Grant, Wang, Charlotte H., Ye, Chun Jimmie, Ntranos, Vasilis · 2022
- GTalign: spatial index-driven protein structure alignment, superposition, and search2024
- SPOT: A machine learning model that predicts specific substrates for transport proteinsAlexander Kroll, Nico Niebuhr, Gregory Butler, Martin J. Lercher · 2024 · PLoS Biology
- SSEmb: A joint embedding of protein sequence and structure enables robust variant effect predictionsLasse M. Blaabjerg, Nicolas Jonsson, Wouter Boomsma, Amelie Stein, Kresten Lindorff‐Larsen · 2024 · Nature Communications
- The Historical Evolution and Significance of Multiple Sequence Alignment in Molecular Structure and Function PredictionChenyue Zhang, Qinxin Wang, Yiyang Li, Anqi Teng, Gang Hu, Qiqige Wuyun, Wei Hui Zheng · 2024 · Biomolecules
- DRAMMA: a multifaceted machine learning approach for novel antimicrobial resistance gene detection in metagenomic dataElla Rannon, Sagi Shaashua, David E Burstein · 2025 · Microbiome
- Comprehensive benchmarking of large language models for RNA secondary structure predictionLuciano I Zablocki, Leandro A. Bugnon, Matias F. Gerard, Leandro Ezequiel Di Persia, Georgina S. Stegmayer, Diego Humberto Milone · 2025 · Briefings in Bioinformatics
- In search of adequate models of pedagogyMiguél Nussbaum, Zvi Bekerman, Leanna Archambault, Maria Rainieri, Ramazan Yılmaz, Di Zou, Johan van Braak, Chin‐Chung Tsai · 2025 · Computers & Education
- Machine learning to predict de novo protein–protein interactionsPablo Gaínza, R.D. Bunker, Sharon A. Townson, John C. Castle · 2025 · Trends in biotechnology
- Language model-guided anticipation and discovery of mammalian metabolitesHantao Qiang, Fei Wang, Wenyun Lu, Xi Xing, Hahn Kim, Sandrine A. M. Mérette, Lucas B. Ayres, Eponine Oler, Jenna E. AbuSalim, Asael Roichman et al. · 2026 · Nature
- RNA Backbone Torsion and Pseudotorsion Angle Prediction Using Dilated Convolutional Neural NetworksJaswinder Singh, Kuldip K. Paliwal, Jaspreet Singh, Yaoqi Zhou · 2021 · Journal of Chemical Information and Modeling
- Learning the local landscape of protein structures with convolutional neural networks2021
- Structure-inducing pre-trainingMatthew B. A. McDermott, Brendan Yap, Peter Szolovits, Marinka Žitnik · 2023 · Nature Machine Intelligence
- Comprehensive phylogenetic analysis of the ribonucleotide reductase family reveals an ancestral cladeAudrey A. Burnim, Matthew A. Spence, Da Zhuan Xu, Colin J. Jackson, Nozomi Ando · 2022 · eLife
- EPT: A data-driven transformer model for earthquake predictionBo Zhang, Ziang Hu, Pin Wu, Haiwang Huang, Jiansheng Xiang · 2023 · Engineering Applications of Artificial Intelligence
- Structural modeling of antibody variable regions using deep learning—progress and perspectives on drug discoveryIgor Jaszczyszyn, Weronika Bielska, Tomasz Gawłowski, Paweł Dudzic, Tadeusz Satława, Jarosław Kończak, Wiktoria Wilman, Bartosz Janusz, Sonia Wróbel, Dawid Chomicz et al. · 2023 · Frontiers in Molecular Biosciences
- Deep learning in preclinical antibody drug discovery and developmentYuwei Zhou, Ziru Huang, Wenzhen Li, Jinyi Wei, Qianhu Jiang, Wei Yang, Jian Hua Huang · 2023 · Methods
- Single-residue linear and conformational B cell epitopes prediction using random and ESM-2 based projectionsSapir Israeli, Yoram Louzoun · 2024 · Briefings in Bioinformatics
- Prediction of virus-host associations using protein language models and multiple instance learningDan Liu, Francesca Young, Kieran D. Lamb, David L. Robertson, Ke Yuan · 2024 · PLoS Computational Biology
- Graphein - a Python Library for Geometric Deep Learning and Network Analysis on Protein Structures and Interaction NetworksArian R. Jamasb, Ramón Viñas, Eric J. Ma, Charlie Harris, Kexin Huang, Dominic Hall, Píetro Lió, Tom L. Blundell · 2020 · bioRxiv (Cold Spring Harbor Laboratory)
- Training Compute-Optimal Protein Language ModelsXingyi Cheng, Bo Chen, Pan Li, Jing Gong, Jie Tang, Le Song · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
- From Mechanistic Interpretability to Mechanistic Biology: Training, Evaluating, and Interpreting Sparse Autoencoders on Protein Language ModelsEtowah Adams, Liam Bai, Minji Lee, Yiyang Yu, Mohammed AlQuraishi · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
- Interpreting Potts and Transformer Protein Models Through the Lens of Simplified AttentionBhattacharya, Nicholas, Thomas, Neil, Rao, Roshan, Dauparas, Justas, Koo, Peter K., Baker, David, Song, Yun S., Ovchinnikov, Sergey · 2021 · Biocomputing 2022
- Protein language model-embedded geometric graphs power inter-protein contact predictionSi, Yunda, Yan, Chengfei · 2024 · eLife
- Elucidation of genome-wide understudied proteins targeted by PROTAC-induced degradation using interpretable machine learningXie, Li, Xie, Lei · 2023 · PLOS Computational Biology
- PHIStruct: improving phage–host interaction prediction at low sequence similarity settings using structure-aware protein embeddingsGonzales, Mark Edward M, Ureta, Jennifer C, Shrestha, Anish M S · 2024 · Bioinformatics
- Evaluating large language models for annotating proteinsRosario Vitale, Leandro A. Bugnon, Emilio Fenoy, Diego Humberto Milone, Georgina S. Stegmayer · 2024 · Briefings in Bioinformatics
- A transformer-based deep reinforcement learning approach for dynamic parallel machine scheduling problem with family setupsFuning Li, Sebastian Lang, Yuan Tian, Bingyuan Hong, Benjamin Rolf, Ruben Noortwyck, Robert Schulz, Tobias Reggelin · 2024 · Journal of Intelligent Manufacturing
- pLM4CPPs: Protein Language Model-Based Predictor for Cell Penetrating PeptidesNandan Kumar, Zhenjiao Du, Yonghui Li · 2025 · Journal of Chemical Information and Modeling
- Ancestral reconstruction of polyethylene terephthalate degrading cutinases reveals a rugged and unexplored sequence-fitness landscapeVanessa Vongsouthi, Rosemary Georgelin, Dana S. Matthews, Jake W. Saunders, Brendon M. Lee, Jennifer Ton, Adam M. Damry, Rebecca L. Frkic, Matthew A. Spence, Colin J. Jackson · 2025 · Science Advances
- Protein functional site annotation using local structure embeddingsAlexander Derry, Alp Tartici, Russ Biagio Altman · 2025 · Proceedings of the National Academy of Sciences
- Efficient Exploration of Sequence Space by Sequence-Guided Protein Engineering and DesignBen E. Clifton, Dan Kozome, Paola Laurino · 2022 · Biochemistry