The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.
Learning protein sequence embeddings using information from structure
Open accessAbstract
Inferring the structural properties of a protein from its amino acid sequence is a challenging yet important problem in biology. Structures are not known for the vast majority of protein sequences, but structure is critical for understanding function. Existing approaches for detecting structural similarity between proteins from sequence are unable to recognize and exploit structural patterns when sequences have diverged too far, limiting our ability to transfer knowledge between structurally related proteins. We newly approach this problem through the lens of representation learning. We introduce a framework that maps any protein sequence to a sequence of vector embeddings --- one per amino acid position --- that encode structural information. We train bidirectional long short-term memory (LSTM) models on protein sequences with a two-part feedback mechanism that incorporates information from (i) global structural similarity between proteins and (ii) pairwise residue contact maps for individual proteins. To enable learning from structural similarity information, we define a novel similarity measure between arbitrary-length sequences of vector embeddings based on a soft symmetric alignment (SSA) between them. Our method is able to learn useful position-specific embeddings despite lacking direct observations of position-level correspondence between sequences. We show empirically that our multi-task framework outperforms other sequence-based methods and even a top-performing structure-based alignment method when predicting structural similarity, our goal. Finally, we demonstrate that our learned embeddings can be transferred to other protein sequence problems, improving the state-of-the-art in transmembrane domain prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, the multi-task learning approach outperforms a two-step learning approach presented previously (SSA-LSTM)27.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“Learned protein representations improve predictive ability for downstream prediction problems through transfer learning (Figure 5a).”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“They also learn summary representations, powerful features that can be used to better capture sequence relationships and link sequence to function via transfer learning 27,28,32-35.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“New work has since shown that the representations learned by language models are also powerful features for learning of variant fitness as a subsequent supervised learning task 32,34, building on earlier observations that language models can improve protein property prediction through transfer learning 27.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“The key insight was that the sequence representations (vector embeddings) learned by the language model were powerful features for solving other prediction problems.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Sorted by citations
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
Elnaggar, A., Heinzinger, M., Dallago, C., Rehawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., Steinegger, M., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3095381 · Cited by 2,329
Machine-learning-guided directed evolution for protein engineering
Yang, K. K., Wu, Z., & Arnold, F. H. (2019) · Nature Methods · doi:10.1038/s41592-019-0496-6 · Cited by 1,130
ProteinBERT: a universal deep-learning model of protein sequence and function
Brandes, N., Ofer, D., Peleg, Y., Rappoport, N., & Linial, M. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac020 · Cited by 1,009
Structure-based protein function prediction using graph convolutional networks
Gligorijević, V., Renfrew, P. D., Kościółek, T., Leman, J. K., Berenberg, D., Vatanen, T., Chandler, C., Taylor, B. C., Fisk, I., Vlamakis, H. C., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-23303-9 · Cited by 984
Evaluating Protein Transfer Learning with TAPE
Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, X., Canny, J., Abbeel, P., & Song, Y. S. (2019) · doi:10.1101/676825 · Cited by 719
Language models enable zero-shot prediction of the effects of mutations on protein function
Meier, J., Rao, R., Verkuil, R., Liu, J., Sercu, T., & Rives, A. (2021) · doi:10.1101/2021.07.09.450648 · Cited by 635
Learning the protein language: Evolution, structure, and function
Bepler, T., & Berger, B. (2021) · Cell Systems · doi:10.1016/j.cels.2021.05.017 · Cited by 483
Self-citationEfficient evolution of human antibodies from general protein language models
Hie, B., Shanker, V. R., Xu, D., Bruun, T. U. J., Weidenbacher, P. A. B., Tang, S., Wu, W. C. H., Pak, J. E., & Kim, P. S. (2023) · Nature Biotechnology · doi:10.1038/s41587-023-01763-2 · Cited by 472
Learning inverse folding from millions of predicted structuresPreprint
Hsu, C., Verkuil, R., Liu, J. J., Lin, Z., Hie, B., Sercu, T., Lerer, A. K., & Rives, A. W. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.04.10.487779 · Cited by 492
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280
“In contrast to models that are based on recurrent or convolutional neural networks, the Transformer makes no assumptions on the ordering of the input and instead uses position embeddings.”
Learning the language of viral evolution and escape
Hie, B., Zhong, E. D., Berger, B., & Bryson, B. (2021) · Science · doi:10.1126/science.abd7331 · Cited by 361
Self-citationThe language of proteins: NLP, machine learning & protein sequences
Ofer, D., Brandes, N., & Linial, M. (2021) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2021.03.022 · Cited by 365
BERTology Meets Biology: Interpreting Attention in Protein Language Models
Vig, J., Madani, A., Varshney, L. R., Xiong, C., Socher, R., & Rajani, N. F. (2020) · doi:10.1101/2020.06.26.174417 · Cited by 338
Transformer protein language models are unsupervised structure learners
Rao, R., Meier, J., Sercu, T., Ovchinnikov, S., & Rives, A. (2020) · doi:10.1101/2020.12.15.422761 · Cited by 341
Predicting drug–protein interaction using quasi-visual question answering system
Zheng, S., Li, Y., Chen, S., Xu, J., & Yang, Y. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0152-y · Cited by 317
Generative models for graph-based protein design
Ingraham, J., Garg, V., Barzilay, R., & Jaakkola, T. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 258
Elnaggar, A., Heinzinger, M., Dallago, C., Rihawi, G., Wang, Y., Jones, L., Gibbs, T., Fehér, T., Angerer, C. M., Steinegger, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06225 · Cited by 364
Sledzieski, S., Singh, R., Cowen, L., & Berger, B. (2021) · Cell Systems · doi:10.1016/j.cels.2021.08.010 · Cited by 235
Self-citationInformed training set design enables efficient machine learning-assisted directed protein evolution
Wittmann, B. J., Yue, Y., & Arnold, F. H. (2021) · Cell Systems · doi:10.1016/j.cels.2021.07.008 · Cited by 215
Singh, R., Sledzieski, S., Bryson, B. D., Cowen, L., & Berger, B. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2220778120 · Cited by 216
Self-citationLanguage models generalize beyond natural proteins
Verkuil, R., Kabeli, O., Du, Y., Wicky, B. I. M., Milles, L. F., Dauparas, J., Baker, D., Ovchinnikov, S., Sercu, T., & Rives, A. (2022) · doi:10.1101/2022.12.21.521521 · Cited by 181
Pre-trained Language Models in Biomedical Domain: A Systematic Survey
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2023) · ACM Computing Surveys · doi:10.1145/3611651 · Cited by 238
ECNet is an evolutionary context-integrated deep learning framework for protein engineering
Luo, Y., Jiang, G., Yu, T., Liu, Y., Vo, L. T., Ding, H., Su, Y., Qian, W. W., Zhao, H., & Peng, J. (2021) · Nature Communications · doi:10.1038/s41467-021-25976-8 · Cited by 174
Advances in machine learning for directed evolution
Wittmann, B. J., Johnston, K. E., Wu, Z., & Arnold, F. H. (2021) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2021.01.008 · Cited by 166
A primer to directed evolution: current methodologies and future directions
Vidal, L. S., Isalan, M., Heap, J. T., & Ledesma‐Amaro, R. (2023) · RSC Chemical Biology · doi:10.1039/d2cb00231k · Cited by 171
Leveraging Uncertainty in Machine Learning Accelerates Biological Discovery and Design
Hie, B., Bryson, B. D., & Berger, B. (2020) · Cell Systems · doi:10.1016/j.cels.2020.09.007 · Cited by 154
“21 M protein sequences) (Bepler and Berger, 2019) (STAR Methods).”
MethodSelf-citationHie, B., Yang, K., & Kim, P. S. (2022) · Cell Systems · doi:10.1016/j.cels.2022.01.003 · Cited by 151
Narayanan, H., Dingfelder, F., Butté, A., Lorenzen, N., Sokolov, M., & Arosio, P. (2021) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2020.12.004 · Cited by 151
Anticancer peptides prediction with deep representation learning features
Lv, Z., Cui, F., Zou, Q., Zhang, L., & Xu, L. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab008 · Cited by 145
Akiyama, M., & Sakakibara, Y. (2022) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqac012 · Cited by 148
Protein language model embeddings for fast, accurate, alignment-free protein structure prediction
Weissenow, K., Heinzinger, M., & Rost, B. (2021) · doi:10.1101/2021.07.31.454572 · Cited by 139
Chen, Z., Hou, C., Wang, L., Yu, C., Chen, T., Shen, B., Hou, Y., Li, P., & Li, T. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2115369119 · Cited by 134
Light attention predicts protein location from the language of life
Stärk, H., Dallago, C., Heinzinger, M., & Rost, B. (2021) · Bioinformatics Advances · doi:10.1093/bioadv/vbab035 · Cited by 130
FLIP: Benchmark tasks in fitness landscape inference for proteinsPreprint
Dallago, C., Mou, J., Johnston, K. E., Wittmann, B. J., Bhattacharya, N., Goldman, S., Madani, A., & Yang, K. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.09.467890 · Cited by 142
Villegas-Morcillo, A., Makrodimitris, S., van Ham, R. C. H. J., Gomez, A. M., Sanchez, V., & Reinders, M. J. T. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa701 · Cited by 122
Machine learning modeling of family wide enzyme-substrate specificity screens
Goldman, S., Das, R., Yang, K. K., & Coley, C. W. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009853 · Cited by 120
Adaptive machine learning for protein engineering
Hie, B., & Yang, K. (2021) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2021.11.002 · Cited by 125
A new age in protein design empowered by deep learning
Khakzad, H., Igashov, I., Schneuing, A., Goverde, C. A., Bronstein, M. M., & Correia, B. E. (2023) · Cell Systems · doi:10.1016/j.cels.2023.10.006 · Cited by 121
Contrastive learning on protein embeddings enlightens midnight zone
(2022) · doi:10.1093/nargab/lqac043 · Cited by 105
Li, L., Gupta, E., Spaeth, J., Shing, L., Jaimes, R., Engelhart, E., Lopez, R., Caceres, R. S., Bepler, T., & Walsh, M. E. (2023) · Nature Communications · doi:10.1038/s41467-023-39022-2 · Cited by 96
Self-citationUsing deep neural networks and biological subwords to detect protein S-sulfenylation sites
Do, D. T., Le, T. Q. T., & Le, N. Q. K. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa128 · Cited by 97
Qiu, Y., & Wei, G. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad289 · Cited by 90
CogMol: Target-Specific and Selective Drug Design for COVID-19 Using Deep Generative ModelsPreprint
Chenthamarakshan, V., Das, P., Hoffman, S. C., Strobelt, H., Padhi, I., Lim, K. W., Hoover, B., Manica, M., Born, J., Laino, T., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.01215 · Cited by 96
Novel machine learning approaches revolutionize protein knowledge
Bordin, N., Dallago, C., Heinzinger, M., Kim, S., Littmann, M., Rauer, C., Steinegger, M., Rost, B., & Orengo, C. (2023) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2022.11.001 · Cited by 72
Zhou, G., Chen, M., Ju, C. J. ‐., Wang, Z., Jiang, J., & Wang, W. W. (2020) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqaa015 · Cited by 70
Self-Supervised Contrastive Learning of Protein Representations By Mutual Information MaximizationPreprint
Lu, A. X., Zhang, H., Ghassemi, M., & Moses, A. M. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.09.04.283929 · Cited by 71
Connecting chemistry and biology through molecular descriptors
Fernández‐Torras, A., Comajuncosa-Creus, A., Duran‐Frigola, M., & Aloy, P. (2021) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2021.09.001 · Cited by 74
Zhu, Y., Zhang, C., Yu, D., & Zhang, Y. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010793 · Cited by 72
Deep contrastive learning enables genome-wide virtual screening
Jia, Y., Gao, B., Tan, J., Zheng, J., Hong, X., Zhu, W., Tan, H., Xiao, Y., Tan, L., Cai, H., et al. (2026) · Science · doi:10.1126/science.ads9530 · Cited by 66
Hoarfrost, A., Aptekmann, A. A., Farfañuk, G., & Bromberg, Y. (2022) · Nature Communications · doi:10.1038/s41467-022-30070-8 · Cited by 65
Cluster learning-assisted directed evolution
Qiu, Y., Hu, J., & Wei, G. (2021) · Nature Computational Science · doi:10.1038/s43588-021-00168-y · Cited by 63
Persistent spectral theory-guided protein engineering
(2023) · doi:10.1038/s43588-022-00394-y · Cited by 62
Boggust, A., Carter, B., & Satyanarayan, A. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511122 · Cited by 75
Deep learning frameworks for protein–protein interaction prediction
Hu, X., Feng, C., Ling, T., & Chen, M. (2022) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2022.06.025 · Cited by 61
End-to-end learning of multiple sequence alignments with differentiable Smith–Waterman
Petti, S., Bhattacharya, N., Rao, R., Dauparas, J., Thomas, N., Zhou, J., Rush, A. M., Koo, P., & Ovchinnikov, S. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btac724 · Cited by 54
Pre-Training of Deep Bidirectional Protein Sequence Representations With Structural Information
Min, S., Park, S., Kim, S., Choi, H.-S., Lee, B., & Yoon, S. (2021) · IEEE Access · doi:10.1109/access.2021.3110269 · Cited by 59
SETH predicts nuances of residue disorder from protein embeddings
Ilzhöfer, D., Heinzinger, M., & Rost, B. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.1019597 · Cited by 52
Domain-Adversarial Network Alignment
Hong, H., Li, X., Pan, Y., & Tsang, I. W.-H. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3023589 · Cited by 52
Using machine learning to predict the effects and consequences of mutations in proteins
Diaz, D. J., Kulikova, A. V., Ellington, A. D., & Wilke, C. O. (2023) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2022.102518 · Cited by 54
Gunasekar, S. K., Xie, L., Kumar, A., Hong, J., Chheda, P. R., Chen, K., Kern, D. M., My-Ta, C., Maurer, J. M., Heebink, J., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28435-0 · Cited by 51
An analysis of protein language model embeddings for fold prediction
Villegas-Morcillo, A., Gomez, A. M., & Sanchez, V. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac142 · Cited by 46
Are protein language models the new universal key?
Weißenow, K., & Rost, B. (2025) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2025.102997 · Cited by 54
Geometry-Based Molecular Generation With Deep Constrained Variational Autoencoder
Li, C., Yao, J., Wei, W., Niu, Z., Zeng, X., Li, J., & Wang, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3147790 · Cited by 50
Nearest neighbor search on embeddings rapidly identifies distant protein relations
Schütze, K., Heinzinger, M., Steinegger, M., & Rost, B. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.1033775 · Cited by 41
ProtInteract: A deep learning framework for predicting protein–protein interactions
Soleymani, F., Paquet, E., Viktor, H. L., Michalowski, W., & Spinello, D. (2023) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.01.028 · Cited by 41
Pretraining model for biological sequence data
Song, B., Li, Z., Lin, X., Wang, J., Wang, T., & Fu, X. (2021) · Briefings in Functional Genomics · doi:10.1093/bfgp/elab025 · Cited by 37
Pre-trained Language Models in Biomedical Domain: A Systematic SurveyPreprint
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.05006 · Cited by 34
Structure-Based Protein Function Prediction using Graph Convolutional NetworksPreprint
Gligorijević, V., Renfrew, P. D., Kościółek, T., Leman, J. K., Berenberg, D., Vatanen, T., Chandler, C., Taylor, B. C., Fisk, I. M., Vlamakis, H. C., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/786236 · Cited by 33
Is Transfer Learning Necessary for Protein Landscape Prediction?Preprint
Shanehsazzadeh, A., Belanger, D., & Dohan, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.03443 · Cited by 62
Cai, T., Lim, H., Abbu, K. A., Qiu, Y., Nussinov, R., & Xie, L. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c01285 · Cited by 31
IAV-CNN: A 2D Convolutional Neural Network Model to Predict Antigenic Variants of Influenza A Virus
Yin, R., Thwin, N. N., Zhuang, P., Zhang, Y., Lin, Z., & Kwoh, C. K. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3108971 · Cited by 31
Li, S., Tian, T., Zhang, Z., Zou, Z., Zhao, D. Y., & Zeng, J. (2023) · Cell Systems · doi:10.1016/j.cels.2023.05.005 · Cited by 31
Medium-sized protein language models perform well at transfer learning on realistic datasets
Vieira, L. C., Handojo, M. L., & Wilke, C. O. (2025) · Scientific Reports · doi:10.1038/s41598-025-05674-x · Cited by 41
Approaching Optimal pH Enzyme Prediction with Large Language Models
Zaretckii, M., Buslaev, P., Kozlovskii, I., Morozov, A., & Popov, P. A. (2024) · ACS Synthetic Biology · doi:10.1021/acssynbio.4c00465 · Cited by 29
Functional Gene Network of Prenyltransferases in Arabidopsis thaliana
Kopcsayová, D., & Vranová, E. (2019) · Molecules · doi:10.3390/molecules24244556 · Cited by 28
Energy-based models for atomic-resolution protein conformationsPreprint
Du, Y., Meier, J., Ma, J., Fergus, R., & Rives, A. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13167 · Cited by 35
ProtMamba: a homology-aware but alignment-free protein state space model
Sgarbossa, D., Malbranke, C., & Bitbol, A.-F. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf348 · Cited by 27
Yan, Z., Ge, F., Liu, Y., Zhang, Y., Li, F., Song, J., & Yu, D. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c02019 · Cited by 25
Learning the language of protein-protein interactions
(2026) · doi:10.1038/s41467-025-67971-3 · Cited by 26
Self-citationDesign in the DARK: Learning Deep Generative Models for De Novo Protein Design
Moffat, L., Kandathil, S. M., & Jones, D. T. (2022) · doi:10.1101/2022.01.27.478087 · Cited by 25
Heinzinger, M., & Rost, B. (2025) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2025.102986 · Cited by 27
Lobo, F., González, M. S., Boto, A., & de la Lastra, J. M. P. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms241210270 · Cited by 26
Intrinsic-Extrinsic Convolution and Pooling for Learning on 3D Protein StructuresPreprint
Hermosilla, P., Schäfer, M., Lang, M., Fackelmann, G., Vázquez, P., Kozlíková, B., Krone, M., Ritschel, T., & Ropinski, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06252 · Cited by 54
Ghosh, S., & Mitra, P. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107955 · Cited by 24
Modeling coronavirus spike protein dynamics: implications for immunogenicity and immune escape
Kunkel, G., Madani, M., White, S. J., Verardi, P. H., & Tarakanova, A. (2021) · Biophysical Journal · doi:10.1016/j.bpj.2021.11.009 · Cited by 23
pLM4CPPs: Protein Language Model-Based Predictor for Cell Penetrating Peptides
Kumar, N., Du, Z., & Li, Y. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c01338 · Cited by 22
MutaGAN: A sequence-to-sequence GAN framework to predict mutations of evolving protein populations
Berman, D. S., Howser, C., Mehoke, T. S., Ernlund, A. W., & Evans, J. D. (2023) · Virus Evolution · doi:10.1093/ve/vead022 · Cited by 31
Proteome-scale analysis of phase-separated proteins in immunofluorescence images
Yu, C., Shen, B., You, K., Huang, Q., Shi, M., Wu, C., Chen, Y., Zhang, C., & Li, T. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa187 · Cited by 21
Assessing the role of evolutionary information for enhancing protein language model embeddings
Erckert, K., & Rost, B. (2024) · Scientific Reports · doi:10.1038/s41598-024-71783-8 · Cited by 21
Mul-SNO: A Novel Prediction Tool for S-Nitrosylation Sites Based on Deep Learning Methods
Zhao, Q., Ma, J., Wang, Y., Xie, F., Lv, Z., Xu, Y., Shi, H., & Han, K. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3123503 · Cited by 20
Transfer learning for predicting virus-host protein interactions for novel virus sequences
Lanchantin, J., Weingarten, T., Sekhon, A., Miller, C. L., & Qi, Y. (2021) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3459930.3469527 · Cited by 20
Improving the topology prediction of α-helical transmembrane proteins with deep transfer learning
Wang, L., Zhong, H., Xue, Z., & Wang, Y. (2022) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2022.04.024 · Cited by 20
Function-guided protein design by deep manifold samplingPreprint
Gligorijević, V., Berenberg, D., Ra, S., Watkins, A. M., Kelow, S. P., Cho, K., & Bonneau, R. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.12.22.473759 · Cited by 25
Wee, J., Chen, J., Xia, K., & Wei, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.107918 · Cited by 20
Protein Representation Learning via Knowledge Enhanced Primary Structure ModelingPreprint
Zhou, H.-Y., Fu, Y., Zhang, Z., Bian, C., & Yu, Y. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.26.525795 · Cited by 27
Super High-Throughput Screening of Enzyme Variants by Spectral Graph Convolutional Neural Networks
Ramírez-Palacios, C., & Marrink, . J. (2023) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.2c01227 · Cited by 18
On the application of artificial intelligence in virtual screening
Thaingtamtanha, T., Ravichandran, R., & Gentile, F. (2025) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2025.2508866 · Cited by 18
Metadata
- Authors
- Bepler, T., & Berger, B.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Volume
- 2019
- Pages
- 3162-3178
- arXiv
- 1902.08661
- PMC
- PMC12947628
- OpenAlex
- W2909727437
- Cited by
- 219
- References
- 0
- Citations by year
- 2026: 4 · 2025: 29 · 2024: 25 · 2023: 29 · 2022: 47 · 2021: 46 · 2020: 33 · 2019: 6
- FWCI
- 100.20
- Type
- conference paper
- Language
- en
- Open access
- green
- pmc.ncbi.nlm.nih.gov
- Locations
- PubMed (publishedVersion)
- PubMed Central (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Institute of General Medical Sciences (R01GM081871)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Keywords
- protein sequence embeddings, protein structural similarity, sequence similarity measures, bidirectional LSTM, multi-task learning, transmembrane domain prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review