The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.
Learning protein sequence embeddings using information from structure
Open accessAbstract
Inferring the structural properties of a protein from its amino acid sequence is a challenging yet important problem in biology. Structures are not known for the vast majority of protein sequences, but structure is critical for understanding function. Existing approaches for detecting structural similarity between proteins from sequence are unable to recognize and exploit structural patterns when sequences have diverged too far, limiting our ability to transfer knowledge between structurally related proteins. We newly approach this problem through the lens of representation learning. We introduce a framework that maps any protein sequence to a sequence of vector embeddings --- one per amino acid position --- that encode structural information. We train bidirectional long short-term memory (LSTM) models on protein sequences with a two-part feedback mechanism that incorporates information from (i) global structural similarity between proteins and (ii) pairwise residue contact maps for individual proteins. To enable learning from structural similarity information, we define a novel similarity measure between arbitrary-length sequences of vector embeddings based on a soft symmetric alignment (SSA) between them. Our method is able to learn useful position-specific embeddings despite lacking direct observations of position-level correspondence between sequences. We show empirically that our multi-task framework outperforms other sequence-based methods and even a top-performing structure-based alignment method when predicting structural similarity, our goal. Finally, we demonstrate that our learned embeddings can be transferred to other protein sequence problems, improving the state-of-the-art in transmembrane domain prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, the multi-task learning approach outperforms a two-step learning approach presented previously (SSA-LSTM)27.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“Learned protein representations improve predictive ability for downstream prediction problems through transfer learning (Figure 5a).”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“They also learn summary representations, powerful features that can be used to better capture sequence relationships and link sequence to function via transfer learning 27,28,32-35.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“New work has since shown that the representations learned by language models are also powerful features for learning of variant fitness as a subsequent supervised learning task 32,34, building on earlier observations that language models can improve protein property prediction through transfer learning 27.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
In the citing paper
“The key insight was that the sequence representations (vector embeddings) learned by the language model were powerful features for solving other prediction problems.”
From Learning the protein language: Evolution, structure, and function (2021) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Sorted by citations
Items 101–200 of 221
Protein Structural Alignments From SequencePreprint
Morton, J. T., Strauss, C. E. M., Blackwell, R., Berenberg, D., Gligorijević, V., & Bonneau, R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.11.03.365932 · Cited by 17
TM-Vec: template modeling vectors for fast homology detection and alignmentPreprint
Hamamsy, T., Morton, J. T., Berenberg, D., Carriero, N. J., Gligorijević, V., Blackwell, R., Strauss, C. E. M., Leman, J. K., Cho, K., & Bonneau, R. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.07.25.501437 · Cited by 16
Foundation models of protein sequences: A brief overview
Bjerregaard, A., Groth, P. M., Hauberg, S., Krogh, A., & Boomsma, W. (2025) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2025.103004 · Cited by 16
Protein sequence profile prediction using ProtAlbert transformer
Behjati, A., Zare‐Mirakabad, F., Arab, S. S., & Nowzari-Dalini, A. (2022) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2022.107717 · Cited by 22
Recent developments of sequence-based prediction of protein–protein interactions
Murakami, Y., & Mizuguchi, K. (2022) · Biophysical Reviews · doi:10.1007/s12551-022-01038-1 · Cited by 16
Improving protein fold recognition using triplet network and ensemble deep learning
Liu, Y., Han, K., Zhu, Y., Zhang, Y., Shen, L.-C., Song, J., & Yu, D. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab248 · Cited by 16
Application of Sequence Embedding in Protein Sequence-Based Predictions
Ibtehaz, N., & Kihara, D. (2022) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789811258589_0002 · Cited by 18
Enhancing cryo-EM structure prediction with DeepTracer and AlphaFold2 integration
Chen, J., Zia, A., Luo, A., Meng, H., Wang, F., Hou, J., Cao, R., & Si, D. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae118 · Cited by 19
Capturing Protein Domain Structure and Function Using Self-Supervision on Domain Architectures
Melidis, D. P., Malone, B., & Nejdl, W. (2021) · Algorithms · doi:10.3390/a14010028 · Cited by 15
Wang, Q., Wang, B., Xu, Z., Wu, J., Zhao, P., Li, Z., Wang, S., Huang, J., & Cui, S. R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16141 · Cited by 18
AffinityVAE: A multi-objective model for protein-ligand affinity prediction and drug design
Wang, M., Li, W., Xiao, Y., Luo, Y., Han, K., Wang, C., & Jin, Q. (2023) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2023.107971 · Cited by 15
Learning the Language of Antibody HypervariabilityPreprint
Singh, R., Im, C., Qiu, Y., Mackness, B. C., Gupta, A., Sorenson, T., Sledzieski, S., Erlach, L., Wendt, M., Fomekong‐Nanfack, Y., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.04.26.538476 · Cited by 16
Self-citationMulti-dimensional metagenomics
Peng, H., Ruiz-Moreno, A. J., & Fu, J. (2025) · Nature Reviews Bioengineering · doi:10.1038/s44222-025-00346-x · Cited by 19
Encoding protein dynamic information in graph representation for functional residue identification
Chiang, Y., Hui, W.-H., & Chang, S. (2022) · Cell Reports Physical Science · doi:10.1016/j.xcrp.2022.100975 · Cited by 13
Evaluating Autoencoder-Based Featurization and Supervised Learning for Protein Decoy Selection
Alam, F. F., Rahman, T., & Shehu, A. (2020) · Molecules · doi:10.3390/molecules25051146 · Cited by 14
Profile Prediction: An Alignment-Based Pre-Training Task for Protein Sequence ModelsPreprint
Sturmfels, P., Vig, J., Madani, A., & Rajani, N. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.00195 · Cited by 16
Filipavicius, M., Manica, M., Cadow, J., & Martínez, M. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03084 · Cited by 25
Zhang, L., & Liu, T. (2024) · International Journal of Biological Macromolecules · doi:10.1016/j.ijbiomac.2024.135762 · Cited by 14
Mansoor, S., Baek, M., Madan, U., & Horvitz, E. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.09.01.458592 · Cited by 12
Adapting protein language models for rapid DTI predictionPreprint
Sledzieski, S., Singh, R., Cowen, L., & Berger, B. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.03.515084 · Cited by 13
Self-citationDeep learning models for unbiased sequence-based PPI prediction plateau at an accuracy of 0.65
Reim, T., Hartebrodt, A., Blumenthal, D. B., Bernett, J., & List, M. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf192 · Cited by 12
Protein–Protein Interaction Prediction Model Based on ProtBert-BiGRU-Attention
Gao, Q., Zhang, C., Li, M., & Yu, T. (2024) · Journal of Computational Biology · doi:10.1089/cmb.2023.0297 · Cited by 12
Kilinc, M., Jia, K., & Jernigan, R. L. (2025) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2025.102984 · Cited by 15
Predicting the Disease Risk of Protein Mutation Sequences With Pre-training Model
Li, K., Zhong, Y., Lin, X., & Quan, Z. (2020) · Frontiers in Genetics · doi:10.3389/fgene.2020.605620 · Cited by 12
SPRoBERTa: protein embedding learning with local fragment modeling
Wu, L., Yin, C., Zhu, J., Wu, Z., He, L., Xia, Y., Xie, S., Qin, T., & Liu, T. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac401 · Cited by 12
Domain Extrapolation via Regret Minimization.Preprint
Jin, W., Barzilay, R., & Jaakkola, T. (2020) · arXiv (Cornell University) · Cited by 13
Do domain-specific protein language models outperform general models on immunology-related tasks?
Deutschmann, N., Pélissier, A., Weber, A., Gao, S., Bogojeska, J., & Martínez, M. R. (2024) · ImmunoInformatics · doi:10.1016/j.immuno.2024.100036 · Cited by 13
Predictive and therapeutic applications of protein language models
Furui, K., Sakano, K., & Ohue, M. (2025) · Allergology International · doi:10.1016/j.alit.2025.08.004 · Cited by 12
ProteinGLUE multi-task benchmark suite for self-supervised protein modeling
Capel, H., Weiler, R., Dijkstra, M., Vleugels, R., Bloem, P., & Feenstra, K. A. (2022) · Scientific Reports · doi:10.1038/s41598-022-19608-4 · Cited by 11
The applications of machine learning in HIV neutralizing antibodies research—A systematic review
Dănăilă, V.-R., Avram, S., & Buiu, C. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102429 · Cited by 12
Multi-Scale Representation Learning on Proteins
Somnath, V. R., Bunne, C., & Krause, A. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.8102782 · Cited by 11
Molecular sequence classification using efficient kernel based embedding
Ali, S., Ali, T. E., Murad, T., Mansoor, H., & Patterson, M. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121100 · Cited by 11
PROVAL: A framework for comparison of protein sequence embeddings
Väth, P., Münch, M., Raab, C., & Schleif, F.-M. (2022) · Journal of Computational Mathematics and Data Science · doi:10.1016/j.jcmds.2022.100044 · Cited by 11
Wang, Q., Wei, J. S., Zhou, Y., Lin, M., Ren, R., Wang, S., Cui, S. R., & Li, Z. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac351 · Cited by 12
Abdollahi, S., Lin, P., & Chiang, J.-H. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3093441 · Cited by 10
Subspace projection-based weighted echo state networks for predicting therapeutic peptides
Guo, X., Tiwari, P., Zou, Q., & Ding, Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110307 · Cited by 10
Neural Potts ModelPreprint
Sercu, T., Verkuil, R., Meier, J., Amos, B., Lin, Z., Chen, C., Liu, J. J., LeCun, Y., & Rives, A. W. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.08.439084 · Cited by 10
Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language ModelPreprint
He, L., Zhang, S., Wu, L., Xia, H., Ju, F., Zhang, H., Liu, S., Xia, Y., Zhu, J., Deng, P., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15527 · Cited by 35
Exploration of protein sequence embeddings for protein-ligand binding site detection
Hoksza, D., & Gamouh, H. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995025 · Cited by 8
Ensemble Machine Learning and Predicted Properties Promote Antimicrobial Peptide Identification
Zhong, G., Liu, H., & Deng, L. (2024) · Interdisciplinary Sciences Computational Life Sciences · doi:10.1007/s12539-024-00640-z · Cited by 9
Classifying alkaliphilic proteins using embeddings from protein language model
Susanty, M., Mursalim, M. K. N., Hertadi, R., Purwarianti, A., & Mengko, T. L. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108385 · Cited by 10
Efficient and accurate sequence generation with small-scale protein language modelsPreprint
Serrano, Y., Rodà, S., Guallar, V., & Molina, A. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.08.04.551626 · Cited by 8
Learning supervised embeddings for large scale sequence comparisons
Kimothi, D., Biyani, P., Hogan, J. M., Soni, A., & Kelly, W. (2020) · PLoS ONE · doi:10.1371/journal.pone.0216636 · Cited by 7
Evaluation of Methods for Protein Representation Learning: A Quantitative AnalysisPreprint
Ünsal, S., Ataş, H., Albayrak, M., Turhan, K., Acar, A. C., & Doğan, T. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.10.28.359828 · Cited by 7
Hydrogen bonds meet self-attention: all you need for general-purpose protein structure embeddingPreprint
Chen, C., Zha, Y., Zhu, D., Ning, K., & Cui, X. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.31.428935 · Cited by 6
fastMSA: Accelerating Multiple Sequence Alignment with Dense Retrieval on Protein LanguagePreprint
Hong, L., Sun, S., Zheng, L., Tan, Q., & Li, Y. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.12.20.473431 · Cited by 9
When Geometric Deep Learning Meets Pretrained Protein Language ModelsPreprint
Wu, F., Tao, Y., Radev, D., & Xu, J. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.01.05.522958 · Cited by 7
Majila, K., Ullanat, V., & Viswanath, S. (2026) · Cell Systems · doi:10.1016/j.cels.2025.101486 · Cited by 8
Smart de novo Macromolecular Structure Modeling from Cryo-EM Maps
Si, D., Chen, J., Nakamura, A., Chang, L., & Guan, H. (2023) · Journal of Molecular Biology · doi:10.1016/j.jmb.2023.167967 · Cited by 6
Annotating Gene Ontology terms for protein sequences with the Transformer modelPreprint
Duong, D., Gai, L., Uppunda, A., Le, D. Q., Eskin, E., Li, J. J., & Chang, K.-W. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.01.31.929604 · Cited by 6
Evolution Is All You Need: Phylogenetic Augmentation for Contrastive LearningPreprint
Lu, A. X., Lu, A. X., & Moses, A. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.13475 · Cited by 17
Liu, D., Song, T., & Wang, S.-D. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.11.050 · Cited by 5
ThermoFinder: A sequence-based thermophilic proteins prediction framework
Yu, H., & Luo, X. (2024) · International Journal of Biological Macromolecules · doi:10.1016/j.ijbiomac.2024.132469 · Cited by 5
Lv, Z., Wei, M., Pei, H., Peng, S., Li, M., & Jiang, L. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109598 · Cited by 5
Deep learning methods for proteome-scale interaction prediction
Yoon, M. S., Bae, B., Kim, K. H., Park, H., & Baek, M. (2025) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2024.102981 · Cited by 6
Mazrooei, P., O’Neil, D., Izadi, S., Chen, B., & Ramanujan, S. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.06.08.597997 · Cited by 6
Pre-trained Language Models for Decoding Protein Language: a Survey
Amjad, M., Munir, A., Zia, U., & Paracha, R. Z. (2024) · International Conference on Digital Futures and Transformative Technologies (ICoDT2) · doi:10.1109/icodt262145.2024.10740205 · Cited by 4
A Benchmarking Platform for Assessing Protein Language Models on Function-Related Prediction Tasks
Çevrim, E., Yiğit, M. G., Ulusoy, E., Yılmaz, A., & Doğan, T. (2025) · Methods in molecular biology · doi:10.1007/978-1-0716-4662-5_14 · Cited by 7
Guo, X., Qian, Y., Tiwari, P., Zou, Q., & Ding, Y. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9994902 · Cited by 4
A Transferability-Based Method for Evaluating the Protein Representation Learning
Hu, F., Zhang, W., Huang, H., Wang, L., Li, Y., & Yin, P. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3370680 · Cited by 4
TMVisDB: Annotation and 3D-visualization of Transmembrane Proteins
Olenyi, T., Marquet, C., Grekova, A., Houri, L., Heinzinger, M., Dallago, C., & Rost, B. (2025) · Journal of Molecular Biology · doi:10.1016/j.jmb.2025.168997 · Cited by 4
Deep Learning Proteins using a Triplet-BERT network
Lennox, M., Robertson, N. M., & Devereux, B. J. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630387 · Cited by 4
Hydrogen bonds meet self-attention: all you need for protein structure embedding
Chen, C., Zha, Y., Zhu, D., Ning, K., & Cui, X. (2021) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm52615.2021.9669557 · Cited by 5
Zhao, J., Zhang, C., & Luo, Y. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.02.11.579859 · Cited by 7
Artificial Intelligence Learns Protein PredictionPreprint
Heinzinger, M., & Rost, B. (2024) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a041458 · Cited by 4
Li, J., Chen, X., Huang, H., Zeng, M., Yu, J., Gong, X., & Ye, Q. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf120 · Cited by 4
Liu, M., Jin, S., Lai, H., Wang, L., Wang, J., Cheng, Z., & Zeng, X. (2025) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbbio.2025.3558959 · Cited by 3
Integration of Time Series Embedding for Efficient Retrieval in Case-Based Reasoning
Weich, J., Schultheis, A., Hoffmann, M., & Bergmann, R. (2025) · International Conference on Case-Based Reasoning · doi:10.1007/978-3-031-96559-3_22 · Cited by 4
(2020) · neural information processing systems · Cited by 3
Self-citationinACP: An integrated approach to the prediction of anticancer peptides
Zhong, G., & Deng, L. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995361 · Cited by 3
EGGNet, a Generalizable Geometric Deep Learning Framework for Protein Complex Pose Scoring
Wang, Z., Brand, R., Adolf-Bryfogle, J., Grewal, J., Qi, Y., Combs, S. A., Golovach, N., Alford, R., Rangwala, H., & Clark, P. M. (2024) · ACS Omega · doi:10.1021/acsomega.3c04889 · Cited by 3
Zhang, L., Wang, S., Wang, Y., & Zhao, T. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae724 · Cited by 3
Prabakaran, R., & Bromberg, Y. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf035 · Cited by 5
RAG-ESM: Improving Pretrained Protein Language Models via Sequence Retrieval
Sgarbossa, D., & Bitbol, A.-F. (2025) · PRX Life · doi:10.1103/db1b-hy16 · Cited by 3
ContactLib-ATT: A Structure-Based Search Engine for Homologous Proteins
Chen, C., Zha, Y., Zhu, D., Ning, K., & Cui, X. (2022) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2022.3197802 · Cited by 3
A deep learning framework for elucidating whole-genome chemical interaction spacePreprint
Cai, T., Lim, H., Abbu, K. A., Qiu, Y., Nussinov, R., & Xie, L. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.10.08.332346 · Cited by 2
RFRSN: Improving protein fold recognition by siamese networkPreprint
Han, K., Liu, Y., & Yu, D.-J. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.27.441698 · Cited by 3
Wang, Z., Combs, S. A., Brand, R. M., Calvo, M. R., Xu, P., Price, G., Golovach, N., Salawu, E. O., Wise, C. J., Ponnapalli, S. P., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.09.21.460852 · Cited by 3
Learning a CoNCISE language for small-molecule bindingPreprint
Erden, M., Devkota, K., Varghese, L., Cowen, L., & Singh, R. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.08.632039 · Cited by 5
Rofougaran, R., Wang, R. C., Ajagekar, A., & You, F. (2025) · Quantum Science and Technology · doi:10.1088/2058-9565/adb3c7 · Cited by 2
PointListNet: Deep Learning on 3D Point Lists
Fan, H., Zhu, L., Yang, Y., & Kankanhalli, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01697 · Cited by 2
Cai, T., Lim, H., Abbu, K. A., Qiu, Y., Nussinov, R., & Xie, L. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.04.236729 · Cited by 2
Zhu, Y., & Yu, D. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.05.30.542787 · Cited by 2
Do Domain-Specific Protein Language Models Outperform General Models on Immunology-Related Tasks?Preprint
Deutschmann, N., Pélissier, A., Weber, A., Gao, S., Bogojeska, J., & Martínez, M. R. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.10.17.562795 · Cited by 4
Ye, Q., li, J., Chen, X., Huang, H., Zeng, M., Yu, J., & Gong, X. (2024) · Research Square · doi:10.21203/rs.3.rs-4647798/v1 · Cited by 2
Protein Sequence Feature Extraction Techniques: Research Advances, Progress, and Applications
Wan, X. (2025) · Biomedical engineering · doi:10.5772/intechopen.1009540 · Cited by 1
A Survey of Pretrained Protein Language Models
Pokharel, S., Pratyush, P., Chaudhari, M., Heinzinger, M., Caragea, D., Saigo, H., & KC, D. B. (2025) · Methods in molecular biology · doi:10.1007/978-1-0716-4623-6_1 · Cited by 1
LMProtein: a protein language model based framework for protein structural property prediction
Yuan, Y., Luo, H., & Tian, Y. (2025) · Physical Chemistry Chemical Physics · doi:10.1039/d5cp01861g · Cited by 1
Wei, A., & Wang, L. (2022) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3535508.3545550 · Cited by 1
Qin, X., Liu, M., & Liu, G. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107571 · Cited by 2
Wang, Q., Wei, J., Wang, B., Li, Z., Wang, S., & Cui, S. R. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/490 · Cited by 1
A Review of Protein Structure Prediction using Deep Learning
Susanty, M., Rajab, T. L. E., & Hertadi, R. (2021) · BIO Web of Conferences · doi:10.1051/bioconf/20214104003 · Cited by 1
ProtTox: Toxin identification from Protein SequencesPreprint
Muthiah, S., Datta, D., Islam, M. R., Butler, P. J., Warren, A. S., & Ramakrishnan, N. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.04.18.048439 · Cited by 1
Meta-analysis on the lethality of influenza A viruses using machine learning approaches
Yin, R. (2020) · doi:10.32657/10356/140723 · Cited by 1
Li, S., Tian, T., Zhang, Z., Zou, Z., Zhao, D. Y., & Zeng, J. (2022) · Research Square · doi:10.21203/rs.3.rs-1583468/v1 · Cited by 1
Contrasting drugs from decoysPreprint
Sledzieski, S., Singh, R., Cowen, L., & Berger, B. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.03.515086 · Cited by 1
Self-citationOpinion piece/Book chapter: Artificial Intelligence learns protein predictionPreprint
Heinzinger, M., & Rost, B. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/n7wfp · Cited by 1
A Deep Learning Method for Predicting Interactions for Intrinsically Disordered Regions of ProteinsPreprint
Majila, K., Ullanat, V., & Viswanath, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5133412 · Cited by 1
Refinement of protein structure via contact based potentials in replica exchange simulationsPreprint
Voronin, A., Weiel, M., & Schug, A. H. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.02.14.949172
Fixed-Length Protein Embeddings using Contextual LensesPreprint
Shanehsazzadeh, A., Belanger, D., & Dohan, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.15065
Metadata
- Authors
- Bepler, T., & Berger, B.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Volume
- 2019
- Pages
- 3162-3178
- arXiv
- 1902.08661
- PMC
- PMC12947628
- OpenAlex
- W2909727437
- Cited by
- 219
- References
- 0
- Citations by year
- 2026: 4 · 2025: 29 · 2024: 25 · 2023: 29 · 2022: 47 · 2021: 46 · 2020: 33 · 2019: 6
- FWCI
- 100.20
- Type
- conference paper
- Language
- en
- Open access
- green
- pmc.ncbi.nlm.nih.gov
- Locations
- PubMed (publishedVersion)
- PubMed Central (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Institute of General Medical Sciences (R01GM081871)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Keywords
- protein sequence embeddings, protein structural similarity, sequence similarity measures, bidirectional LSTM, multi-task learning, transmembrane domain prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
