PIPENN-EMB: ensemble net and protein embeddings generalise protein interface prediction beyond homology
Open accessPreprint — published as 10.1038/s41598-025-88445-y · Paper page
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Protein interactions are crucial for understanding biological functions and disease mechanisms, but predicting these remains a complex task in computational biology. Increasingly, Deep Learning models are having success in interface prediction. This study presents PIPENN-EMB which explores the added value of using embeddings from the ProtT5-XL protein language model. Our results show substantial improvement over the previously published PIPENN model for protein interaction interface prediction, reaching an MCC of 0.313 vs. 0.249, and AUC-ROC 0.800 vs. 0.755 on the BIO_DL_TE test set. We furthermore show that these embeddings cover a broad range of ‘hand-crafted’ protein features in ablation studies. PIPENN-EMB reaches state-of-the-art performance on the ZK448 dataset for protein-protein interface prediction. We showcase predictions on 25 resistance-related proteins from Mycobacterium tuberculosis . Furthermore, whereas other state-of-the-art sequence-based methods perform worse for proteins that have little recognisable homology in their training data, PIPENN-EMB generalises to remote homologs, yielding stable AUC-ROC across all three test sets with less than 30% sequence identity to the training dataset, and even to proteins with less than 15% sequence identity. Availability: Webserver, source code and datasets at www.ibi.vu.nl/programs/pipennemb/
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
BLAST+: architecture and applications
Camacho, C., Coulouris, G., Avagyan, V., Ma, N., Papadopoulos, J., Bealer, K., & Madden, T. L. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-421 · Cited by 22,074
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Highly accurate protein structure prediction for the human proteome
Tunyasuvunakool, K., Adler, J., Wu, Z., Green, T., Zielinski, M., Žídek, A., Bridgland, A., Cowie, A., Meyer, C., Laydon, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03828-1 · Cited by 3,025
Principles of protein-protein interactions
Jones, S., & Thornton, J. M. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.1.13 · Cited by 2,684
ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
Elnaggar, A., Heinzinger, M., Dallago, C., Rehawi, G., Wang, Y., Jones, L., Gibbs, T., Feher, T., Angerer, C., Steinegger, M., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3095381 · Cited by 2,329
Ensemble deep learning: A review
Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105151 · Cited by 2,143
No evidence that carotenoid pigments boost either immune or antioxidant defenses in a songbird
Koch, R. E., Kavazis, A. N., Hasselquist, D., Hood, W. R., Zhang, Y., Toomey, M. B., & Hill, G. E. (2018) · Nature Communications · doi:10.1038/s41467-018-02974-x · Cited by 1,924
UniRef: comprehensive and non-redundant UniProt reference clusters
Suzek, B. E., Huang, H., McGarvey, P., Mazumder, R., & Wu, C. H. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm098 · Cited by 1,613
Small molecules, big targets: drug discovery faces the protein–protein interaction challenge
Scott, D. E., Bayly, A. R., Abell, C., & Skidmore, J. (2016) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2016.29 · Cited by 1,137
ProteinBERT: a universal deep-learning model of protein sequence and function
Brandes, N., Ofer, D., Peleg, Y., Rappoport, N., & Linial, M. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac020 · Cited by 1,009 · cited 2×
“Transfer learning techniques, such as using embeddings, leverage a self-supervised learning approach to learn powerful representation of proteins at the amino acid level 20,25 .”
BackgroundMalhotra, A., Walle, M., Paul, G. R., Kuhn, G. A., & Müller, R. (2021) · Scientific Reports · doi:10.1038/s41598-021-81132-8 · Cited by 828
Modeling aspects of the language of life through transfer-learning protein sequences
Heinzinger, M., Elnaggar, A., Wang, Y., Dallago, C., Nechaev, D., Matthes, F., & Rost, B. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-3220-8 · Cited by 606 · cited 1×
“Protein Language Models (PLMs) extend the concepts of Natural Language Processing (NLP) language models to the realm of protein sequences: amino acids are treated as tokens (cf. words in NLP), and entire protein sequences are regarded as sentences 20,35 .”
BackgroundQuantifying the local adaptive landscape of a nascent bacterial community
Ascensao, J. A., Wetmore, K. M., Good, B. H., Arkin, A. P., & Hallatschek, O. (2023) · Nature Communications · doi:10.1038/s41467-022-35677-5 · Cited by 447
Comprehensive characterization of protein–protein interactions perturbed by disease mutations
Cheng, F., Zhao, J., Wang, Y., Lu, W., Liu, Z., Zhou, Y., Martin, W. R., Wang, R., Huang, J., Hao, T., et al. (2021) · Nature Genetics · doi:10.1038/s41588-020-00774-y · Cited by 227
Computational prediction of protein interfaces: A review of data driven methods
Xue, L. C., Dobbs, D., Bonvin, A. M. J. J., & Honavar, V. (2015) · FEBS Letters · doi:10.1016/j.febslet.2015.10.003 · Cited by 194
AlphaFold heralds a data-driven revolution in biology and medicine
Thornton, J. M., Laskowski, R. A., & Borkakoti, N. (2021) · Nature Medicine · doi:10.1038/s41591-021-01533-0 · Cited by 185
Embeddings from deep learning transfer GO annotations beyond homology
Littmann, M., Heinzinger, M., Dallago, C., Olenyi, T., & Rost, B. (2021) · Scientific Reports · doi:10.1038/s41598-020-80786-0 · Cited by 175
Progress and challenges in predicting protein-protein interaction sites
Ezkurdia, I., Bartoli, L., Fariselli, P., Casadio, R., Valencia, A., & Tress, M. L. (2008) · Briefings in Bioinformatics · doi:10.1093/bib/bbp021 · Cited by 169
DELPHI: accurate deep ensemble model for protein interaction sites prediction
Li, Y., Golding, G. B., & Ilie, L. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa750 · Cited by 162
The impact of AlphaFold2 one year on
Jones, D. T., & Thornton, J. M. (2022) · Nature Methods · doi:10.1038/s41592-021-01365-3 · Cited by 159
Zhang, J., & Kurgan, L. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz324 · Cited by 157
Identification of Protein Interactions Involved in Cellular Signaling
Westermarck, J., Ivaska, J., & Corthals, G. L. (2013) · Molecular & Cellular Proteomics · doi:10.1074/mcp.r113.027771 · Cited by 143
Villegas-Morcillo, A., Makrodimitris, S., van Ham, R. C. H. J., Gomez, A. M., Sanchez, V., & Reinders, M. J. T. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa701 · Cited by 123
Review and comparative assessment of sequence-based predictors of protein-binding residues
Zhang, J., & Kurgan, L. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx022 · Cited by 118
A Transformer-Based Ensemble Framework for the Prediction of Protein–Protein Interaction Sites
Mou, M., Pan, Z., Zhou, Z., Zheng, L., Zhang, H., Shi, S., Li, F., Sun, X., & Zhu, F. (2023) · Research · doi:10.34133/research.0240 · Cited by 117
Improved Protein Structure Prediction Using a New Multi‐Scale Network and Homologous Templates
Su, H., Wang, W., Du, Z., Peng, Z., Gao, S., Cheng, M., & Yang, J. (2021) · Advanced Science · doi:10.1002/advs.202102592 · Cited by 108
Contrastive learning on protein embeddings enlightens midnight zone
(2022) · doi:10.1093/nargab/lqac043 · Cited by 105
Predicting protein-ligand binding residues with deep convolutional neural networks
Cui, Y., Dong, Q., Hong, D., & Wang, X. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2672-1 · Cited by 95
PDBe-KB: collaboratively defining the biological context of structural data
PDBe-KB consortium, Varadi, M., Anyango, S., Armstrong, D., Berrisford, J., Choudhary, P., Deshpande, M., Nadzirin, N., Nair, S. S., Pravda, L., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab988 · Cited by 82
Impact of AlphaFold on structure prediction of protein complexes: The CASP15‐CAPRI experiment
Lensink, M. F., Brysbaert, G., Raouraoua, N., Bates, P. A., Giulini, M., Honorato, R. V., van Noort, C., Teixeira, J. M. C., Bonvin, A. M. J. J., Kong, R., et al. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26609 · Cited by 77
Deep graph learning of inter-protein contacts
Xie, Z., & Xu, J. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab761 · Cited by 67
Gao, M., Callari, M., Beddowes, E., Sammut, S.-J., Grzelak, M., Biggs, H., Jones, L., Boumertit, A., Linn, S. C., Cortes, J., et al. (2019) · Genome Medicine · doi:10.1186/s13073-018-0611-9 · Cited by 66
Combining structure and genomics to understand antimicrobial resistance
Tunstall, T., Portelli, S., Phelan, J. E., Clark, T. G., Ascher, D. B., & Furnham, N. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.10.017 · Cited by 35
Amalgamation of 3D structure and sequence information for protein–protein interaction prediction
Jha, K., & Saha, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-75467-x · Cited by 34
Pitfalls of machine learning models for protein–protein interaction networks
Lannelongue, L., & Inouye, M. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae012 · Cited by 27
Seq-InSite: sequence supersedes structure for protein interaction site prediction
Hosseini, S., Golding, G. B., & Ilie, L. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btad738 · Cited by 26
PIPENN: protein interface prediction from sequence with an ensemble of neural nets
Stringer, B., de Ferrante, H. C., Abeln, S., Heringa, J., Feenstra, K. A., & Haydarlou, R. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac071 · Cited by 25
Self-citationTen quick tips for sequence-based prediction of protein properties using machine learning
Hou, Q., Waury, K., Gogishvili, D., & Feenstra, K. A. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010669 · Cited by 24
Self-citationSingh, P., Jamal, S., Ahmed, F., Saqib, N., Mehra, S., Ali, W., Roy, D., Ehtesham, N. Z., & Hasnain, S. E. (2021) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2021.04.034 · Cited by 23
End-to-end multitask learning, from protein language to protein features without alignmentsPreprint
Elnaggar, A., Heinzinger, M., Dallago, C., & Rost, B. (2019) · bioRxiv · doi:10.1101/864405 · Cited by 19
Editorial: [Hot Topics: Toward the Design of Drugs on Protein-Protein Interactions]
Spérandio, O. (2012) · Current Pharmaceutical Design · doi:10.2174/138161212802651661 · Cited by 17
Multi-task learning to leverage partially annotated data for PPI interface prediction
Capel, H., Feenstra, K. A., & Abeln, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-13951-2 · Cited by 13
Self-citationCodon language embeddings provide strong signals for protein engineeringPreprint
Outeiral, C., & Deane, C. M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.15.519894 · Cited by 12
ProteinGLUE multi-task benchmark suite for self-supervised protein modeling
Capel, H., Weiler, R., Dijkstra, M., Vleugels, R., Bloem, P., & Feenstra, K. A. (2022) · Scientific Reports · doi:10.1038/s41598-022-19608-4 · Cited by 11
Self-citationAAA ATPase protein–protein interactions as therapeutic targets in cancer
Mannar, D., Ahmed, S., & Subramaniam, S. (2023) · Current Opinion in Cell Biology · doi:10.1016/j.ceb.2023.102291 · Cited by 10
Rodrigues, C. H. M., & Ascher, D. B. (2023) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.26615 · Cited by 9
Liver and brain differential expression of one-carbon metabolism genes during ontogenesis
Imbard, A., Schwendimann, L., Lebon, S., Gressèns, P., Blom, H. J., & Benoist, J. (2021) · Scientific Reports · doi:10.1038/s41598-021-00311-9 · Cited by 9
Research works printed but not linked: 4
- 10.1093/bioinformatics/005 · doi:10.1093/bioinformatics/005
- 10.3389/FMOLB.2021.619403/BIBTEX · doi:10.3389/fmolb.2021.619403/bibtex
- 2014, SPRINGS: Prediction of Protein-Protein Interaction Sites Using Artificial Neural Networks, J Proteom & Comput. Biol, 1, 7
- 10.1038/s41586-021-03819-2 · DOI · Paper page
Metadata
- Authors
- Thomas, D. P. G., Garcia Fernandez, C. M., Haydarlou, R., & Feenstra, K. A.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Haydarlou, Reza
- Feenstra, K. Anton
- Venue
- Scientific Reports
- Publisher
- openRxiv
- Published
- 2024-11-02
- Volume
- 15
- Issue
- 1
- Pages
- 4391-4391
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC11799512
- OpenAlex
- W4407153268
- Cited by
- 4
- References
- 49
- Citations by year
- 2026: 4
- FWCI
- 1.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Scientific Reports (publishedVersion, cc-by-nc-nd)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Vrije Universiteit Amsterdam
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Keywords
- protein-protein interface prediction, protein language models, protein embeddings, protein-protein interaction, ablation study
- MeSH terms
- Deep Learning, Bacterial Proteins, Mycobacterium tuberculosis, Proteins, Computational Biology, Protein Interaction Mapping, Databases, Protein
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.