The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Exploring the Knowledge of An Outstanding Protein to Protein Interaction Transformer
Open accessPreprint — published as 10.1109/tcbb.2024.3381825 · Paper page
Abstract
Protein-to-protein interaction (PPI) prediction aims to predict whether two given proteins interact or not. Compared with traditional experimental methods of high cost and low efficiency, the current deep learning based approach makes it possible to discover massive potential PPIs from large-scale databases. However, deep PPI prediction models perform poorly on unseen species, as their proteins are not in the training set. Targetting on this issue, the paper first proposes PPITrans, a Transformer based PPI prediction model that exploits a language model pre-trained on proteins to conduct binary PPI prediction. To validate the effectiveness on unseen species, PPITrans is trained with Human PPIs and tested on PPIs of other species. Experimental results show that PPITrans significantly outperforms the previous state-of-the-art on various metrics, especially on PPIs of unseen species. For example, the AUPR improves 0.339 absolutely on Fly PPIs. Aiming to explore the knowledge learned by PPITrans from PPI data, this paper also designs a series of probes belonging to three categories. Their results reveal several interesting findings, like that although PPITrans cannot capture the spatial structure of proteins, it can obtain knowledge of PPI type and binding affinity, learning more than binary PPI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Research works printed but not linked: 43
- 2020, Recent advances in the development of protein–protein interactions modulators: mechanisms and clinical trials, Signal transduction and targeted therapy, 5, 1
- 10.1038/nrc2981 · DOI · Paper page
- 10.1038/340245a0 · DOI
- 10.1126/science.1062191 · DOI · Paper page
- 10.1038/nature14539 · DOI · Paper page
- 2021, A survey on computational models for predicting protein–protein interactions, Briefings in Bioinformatics, 22, bbab036, 10.1093/bib/bbab036 · DOI
- 2021, The language of proteins: Nlp, machine learning & protein sequences, Computational and Structural Biotechnology Journal, 19, 1750, 10.1016/j.csbj.2021.03.022 · DOI
- R. Girshick , J. Donahue , T. Darrell , and J. Malik , “Rich feature hierarchies for accurate object detection and semantic segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 580–587. · DOI · Paper page
- 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), 1, 539
- S. Sledzieski , R. Singh , L. Cowen , and B. Berger , “Sequencebased prediction of protein-protein interactions: a structure-aware interpretable deep learning model,” bioRxiv, 2021. · DOI
- 10.1126/science.181.4096.223 · DOI · Paper page
- 10.1093/bioinformatics/bty573 · DOI
- 10.1093/bioinformatics/btz328 · DOI
- 10.3390/molecules23081923 · DOI
- 2020, Exploring the limits of transfer learning with a unified text-to-text transformer, Journal of Machine Learning Research, 21, 1
- A. Elnaggar , M. Heinzinger , C. Dallago , G. Rehawi , Y. Wang , L. Jones , T. Gibbs , T. Feher , C. Angerer , M. Steinegger et al., “Prottrans: Towards cracking the language of lifes code through self-supervised deep learning and high performance computing,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021. · DOI
- A. Vaswani , N. Shazeer , N. Parmar , J. Uszkoreit , L. Jones , A. N. Gomez , Ł. Kaiser , and I. Polosukhin , “Attention is all you need,” Advances in neural information processing systems, vol. 30, 2017.
- 10.1093/nar/gkaa1074 · DOI · Paper page
- 2021, Journal of Physics: Conference Series, 1937, 012011
- 10.1093/nar/gkaa1100 · DOI · Paper page
- 10.1093/nar/gkg095 · DOI
- 10.1093/nar/27.1.39 · DOI
- K. Cho , B. van Merrienboer , C. Gulcehre , F. Bougares , H. Schwenk , and Y. Bengio , “Learning phrase representations using rnn encoder-decoder for statistical machine translation,” in Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), 2014. · DOI · Paper page
- T. Mikolov , K. Chen , G. S. Corrado , and J. Dean , “Efficient estimation of word representations in vector space,” in Proceedings of 1st International Conference on Learning Representations, 2013, pp. 1–12.
- 10.1073/pnas.0607879104 · DOI
- 2021, D-script translates genome to phenome with sequence-based, structure-aware, genome-scale predictions of protein–protein interactions, Cell Systems, 12, 969, 10.1016/j.cels.2021.08.010 · DOI
- B. Song , X. Luo , X. Luo , Y. Liu , Z. Niu , and X. Zeng , “Learning spatial structures of proteins improves protein-protein interaction prediction,” Briefings in Bioinformatics, vol. 3, 2022. · DOI
- 2022, Proceedings of the 16th Machine Learning in Computational Biology meeting, ser. Proceedings of Machine Learning Research, 165, 34
- P. Veličković , G. Cucurull , A. Casanova , A. Romero , P. Liò , and Y. Bengio , “Graph attention networks,” in Proceedings of the 6th International Conference on Learning Representations, 2018, pp. 1–12.
- 10.1093/bioinformatics/bts688 · DOI
- 2019, Network-based prediction of protein interactions, Nature communications, 10, 1
- 2020, Graph embedding-based novel protein interaction prediction via higher-order graph convolutional network, PloS one, 15, e0238915, 10.1371/journal.pone.0238915 · DOI
- G. Lv , Z. Hu , Y. Bi , and S. Zhang , “Learning unknown from correlations: Graph neural network for inter-novel-protein interaction prediction,” in Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, Z.-H. Zhou , Ed. International Joint Conferences on Artificial Intelligence Organization, 8 2021, pp. 3677–3683, main Track. · DOI
- 10.1371/journal.pone.0141287 · DOI
- 10.1093/bioinformatics/bty178 · DOI
- 2019, Unified rational protein engineering with sequencebased deep representation learning, Nature methods, 16, 1315, 10.1038/s41592-019-0598-1 · DOI · Paper page
- 10.1073/pnas.2016239118 · DOI · Paper page
- J. D. M.-W. C. Kenton and L. K. Toutanova , “Bert: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of NAACL-HLT, 2019, pp. 4171–4186.
- 2019, Protein-level assembly increases protein sequence recovery from metagenomic samples manyfold, Nature methods, 16, 603, 10.1038/s41592-019-0437-4 · DOI · Paper page
- 10.1093/bioinformatics/btu739 · DOI · Paper page
- 1983, Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features, Biopolymers: Original Research on Biomolecules, 22, 2577, 10.1002/bip.360221211 · DOI · Paper page
- 10.1093/nar/gkp944 · DOI
- D. P. Kingma and J. Ba , “Adam: A method for stochastic optimization,”in Proceedings of 3rd International Conference on Learning Representations, 2015.
Metadata
- Authors
- Yang, S., Feng, D., Cheng, P., Liu, Y., & Wang, S.
- Affiliations
- Beijing Institute of Microbiology and Epidemiology (CN)
- National University of Defense Technology (CN)
- Chinese PLA General Hospital (CN)
- Corresponding author
- Yang, Sen
- ORCID
- Venue
- IEEE Transactions on Computational Biology and Bioinformatics
- Publisher
- openRxiv
- Published
- 2023-02-10
- Volume
- 21
- Issue
- 5
- Pages
- 1287-1298
- ISSN
- 1545-5963 (ISSN-L)
- OpenAlex
- W4393217153
- Cited by
- 6
- References
- 1
- Citations by year
- 2026: 3 · 2025: 2 · 2023: 1
- FWCI
- 0.68
- Type
- journal article
- Language
- en
- Open access
- green
- dx.doi.org
- Locations
- IEEE Transactions on Computational Biology and Bioinformatics (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (62306334, 81830101)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Keywords
- protein-protein interaction prediction, transformer models, protein language models, cross-species generalization, binding affinity, protein spatial structure
- MeSH terms
- Deep Learning, Algorithms, Animals, Humans, Proteins, Computational Biology, Protein Interaction Mapping, Databases, Protein, Protein Interaction Maps
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
