PreprintCited by 18Protein Structure and DynamicsEnzyme Structure and FunctionMachine Learning in Bioinformatics

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

GraphCPLMQA: Assessing protein model quality based on deep graph coupled networks using protein language model

Open access
Liu, Dong, Zhang, Biao, Liu, Jun, Li, Hui, Song, Le, Zhang, Gui-Jun·2023·Briefings in Bioinformatics

Preprint — published as 10.1093/bib/bbad420

Abstract

Model quality evaluation is crucial part of protein structural biology. How to distinguish high-quality models from low-quality models, and to assess which high-quality models have relatively incorrect regions for improvement, are remain challenge. More importantly, the quality assessment of multimer models is a hot topic for structure predicton.In this work, we present GraphCPLMQA, a novel graph-coupled network that uses embeddings from protein language models to assess residue-level protein model quality. The GraphCPLMQA consists of a graph encoding module and a transform-based convolutional decoding module. In encoding module, the underlying relational representations of sequence and high-dimensional geometry structure are extracted by protein language models with Evolutionary Scale Modeling. In decoding module, the mapping connection between structure and quality are inferred by the representations and low-dimensional features. Specifically, the triangular location and residue level contact order features are designed to enhance the association between the local structure and the overall topology. Experimental results demonstrate that GraphCPLMQA using single-sequence embedding achieves the best performance compared to the CASP15 interface evaluation method in 9108 models of CASP15 multimer test set. In CAMEO blind test (2022-05-20∼2022-08-13), GraphCPLMQA ranked first compared to other servers. GraphCPLMQA also outperforms state-of-the-art methods on 19,035 models in CASP13 and CASP14 monomer test set. Finally, on AlphaFold2 datasets, GraphCPLMQA was superior to self-assessment of AlphaFold2 in MAE metric, and it was able to screen out better models than AlphaFold2.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2023.05.16.540981

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 56

  1. 10.1126/science.abj8754 · DOI · Paper page
  2. Lin, Z. et al. (2022) Language models of protein sequences at the scale of evolution enable accurate structure prediction. bioRxiv doi: https://doi.org/10.1101/2022.07.20.500902, 21 July 2022, preprint:not peer reviewed. · DOI · Paper page
  3. Chowdhury, R. et al. (2022) Single-sequence protein structure prediction using a language model and deep learning. Nat. Biotechnol., 1–7. · DOI · Paper page
  4. 2023, Protein structure and folding pathway prediction based on remote homologs recognition using PAthreader, Commun Biol, 6, 243, 10.1038/s42003-023-04605-8 · DOI
  5. 2022, The impact of AlphaFold2 one year on, Nat. Methods, 19, 15, 10.1038/s41592-021-01365-3 · DOI
  6. Ahdritz, G. et al. (2021) OpenFold: Retraining AlphaFold2 yields new insights into its learning mechanisms and capacity for generalization. bioRxiv doi: https://doi.org/10.1101/2022.07.21.500999, 22 July 2022, preprint: not peer reviewed. · DOI
  7. 10.1038/s41467-020-20241-w · DOI · Paper page
  8. 2018, Deep convolutional networks for quality assessment of protein folds, Bioinformatics, 34, 4046, 10.1093/bioinformatics/bty494 · DOI
  9. 2019, Protein model quality assessment using 3D oriented convolutional neural networks, Bioinformatics, 35, 3313, 10.1093/bioinformatics/btz122 · DOI
  10. 10.1038/s41598-016-0001-8 · DOI · Paper page
  11. 10.1002/prot.25278 · DOI
  12. Hurtado, D. M. , et al. (2018) Deep transfer learning in the assessment of the quality of protein models. bioRxiv doi: https://doi.org/10.48550/arXiv.1804.06281, 17 mApr 2018, preprint: not peer reviewed. · DOI
  13. 2022, DeepUMQA: ultrafast shape recognition-based protein model quality assessment using deep learning, Bioinformatics, 38, 1895, 10.1093/bioinformatics/btac056 · DOI · Paper page
  14. Liu, J. et al. (2022) Improved model quality assessment using sequence and structural information by enhanced deep neural networks. Brief Bioinform., 24. · DOI · Paper page
  15. 2017, ProQ3D: improved model quality assessments using deep learning, Bioinformatics, 33, 1578, 10.1093/bioinformatics/btw819 · DOI
  16. 2019, AngularQA: protein model quality assessment with LSTM networks, Computational and Mathematical Biophysics, 7, 1, 10.1515/cmb-2019-0001 · DOI
  17. 2021, GraphQA: protein model quality assessment using graph convolutional networks, Bioinformatics, 37, 360, 10.1093/bioinformatics/btaa714 · DOI
  18. 10.1093/nar/gkab321 · DOI
  19. 10.1093/bioinformatics/btz828 · DOI
  20. 2019, Assessment of protein model structure accuracy estimation in CASP13: challenges in the era of deep learning, Proteins, 87, 1351, 10.1002/prot.25804 · DOI
  21. 2019, Estimation of model accuracy in CASP13, Proteins, 87, 1361, 10.1002/prot.25767 · DOI
  22. 2016, Methods of model accuracy estimation can help selecting the best models from decoy sets: Assessment of model accuracy estimations in CASP 11, Bioinformatics, 84, 349
  23. 10.1016/B978-0-12-381270-4.00019-6 · DOI
  24. 10.1016/S0076-6879(04)83004-0 · DOI
  25. 10.1073/pnas.1914677117 · DOI · Paper page
  26. 10.1002/jcc.20681 · DOI
  27. 2022, Fast, accurate antibody structure prediction from deep learning on massive set of natural antibodies, Biophys. J, 121, 155a, 10.1016/j.bpj.2021.11.1942 · DOI
  28. Hsu, C. et al. (2022) Learning inverse folding from millions of predicted structures. bioRxiv doi: https://doi.org/10.1101/2022.04.10.487779, 06 mSeptember 2022, preprint:not peer reviewed. · DOI
  29. 2019, Protein Data Bank: the single global archive for 3D macromolecular structure data, Nucleic Acids Res, 47, D520, 10.1093/nar/gky949 · DOI · Paper page
  30. 10.1093/NAR/GKAB1061 · DOI · Paper page
  31. 10.1016/j.str.2013.08.005 · DOI
  32. 2022, I-TASSER-MTD: a deep-learning-based platform for multi-domain protein structure and function prediction, Nature Protocols, 17, 2326, 10.1038/s41596-022-00728-0 · DOI
  33. 10.1073/pnas.2016239118 · DOI · Paper page
  34. 2021, Language models enable zero-shot prediction of the effects of mutations on protein function, NIPS, 34, 29287
  35. 2021, MSA Transformer, PMLR, 139, 8844
  36. 10.1038/nmeth.1818 · DOI · Paper page
  37. 10.1073/pnas.89.22.10915 · DOI · Paper page
  38. 2001, Generation and evaluation of dimension-reduced amino acid parameter representations by artificial neural networks, Molecular modeling annual, 7, 360, 10.1007/s008940100038 · DOI
  39. 1983, Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features, Biopolymers: Original Research on Biomolecules, 22, 2577, 10.1002/bip.360221211 · DOI · Paper page
  40. Yun, S. et al. (2019) Graph transformer networks. NIPS, 32.
  41. Satorras, V.G. et al. (2021) E(n) equivariant graph neural networks. ICML, 9323–9332.
  42. Hendrycks, D. and Gimpel, K. (2016) Gaussian error linear units (gelus). arXiv doi: https://doi.org/10.48550/arXiv.1606.08415, 08 mJuly 2020, preprint:not peer reviewed. · DOI · Paper page
  43. Liu, Z. et al. (2022) A convnet for the 2020s. CVPR, 11976–11986. · DOI · Paper page
  44. 10.1093/bioinformatics/btt473 · DOI · Paper page
  45. Loshchilov, I. and Hutter, F. (2017) Decoupled weight decay regularization. arXiv doi: https://doi.org/10.48550/arXiv.1711.05101, 04 January 2019, preprint:not peer reviewed. · DOI · Paper page
  46. Agarap, A.F et al. (2018) Deep learning using rectified linear units (relu). arXiv doi: https://doi.org/10.48550/arXiv.1803.08375, 07 mFebruary 2019, preprint:not peer reviewed. · DOI
  47. 10.1002/prot.20264 · DOI · Paper page
  48. 2017, Attention is all you need, Advances in neural information processing systems, 30, 6000
  49. 1998, Contact order, transition state placement and the refolding rates of single domain proteins, 4, 985
  50. 10.1093/nar/gkw1081 · DOI
  51. 10.1038/s41592-019-0437-4 · DOI · Paper page
  52. 10.1093/biomet/30.1-2.81 · DOI
  53. 2004, Confidence intervals for the area under the ROC curve, NIPS, 17, 305
  54. 10.2307/2284441 · DOI
  55. 2021, Assessment of protein model structure accuracy estimation in CASP14: Old and new challenges, Proteins, 89, 1940, 10.1002/prot.26192 · DOI
  56. Liu, J. et al. (2022) De novo protein structure prediction by incremental inter-residue geometries prediction and model quality assessment using deep learning. arXiv doi: https://doi.org/10.1101/2022.01.11.475831, 12 January 2022, preprint:not peer reviewed. · DOI

Metadata

Authors
Liu, D., Zhang, B., Liu, J., Li, H., Song, L., & Zhang, G.-J.
Affiliations
  • Zhejiang University of Technology (CN)
  • Mohamed bin Zayed University of Artificial Intelligence (AE)
Corresponding author
  • Li, Hui
  • Song, Le
Venue
Briefings in Bioinformatics
Publisher
openRxiv
Published
2023-05-18
Volume
25
Issue
1
ISSN
1467-5463 (ISSN-L)
OpenAlex
W4389141360
Cited by
18
References
1
Citations by year
2026: 2 · 2025: 9 · 2024: 6 · 2023: 1
FWCI
1.60
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Briefings in Bioinformatics (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • National Natural Science Foundation of China (62201506, LZ20F030002, 62173304)
  • National Key Research and Development Program of China (2022ZD0115103)
  • Natural Science Foundation of Zhejiang Province (LQ22F020028, LZ20F030002)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
Keywords
protein language models, CASP15
MeSH terms
Language, Proteins, Neural Networks, Computer, Computational Biology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review