The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
GraphCPLMQA: Assessing protein model quality based on deep graph coupled networks using protein language model
Open accessPreprint — published as 10.1093/bib/bbad420
Abstract
Model quality evaluation is crucial part of protein structural biology. How to distinguish high-quality models from low-quality models, and to assess which high-quality models have relatively incorrect regions for improvement, are remain challenge. More importantly, the quality assessment of multimer models is a hot topic for structure predicton.In this work, we present GraphCPLMQA, a novel graph-coupled network that uses embeddings from protein language models to assess residue-level protein model quality. The GraphCPLMQA consists of a graph encoding module and a transform-based convolutional decoding module. In encoding module, the underlying relational representations of sequence and high-dimensional geometry structure are extracted by protein language models with Evolutionary Scale Modeling. In decoding module, the mapping connection between structure and quality are inferred by the representations and low-dimensional features. Specifically, the triangular location and residue level contact order features are designed to enhance the association between the local structure and the overall topology. Experimental results demonstrate that GraphCPLMQA using single-sequence embedding achieves the best performance compared to the CASP15 interface evaluation method in 9108 models of CASP15 multimer test set. In CAMEO blind test (2022-05-20∼2022-08-13), GraphCPLMQA ranked first compared to other servers. GraphCPLMQA also outperforms state-of-the-art methods on 19,035 models in CASP13 and CASP14 monomer test set. Finally, on AlphaFold2 datasets, GraphCPLMQA was superior to self-assessment of AlphaFold2 in MAE metric, and it was able to screen out better models than AlphaFold2.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Flagged first, then by citations
Research works printed but not linked: 56
- 10.1126/science.abj8754 · DOI · Paper page
- Lin, Z. et al. (2022) Language models of protein sequences at the scale of evolution enable accurate structure prediction. bioRxiv doi: https://doi.org/10.1101/2022.07.20.500902, 21 July 2022, preprint:not peer reviewed. · DOI · Paper page
- Chowdhury, R. et al. (2022) Single-sequence protein structure prediction using a language model and deep learning. Nat. Biotechnol., 1–7. · DOI · Paper page
- 2023, Protein structure and folding pathway prediction based on remote homologs recognition using PAthreader, Commun Biol, 6, 243, 10.1038/s42003-023-04605-8 · DOI
- 2022, The impact of AlphaFold2 one year on, Nat. Methods, 19, 15, 10.1038/s41592-021-01365-3 · DOI
- Ahdritz, G. et al. (2021) OpenFold: Retraining AlphaFold2 yields new insights into its learning mechanisms and capacity for generalization. bioRxiv doi: https://doi.org/10.1101/2022.07.21.500999, 22 July 2022, preprint: not peer reviewed. · DOI
- 10.1038/s41467-020-20241-w · DOI · Paper page
- 2018, Deep convolutional networks for quality assessment of protein folds, Bioinformatics, 34, 4046, 10.1093/bioinformatics/bty494 · DOI
- 2019, Protein model quality assessment using 3D oriented convolutional neural networks, Bioinformatics, 35, 3313, 10.1093/bioinformatics/btz122 · DOI
- 10.1038/s41598-016-0001-8 · DOI · Paper page
- 10.1002/prot.25278 · DOI
- Hurtado, D. M. , et al. (2018) Deep transfer learning in the assessment of the quality of protein models. bioRxiv doi: https://doi.org/10.48550/arXiv.1804.06281, 17 mApr 2018, preprint: not peer reviewed. · DOI
- 2022, DeepUMQA: ultrafast shape recognition-based protein model quality assessment using deep learning, Bioinformatics, 38, 1895, 10.1093/bioinformatics/btac056 · DOI · Paper page
- Liu, J. et al. (2022) Improved model quality assessment using sequence and structural information by enhanced deep neural networks. Brief Bioinform., 24. · DOI · Paper page
- 2017, ProQ3D: improved model quality assessments using deep learning, Bioinformatics, 33, 1578, 10.1093/bioinformatics/btw819 · DOI
- 2019, AngularQA: protein model quality assessment with LSTM networks, Computational and Mathematical Biophysics, 7, 1, 10.1515/cmb-2019-0001 · DOI
- 2021, GraphQA: protein model quality assessment using graph convolutional networks, Bioinformatics, 37, 360, 10.1093/bioinformatics/btaa714 · DOI
- 10.1093/nar/gkab321 · DOI
- 10.1093/bioinformatics/btz828 · DOI
- 2019, Assessment of protein model structure accuracy estimation in CASP13: challenges in the era of deep learning, Proteins, 87, 1351, 10.1002/prot.25804 · DOI
- 2019, Estimation of model accuracy in CASP13, Proteins, 87, 1361, 10.1002/prot.25767 · DOI
- 2016, Methods of model accuracy estimation can help selecting the best models from decoy sets: Assessment of model accuracy estimations in CASP 11, Bioinformatics, 84, 349
- 10.1016/B978-0-12-381270-4.00019-6 · DOI
- 10.1016/S0076-6879(04)83004-0 · DOI
- 10.1073/pnas.1914677117 · DOI · Paper page
- 10.1002/jcc.20681 · DOI
- 2022, Fast, accurate antibody structure prediction from deep learning on massive set of natural antibodies, Biophys. J, 121, 155a, 10.1016/j.bpj.2021.11.1942 · DOI
- Hsu, C. et al. (2022) Learning inverse folding from millions of predicted structures. bioRxiv doi: https://doi.org/10.1101/2022.04.10.487779, 06 mSeptember 2022, preprint:not peer reviewed. · DOI
- 2019, Protein Data Bank: the single global archive for 3D macromolecular structure data, Nucleic Acids Res, 47, D520, 10.1093/nar/gky949 · DOI · Paper page
- 10.1093/NAR/GKAB1061 · DOI · Paper page
- 10.1016/j.str.2013.08.005 · DOI
- 2022, I-TASSER-MTD: a deep-learning-based platform for multi-domain protein structure and function prediction, Nature Protocols, 17, 2326, 10.1038/s41596-022-00728-0 · DOI
- 10.1073/pnas.2016239118 · DOI · Paper page
- 2021, Language models enable zero-shot prediction of the effects of mutations on protein function, NIPS, 34, 29287
- 2021, MSA Transformer, PMLR, 139, 8844
- 10.1038/nmeth.1818 · DOI · Paper page
- 10.1073/pnas.89.22.10915 · DOI · Paper page
- 2001, Generation and evaluation of dimension-reduced amino acid parameter representations by artificial neural networks, Molecular modeling annual, 7, 360, 10.1007/s008940100038 · DOI
- 1983, Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features, Biopolymers: Original Research on Biomolecules, 22, 2577, 10.1002/bip.360221211 · DOI · Paper page
- Yun, S. et al. (2019) Graph transformer networks. NIPS, 32.
- Satorras, V.G. et al. (2021) E(n) equivariant graph neural networks. ICML, 9323–9332.
- Hendrycks, D. and Gimpel, K. (2016) Gaussian error linear units (gelus). arXiv doi: https://doi.org/10.48550/arXiv.1606.08415, 08 mJuly 2020, preprint:not peer reviewed. · DOI · Paper page
- Liu, Z. et al. (2022) A convnet for the 2020s. CVPR, 11976–11986. · DOI · Paper page
- 10.1093/bioinformatics/btt473 · DOI · Paper page
- Loshchilov, I. and Hutter, F. (2017) Decoupled weight decay regularization. arXiv doi: https://doi.org/10.48550/arXiv.1711.05101, 04 January 2019, preprint:not peer reviewed. · DOI · Paper page
- Agarap, A.F et al. (2018) Deep learning using rectified linear units (relu). arXiv doi: https://doi.org/10.48550/arXiv.1803.08375, 07 mFebruary 2019, preprint:not peer reviewed. · DOI
- 10.1002/prot.20264 · DOI · Paper page
- 2017, Attention is all you need, Advances in neural information processing systems, 30, 6000
- 1998, Contact order, transition state placement and the refolding rates of single domain proteins, 4, 985
- 10.1093/nar/gkw1081 · DOI
- 10.1038/s41592-019-0437-4 · DOI · Paper page
- 10.1093/biomet/30.1-2.81 · DOI
- 2004, Confidence intervals for the area under the ROC curve, NIPS, 17, 305
- 10.2307/2284441 · DOI
- 2021, Assessment of protein model structure accuracy estimation in CASP14: Old and new challenges, Proteins, 89, 1940, 10.1002/prot.26192 · DOI
- Liu, J. et al. (2022) De novo protein structure prediction by incremental inter-residue geometries prediction and model quality assessment using deep learning. arXiv doi: https://doi.org/10.1101/2022.01.11.475831, 12 January 2022, preprint:not peer reviewed. · DOI
Metadata
- Authors
- Liu, D., Zhang, B., Liu, J., Li, H., Song, L., & Zhang, G.-J.
- Affiliations
- Zhejiang University of Technology (CN)
- Mohamed bin Zayed University of Artificial Intelligence (AE)
- Corresponding author
- Li, Hui
- Song, Le
- Venue
- Briefings in Bioinformatics
- Publisher
- openRxiv
- Published
- 2023-05-18
- Volume
- 25
- Issue
- 1
- ISSN
- 1467-5463 (ISSN-L)
- PMC
- PMC10685403
- OpenAlex
- W4389141360
- Cited by
- 18
- References
- 1
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 6 · 2023: 1
- FWCI
- 1.60
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Briefings in Bioinformatics (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (62201506, LZ20F030002, 62173304)
- National Key Research and Development Program of China (2022ZD0115103)
- Natural Science Foundation of Zhejiang Province (LQ22F020028, LZ20F030002)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Keywords
- protein language models, CASP15
- MeSH terms
- Language, Proteins, Neural Networks, Computer, Computational Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review