CoChat

Estimation of model accuracy in CASP15 using the M odFOLDdock server

Open access
Edmunds, Nicholas S., Alharbi, Shuaa M. A., Genc, Ahmet G., Adiyaman, Recep, McGuffin, Liam J. · 2023 · Proteins: Structure, Function, and Bioinformatics
Cited by 23

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

In CASP15, there was a greater emphasis on multimeric modeling than in previous experiments, with assembly structures nearly doubling in number (41 up from 22) since the previous round. CASP15 also included a new estimation of model accuracy (EMA) category in recognition of the importance of objective quality assessment (QA) for quaternary structure models. ModFOLDdock is a multimeric model QA server developed by the McGuffin group at the University of Reading, which brings together a range of single‐model, clustering, and deep learning methods to form a consensus of approaches. For CASP15, three variants of ModFOLDdock were developed to optimize for the different facets of the quality estimation problem. The standard ModFOLDdock variant produced predicted scores optimized for positive linear correlations with the observed scores. The ModFOLDdockR variant produced predicted scores optimized for ranking, that is, the top‐ranked models have the highest accuracy. In addition, the ModFOLDdockS variant used a quasi‐single model approach to score each model on an individual basis. The scores from all three variants achieved strongly positive Pearson correlation coefficients with the CASP observed scores (oligo‐lDDT) in excess of 0.70, which were maintained across both homomeric and heteromeric model populations. In addition, at least one of the ModFOLDdock variants was consistently ranked in the top two methods across all three EMA categories. Specifically, for overall global fold prediction accuracy, ModFOLDdock placed second and ModFOLDdockR placed third; for overall interface quality prediction accuracy, ModFOLDdockR, ModFOLDdock, and ModFOLDdockS were placed above all other predictor methods, and ModFOLDdockR and ModFOLDdockS were placed second and third respectively for individual residue confidence scores. The ModFOLDdock server is available at: https://www.reading.ac.uk/bioinf/ModFOLDdock/. ModFOLDdock is also available as part of the MultiFOLD docker package: https://hub.docker.com/r/mcguffin/multifold.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/prot.26532

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 14

  1. 10.1093/nar/gkab321 · DOI · Paper page
  2. 10.1093/nar/gkad297 · DOI · Paper page
  3. 10.1002/prot.26542 · DOI
  4. 10.1093/nar/gkp318 · DOI · Paper page
  5. 10.1002/prot.26569 · DOI · Paper page
  6. 10.1002/prot.26564 · DOI · Paper page
  7. 10.1093/bioinformatics/btac056 · DOI · Paper page
  8. 10.1002/jcc.23538 · DOI · Paper page
  9. 10.1002/prot.25360 · DOI
  10. 10.1093/nar/gkx332 · DOI · Paper page
  11. 10.1038/s41598‐017‐09654‐8 · DOI · Paper page
  12. 10.1107/S0907444913007051 · DOI · Paper page
  13. 10.1002/prot.21804 · DOI · Paper page
  14. 10.1038/s41592‐022‐01488‐1 · doi:10.1038/s41592-022-01488-1 · Paper page

Cited by

See all 23

Metadata

Authors
Edmunds, N. S., Alharbi, S. M. A., Genc, A. G., Adiyaman, R., & McGuffin, L. J.
Venue
Proteins: Structure, Function, and Bioinformatics
Publisher
Wiley
Published
2023-06-14
Volume
91
Issue
12
Pages
1871-1878
ISSN
  • 0887-3585 (ISSN-L)
  • 1097-0134
OpenAlex
W4380577696
Cited by
23
References
5
FWCI
1.72
Type
journal article
Language
en
Open access
hybrid
Funders
  • Biotechnology and Biological Sciences Research Council (BB/T018496/1)
  • Saudi Arabian Cultural Bureau

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.