CoChat

Assessment of protein model structure accuracy estimation in CASP14 : Old and new challenges

Open access
Kwon, Sohee, Won, Jonghun, Kryshtafovych, Andriy, Seok, Chaok · 2021 · Proteins: Structure, Function, and Bioinformatics
Cited by 57

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

In CASP, blind testing of model accuracy estimation methods has been conducted on models submitted by tertiary structure prediction servers. In CASP14, model accuracy estimation results were evaluated in terms of both global and local structure accuracy, as in the previous CASPs. Unlike the previous CASPs that did not show pronounced improvements in performance, the best single‐model method (from the Baker group) showed an improved performance in CASP14, particularly in evaluating global structure accuracy when compared to both the best single‐model methods in previous CASPs and the best multi‐model methods in the current CASP. Although the CASP14 experiment on model accuracy estimation did not deal with the structures generated by AlphaFold2, new challenges that have arisen due to the success of AlphaFold2 are discussed.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/prot.26192

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 15

  1. 10.1002/prot.21669 · DOI · Paper page
  2. 10.1002/prot.22534 · DOI · Paper page
  3. 10.1002/prot.23180 · DOI · Paper page
  4. 10.1002/prot.24347 · DOI · Paper page
  5. 10.1002/prot.24919 · DOI · Paper page
  6. 10.1002/prot.25371 · DOI · Paper page
  7. 10.1002/prot.25804 · DOI · Paper page
  8. Kinch LN, 2021, Topology evaluation of models for difficult targets in the 14th round of the critical assessment of protein structure prediction (CASP14), Proteins Struct Funct Bioinformatics
  9. 10.1002/prot.24172 · DOI · Paper page
  10. 10.1093/nar/gku294 · DOI
  11. 10.1002/prot.24399 · DOI · Paper page
  12. 10.1016/j.bpj.2011.09.012 · DOI · Paper page
  13. 10.1002/prot.25775 · DOI · Paper page
  14. 10.1002/prot.26231 · DOI
  15. 10.1002/prot.26222 · DOI · Paper page

Cited by

Metadata

Authors
Kwon, S., Won, J., Kryshtafovych, A., & Seok, C.
Venue
Proteins: Structure, Function, and Bioinformatics
Publisher
Wiley
Published
2021-08-05
Volume
89
Issue
12
Pages
1940-1948
ISSN
  • 0887-3585 (ISSN-L)
  • 1097-0134
OpenAlex
W3186243460
Cited by
57
References
5
FWCI
3.15
Type
journal article
Language
en
Open access
green
Funders
  • National Institute of General Medical Sciences (R01GM100482)
  • National Research Foundation of Korea (2019M3E5D4066898, 2020M3A9G7103933)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.