CASP 11 statistics and the prediction center evaluation system
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
We outline the role of the Protein Structure Prediction Center (predictioncenter.org) in conducting the CASP11 and CASP ROLL experiments, discuss the experiment statistics, and provide an overview of the present CASP infrastructure. The biggest changes compared to the previous CASPs are the implementation of the evaluation system incorporating practically all evaluation measures, statistical tests, and visualization tools historically used by the CASP assessors, the expansion of the infrastructure to incorporate new categories of contact‐assisted and multimeric predictions, and the redesign of the assessors' web‐workspace enabling assessments based on multiple measures for different group categories and target sets. Proteins 2016; 84(Suppl 1):15–19. © 2016 Wiley Periodicals, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
TM-align: a protein structure alignment algorithm based on the TM-score
Zhang, Y. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki524 · Cited by 3,774
HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
Mariani, V., Biasini, M., Barbato, A., & Schwede, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt473 · Cited by 1,138
LGA: a method for finding 3D similarities in protein structures
Zemla, A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg571 · Cited by 1,069 · cited 2×
“…evaluation (regular, refinement, and contact-assisted categories): GDT-like measures of global model accuracy (GDT_TS, GDT_HA, GDC_SC, GDC_ALL)8–10 (Definitions of the measures used in CASP are also available via the Prediction Center website, e.g.:…”
Method
Cited by
End-to-End Differentiable Learning of Protein Structure
AlQuraishi, M. (2019) · Cell Systems · doi:10.1016/j.cels.2019.03.006 · Cited by 371
Critical assessment of methods of protein structure prediction (CASP)—Round XII
Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25415 · Cited by 326
Self-citationHigh‐accuracy protein structure prediction in CASP14
Pereira, J., Simpkin, A. J., Hartmann, M. D., Rigden, D. J., Keegan, R. M., & Lupas, A. N. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26171 · Cited by 314
“14 There, the different targets submitted are divided into evaluation units (or domains), each classified as “ template-based easy ” (TBM-Easy), “ template-based hard ” (TBM-Hard), “ hybrid template-based/free modeling ” (TBM/FM), or “ free-modeling ” (FM) targets, depending on whether good…”
BackgroundAbriata, L. A., Tamò, G. E., & Dal Peraro, M. (2019) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25787 · Cited by 79
CASP13 target classification into tertiary structure prediction categories
Kinch, L. N., Kryshtafovych, A., Monastyrskyy, B., & Grishin, N. V. (2019) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25775 · Cited by 36
Self-citation
Metadata
- Authors
- Kryshtafovych, A., Monastyrskyy, B., & Fidelis, K.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2016-03-09
- Volume
- 84
- Issue
- S1
- Pages
- 15-19
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W2299697047
- Cited by
- 41
- References
- 4
- FWCI
- 4.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CASP 11 statistics and the prediction center evaluation system. https://app.cochat.ai/papers/10.1002/prot.25005
- The paper
- Kryshtafovych, A., Monastyrskyy, B., & Fidelis, K. (2016). CASP 11 statistics and the prediction center evaluation system. Proteins: Structure, Function, and Bioinformatics. https://doi.org/10.1002/prot.25005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.