Evaluation of disorder predictions in CASP9
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Lack of stable three‐dimensional structure, or intrinsic disorder, is a common phenomenon in proteins. Naturally, unstructured regions are proven to be essential for carrying function by many proteins, and therefore identification of such regions is an important issue. CASP has been assessing the state of the art in predicting disorder regions from amino acid sequence since 2002. Here, we present the results of the evaluation of the disorder predictions submitted to CASP9. The assessment is based on the evaluation measures and procedures used in previous CASPs. The balanced accuracy and the Matthews correlation coefficient were chosen as basic measures for evaluating the correctness of binary classifications. The area under the receiver operating characteristic curve was the measure of choice for evaluating probability‐based predictions of disorder. The CASP9 methods are shown to perform slightly better than the CASP7 methods but not better than the methods in CASP8. It was also shown that capability of most CASP9 methods to predict disorder decreases with increasing minimum disorder segment length. Proteins 2011;. © 2011 Wiley‐Liss, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Principles that Govern the Folding of Protein Chains
Anfinsen, C. B. (1973) · Science · doi:10.1126/science.181.4096.223 · Cited by 7,096
Comparison of the predicted and observed secondary structure of T4 phage lysozyme
Matthews, B. W. (1975) · Biochimica et Biophysica Acta (BBA) - Protein Structure · doi:10.1016/0005-2795(75)90109-9 · Cited by 5,399 · cited 1×
“39,40 MCC varies between 2 1 and 1 with a random prediction scoring zero.”
BackgroundIntrinsically unstructured proteins and their functions
Dyson, H. J., & Wright, P. E. (2005) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm1589 · Cited by 3,871 · cited 2×
“…molecular recognition and signal transduc-The tion.11 –14 The number of experimentally verified IDPs and IDRs is rapidly rising15: the DisProt database16 currently contains annotations for more than 640 proteins with disordered regions and recent reviews on this topic6,11,12 cite hundreds of works.”
BackgroundAssessing the accuracy of prediction algorithms for classification: an overview
Baldi, P., Brunak, S., Chauvin, Y., Andersen, C. A. F., & Nielsen, H. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.5.412 · Cited by 2,111
LGA: a method for finding 3D similarities in protein structures
Zemla, A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg571 · Cited by 1,069
Cited by
Classification of Intrinsically Disordered Regions and Proteins
van der Lee, R., Buljan, M., Lang, B., Weatheritt, R. J., Daughdrill, G. W., Dunker, A. K., Fuxreiter, M., Gough, J., Gsponer, J., Jones, D. T., et al. (2014) · Chemical Reviews · doi:10.1021/cr400525m · Cited by 2,174
Intrinsically Disordered Proteins and Intrinsically Disordered Protein Regions
Oldfield, C. J., & Dunker, A. K. (2014) · Annual Review of Biochemistry · doi:10.1146/annurev-biochem-072711-164947 · Cited by 1,057
DISOPRED3: precise disordered region predictions with annotated protein-binding activity
Jones, D. T., & Cozzetto, D. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btu744 · Cited by 877
D2P2: database of disordered protein predictions
Oates, M. E., Romero, P., Ishida, T., Ghalwash, M., Mizianty, M. J., Xue, B., Dosztányi, Z., Uversky, V. N., Obradovic, Z., Kurgan, L., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1226 · Cited by 705
“The meta-predictor PV2 achieved either higher or comparable accuracy with other methods in both CASP8 and CASP9 sequences and it had a good balance between sensitivity and specificity.”
MethodIntrinsically disordered proteins: a 10-year recap
Tompa, P. (2012) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2012.08.004 · Cited by 631
Metadata
- Authors
- Monastyrskyy, B., Fidelis, K., Moult, J., Tramontano, A., & Kryshtafovych, A.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2011-01
- Volume
- 79
- Issue
- S10
- Pages
- 107-118
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W2159938554
- Cited by
- 118
- References
- 5
- FWCI
- 6.23
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of disorder predictions in CASP9. https://app.cochat.ai/papers/10.1002/prot.23161
- The paper
- Monastyrskyy, B., Fidelis, K., Moult, J., Tramontano, A., & Kryshtafovych, A. (2011). Evaluation of disorder predictions in CASP9. Proteins: Structure, Function, and Bioinformatics. https://doi.org/10.1002/prot.23161
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.