Assessment of the assessment—All about complexes
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Predicting model quality is a fundamental component of any modeling procedure, and blind assessment of these methods constitutes a crucial aspect of the Critical Assessment of Protein Structure Prediction (CASP) experiment. Historically, the main focus was on assessing methods that predict global and per‐residue accuracies in tertiary structure models. This focus shifted with the community's increased efforts in modeling complexes and assemblies. We asked the community to process the models from the CASP15 assembly category and provide estimates of the accuracy of the predicted quaternary structure, both globally and at the local interface level. Besides identifying remarkable accuracy of modeling groups in assessing their own predictions, we set up a benchmarking pipeline to highlight different aspects of quaternary structure models and introduced a simple consensus EMA method as baseline. While participating methods showed commendable performance, the baseline was difficult to surpass. It is important to point out that prediction performance varies for the individual CASP targets, highlighting potential areas of improvement and challenges ahead.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Mariani, V., Biasini, M., Barbato, A., & Schwede, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt473 · Cited by 1,138
Self-citationLGA: a method for finding 3D similarities in protein structures
Zemla, A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg571 · Cited by 1,069
US-align: universal structure alignments of proteins, nucleic acids, and macromolecular complexes
Zhang, C., Shine, M., Pyle, A. M., & Zhang, Y. (2022) · Nature Methods · doi:10.1038/s41592-022-01585-1 · Cited by 511
DockQ: A Quality Measure for Protein-Protein Docking Models
Basu, S., & Wallner, B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161879 · Cited by 460 · cited 1×
“The superposition independent QS-score 21 as well as a variant of DockQ, 22 were used as reference values for QSCORE predictions.”
MethodImproved protein structure refinement guided by deep learning based accuracy estimation
Hiranuma, N., Park, H., Baek, M., Anishchenko, I., Dauparas, J., & Baker, D. (2021) · Nature Communications · doi:10.1038/s41467-021-21511-x · Cited by 243
Deep, A., Gu, Y., Gao, Y.-Q., Ego, K. M., Herzik, M. A., Zhou, H., & Corbett, K. D. (2022) · Molecular Cell · doi:10.1016/j.molcel.2022.09.008 · Cited by 106
Research works printed but not linked: 19
- 10.1016/B978-0-12-438150-6.50018-2 · DOI · Paper page
- 10.1002/prot.21669 · DOI · Paper page
- 10.1002/prot.22534 · DOI · Paper page
- 10.1002/prot.23180 · DOI · Paper page
- 10.1002/prot.24347 · DOI · Paper page
- 10.1002/prot.24919 · DOI · Paper page
- 10.1002/prot.25371 · DOI · Paper page
- 10.1002/prot.25804 · DOI · Paper page
- 10.1002/prot.26192 · DOI · Paper page
- 10.1093/nar/gkt294 · DOI
- 10.1093/nar/gkab321 · DOI · Paper page
- 10.1002/prot.26598 · DOI · Paper page
- 10.1002/prot.20264 · DOI · Paper page
- 10.1002/prot.25795 · DOI · Paper page
- 10.1107/S0907444913007051 · DOI · Paper page
- 10.1107/S0567739476001873 · DOI · Paper page
- 10.1038/s41598-017-09654-8 · DOI · Paper page
- 10.1002/prot.24172 · DOI · Paper page
- 10.1371/journal.pcbi.1006791 · DOI
Cited by
Critical assessment of methods of protein structure prediction ( CASP )—Round XV
Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K., & Moult, J. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26617 · Cited by 148
“12 For multimers, third-party selection of models appears impressive, with about 2/3 of targets having a loss of accuracy less than 0.1 in TM score 36 when models estimated to be most accurate are selected.”
BackgroundInfluentialSelf-citationNew prediction categories in CASP15
Kryshtafovych, A., Antczak, M., Szachniuk, M., Zok, T., Kretsch, R. C., Rangan, R., Pham, P., Das, R., Robin, X., Studer, G., et al. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26515 · Cited by 54
“Finally, a validation report is created showing the results of the validation process to aid in troubleshooting invalid submissions.”
BackgroundMethodSelf-citationOzden, B., Kryshtafovych, A., & Karaca, E. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26598 · Cited by 51
Assessment of Nucleic Acid Structure Prediction in CASP16
Kretsch, R. C., Hummer, A. M., He, S., Yuan, R., Zhang, J., Karagianes, T., Cong, Q., Kryshtafovych, A., & Das, R. (2026) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.70072 · Cited by 51
“This approximation was appropriate for the dimeric and symmetric homo-oligomeric complexes in CASP16, but in the future, for more complex targets and more accurate predictions, the chain mapping problems should be considered [64].”
Assessing scoring metrics for AlphaFold2 and AlphaFold3 protein complex predictions
Genz, L. R., Nair, S., Nagar, N., & Topf, M. (2025) · Protein Science · doi:10.1002/pro.70327 · Cited by 17
Metadata
- Authors
- Studer, G., Tauriello, G., & Schwede, T.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2023-10-19
- Volume
- 91
- Issue
- 12
- Pages
- 1850-1860
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W4387798438
- Cited by
- 33
- References
- 7
- FWCI
- 2.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Swiss Institute of Bioinformatics
- Universität Basel
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessment of the assessment—All about complexes. https://app.cochat.ai/papers/10.1002/prot.26612
- The paper
- Studer, G., Tauriello, G., & Schwede, T. (2023). Assessment of the assessment—All about complexes. Proteins: Structure, Function, and Bioinformatics. https://doi.org/10.1002/prot.26612
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.