Assessment of protein assembly prediction in CASP12
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
We present the results of the first independent assessment of protein assemblies in CASP. A total of 1624 oligomeric models were submitted by 108 predictor groups for the 30 oligomeric targets in the CASP12 edition. We evaluated the accuracy of oligomeric predictions by comparison to their reference structures at the interface patch and residue contact levels. We find that interface patches are more reliably predicted than the specific residue contacts. Whereas none of the 15 hard oligomeric targets have successful predictions for the residue contacts at the interface, six have models with resemblance in the interface patch. Successful predictions of interface patch and contacts exist for all targets suitable for homology modeling, with at least one group improving over the best available template for each target. However, the participation in protein assembly prediction is low and uneven. Three human groups are closely ranked at the top by overall performance, but a server outperforms all other predictors for targets suitable for homology modeling. The state of the art of protein assembly prediction methods is in development and has apparent room for improvement, especially for assemblies without templates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ovchinnikov, S., Kamisetty, H., & Baker, D. (2014) · eLife · doi:10.7554/elife.02030 · Cited by 629 · cited 1×
“9 These approaches are added to the already established methods of the docking community and bring the CASP and CAPRI experiments closer together.”
Method
Cited by
SWISS-MODEL: homology modelling of protein structures and complexes
Waterhouse, A., Bertoni, M., Bienert, S., Studer, G., Tauriello, G., Gumienny, R., Heer, F. T., de Beer, T. A. P., Rempfer, C., Bordoli, L., et al. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky427 · Cited by 13,067
Self-citationAccurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Critical assessment of methods of protein structure prediction (CASP)—Round XII
Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25415 · Cited by 326
Self-citationHaas, J., Barbato, A., Behringer, D., Studer, G., Roth, S., Bertoni, M., Mostaguir, K., Gumienny, R., & Schwede, T. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25431 · Cited by 168
“Prediction of quaternary structures remains a challenge in structure prediction[55] as observed both in CAMEO and CASP12.”
BackgroundSelf-citationBlind prediction of homo- and hetero-protein complexes: the CASP13-CAPRI experiment
Lensink, M. F., Brysbaert, G., Nadzirin, N., Velankar, S., Chaleil, R. A. G., Gerguri, T., Bates, P. A., Laine, E., Carbone, A., Grudinin, S., et al. (2019) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25838 · Cited by 122
“40-42 Here we present the results of the CASP13-CAPRI challenge, the third joint assembly prediction experiment with CASP, representing Round 46 of CAPRI.”
Enhancing alphafold-multimer-based protein complex structure prediction with MULTICOM in CASP15
Liu, J., Guo, Z., Wu, T., Roy, R. S., Quadir, F., Chen, C., & Cheng, J. (2023) · Communications Biology · doi:10.1038/s42003-023-05525-3 · Cited by 86
Shor, B., & Schneidman-Duhovny, D. (2024) · Nature Methods · doi:10.1038/s41592-024-02174-0 · Cited by 85
Building structural models of a whole mycoplasma cell
Maritan, M., Autin, L., Karr, J., Covert, M. W., Olson, A. J., & Goodsell, D. S. (2022) · Journal of Molecular Biology · doi:10.1016/j.jmb.2021.167351 · Cited by 75
“This is in line with the experiences of other groups participating in the recently introduced ‘Assembly’ category in CASP experiments, where the human factor was often key for the success of their oligomeric modeling methods.(53,54) Certain classes of molecules continue to pose challenges to structural biologists, so…”
ResultOzden, B., Kryshtafovych, A., & Karaca, E. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26598 · Cited by 51
Self-citationAssessment of the CASP14 assembly predictions
Ozden, B., Kryshtafovych, A., & Karaca, E. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26199 · Cited by 41
“12 In CASP14, we had five targets (H1036, H1047, H1060, H1081, and T1099o), which were challenging to assess with the standard CASP metrics.”
BackgroundMethodSelf-citationPrediction of protein assemblies by structure sampling followed by interface‐focused scoring
Olechnovič, K., Valančauskas, L., Dapkūnas, J., & Venclovas, Č. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26569 · Cited by 40
Olechnovič, K., & Venclovas, Č. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26554 · Cited by 38
Breaking the conformational ensemble barrier: Ensemble structure modeling challenges in CASP15
Kryshtafovych, A., Montelione, G., Rigden, D., Mesdaghi, S., Karaca, E., & Moult, J. (2023) · doi:10.22541/au.169199504.48580490/v1 · Cited by 31
Self-citationBreaking the conformational ensemble barrier: Ensemble structure modeling challenges in CASP15
Kryshtafovych, A., Montelione, G. T., Rigden, D. J., Mesdaghi, S., Karaca, E., & Moult, J. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26584 · Cited by 31
Self-citationAssessment of Nucleic Acid Structure Prediction in CASP16
Kretsch, R. C., Hummer, A. M., He, S., Yuan, R., Zhang, J., Karagianes, T., Cong, Q., Kryshtafovych, A., & Das, R. (2026) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.70072 · Cited by 51
“For NA-NA, protein–protein, and NA-protein interfaces, the F1-score (ICS) and Jaccard coefficient (IPS) of the inter-chain pairs of residues [41, 42], the lDDT of interface residues (i-lDDT), and DockQ [43] were calculated.”
Self-citationProtein oligomer modeling guided by predicted interchain contacts in CASP14
Baek, M., Anishchenko, I., Park, H., Humphreys, I. R., & Baker, D. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26197 · Cited by 18
“Many computational methods have been developed to predict oligomer structures,(4-9) but good performance has required matching oligomer template structures or utilization of experimental data, and accurate subunit structures.(10,11) Protein interchain contact predictions have been utilized for oligomer modeling,(12-14…”
MethodA fully automated benchmarking suite to compare macromolecular complexes
Studer, G., Robin, X., Bienert, S., Durairaj, J., Škrinjar, P., Tauriello, G., Waterhouse, A. M., & Schwede, T. (2026) · Nature Methods · doi:10.1038/s41592-025-02973-z · Cited by 10
“The CASP assessment of oligomers primarily relies on interface contact-based scores, akin to f nat , named the interface contact similarity (ICS) and interface patch similarity (IPS) scores 6 .”
Self-citation
Metadata
- Authors
- Lafita, A., Bliven, S., Kryshtafovych, A., Bertoni, M., Monastyrskyy, B., Duarte, J. M., Schwede, T., & Capitani, G.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2017-11-08
- Volume
- 86
- Issue
- S1
- Pages
- 247-256
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W2766157941
- Cited by
- 67
- References
- 1
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.