Prediction of protein assemblies, the next frontier: The CASP14‐CAPRI experiment
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
We present the results for CAPRI Round 50, the fourth joint CASP‐CAPRI protein assembly prediction challenge. The Round comprised a total of twelve targets, including six dimers, three trimers, and three higher‐order oligomers. Four of these were easy targets, for which good structural templates were available either for the full assembly, or for the main interfaces (of the higher‐order oligomers). Eight were difficult targets for which only distantly related templates were found for the individual subunits. Twenty‐five CAPRI groups including eight automatic servers submitted ~1250 models per target. Twenty groups including six servers participated in the CAPRI scoring challenge submitted ~190 models per target. The accuracy of the predicted models was evaluated using the classical CAPRI criteria. The prediction performance was measured by a weighted scoring scheme that takes into account the number of models of acceptable quality or higher submitted by each group as part of their five top‐ranking models. Compared to the previous CASP‐CAPRI challenge, top performing groups submitted such models for a larger fraction (70–75%) of the targets in this Round, but fewer of these models were of high accuracy. Scorer groups achieved stronger performance with more groups submitting correct models for 70–80% of the targets or achieving high accuracy predictions. Servers performed less well in general, except for the MDOCKPP and LZERD servers, who performed on par with human groups. In addition to these results, major advances in methodology are discussed, providing an informative overview of where the prediction of protein assemblies currently stands.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Network medicine: a network-based approach to human disease
Barabási, A.-L., Gulbahce, N., & Loscalzo, J. (2011) · Nature Reviews Genetics · doi:10.1038/nrg2918 · Cited by 5,034 · cited 1×
“Their disruption or dysregulation often causes disease.(1,2) Characterizing the threedimensional (3D) structure and function of these interactions, at both the molecular and cellular levels, and elucidating the underlying physical principles remains an important goal of biology and medicine.”
BackgroundImproved protein structure prediction using potentials from deep learning
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1923-7 · Cited by 3,378
HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Wang, S., Sun, S., Li, Z., Zhang, R., & Xu, J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005324 · Cited by 931
Zhou, H., & Zhou, Y. (2002) · Protein Science · doi:10.1110/ps.0217002 · Cited by 902
Ideker, T., & Sharan, R. (2008) · Genome Research · doi:10.1101/gr.071852.107 · Cited by 817
Protein structure prediction from sequence variation
Marks, D. S., Hopf, T. A., & Sander, C. (2012) · Nature Biotechnology · doi:10.1038/nbt.2419 · Cited by 622
Protein structure determination using metagenome sequence data
Ovchinnikov, S., Park, H., Varghese, N., Huang, P.-S., Pavlopoulos, G. A., Kim, D. E., Kamisetty, H., Kyrpides, N. C., & Baker, D. (2017) · Science · doi:10.1126/science.aah4043 · Cited by 520
Cited by
Improved prediction of protein-protein interactions using AlphaFold2
Bryant, P., Pozzati, G., & Elofsson, A. (2021) · doi:10.1101/2021.09.15.460468 · Cited by 1,022
Critical assessment of methods of protein structure prediction (CASP)—Round XIV
Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K., & Moult, J. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26237 · Cited by 503
Towards a structurally resolved human protein interaction network
Burke, D. F., Bryant, P., Barrio-Hernandez, I., Memon, D., Pozzati, G., Shenoy, A., Zhu, W., Dunham, A. S., Albanese, P., Keller, A., et al. (2023) · Nature Structural & Molecular Biology · doi:10.1038/s41594-022-00910-8 · Cited by 269
Self-citationAF2Complex predicts direct physical interactions in multimeric proteins with deep learning
Gao, M., Nakajima An, D., Parks, J. M., & Skolnick, J. (2022) · Nature Communications · doi:10.1038/s41467-022-29394-2 · Cited by 252
DeepRank-GNN: a graph neural network framework to learn patterns in protein–protein interfaces
Réau, M., Renaud, N., Xue, L. C., & Bonvin, A. M. J. J. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btac759 · Cited by 190
Self-citationAssessment of three‐dimensional RNA structure prediction in CASP15
Das, R., Kretsch, R. C., Simpkin, A. J., Mulvaney, T., Pham, P., Rangan, R., Bu, F., Keegan, R. M., Topf, M., Rigden, D. J., et al. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26602 · Cited by 139
Enhancing alphafold-multimer-based protein complex structure prediction with MULTICOM in CASP15
Liu, J., Guo, Z., Wu, T., Roy, R. S., Quadir, F., Chen, C., & Cheng, J. (2023) · Communications Biology · doi:10.1038/s42003-023-05525-3 · Cited by 86
Self-citationOzden, B., Kryshtafovych, A., & Karaca, E. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26598 · Cited by 51
PrePPI: A Structure Informed Proteome-wide Database of Protein–Protein Interactions
(2023) · doi:10.1016/j.jmb.2023.168052 · Cited by 48
Roy, R. S., Quadir, F., Soltanikazemi, E., & Cheng, J. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac063 · Cited by 45
Self-citationAssessment of the CASP14 assembly predictions
Ozden, B., Kryshtafovych, A., & Karaca, E. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26199 · Cited by 41
Giulini, M., Schneider, C., Cutting, D., Desai, N., Deane, C. M., & Bonvin, A. M. J. J. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae583 · Cited by 41
Self-citationPrediction of protein assemblies by structure sampling followed by interface‐focused scoring
Olechnovič, K., Valančauskas, L., Dapkūnas, J., & Venclovas, Č. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26569 · Cited by 40
Self-citationAssessment of three-dimensional RNA structure prediction in CASP15
(2023) · doi:10.1101/2023.04.25.538330 · Cited by 31
Varadi, M., Bordin, N., Orengo, C., & Velankar, S. (2023) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2023.102543 · Cited by 29
Self-citationImproved prediction of MHC-peptide binding using protein language models
Hashemi, N., Hao, B., Ignatov, M., Paschalidis, I. C., Vakili, P., Vajda, S., & Kozakov, D. (2023) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2023.1207380 · Cited by 25
Self-citationInduced fit with replica exchange improves protein complex structure prediction
Harmalkar, A., Mahajan, S. P., & Gray, J. J. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010124 · Cited by 16
Self-citationA fully automated benchmarking suite to compare macromolecular complexes
Studer, G., Robin, X., Bienert, S., Durairaj, J., Škrinjar, P., Tauriello, G., Waterhouse, A. M., & Schwede, T. (2026) · Nature Methods · doi:10.1038/s41592-025-02973-z · Cited by 10
Liu, J., Neupane, P., & Cheng, J. (2025) · Communications Biology · doi:10.1038/s42003-025-08960-6 · Cited by 10
Self-citationAlphaFold model quality self‐assessment improvement via deep graph learning
Verburgt, J., Zhang, Z., & Kihara, D. (2025) · Protein Science · doi:10.1002/pro.70274 · Cited by 8
Self-citationStratiichuk, R., Kyrylenko, R., Koleiev, I., Savchenko, I., Voitsitskyi, T., Husak, V., Yesylevskyy, S., Starosyla, S., & Nafiiev, A. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c01765 · Cited by 6
Visualizing the energy landscape for a molecular dynamics trajectory
Neuman, V., Wesołowski, P. A., Bojarski, K. K., Dewan, D., Schäffler, M., Smardz, P., & Wales, D. J. (2026) · The Journal of Chemical Physics · doi:10.1063/5.0310206 · Cited by 6
Self-citationAssembly of Protein Complexes in and on the Membrane with Predicted Spatial Arrangement Constraints
Christoffer, C., Harini, K., Archit, G., & Kihara, D. (2024) · Journal of Molecular Biology · doi:10.1016/j.jmb.2024.168486 · Cited by 4
Self-citationAccurate protein-protein interactions modeling through physics-informed geometric invariant learning
(2026) · doi:10.1038/s42003-026-09809-2 · Cited by 1
Choi, J. (2023) · iScience · doi:10.1016/j.isci.2023.106911 · Cited by 1
Metadata
- Authors
- Lensink, M. F., Brysbaert, G., Mauri, T., Nadzirin, N., Velankar, S., Chaleil, R. A. G., Clarence, T., Bates, P. A., Kong, R., Liu, B., Yang, G., Liu, M., Shi, H., Lu, X., Chang, S., Roy, R. S., Quadir, F., Liu, J., Cheng, J., Antoniak, A., Czaplewski, C., Giełdoń, A., Kogut, M., Lipska, A. G., Liwo, A., Lubecka, E. A., Maszota‐Zieleniak, M., Sieradzan, A. K., Ślusarz, R., Wesołowski, P. A., Zięba, K., Del Carpio Muñoz, C. A., Ichiishi, E., Harmalkar, A., Gray, J. J., Bonvin, A. M. J. J., Ambrosetti, F., Vargas Honorato, R., Jandova, Z., Jiménez‐García, B., Koukos, P. I., Van Keulen, S., Van Noort, C. W., Réau, M., Roel‐Touris, J., Kotelnikov, S., Padhorny, D., Porter, K. A., Alekseenko, A., Ignatov, M., Desta, I., Ashizawa, R., Sun, Z., Ghani, U., Hashemi, N., Vajda, S., Kozakov, D., Rosell, M., Rodríguez‐Lumbreras, L. A., Fernandez‐Recio, J., Karczynska, A., Grudinin, S., Yan, Y., Li, H., Lin, P., Huang, S., Christoffer, C., Terashi, G., Verburgt, J., Sarkar, D., Aderinwale, T., Wang, X., Kihara, D., Nakamura, T., Hanazono, Y., Gowthaman, R., Guest, J. D., Yin, R., Taherzadeh, G., Pierce, B. G., Barradas‐Bautista, D., Cao, Z., Cavallo, L., Oliva, R., Sun, Y., Zhu, S., Shen, Y., Park, T., Woo, H., Yang, J., Kwon, S., Won, J., Seok, C., Kiyota, Y., Kobayashi, S., Harada, Y., Takeda‐Shitaka, M., Kundrotas, P. J., Singh, A., Vakser, I. A., Dapkūnas, J., Olechnovič, K., Venclovas, Č., Duan, R., Qiu, L., Xu, X., Zhang, S., Zou, X., & Wodak, S. J.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2021-09-13
- Volume
- 89
- Issue
- 12
- Pages
- 1800-1823
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W3195593976
- Cited by
- 114
- References
- 20
- FWCI
- 5.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.