Discriminating physiological from non‐physiological interfaces in structures of protein complexes: A community‐wide study
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Reliably scoring and ranking candidate models of protein complexes and assigning their oligomeric state from the structure of the crystal lattice represent outstanding challenges. A community‐wide effort was launched to tackle these challenges. The latest resources on protein complexes and interfaces were exploited to derive a benchmark dataset consisting of 1677 homodimer protein crystal structures, including a balanced mix of physiological and non‐physiological complexes. The non‐physiological complexes in the benchmark were selected to bury a similar or larger interface area than their physiological counterparts, making it more difficult for scoring functions to differentiate between them. Next, 252 functions for scoring protein‐protein interfaces previously developed by 13 groups were collected and evaluated for their ability to discriminate between physiological and non‐physiological complexes. A simple consensus score generated using the best performing score of each of the 13 groups, and a cross‐validated Random Forest (RF) classifier were created. Both approaches showed excellent performance, with an area under the Receiver Operating Characteristic (ROC) curve of 0.93 and 0.94, respectively, outperforming individual scores developed by different groups. Additionally, AlphaFold2 engines recalled the physiological dimers with significantly higher accuracy than the non‐physiological set, lending support to the reliability of our benchmark dataset annotations. Optimizing the combined power of interface scoring functions and evaluating it on challenging benchmark datasets appears to be a promising strategy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Protein complex prediction with AlphaFold-Multimer
Evans, R., O’Neill, M., Pritzel, A., Antropova, N., Senior, A., Green, T., Žídek, A., Bates, R., Blackwell, S., Yim, J., et al. (2021) · doi:10.1101/2021.10.04.463034 · Cited by 3,808 · cited 6×
“The sequencewas then run through two versions of AlphaFold2 (“Gap” [40, 41] and “Multimer” [7] versions) each resulting in five predictedmodels for each dimer.”
BackgroundMethodInfluentialThe Rosetta All-Atom Energy Function for Macromolecular Modeling and Design
Alford, R. F., Leaver-Fay, A., Jeliazkov, J. R., O’Meara, M. J., DiMaio, F. P., Park, H., Shapovalov, M. V., Renfrew, P. D., Mulligan, V. K., Kappel, K., et al. (2017) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.7b00125 · Cited by 1,532
Self-citationThe Cell as a Collection of Protein Machines: Preparing the Next Generation of Molecular Biologists
Alberts, B. (1998) · Cell · doi:10.1016/s0092-8674(00)80922-8 · Cited by 1,411
Improved prediction of protein-protein interactions using AlphaFold2
Bryant, P., Pozzati, G., & Elofsson, A. (2021) · doi:10.1101/2021.09.15.460468 · Cited by 1,022 · cited 3×
“Follow up studies have indicated that the same engine can accurately predict the 3D structure of protein complexes by concatenating the sequences of the two protein chains, separated by a gap [40, 41].”
BackgroundMethodIdeker, T., & Sharan, R. (2008) · Genome Research · doi:10.1101/gr.071852.107 · Cited by 817
CAPRI: A Critical Assessment of PRedicted Interactions
Janin, J., Henrick, K., Moult, J., Eyck, L. T., Sternberg, M. J. E., Vajda, S., Vakser, I., & Wodak, S. J. (2003) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.10381 · Cited by 703
Self-citationCATH: increased structural coverage of functional space
Sillitoe, I., Bordin, N., Dawson, N., Waman, V. P., Ashford, P., Scholes, H. M., Pang, C. S. M., Woodridge, L., Rauer, C., Sen, N., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa1079 · Cited by 509
DockQ: A Quality Measure for Protein-Protein Docking Models
Basu, S., & Wallner, B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161879 · Cited by 460 · cited 1×
“The 5 models produced for each dimer (“Gap” or “Multimer” approaches) were compared with the corresponding structure in the benchmark dataset, using the QS-score, a measure that quantifies the similarity between interfaces as a function of shared interfacial contacts [46,47] and DockQ [48], a composite score which int…”
MethodVreven, T., Moal, I. H., Vangone, A., Pierce, B. G., Kastritis, P. L., Torchala, M., Chaleil, R., Jiménez-García, B., Bates, P. A., Fernandez-Recio, J., et al. (2015) · Journal of Molecular Biology · doi:10.1016/j.jmb.2015.07.016 · Cited by 424 · cited 2×
“An updated version of this benchmark also integrates binding affinity data for a subset of the complexes [26].”
BackgroundSelf-citationTubiana, J., Schneidman-Duhovny, D., & Wolfson, H. J. (2022) · Nature Methods · doi:10.1038/s41592-022-01490-7 · Cited by 274
Self-citationDocking, scoring, and affinity prediction in CAPRI
Lensink, M. F., & Wodak, S. J. (2013) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24428 · Cited by 249
Self-citationModeling protein–protein and protein–peptide complexes: CAPRI 6th edition
Lensink, M. F., Velankar, S., & Wodak, S. J. (2017) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25215 · Cited by 222 · cited 1×
“These scores are commonly used to rank interfaces, notably in blind prediction challenges [30,36].”
BackgroundBlind prediction of homo- and hetero-protein complexes: the CASP13-CAPRI experiment
Lensink, M. F., Brysbaert, G., Nadzirin, N., Velankar, S., Chaleil, R. A. G., Gerguri, T., Bates, P. A., Laine, E., Carbone, A., Grudinin, S., et al. (2019) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25838 · Cited by 122 · cited 1×
“These results are consistent with the outstanding performance of the Venclovas team in recent blind prediction challenges [43,49,53].”
ResultSelf-citation
Research works printed but not linked: 76
- 10.1038/nrg2918 · DOI · Paper page
- 10.1038/nsb1203-980 · DOI · Paper page
- 10.1126/science.abj8754 · doi:10.1126/science.abj8754 · Paper page
- 10.1016/j.sbi.2019.05.024 · DOI · Paper page
- 10.1038/s41467-021-27287-4 · DOI · Paper page
- 10.1371/journal.pcbi.0020155 · DOI · Paper page
- 10.1002/prot.340230413 · DOI · Paper page
- 10.1186/s12900-014-0022-0 · DOI
- 10.1016/j.jmb.2007.05.022 · DOI · Paper page
- 10.1093/bioinformatics/19.1.163 · DOI · Paper page
- 10.1016/S0065-3233(02)61001-0 · DOI · Paper page
- 10.1016/j.sbi.2004.02.003 · DOI
- 10.1002/prot.25889 · DOI · Paper page
- 10.1002/prot.24736 · DOI
- 10.1002/prot.21117 · DOI · Paper page
- 10.1007/978-1-4939-7759-8_28 · DOI
- 10.1002/prot.25278 · DOI · Paper page
- 10.1038/s41467-021-27396-0 · DOI · Paper page
- 10.1002/prot.22106 · DOI · Paper page
- 10.1002/prot.22830 · DOI · Paper page
- 10.1016/j.str.2021.01.005 · DOI
- 10.1002/pro.3295 · DOI · Paper page
- 10.21769/BioProtoc.2124 · DOI · Paper page
- 10.1002/prot.24678 · DOI · Paper page
- 10.1093/bioadv/vbab042 · DOI
- 10.1038/s41467-020-14301-4 · DOI · Paper page
- 10.1038/nmeth.4510 · DOI
- 10.1016/0300-9084(96)88166-1 · DOI
- 10.1007/978-0-387-21606-5 · DOI · Paper page
- 10.1002/prot.26257 · DOI · Paper page
- 10.1038/s41467-022-28865-w · doi:10.1038/s41467-022-28865-w · Paper page
- 10.1038/s41592-022-01488-1 · doi:10.1038/s41592-022-01488-1 · Paper page
- 10.3389/fmolb.2021.787510 · DOI
- 10.1002/prot.25870 · DOI · Paper page
- Pedregosa F., 2012, Scikit‐learn: Machine learning in python, arXiv [cs.LG], 2825
- Lundberg S. M. &Lee S.‐I.(2017).Proceedings of the 31st International Conference on Neural Information Processing Systems Curran Associates Inc. Red Hook NY USA 4768–4777.
- 10.1038/s41598-017-09654-8 · DOI · Paper page
- 10.1016/j.jmb.2008.06.002 · DOI
- 10.1002/prot.26222 · DOI · Paper page
- 10.1107/S0907444913007051 · DOI · Paper page
- 10.1093/nar/gkx1069 · DOI · Paper page
- 10.1093/nar/gkac937 · DOI
- 10.3389/fbinf.2022.959160 · DOI · Paper page
- 10.1093/bioinformatics/btz863 · DOI · Paper page
- Yan L., ggvenn: Venn Diagram by ggplot2, with really easy‐to‐use API
- 10.1093/bioinformatics/btu594 · DOI · Paper page
- 10.1002/prot.21419 · DOI · Paper page
- 10.1186/2046-1682-5-7 · DOI
- 10.1371/journal.pone.0162143 · DOI
- 10.1093/nar/gkz367 · DOI · Paper page
- 10.1093/bioinformatics/btt560 · DOI · Paper page
- 10.1002/prot.21949 · DOI · Paper page
- 10.1002/prot.23086 · DOI · Paper page
- 10.1093/bioinformatics/btz437 · DOI · Paper page
- 10.1016/j.jmb.2015.09.014 · DOI · Paper page
- 10.1093/bioinformatics/btac759 · DOI · Paper page
- 10.1002/pro.2187 · DOI · Paper page
- 10.1016/S0022-2836(03)00670-3 · DOI · Paper page
- 10.1002/prot.24314 · DOI
- Hubbard S. J., 1993, computer program. Department of Biochemistry and Molecular Biology
- 10.12688/f1000research.7931.1 · DOI · Paper page
- 10.1016/j.bpj.2011.09.012 · DOI · Paper page
- 10.1093/bioinformatics/btz870 · DOI · Paper page
- 10.3389/fmolb.2021.647915 · DOI · Paper page
- 10.1002/prot.24079 · DOI · Paper page
- 10.1093/bioinformatics/bty355 · DOI · Paper page
- 10.1093/bioinformatics/btx044 · DOI
- 10.1093/bioinformatics/btr638 · DOI · Paper page
- 10.1186/1472-6807-8-21 · DOI · Paper page
- 10.1093/nar/gky427 · DOI · Paper page
- 10.1093/nar/gky377 · DOI · Paper page
- 10.1093/bioinformatics/btt260 · DOI · Paper page
- 10.1038/s41592-019-0666-6 · DOI · Paper page
- 10.1002/jcc.23538 · DOI · Paper page
- 10.1093/bioinformatics/btr484 · DOI · Paper page
- 10.1016/j.febslet.2010.02.021 · DOI
Cited by
An atlas of protein homo-oligomerization across domains of life
Schweke, H., Pacesa, M., Levin, T., Goverde, C. A., Kumar, P., Duhoo, Y., Dornfeld, L. J., Dubreuil, B., Georgeon, S., Ovchinnikov, S., et al. (2024) · Cell · doi:10.1016/j.cell.2024.01.022 · Cited by 144
Self-citation(2023) · doi:10.1093/bioadv/vbad191 · Cited by 37
Assessing scoring metrics for AlphaFold2 and AlphaFold3 protein complex predictions
Genz, L. R., Nair, S., Nagar, N., & Topf, M. (2025) · Protein Science · doi:10.1002/pro.70327 · Cited by 17
Assessing scoring metrics for AlphaFold2 and AlphaFold3 protein complex predictions
Genz, L. R., Nair, S., Nagar, N., & Topf, M. (2025) · doi:10.1101/2025.04.16.648930 · Cited by 5
(2025) · doi:10.1093/nar/gkaf1099 · Cited by 4
Metadata
- Authors
- Schweke, H., Xu, Q., Tauriello, G., Pantolini, L., Schwede, T., Cazals, F., Lhéritier, A., Fernandez‐Recio, J., Rodríguez‐Lumbreras, L. A., Schueler‐Furman, O., Varga, J. K., Jiménez‐García, B., Réau, M. F., Bonvin, A. M. J. J., Savojardo, C., Martelli, P., Casadio, R., Tubiana, J., Wolfson, H. J., Oliva, R., Barradas‐Bautista, D., Ricciardelli, T., Cavallo, L., Venclovas, Č., Olechnovič, K., Guerois, R., Andreani, J., Martin, J., Wang, X., Terashi, G., Sarkar, D., Christoffer, C., Aderinwale, T., Verburgt, J., Kihara, D., Marchand, A., Correia, B. E., Duan, R., Qiu, L., Xu, X., Zhang, S., Zou, X., Dey, S., Dunbrack, R. L., Levy, E. D., & Wodak, S. J.
- Venue
- PROTEOMICS
- Publisher
- Wiley
- Published
- 2023-06-27
- Volume
- 23
- Issue
- 17
- Pages
- e2200323-e2200323
- ISSN
- 1615-9853 (ISSN-L)
- 1615-9861
- OpenAlex
- W4382181821
- Cited by
- 22
- References
- 15
- FWCI
- 1.55
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Horizon 2020 Framework Programme (819318, 823830)
- National Science Foundation (DMS2151678, DBI2003635, CMMI1825941, MCB2146026, MCB1925643)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (718.015.001)
- H2020 Marie Skłodowska-Curie Actions (801342)
- Ministerio de Ciencia e Innovación (PID2019‐110167RB‐I00 / AEI / 10.13039/501100011033)
- Netherlands eScience Center (ASDI.2016.043)
- National Institutes of Health (R01GM133840)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.