The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
DockQ: A Quality Measure for Protein-Protein Docking Models
Open accessAbstract
The state-of-the-art to assess the structural quality of docking models is currently based on three related yet independent quality measures: Fnat, LRMS, and iRMS as proposed and standardized by CAPRI. These quality measures quantify different aspects of the quality of a particular docking model and need to be viewed together to reveal the true quality, e.g. a model with relatively poor LRMS (>10Å) might still qualify as 'acceptable' with a descent Fnat (>0.50) and iRMS (<3.0Å). This is also the reason why the so called CAPRI criteria for assessing the quality of docking models is defined by applying various ad-hoc cutoffs on these measures to classify a docking model into the four classes: Incorrect, Acceptable, Medium, or High quality. This classification has been useful in CAPRI, but since models are grouped in only four bins it is also rather limiting, making it difficult to rank models, correlate with scoring functions or use it as target function in machine learning algorithms. Here, we present DockQ, a continuous protein-protein docking model quality measure derived by combining Fnat, LRMS, and iRMS to a single score in the range [0, 1] that can be used to assess the quality of protein docking models. By using DockQ on CAPRI models it is possible to almost completely reproduce the original CAPRI classification into Incorrect, Acceptable, Medium and High quality. An average PPV of 94% at 90% Recall demonstrating that there is no need to apply predefined ad-hoc cutoffs to classify docking models. Since DockQ recapitulates the CAPRI classification almost perfectly, it can be viewed as a higher resolution version of the CAPRI classification, making it possible to estimate model quality in a more quantitative way using Z-scores or sum of top ranked models, which has been so valuable for the CASP community. The possibility to directly correlate a quality measure to a scoring function has been crucial for the development of scoring functions for protein structure prediction, and DockQ should be useful in a similar development in the protein docking field. DockQ is available at http://github.com/bjornwallner/DockQ/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In a comparison with AlphaFold-Multimer (45) on a dataset of 2,978 recent multimeric complexes deposited in the PDB, ESMFold achieves the same qualitative DockQ (39) categorization for 53.2% of chain pairs, despite not being trained on protein complexes (Fig. S6).”
From Evolutionary-scale prediction of atomic level protein structure with a language model (2022) · cites this paper as [39]
The cited source says what the claim attributes to it.
In the citing paper
“Generally, protein–protein prediction success (DockQ > 0.23)40 has increased (paired Wilcoxon signed-rank test, P = 1.8 × 10−18)”
From Accurate structure prediction of biomolecular interactions with AlphaFold 3 (2024) · cites this paper as [40]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“As the bound form of the proteins is used, this should represent an easy case for GRAMM-based docking, and performance drops significantly when unbound structures or models are used53.”
From Improved prediction of protein-protein interactions using AlphaFold2 (2021) · cites this paper as [53]
Experimental — accuracy not yet measuredIn the citing paper
“the overall top models from AF2Complex are acceptable or better in 15 of 17 (88%) cases, and 13 (76%) models are of medium or high quality according to the DockQ score42 (Fig. 3a, Supplementary Data 1), with a mean of 0.62”
From AF2Complex predicts direct physical interactions in multimeric proteins with deep learning (2022) · cites this paper as [42]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scoring function for automated assessment of protein structure template quality
Zhang, Y., & Skolnick, J. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20264 · Cited by 2,392
ZDOCK: An initial‐stage protein‐docking algorithm
Chen, R., Li, L., & Weng, Z. (2003) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.10389 · Cited by 1,393 · cited 1×
“Thus, the scoring part of CAPRI [8] and benchmarks of scoring functions for docking [11,10,12,13] only focuses on the ability to select good models according to the CAPRI classification, completely ignoring the potential useful information in the lower ranked models in assessing the ability to…”
MethodAssessment of blind predictions of protein–protein interactions: Current status of docking methods
Méndez, R., Leplae, R., De Maria, L., & Wodak, S. J. (2003) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.10393 · Cited by 418 · cited 2×
“The backbone atoms of these 'interface' residues is then superposed on their equivalents in the predicted complex (model) to compute the iRMS [9].”
BackgroundMethodMaxSub: an automated measure for the assessment of protein structure prediction quality
Siew, N., Elofsson, A., Rychlewski, L., & Fischer, D. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.9.776 · Cited by 401 · cited 1×
“In contrast to the protein structure prediction field, where there are several widely accepted quality measures; e.g., C α -RMSD, GDT_TS [3], MaxSub [4], TM-score [5], and S-score [6], the IS-score [7] for assessing protein complex models has not achieved wide adoption by the field and the current…”
ResultDocking and scoring protein complexes: CAPRI 3rd Edition
Lensink, M. F., Méndez, R., & Wodak, S. J. (2007) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.21804 · Cited by 340 · cited 4×
“…standard, the average iRMS for the models with Medium quality classified incorrectly as High by DockQ is 1.05Å, and High quality classified incorrectly as Medium is 0.93Å, while the cutoff in iRMS between medium and high quality is 1.0Å (Medium < 1.0Å; High (cid:1) 1.0Å) according to CAPRI [10].”
BackgroundMethodInfluentialStructure of the Cytoplasmic β Subunit--T1 Assembly of Voltage-Dependent K + Channels
Gulbis, J. M., Zhou, M., Mann, S., & MacKinnon, R. (2000) · Science · doi:10.1126/science.289.5476.123 · Cited by 320
3did: a catalog of domain-based interactions of known three-dimensional structure
Mosca, R., Céol, A., Stein, A., Olivella, R., & Aloy, P. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt887 · Cited by 305 · cited 1×
“…in traditional structural biology and the structural genomics projects that aim at high-throughput complex structure determination [1], the latest statistics from 3did database [2] show that only 7% of the known protein interactions in humans have an associated experimental complex structure.”
BackgroundSwarmDock: a server for flexible protein–protein docking
Torchala, M., Moal, I. H., Chaleil, R. A. G., Fernandez-Recio, J., & Bates, P. A. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt038 · Cited by 285 · cited 1×
“This set contained 56,015 docking models for 118 targets from the protein-protein docking Benchmark 4.0 [17], constructed using SwarmDock [18] gra-ciously provided by the authors of Moal et al [13].”
MethodInfluentialProcessing and analysis of CASP3 protein structure predictions
Zemla, A., Venclovas, ?., Moult, J., & Fidelis, K. (1999) · Proteins: Structure, Function, and Genetics · doi:10.1002/(sici)1097-0134(1999)37:3+<22::aid-prot5>3.0.co;2-w · Cited by 282 · cited 1×
“In contrast to the protein structure prediction field, where there are several widely accepted quality measures; e.g., C α -RMSD, GDT_TS [3], MaxSub [4], TM-score [5], and S-score [6], the IS-score [7] for assessing protein complex models has not achieved wide adoption by the field and the current…”
ResultDocking, scoring, and affinity prediction in CAPRI
Lensink, M. F., & Wodak, S. J. (2013) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24428 · Cited by 249
Cited by
Accurate structure prediction of biomolecular interactions with AlphaFold 3
Abramson, J., Adler, J., Dunger, J., Evans, R., Green, T., Pritzel, A., Ronneberger, O., Willmore, L., Ballard, A. J., Bambrick, J., et al. (2024) · Nature · doi:10.1038/s41586-024-07487-w · Cited by 15,861
ColabFold - Making protein folding accessible to all
Mirdita, M., Schütze, K., Moriwaki, Y., Heo, L., Ovchinnikov, S., & Steinegger, M. (2021) · doi:10.1101/2021.08.15.456425 · Cited by 9,391
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
Protein complex prediction with AlphaFold-Multimer
Evans, R., O’Neill, M., Pritzel, A., Antropova, N., Senior, A., Green, T., Žídek, A., Bates, R., Blackwell, S., Yim, J., et al. (2021) · doi:10.1101/2021.10.04.463034 · Cited by 3,808
Harnessing protein folding neural networks for peptide–protein docking
Tsaban, T., Varga, J. K., Avraham, O., Ben-Aharon, Z., Khramushin, A., & Schueler-Furman, O. (2022) · Nature Communications · doi:10.1038/s41467-021-27838-9 · Cited by 1,205
Metadata
- Authors
- Basu, S., & Wallner, B.
- Affiliations
- Linköping University (SE)
- Corresponding author
- Wallner, Björn
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-08-25
- Volume
- 11
- Issue
- 8
- Pages
- e0161879
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4999177
- OpenAlex
- W2508425869
- Cited by
- 460
- References
- 26
- Citations by year
- 2026: 78 · 2025: 118 · 2024: 90 · 2023: 70 · 2022: 44 · 2021: 34 · 2020: 8 · 2019: 9 · 2018: 2 · 2017: 4 · 2016: 2
- FWCI
- 2.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DiVA (Linkoping University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Vetenskapsrådet (SE) (2012-5270)
- Swedish e-Science Research Center
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Keywords
- protein-protein docking, model ranking
- MeSH terms
- Algorithms, Protein Binding, Proteins, Reproducibility of Results, Computational Biology, Internet, Protein Interaction Mapping, Molecular Docking Simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: DockQ: A Quality Measure for Protein-Protein Docking Models. https://app.cochat.ai/papers/10.1371/journal.pone.0161879
- The paper
- Basu, S., & Wallner, B. (2016). DockQ: A Quality Measure for Protein-Protein Docking Models. PLOS ONE. https://doi.org/10.1371/journal.pone.0161879
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.