Estimation of model accuracy in CASP15 using the M odFOLDdock server
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
In CASP15, there was a greater emphasis on multimeric modeling than in previous experiments, with assembly structures nearly doubling in number (41 up from 22) since the previous round. CASP15 also included a new estimation of model accuracy (EMA) category in recognition of the importance of objective quality assessment (QA) for quaternary structure models. ModFOLDdock is a multimeric model QA server developed by the McGuffin group at the University of Reading, which brings together a range of single‐model, clustering, and deep learning methods to form a consensus of approaches. For CASP15, three variants of ModFOLDdock were developed to optimize for the different facets of the quality estimation problem. The standard ModFOLDdock variant produced predicted scores optimized for positive linear correlations with the observed scores. The ModFOLDdockR variant produced predicted scores optimized for ranking, that is, the top‐ranked models have the highest accuracy. In addition, the ModFOLDdockS variant used a quasi‐single model approach to score each model on an individual basis. The scores from all three variants achieved strongly positive Pearson correlation coefficients with the CASP observed scores (oligo‐lDDT) in excess of 0.70, which were maintained across both homomeric and heteromeric model populations. In addition, at least one of the ModFOLDdock variants was consistently ranked in the top two methods across all three EMA categories. Specifically, for overall global fold prediction accuracy, ModFOLDdock placed second and ModFOLDdockR placed third; for overall interface quality prediction accuracy, ModFOLDdockR, ModFOLDdock, and ModFOLDdockS were placed above all other predictor methods, and ModFOLDdockR and ModFOLDdockS were placed second and third respectively for individual residue confidence scores. The ModFOLDdock server is available at: https://www.reading.ac.uk/bioinf/ModFOLDdock/. ModFOLDdock is also available as part of the MultiFOLD docker package: https://hub.docker.com/r/mcguffin/multifold.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Mariani, V., Biasini, M., Barbato, A., & Schwede, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt473 · Cited by 1,138
DockQ: A Quality Measure for Protein-Protein Docking Models
Basu, S., & Wallner, B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0161879 · Cited by 460
High‐accuracy protein structure prediction in CASP14
Pereira, J., Simpkin, A. J., Hartmann, M. D., Rigden, D. J., Keegan, R. M., & Lupas, A. N. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26171 · Cited by 314
Assessment of the CASP14 assembly predictions
Ozden, B., Kryshtafovych, A., & Karaca, E. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26199 · Cited by 41
Research works printed but not linked: 14
- 10.1093/nar/gkab321 · DOI · Paper page
- 10.1093/nar/gkad297 · DOI · Paper page
- 10.1002/prot.26542 · DOI
- 10.1093/nar/gkp318 · DOI · Paper page
- 10.1002/prot.26569 · DOI · Paper page
- 10.1002/prot.26564 · DOI · Paper page
- 10.1093/bioinformatics/btac056 · DOI · Paper page
- 10.1002/jcc.23538 · DOI · Paper page
- 10.1002/prot.25360 · DOI
- 10.1093/nar/gkx332 · DOI · Paper page
- 10.1038/s41598‐017‐09654‐8 · DOI · Paper page
- 10.1107/S0907444913007051 · DOI · Paper page
- 10.1002/prot.21804 · DOI · Paper page
- 10.1038/s41592‐022‐01488‐1 · doi:10.1038/s41592-022-01488-1 · Paper page
Cited by
Critical assessment of methods of protein structure prediction ( CASP )—Round XV
Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K., & Moult, J. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26617 · Cited by 148
“But some publicly available methods requiring at most a few additional models rank highly and may be valuable for users, for example, 32,37,38 in this issue.”
MethodAssessing protein model quality based on deep graph coupled networks using protein language model
(2023) · doi:10.1093/bib/bbad420 · Cited by 18
Assessing scoring metrics for AlphaFold2 and AlphaFold3 protein complex predictions
Genz, L. R., Nair, S., Nagar, N., & Topf, M. (2025) · Protein Science · doi:10.1002/pro.70327 · Cited by 17
Diverse genetic contexts of HicA toxin domains propose a role in anti-phage defense
Gerdes, K. (2024) · mBio · doi:10.1128/mbio.03293-23 · Cited by 14
Estimating protein complex model accuracy using graph transformers and pairwise similarity graphs
Liu, J., Neupane, P., & Cheng, J. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf180 · Cited by 6
Metadata
- Authors
- Edmunds, N. S., Alharbi, S. M. A., Genc, A. G., Adiyaman, R., & McGuffin, L. J.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2023-06-14
- Volume
- 91
- Issue
- 12
- Pages
- 1871-1878
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W4380577696
- Cited by
- 23
- References
- 5
- FWCI
- 1.72
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Biotechnology and Biological Sciences Research Council (BB/T018496/1)
- Saudi Arabian Cultural Bureau
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Estimation of model accuracy in CASP15 using the M odFOLDdock server. https://app.cochat.ai/papers/10.1002/prot.26532
- The paper
- Edmunds, N. S., Alharbi, S. M. A., Genc, A. G., Adiyaman, R., & McGuffin, L. J. (2023). Estimation of model accuracy in CASP15 using the M odFOLDdock server. Proteins: Structure, Function, and Bioinformatics. https://doi.org/10.1002/prot.26532
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.