Estimation of model accuracy in CASP13
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Methods to reliably estimate the accuracy of 3D models of proteins are both a fundamental part of most protein folding pipelines and important for reliable identification of the best models when multiple pipelines are used. Here, we describe the progress made from CASP12 to CASP13 in the field of estimation of model accuracy (EMA) as seen from the progress of the most successful methods in CASP13. We show small but clear progress, that is, several methods perform better than the best methods from CASP12 when tested on CASP13 EMA targets. Some progress is driven by applying deep learning and residue‐residue contacts to model accuracy prediction. We show that the best EMA methods select better models than the best servers in CASP13, but that there exists a great potential to improve this further. Also, according to the evaluation criteria based on local similarities, such as lDDT and CAD, it is now clear that single model accuracy methods perform relatively better than consensus‐based methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
TM-align: a protein structure alignment algorithm based on the TM-score
Zhang, Y. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki524 · Cited by 3,774
HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
Mariani, V., Biasini, M., Barbato, A., & Schwede, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt473 · Cited by 1,138
Self-citationLGA: a method for finding 3D similarities in protein structures
Zemla, A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg571 · Cited by 1,069
Haas, J., Barbato, A., Behringer, D., Studer, G., Roth, S., Bertoni, M., Mostaguir, K., Gumienny, R., & Schwede, T. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25431 · Cited by 168
Self-citation
Cited by
Deep learning methods in protein structure prediction
Torrisi, M., Pollastri, G., & Le, Q. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2019.12.011 · Cited by 284
DeepUMQA: Ultrafast Shape Recognition-based Protein Model Quality Assessment using Deep Learning
Guo, S.-S., Liu, J., Zhou, X.-G., & Zhang, G.-J. (2021) · doi:10.1101/2021.10.02.462491 · Cited by 53
DeepUMQA: ultrafast shape recognition-based protein model quality assessment using deep learning
Guo, S.-S., Liu, J., Zhou, X.-G., & Zhang, G.-J. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac056 · Cited by 53
Inhibiting a promiscuous GPCR: iterative discovery of bitter taste receptor ligands
Fierro, F., Peri, L., Hübner, H., Tabor-Schkade, A., Waterloo, L., Löber, S., Pfeiffer, T., Weikert, D., Dingjan, T., Margulis, E., et al. (2023) · Cellular and Molecular Life Sciences · doi:10.1007/s00018-023-04765-0 · Cited by 36
Assessing protein model quality based on deep graph coupled networks using protein language model
(2023) · doi:10.1093/bib/bbad420 · Cited by 18
High-accuracy protein model quality assessment using attention graph neural networks
Zhang, P., Xia, C., & Shen, H.-B. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbac614 · Cited by 9
Estimating protein complex model accuracy using graph transformers and pairwise similarity graphs
Liu, J., Neupane, P., & Cheng, J. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf180 · Cited by 6
Self-citationChoi, J. (2023) · iScience · doi:10.1016/j.isci.2023.106911 · Cited by 1
Metadata
- Authors
- Cheng, J., Choe, M., Elofsson, A., Han, K., Hou, J., Maghrabi, A. H. A., McGuffin, L. J., Menéndez‐Hurtado, D., Olechnovič, K., Schwede, T., Studer, G., Uziela, K., Venclovas, Č., & Wallner, B.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2019-07-16
- Volume
- 87
- Issue
- 12
- Pages
- 1361-1377
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W2953524386
- Cited by
- 83
- References
- 5
- FWCI
- 4.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.