How well can the accuracy of comparative protein structure models be predicted?
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Comparative structure models are available for two orders of magnitude more protein sequences than are experimentally determined structures. These models, however, suffer from two limitations that experimentally determined structures do not: They frequently contain significant errors, and their accuracy cannot be readily assessed. We have addressed the latter limitation by developing a protocol optimized specifically for predicting the Cα root‐mean‐squared deviation (RMSD) and native overlap (NO3.5Å) errors of a model in the absence of its native structure. In contrast to most traditional assessment scores that merely predict one model is more accurate than others, this approach quantifies the error in an absolute sense, thus helping to determine whether or not the model is suitable for intended applications. The assessment relies on a model‐specific scoring function constructed by a support vector machine. This regression optimizes the weights of up to nine features, including various sequence similarity measures and statistical potentials, extracted from a tailored training set of models unique to the model being assessed: If possible, we use similarly sized models with the same fold; otherwise, we use similarly sized models with the same secondary structure composition. This protocol predicts the RMSD and NO3.5Å errors for a diverse set of 580,317 comparative models of 6174 sequences with correlation coefficients ( r ) of 0.84 and 0.86, respectively, to the actual errors. This scoring function achieves the best correlation compared to 13 other tested assessment criteria that achieved correlations ranging from 0.35 to 0.71.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Comparative Protein Modelling by Satisfaction of Spatial Restraints
Šali, A., & Blundell, T. L. (1993) · Journal of Molecular Biology · doi:10.1006/jmbi.1993.1626 · Cited by 12,977
Self-citationComparative Protein Structure Modeling of Genes and Genomes
Martí-Renom, M. A., Stuart, A. C., Fiser, A., Sánchez, R., Melo, F., & Šali, A. (2000) · Annual Review of Biophysics and Biomolecular Structure · doi:10.1146/annurev.biophys.29.1.291 · Cited by 3,169 · cited 1×
“Comparative modeling is the most widely used and generally most accurate class of protein structure prediction approaches (Marti-Renom et al. 2000; Tramontano et al. 2001; Eswar et al. 2007).”
MethodSelf-citationThe relation between the divergence of sequence and structure in proteins.
Chothia, C., & Lesk, A. M. (1986) · The EMBO Journal · doi:10.1002/j.1460-2075.1986.tb04288.x · Cited by 2,458 · cited 2×
“At lower values of sequence identity, especially below 30%, alignment errors and differences between the target and template structures can become major sources of errors (Chothia and Lesk 1986; Rost 1999; Sauder et al. 2000; Jaroszewski et al. 2002; Ginalski et al. 2005; Madhusudhan et al. 2006; Rai and Fiser 2006).”
BackgroundScoring function for automated assessment of protein structure template quality
Zhang, Y., & Skolnick, J. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20264 · Cited by 2,392
Modeling of loops in protein structures
Fiser, A., Do, R. K. G., & Šali, A. (2000) · Protein Science · doi:10.1110/ps.9.9.1753 · Cited by 2,116 · cited 5×
“Predicting the absolute accuracy of a model is particularly difficult due to the lack of principled reasons why an individual assessment score should correlate well with accuracy measures such as RMSD, particularly if the models are not native-like (Fiser et al. 2000).”
BackgroundInfluentialTwilight zone of protein sequence alignments
Rost, B. (1999) · Protein Engineering, Design and Selection · doi:10.1093/protein/12.2.85 · Cited by 1,833 · cited 2×
“At lower values of sequence identity, especially below 30%, alignment errors and differences between the target and template structures can become major sources of errors (Chothia and Lesk 1986; Rost 1999; Sauder et al. 2000; Jaroszewski et al. 2002; Ginalski et al. 2005; Madhusudhan et al. 2006; Rai and Fiser 2006).”
BackgroundProtein Structure Prediction and Structural Genomics
Baker, D., & Sali, A. (2001) · Science · doi:10.1126/science.1065659 · Cited by 1,587
Zhou, H., & Zhou, Y. (2002) · Protein Science · doi:10.1110/ps.0217002 · Cited by 902 · cited 2×
“2002; McGuffin and Jones 2003; Melo and Sali 2007), (2) discriminating between the native and near-native states (Sippl 1993; Melo and Feytmans 1997, 1998; Park et al. 1997; Fiser et al. 2000; Lazaridis and Karplus 2000; Zhou and Zhou 2002; Seok et al. 2003; Tsai et al. 2003; Shen and Sali 2006), (3) selecting the mos…”
BackgroundAn improved protein decoy set for testing energy functions for protein structure prediction
Tsai, J., Bonneau, R., Morozov, A. V., Kuhlman, B., Rohl, C. A., & Baker, D. (2003) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.10454 · Cited by 158 · cited 3×
“2002; McGuffin and Jones 2003; Melo and Sali 2007), (2) discriminating between the native and near-native states (Sippl 1993; Melo and Feytmans 1997, 1998; Park et al. 1997; Fiser et al. 2000; Lazaridis and Karplus 2000; Zhou and Zhou 2002; Seok et al. 2003; Tsai et al. 2003; Shen and Sali 2006), (3) selecting the mos…”
Background
Cited by
Comparative Protein Structure Modeling Using MODELLER
Webb, B., & Sali, A. (2016) · Current Protocols in Bioinformatics · doi:10.1002/cpbi.3 · Cited by 4,316
Self-citationComparative Protein Structure Modeling Using MODELLER
Eswar, N., Webb, B., Marti‐Renom, M. A., Madhusudhan, M. S., Eramian, D., Shen, M., Pieper, U., & Sali, A. (2007) · Current Protocols in Protein Science · doi:10.1002/0471140864.ps0209s50 · Cited by 2,846
Self-citationToward the estimation of the absolute quality of individual protein structure models
Benkert, P., Biasini, M., & Schwede, T. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btq662 · Cited by 2,260
Guex, N., Peitsch, M. C., & Schwede, T. (2009) · ELECTROPHORESIS · doi:10.1002/elps.200900140 · Cited by 2,097
Protein Structure Modeling with MODELLER
Eswar, N., Eramian, D., Webb, B., Shen, M.-Y., & Sali, A. (2008) · Methods in Molecular Biology · doi:10.1007/978-1-60327-058-8_8 · Cited by 1,773
Self-citation
Metadata
- Authors
- Eramian, D., Eswar, N., Shen, M., & Sali, A.
- Venue
- Protein Science
- Publisher
- Wiley
- Published
- 2008-11
- Volume
- 17
- Issue
- 11
- Pages
- 1881-1893
- ISSN
- 0961-8368 (ISSN-L)
- 1469-896X
- OpenAlex
- W2162751934
- Cited by
- 144
- References
- 9
- FWCI
- 3.72
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.