lDDT: a local superposition-free score for comparing protein structures and models using distance difference tests
Open accessThe DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Motivation: The assessment of protein structure prediction techniques requires objective criteria to measure the similarity between a computational model and the experimentally determined reference structure. Conventional similarity measures based on a global superposition of carbon α atoms are strongly influenced by domain motions and do not assess the accuracy of local atomic details in the model. Results: The Local Distance Difference Test (lDDT) is a superposition-free score that evaluates local distance differences of all atoms in a model, including validation of stereochemical plausibility. The reference can be a single structure, or an ensemble of equivalent structures. We demonstrate that lDDT is well suited to assess local model quality, even in the presence of domain movements, while maintaining good correlation with global measures. These properties make lDDT a robust tool for the automated assessment of structure prediction servers without manual intervention. Availability and implementation: Source code, binaries for Linux and MacOSX, and an interactive web server are available at http://swissmodel.expasy.org/lddt Contact: torsten.schwede@unibas.ch Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As a confidence metric based on lDDT, pLDDT also reflects local confidence in the structure, and should be used, for example, to assess confidence within a single domain.”
From AlphaFold Protein Structure Database: massively expanding the structural coverage of protein-sequence space with high-accuracy models (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AlphaFold yields a per-residue estimate of its confidence, known as pLDDT, ranging from 0 to 100, indicating the tool's predicted score on the lDDT-Cα metric (19).”
From AlphaFold Protein Structure Database in 2024: providing structure coverage for over 214 million protein sequences (2024) · cites this paper as [19]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Empirically, this final relaxation does not improve the accuracy of the model as measured by the global distance test (GDT)33 or lDDT-Cα34 but does remove distracting stereochemical violations without the loss of accuracy.”
From Highly accurate protein structure prediction with AlphaFold (2021) · cites this paper as [34]
The cited source says what the claim attributes to it.
In the citing paper
“this metric reports the domain accuracy without requiring a domain segmentation of chain structures”
From Highly accurate protein structure prediction with AlphaFold (2021) · cites this paper as [34]
In the citing paper
“the predicted Local Distance Difference Test (pLDDT) score, which ranges from 0 to 100 with higher values assigned higher confidence in the model”
From The power and pitfalls of AlphaFold2 for structure prediction beyond rigid globular proteins (2024) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MolProbity : all-atom structure validation for macromolecular crystallography
Chen, V. B., Arendall, W. B., Headd, J. J., Keedy, D. A., Immormino, R. M., Kapral, G. J., Murray, L. W., Richardson, J. S., & Richardson, D. C. (2010) · Acta Crystallographica Section D Biological Crystallography · doi:10.1107/s0907444909042073 · Cited by 14,115
The Cambridge Structural Database: a quarter of a million crystal structures and rising
Allen, F. H. (2002) · Acta Crystallographica Section B Structural Science · doi:10.1107/s0108768102003890 · Cited by 9,898
Statistical mechanics of chain molecules
Flory, P. J., & Volkenstein, M. (1969) · Biopolymers · doi:10.1002/bip.1969.360080514 · Cited by 6,427
International Tables for Crystallography: Physical properties of crystals
(2013) · International Tables for Crystallography · doi:10.1107/97809553602060000113 · Cited by 3,794
Accurate bond and angle parameters for X-ray protein structure refinement
Engh, R. A., & Huber, R. (1991) · Acta Crystallographica Section A Foundations of Crystallography · doi:10.1107/s0108767391001071 · Cited by 2,489
Scoring function for automated assessment of protein structure template quality
Zhang, Y., & Skolnick, J. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20264 · Cited by 2,392
Guex, N., Peitsch, M. C., & Schwede, T. (2009) · ELECTROPHORESIS · doi:10.1002/elps.200900140 · Cited by 2,097
Self-citationImproved prediction of protein side‐chain conformations with SCWRL4
Krivov, G. G., Shapovalov, M. V., & Dunbrack, R. L. (2009) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.22488 · Cited by 1,301
LGA: a method for finding 3D similarities in protein structures
Zemla, A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg571 · Cited by 1,069
Critical assessment of methods of protein structure prediction (CASP) — round x
Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A. (2014) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.24452 · Cited by 652
Self-citationA decade of CASP: progress, bottlenecks and prognosis in protein structure prediction
Moult, J. (2005) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2005.05.011 · Cited by 484
A New Generation of Crystallographic Validation Tools for the Protein Data Bank
Read, R. J., Adams, P. D., Arendall, W. B., Brunger, A. T., Emsley, P., Joosten, R. P., Kleywegt, G. J., Krissinel, E. B., Lütteke, T., Otwinowski, Z., et al. (2011) · Structure · doi:10.1016/j.str.2011.08.006 · Cited by 467
Flexible protein–ligand docking by global energy optimization in internal coordinates
Totrov, M., & Abagyan, R. (1997) · Proteins: Structure, Function, and Genetics · doi:10.1002/(sici)1097-0134(1997)1+<215::aid-prot29>3.0.co;2-q · Cited by 407
MaxSub: an automated measure for the assessment of protein structure prediction quality
Siew, N., Elofsson, A., Rychlewski, L., & Fischer, D. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.9.776 · Cited by 401
Critical assessment of methods of protein structure prediction (CASP)—round IX
Moult, J., Fidelis, K., Kryshtafovych, A., & Tramontano, A. (2011) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.23200 · Cited by 211
Assessment of template based protein structure predictions in CASP9
Mariani, V., Kiefer, F., Schmidt, T., Haas, J., & Schwede, T. (2011) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.23177 · Cited by 179
Self-citationAssessment of CASP7 predictions for template-based modeling targets
Kopp, J., Bordoli, L., Battey, J. N. D., Kiefer, F., & Schwede, T. (2007) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.21753 · Cited by 163
Self-citationA critical assessment of comparative molecular modeling of tertiary structures of proteins*
Mosimann, S. C., Meleshko, R. A., & James, M. N. G. (1995) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.340230305 · Cited by 158
Processing and evaluation of predictions in CASP4
Zemla, A. T., Venclovas, ?., Moult, J., & Fidelis, K. A. (2001) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.10052 · Cited by 157
CAD‐score: A new contact area difference‐based function for evaluation of protein structural models
Olechnovič, K., Kulberkytė, E., & Venclovas, Č. (2012) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24172 · Cited by 154
Outcome of a Workshop on Applications of Protein Models in Biomedical Research
Schwede, T. F., Šali, A., Honig, B. H., Levitt, M., Berman, H. M., Jones, D. T., Brenner, S. E., Burley, S. K., Das, R., Dokholyan, N. V., et al. (2009) · Structure · doi:10.1016/j.str.2008.12.014 · Cited by 150
Self-citationCuff, A. L., Sillitoe, I., Lewis, T. E., Clegg, A. B., Rentzsch, R., Furnham, N., Pellegrini‐Calace, M., Jones, D. T., Thornton, J. M., & Orengo, C. A. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq1001 · Cited by 136
Clustering biomolecular complexes by residue contacts similarity
Rodrigues, J., Trellet, M. E., Schmitz, C., Kastritis, P. L., Karaca, E., Melquiond, A. S. J., & Bonvin, A. M. J. J. (2012) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24078 · Cited by 132
Physical Chemistry of High Polymers
Huggins, M. L., & Salzberg, H. W. (1959) · Journal of The Electrochemical Society · doi:10.1149/1.2427486 · Cited by 126
Automated server predictions in CASP7
Battey, J. N. D., Kopp, J., Bordoli, L., Read, R. J., Clarke, N. D., & Schwede, T. F. (2007) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.21761 · Cited by 117
Self-citationPredicting the accuracy of protein–ligand docking on homology models
Bordogna, A., Pandini, A., & Bonati, L. (2011) · Journal of Computational Chemistry · doi:10.1002/jcc.21601 · Cited by 107
Assessment of comparative modeling in CASP2
Martin, A. C. R., MacArthur, M. W., & Thornton, J. M. (1997) · Proteins Structure Function and Bioinformatics · doi:10.1002/(sici)1097-0134(1997)1+<14::aid-prot4>3.0.co;2-o · Cited by 104
CASP prediction center infrastructure and evaluation measures in CASP10 and CASP ROLL
Kryshtafovych, A., Monastyrskyy, B., & Fidelis, K. A. (2013) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24399 · Cited by 101
Assessment of protein structure refinement in CASP9
Maccallum, J., Pérez, A., Schnieders, M., Hua, L., Jacobson, M., & Dill, K. (2011) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.23131 · Cited by 97
Kinch, L. N., Shi, S., Cheng, H., Cong, Q., Pei, J., Mariani, V., Schwede, T. F., & Grishin, N. V. (2011) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.23190 · Cited by 88
Self-citationKeedy, D. A., Williams, C. J., Headd, J. J., Arendall, W. B., Chen, V. B., Kapral, G. J., Gillespie, R. A., Block, J. N., Zemla, A. T., Richardson, D. C., et al. (2009) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.22551 · Cited by 80
On distance and similarity in fold space
Sippl, M. J. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn040 · Cited by 59
Structure quality and target parameters
Engh, R. A., & Huber, R. (2012) · International Tables for Crystallography · doi:10.1107/97809553602060000857 · Cited by 54
RPF: a quality assessment tool for protein NMR structures
Huang, Y. J., Rosato, A., Singh, G., & Montelione, G. T. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks373 · Cited by 50
CASP3 comparative modeling evaluation
Jones, T., & Kleywegt, G. (1999) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/(sici)1097-0134(1999)37:3+<30::aid-prot6>3.0.co;2-s · Cited by 50
Structure quality and target parameters
Engh, R. A., & Huber, R. (2006) · International Tables for Crystallography · doi:10.1107/97809553602060000695 · Cited by 49
Hubbard, T. (1999) · Proteins Structure Function and Bioinformatics · doi:10.1002/(sici)1097-0134(1999)37:3+<15::aid-prot4>3.0.co;2-z · Cited by 47
Statistical properties of contact maps
Vendruscolo, M., Subramanian, B., Kanter, I., Domany, E., & Lebowitz, J. L. (1999) · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · doi:10.1103/physreve.59.977 · Cited by 42
OpenStructure: a flexible software framework for computational structural biology
Biasini, M., Mariani, V., Haas, J., Scheuber, S., Schenk, A. D., Schwede, T. F., & Philippsen, A. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq481 · Cited by 38
Self-citationAnalysis of CASP8 targets, predictions and assessment methods
Shi, S., Pei, J., Sadreyev, R. I., Kinch, L. N., Majumdar, I., Tong, J., Cheng, H., Kim, B., & Grishin, N. V. (2009) · Database · doi:10.1093/database/bap003 · Cited by 38
Improved Technologies Now Routinely Provide Protein NMR Structures Useful for Molecular Replacement
Mao, B., Guan, R., & Montelione, G. T. (2011) · Structure · doi:10.1016/j.str.2011.04.005 · Cited by 36
Domain definition and target classification for CASP7
Clarke, N. D., Ezkurdia, I., Kopp, J., Read, R. J., Schwede, T. F., & Tress, M. L. (2007) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.21686 · Cited by 27
Self-citationFlexE: Using Elastic Network Models to Compare Models of Protein Structure
Pérez, A., Yang, Z., Bahar, İ., Dill, K. A., & MacCallum, J. L. (2012) · Journal of Chemical Theory and Computation · doi:10.1021/ct300148f · Cited by 24
Physical chemistry of high polymers
Oster, G. (1959) · Journal of Chemical Education · doi:10.1021/ed036pa176.1 · Cited by 24
Cited by
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate structure prediction of biomolecular interactions with AlphaFold 3
Abramson, J., Adler, J., Dunger, J., Evans, R., Green, T., Pritzel, A., Ronneberger, O., Willmore, L., Ballard, A. J., Bambrick, J., et al. (2024) · Nature · doi:10.1038/s41586-024-07487-w · Cited by 15,861
SWISS-MODEL: homology modelling of protein structures and complexes
Waterhouse, A., Bertoni, M., Bienert, S., Studer, G., Tauriello, G., Gumienny, R., Heer, F. T., de Beer, T. A. P., Rempfer, C., Bordoli, L., et al. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky427 · Cited by 13,067
Self-citationVaradi, M., Anyango, S., Deshpande, M., Nair, S., Natassia, C., Yordanova, G., Yuan, D., Stroe, O., Wood, G., Laydon, A., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1061 · Cited by 7,850
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Metadata
- Authors
- Mariani, V., Biasini, M., Barbato, A., & Schwede, T.
- Affiliations
- SIB Swiss Institute of Bioinformatics (CH)
- Corresponding author
- Schwede, Torsten
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-08-27
- Volume
- 29
- Issue
- 21
- Pages
- 2722-2728
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC3799472
- OpenAlex
- W2140673705
- Cited by
- 1,138
- References
- 44
- Citations by year
- 2026: 142 · 2025: 258 · 2024: 211 · 2023: 221 · 2022: 145 · 2021: 72 · 2020: 17 · 2019: 22 · 2018: 12 · 2017: 9 · 2016: 8 · 2015: 10 · 2014: 5 · 2013: 5
- FWCI
- 4.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- reroDoc Digital Library (submittedVersion)
- Funders
- Swiss Institute of Bioinformatics
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Keywords
- protein structure comparison, model quality assessment, domain motion, structure ensemble
- MeSH terms
- Models, Molecular, Protein Conformation, Proteins, Software, Stereoisomerism, Protein Structure, Tertiary, Protein Folding, Computational Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.