PreprintCited by 411Protein Structure and DynamicsEnzyme Structure and FunctionMachine Learning in Bioinformatics

AlphaFold predictions are valuable hypotheses, and accelerate but do not replace experimental structure determination

Open access
Terwilliger, Thomas C., Liebschner, Dorothee, Croll, Tristan I., Williams, Christopher J., McCoy, Airlie J., Poon, Billy K., Afonine, Pavel V., Oeffner, Robert D. +3 more·2022·Nature Methods

Preprint — published as 10.1038/s41592-023-02087-4 · Paper page

Abstract

AI-based methods such as AlphaFold have revolutionized structural biology, often making it possible to predict protein structures with high accuracy. The accuracies of these predictions vary, however, and they do not include ligands, covalent modifications or other environmental factors. Here we focus on very-high-confidence parts of AlphaFold predictions, evaluating how well they can be expected to describe the structure of a protein in a particular environment. We compare predictions with experimental crystallographic maps of the same proteins for 102 crystal structures. In many cases, those parts of AlphaFold predictions that were predicted with very high confidence matched experimental maps remarkably closely. In other cases, these predictions differed from experimental maps on a global scale through distortion and domain orientation, and on a local scale in backbone and side-chain conformation. Overall, C α atoms in very-high-confidence parts of AlphaFold predictions differed from corresponding crystal structures by a median of 0.6 Å, and about 10% of these differed by more than 2 Å, each about twice the values found for pairs of crystal structures containing the same components but determined in different space groups. We suggest considering AlphaFold predictions as exceptionally useful hypotheses. We further suggest that it is important to consider the confidence in prediction when interpreting AlphaFold predictions and to carry out experimental structure determination to verify structural details, particularly those that involve interactions not included in the prediction.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2022.11.21.517405

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Terwilliger, T. C., Liebschner, D., Croll, T. I., Williams, C. J., McCoy, A. J., Poon, B. K., Afonine, P. V., Oeffner, R. D., Richardson, J. S., Read, R. J., & Adams, P. D.
Affiliations
  • Los Alamos National Laboratory (US)
  • Lawrence Berkeley National Laboratory (US)
  • University of Cambridge (GB)
  • Duke University (US)
Corresponding author
Terwilliger, Thomas C.
Venue
Nature Methods
Publisher
openRxiv
Published
2022-11-22
Volume
21
Issue
1
Pages
110-116
ISSN
1548-7091 (ISSN-L)
OpenAlex
W4389174567
Cited by
411
References
5
Citations by year
2026: 123 · 2025: 150 · 2024: 113 · 2023: 22 · 2022: 2 · 2013: 1
FWCI
36.04
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Nature Methods (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • eScholarship (California Digital Library) (submittedVersion, cc-by)
  • Apollo (University of Cambridge) (submittedVersion, cc-by)
  • OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
  • Apollo (University of Cambridge) (submittedVersion)
  • Apollo
Funders
  • U.S. Department of Health and Human Services (GM063210)
  • Wellcome Trust (Z/17/Z, 209407/Z/17/Z, 209407)
  • National Institutes of Health (DE-AC02–05CH11231, GM063210)
  • National Institute of General Medical Sciences (P01GM063210, GM063210)
  • Laboratory Directed Research and Development (DEAC02-05CH11231)
  • Lawrence Berkeley National Laboratory (AC02‐05CH11231, DE-AC02-05CH11231, 05CH11231)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Physical Sciences › Materials Science › Materials Chemistry › Enzyme Structure and Function
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
Keywords
AlphaFold, protein structure prediction, prediction accuracy, prediction confidence, protein conformation, side-chain conformation, domain orientation, hypothesis generation
MeSH terms
Artificial Intelligence, Crystallography, Mental Processes, Protein Conformation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review