Cited by 411Protein Structure and DynamicsEnzyme Structure and FunctionMachine Learning in Bioinformatics

AlphaFold predictions are valuable hypotheses and accelerate but do not replace experimental structure determination

Open access
Terwilliger, Thomas C., Liebschner, Dorothee, Croll, Tristan I., Williams, Christopher J., McCoy, Airlie J., Poon, Billy K., Afonine, Pavel V., Oeffner, Robert D. +3 more·2024·Nature Methods

Published version of a preprint

Abstract

Artificial intelligence-based protein structure prediction methods such as AlphaFold have revolutionized structural biology. The accuracies of these predictions vary, however, and they do not take into account ligands, covalent modifications or other environmental factors. Here, we evaluate how well AlphaFold predictions can be expected to describe the structure of a protein by comparing predictions directly with experimental crystallographic maps. In many cases, AlphaFold predictions matched experimental maps remarkably closely. In other cases, even very high-confidence predictions differed from experimental maps on a global scale through distortion and domain orientation, and on a local scale in backbone and side-chain conformation. We suggest considering AlphaFold predictions as exceptionally useful hypotheses. We further suggest that it is important to consider the confidence in prediction when interpreting AlphaFold predictions and to carry out experimental structure determination to verify structural details, particularly those that involve interactions not included in the prediction.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41592-023-02087-4

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 28

  1. [2]Baek M Accurate prediction of protein structures and interactions using a three-track neural network Science 2021 373 871 876 10.1126/science.abj8754 34282049 PMC7612213 · DOI · Paper page
  2. [4]Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K. & Moult, J. Critical assessment of methods of protein structure prediction (CASP)—round XIV. Proteins89, 1607–1617 (2021). PMC8726744 34533838
  3. [7]van Breugel M Rosa e Silva I Andreeva A Structural validation and assessment of AlphaFold2 predictions for centrosomal and centriolar proteins and their complexes Commun. Biol. 2022 5 312 10.1038/s42003-022-03269-0 35383272 PMC8983713 · DOI
  4. [8]Subramaniam S Kleywegt GJ A paradigm shift in structural biology Nat. Methods 2022 19 20 23 10.1038/s41592-021-01361-7 35017736 · DOI
  5. [9]Ourmazd A Moffat K Lattman EE Structural biology is solved—now what? Nat. Methods 2022 19 24 26 10.1038/s41592-021-01357-3 35017723 · DOI
  6. [11]Shao C Bittrich S Wang S Burley SK Assessing PDB macromolecular crystal structure confidence at the individual amino acid residue level Structure 2022 30 1385 1394 10.1016/j.str.2022.08.004 36049478 PMC9547844 · DOI
  7. [12]Goulet A Cambillau C Present impact of AlphaFold2 revolution on structural biology, and an illustration with the structure prediction of the bacteriophage J-1 host adhesion device Front. Mol. Biosci. 2022 9 907452 10.3389/fmolb.2022.907452 35615740 PMC9124777 · DOI
  8. [13]Moore PB Hendrickson WA Henderson R Brunger AT The protein-folding problem: not yet solved Science 2022 375 507 10.1126/science.abn9422 35113705 · DOI
  9. [14]Acharya KR Lloyd MD The advantages and limitations of protein crystal structures Trends Pharmacol. Sci. 2005 26 10 14 10.1016/j.tips.2004.10.011 15629199 · DOI
  10. [15]Fraser JS Accessing protein conformational ensembles using room-temperature X-ray crystallography Proc. Natl Acad. Sci. USA 2011 108 16247 16252 10.1073/pnas.1111325108 21918110 PMC3182744 · DOI
  11. [18]wwPDB Consortium. Protein Data Bank: the single global archive for 3D macromolecular structure data Nucleic Acids Res. 2018 47 D520 D528 10.1093/nar/gky949 PMC6324056 30357364 · DOI · Paper page
  12. [19]Jumper J Hassabis D Protein structure predictions to atomic accuracy with AlphaFold Nat. Methods 2022 19 11 12 10.1038/s41592-021-01362-6 35017726 · DOI · Paper page
  13. [20]van Beusekom B Joosten K Hekkelman ML Joosten RP Perrakis A Homology-based loop modeling yields more complete crystallographic protein structures IUCrJ 2018 5 585 594 10.1107/S2052252518010552 30224962 PMC6126648 · DOI
  14. [21]Hryc CF Baker ML AlphaFold2 and CryoEM: revisiting CryoEM modeling in near-atomic resolution density maps iScience 2022 25 104496 10.1016/j.isci.2022.104496 35733789 PMC9207676 · DOI
  15. [24]Dunker AK Intrinsically disordered protein J. Mol. Graph. Model. 2001 19 26 59 10.1016/S1093-3263(00)00138-8 11381529 · DOI · Paper page
  16. [27]Terwilliger TC Improved AlphaFold modeling with implicit experimental information Nat. Methods 2022 19 1376 1382 10.1038/s41592-022-01645-6 36266465 PMC9636017 · DOI · Paper page
  17. [28]Zhang Q Re-sensitization of mcr carrying multidrug resistant bacteria to colistin by silver Proc. Natl Acad. Sci. USA 2022 119 e2119417119 10.1073/pnas.2119417119 35263219 PMC8931383 · DOI
  18. [29]Burkhardt I de Rond T Chen PY-T Moore BS Ancient plant-like terpene biosynthesis in corals Nat. Chem. Biol. 2022 18 664 669 10.1038/s41589-022-01026-2 35606558 PMC9179088 · DOI
  19. [30]Hobbs SJ Phage anti-CBASS and anti-Pycsar nucleases subvert bacterial immunity Nature 2022 605 522 526 10.1038/s41586-022-04716-y 35395152 PMC9117128 · DOI
  20. [31]Terwilliger, T. C. et al. Accelerating crystal structure determination with iterative AlphaFold prediction. Acta Crystallogr.D42, 234–244 (2023). PMC9986801 36876433
  21. [33]Bartlett GJ Porter CT Borkakoti N Thornton JM Analysis of catalytic residues in enzyme active sites J. Mol. Biol. 2002 324 105 121 10.1016/S0022-2836(02)01036-7 12421562 · DOI
  22. [34]McCoy AJ Sammito MD Read RJ Implications of AlphaFold2 for crystallographic phasing by molecular replacement Acta Crystallogr. D Struct. Biol. 2022 78 1 13 10.1107/S2059798321012122 34981757 PMC8725160 · DOI · Paper page
  23. [36]Oeffner RD Putting AlphaFold models to work with phenix.process_predicted_model and ISOLDE Acta Crystallogr. D Struct. Biol. 2022 78 1303 1314 10.1107/S2059798322010026 36322415 PMC9629492 · DOI · Paper page
  24. [37]Terwilliger T Maximum-likelihood density modification Acta Crystallogr. D Biol. Crystalogr. 2000 56 965 972 10.1107/S0907444900005072 PMC2792768 10944333 · DOI
  25. [38]Cowtan K Metcalfe S Bond P Shift-field refinement of macromolecular atomic models Acta Crystallogr. D Struct. Biol. 2020 76 1192 1200 10.1107/S2059798320013170 33263325 PMC7709196 · DOI
  26. [40]Pettersen EF UCSF ChimeraX: structure visualization for researchers, educators, and developers Protein Sci. 2021 30 70 82 10.1002/pro.3943 32881101 PMC7737788 · DOI
  27. [41]Davis IW Arendall WB Richardson DC Richardson JS The backrub motion: how protein backbone shrugs when a sidechain dances Structure 2006 14 265 274 10.1016/j.str.2005.10.007 16472746 · DOI
  28. [42]Bennett MJ Choe S Eisenberg D Domain swapping: entangling alliances between proteins Proc. Natl Acad. Sci. USA 1994 91 3127 3131 10.1073/pnas.91.8.3127 8159715 PMC43528 · DOI

Cited by

Sorted by citations

Authors
Terwilliger, T. C., Liebschner, D., Croll, T. I., Williams, C. J., McCoy, A. J., Poon, B. K., Afonine, P. V., Oeffner, R. D., Richardson, J. S., Read, R. J., & Adams, P. D.
Affiliations
  • Los Alamos National Laboratory (US)
  • Lawrence Berkeley National Laboratory (US)
  • University of Cambridge (GB)
  • Duke University (US)
Corresponding author
Terwilliger, Thomas C.
Venue
Nature Methods
Published
2023-11-30
Volume
21
Issue
1
Pages
110-116
ISSN
  • 1548-7091 (ISSN-L)
  • 1548-7105
OpenAlex
W4389174567
Cited by
411
References
12
Citations by year
2026: 123 · 2025: 150 · 2024: 113 · 2023: 22 · 2022: 2 · 2013: 1
FWCI
36.04
Type
journal article
Language
en
Open access
Locations
  • Nature Methods (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • eScholarship (California Digital Library) (submittedVersion, cc-by)
  • Apollo (University of Cambridge) (submittedVersion, cc-by)
  • OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
  • Apollo (University of Cambridge) (submittedVersion)
  • Apollo
Funders
  • U.S. Department of Health & Human Services | NIH | National Institute of General Medical Sciences (GM063210)
  • Wellcome Trust (209407/Z/17/Z)
  • DOE | LDRD | Lawrence Berkeley National Laboratory (DE-AC02-05CH11231)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Physical Sciences › Materials Science › Materials Chemistry › Enzyme Structure and Function
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
Keywords
AlphaFold, protein structure prediction, prediction accuracy, prediction confidence, protein conformation, side-chain conformation, domain orientation, hypothesis generation
MeSH terms
Artificial Intelligence, Crystallography, Mental Processes, Protein Conformation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review