AlphaFold predictions are valuable hypotheses, and accelerate but do not replace experimental structure determination
Open accessPreprint — published as 10.1038/s41592-023-02087-4 · Paper page
Abstract
AI-based methods such as AlphaFold have revolutionized structural biology, often making it possible to predict protein structures with high accuracy. The accuracies of these predictions vary, however, and they do not include ligands, covalent modifications or other environmental factors. Here we focus on very-high-confidence parts of AlphaFold predictions, evaluating how well they can be expected to describe the structure of a protein in a particular environment. We compare predictions with experimental crystallographic maps of the same proteins for 102 crystal structures. In many cases, those parts of AlphaFold predictions that were predicted with very high confidence matched experimental maps remarkably closely. In other cases, these predictions differed from experimental maps on a global scale through distortion and domain orientation, and on a local scale in backbone and side-chain conformation. Overall, C α atoms in very-high-confidence parts of AlphaFold predictions differed from corresponding crystal structures by a median of 0.6 Å, and about 10% of these differed by more than 2 Å, each about twice the values found for pairs of crystal structures containing the same components but determined in different space groups. We suggest considering AlphaFold predictions as exceptionally useful hypotheses. We further suggest that it is important to consider the confidence in prediction when interpreting AlphaFold predictions and to carry out experimental structure determination to verify structural details, particularly those that involve interactions not included in the prediction.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764 · see citing works
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,523 · see citing works
Highly accurate protein structure prediction for the human proteome
Tunyasuvunakool, K., Adler, J., Wu, Z., Green, T., Zielinski, M., Žídek, A., Bridgland, A., Cowie, A., Meyer, C., Laydon, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03828-1 · Cited by 3,025 · see citing works
A structural biology community assessment of AlphaFold2 applications
Akdel, M., Pires, D. E. V., Pardo, E. P., Jänes, J., Zalevsky, A. O., Mészáros, B., Bryant, P., Good, L. L., Laskowski, R. A., Pozzati, G., et al. (2022) · Nature Structural & Molecular Biology · doi:10.1038/s41594-022-00849-w · Cited by 675 · see citing works
Self-citation‘The entire protein universe’: AI predicts shape of nearly every known protein
Callaway, E. (2022) · Nature · doi:10.1038/d41586-022-02083-2 · Cited by 113 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Clustering predicted structures at the scale of the known protein universe
Barrio-Hernandez, I., Yeo, J., Jänes, J., Mirdita, M., Gilchrist, C. L. M., Wein, T., Varadi, M., Velankar, S., Beltrao, P., & Steinegger, M. (2023) · Nature · doi:10.1038/s41586-023-06510-w · Cited by 362 · see citing works
- Authors
- Terwilliger, T. C., Liebschner, D., Croll, T. I., Williams, C. J., McCoy, A. J., Poon, B. K., Afonine, P. V., Oeffner, R. D., Richardson, J. S., Read, R. J., & Adams, P. D.
- Affiliations
- Los Alamos National Laboratory (US)
- Lawrence Berkeley National Laboratory (US)
- University of Cambridge (GB)
- Duke University (US)
- Corresponding author
- Terwilliger, Thomas C.
- ORCID
- Venue
- Nature Methods
- Publisher
- openRxiv
- Published
- 2022-11-22
- Volume
- 21
- Issue
- 1
- Pages
- 110-116
- ISSN
- 1548-7091 (ISSN-L)
- PMC
- PMC10776388
- OpenAlex
- W4389174567
- Cited by
- 411
- References
- 5
- Citations by year
- 2026: 123 · 2025: 150 · 2024: 113 · 2023: 22 · 2022: 2 · 2013: 1
- FWCI
- 36.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Nature Methods (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- Apollo (University of Cambridge) (submittedVersion)
- Apollo
- Funders
- U.S. Department of Health and Human Services (GM063210)
- Wellcome Trust (Z/17/Z, 209407/Z/17/Z, 209407)
- National Institutes of Health (DE-AC02–05CH11231, GM063210)
- National Institute of General Medical Sciences (P01GM063210, GM063210)
- Laboratory Directed Research and Development (DEAC02-05CH11231)
- Lawrence Berkeley National Laboratory (AC02‐05CH11231, DE-AC02-05CH11231, 05CH11231)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Physical Sciences › Materials Science › Materials Chemistry › Enzyme Structure and Function
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Keywords
- AlphaFold, protein structure prediction, prediction accuracy, prediction confidence, protein conformation, side-chain conformation, domain orientation, hypothesis generation
- MeSH terms
- Artificial Intelligence, Crystallography, Mental Processes, Protein Conformation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review