Appraisal of AlphaFold2-Predicted Models in Cryo-EM Map Interpretation
Open accessAbstract
Highly accurate predicted models from deep-learning-based protein structure prediction approaches, specifically AlphaFold2, are now readily available to aid structural biologists and computational modelers. We study the dependencies, as well as the strengths and limitations, of integrating cryo-EM maps and AlphaFold2 models into building accurate models, even from poorly resolved density maps. In our previous work [1, 2], we refined AlphaFold2 models systematically using Phenix software against experimental and “hybrid” cryo-EM maps at resolution values ranging from 4–12Å. Hybrid maps are experimental maps filtered to a lower-than-experimental resolution using a Gaussian convolution in real space; they provide a convenient variable resolution that can be tuned to find the refinement approach’s breaking point. Starting with 13 high-resolution experimental maps, we extended the resolution to values of 5Å, 6Å, 8Å, 10Å, and 12Å [1]. Our results suggested that cryo-EM density maps at resolution values as low as 6Å can be used to improve the AlphaFold2 models, which exceeded the resolution limit of 4.5Å suggested by the Phenix developers. We also explored the refinement success for AlphaFold2 models using only experimental cryo-EM maps in the 4–6Å resolution range [2]. While most of the AlphaFold2 predicted models were outright successful (TM scores above 0.9), the observed success of the subsequent refinement depended significantly on the qualities of the AlphaFold2 prediction, the experimental cryo-EM data, and the alignment of the model with the density [2]. Our experiences and observations in [1, 2] are summarized as a schematic in Fig. 1 that provides a blueprint for our ongoing work. We start the evaluation of the refinement strategy by assessing the match between the AlphaFold2 model and the cryo-EM map. In fitting atomic structures to cryo-EM maps, there is a widely used score called cross-correlation (implemented in our Situs collage or colores tools). However, it has some limitations. For example, the absolute value depends on the resolution of a map on any cropping, masking, or zero padding or on sequence insertions or deletions in the structure. It would be worth developing a more robust score like TM in an atomic structure alignment that is invariant under all these changes, so it can be used objectively to compare map/model pairs. However, often, in practice, only relative comparisons are required, for which the cross-correlation remains adequate. If the match is good and the cryo-EM map exhibits a resolution above 4.5Å, the AlphaFold2 model can be refined (left scenario in Fig. 1). For map resolutions below 6Å, the refinement performance with Phenix declines significantly (the center scenario in Fig. 1). In such a case, it might be best to leave the AlphaFold2 model alone. An intriguing alternative hypothesis is to ask if one can improve the map faithfully and sufficiently (e.g., with deep learning trained on known map-model pairs). Making low-resolution maps suitable for refinement is challenging because maps cannot typically be sharpened beyond their experimental resolution. If there is no suitable map-model match to initiate the refinement (right branch in Fig. 1), it could be due to an imperfect AlphaFold2 prediction (5 of 13 cases in [1] and 1 of 10 cases in [2] exhibited a TM score below 0.8), or the cryo-EM map might be of low quality. The actual reason for the mismatch can be determined by visual inspection of the map-model pair and by local resolution measures that assess local cryo-EM map quality. If the local map quality is low, one arrives again at the center scenario in Fig. 1 described above. A more intriguing case is the right scenario in Fig. 1, where the cryo-EM map is deemed more reliable than the AlphaFold2 prediction. Straightforward refinement of the AlphaFold2 model will then fail because of the tendency of refinement to find the nearest optimum [2]. One could overcome the local trap by generating a large number of structurally perturbed decoys from the AlphaFold2 model and then screening them against the EM data using cross-correlation or secondary structure agreement scores for ranking. The best decoy would then be used for the Phenix refinement. The structural perturbation can be implemented with a dimensionality reduction like PCA or normal mode analysis or with a reverse kinematic tracing inspired by robotics [3] to avoid the curse of dimensionality in the perturbation since an exhaustive search for more than a few degrees of freedom in the flexibility model is prohibitively expensive. Or one could use molecular dynamics simulations, but large deformations are often not exhaustively sampled in short simulation runs. Finally, one could develop an alternative flexible refinement tool that uses helical or sheet propensities to guide the flexible fitting (in addition to mere fitting to density), but this would require a more substantial development effort. We will present the
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AF2 models are not suitable for fitting into cryo-EM maps with resolution worse than 6 Å.
“Reports suggest AF2 models should not be fit into cryo-EM maps with resolution greater than 6Å98,99.”
From The power and pitfalls of AlphaFold2 for structure prediction beyond rigid globular proteins (2024) · cites this paper as [99]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Nasr, K. A., & He, J. J. (2016) · Robotica · doi:10.1017/s0263574716000242 · Cited by 13 · see citing works
Self-citationRefinement of AlphaFold2 models against experimental and hybrid cryo-EM density maps
Alshammari, M., Wriggers, W., Sun, J., & He, J. (2022) · QRB Discovery · doi:10.1017/qrd.2022.13 · Cited by 12 · see citing works
Self-citationRefinement of AlphaFold2 Models against Experimental Cryo-EM Density Maps at 4-6Å Resolution
Alshammari, M., He, J. J., & Wriggers, W. R. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9995676 · Cited by 6 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [2]2. M Alshammari et al. Proc. IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (2022), p. 3423. doi:10.1109/BIBM55620. 2022.9995676 · DOI
Cited by
Sorted by citations
The power and pitfalls of AlphaFold2 for structure prediction beyond rigid globular proteins
Agarwal, V., & McShan, A. C. (2024) · Nature Chemical Biology · doi:10.1038/s41589-024-01638-w · Cited by 155 · see citing works
“Reports suggest that AF2 models should not be fit into cryo-EM maps with resolution greater than 6 Å 98,99 .”
Background
- Authors
- Alshammari, M., He, J., & Wriggers, W.
- Affiliations
- Old Dominion University (US)
- Corresponding author
- Wriggers, Willy
- Venue
- Microscopy and Microanalysis
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-07-22
- Volume
- 29
- Issue
- Supplement_1
- Pages
- 977-978
- ISSN
- 1431-9276 (ISSN-L)
- 1435-8115
- OpenAlex
- W4385055272
- Cited by
- 1
- References
- 3
- Citations by year
- 2024: 1
- FWCI
- 0.09
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Microscopy and Microanalysis (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of General Medical Sciences (R01GM062968)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Advanced Electron Microscopy Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Physical Sciences › Materials Science › Materials Chemistry › Enzyme Structure and Function
- Keywords
- AlphaFold2, cryo-EM density maps, model refinement, hybrid maps, Gaussian convolution, cross correlation function, TM-score, PHENIX, protein structure prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review