Using AlphaFold to predict the impact of single mutations on protein stability and function
Open accessPublished version of a preprint
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index; 2 of the 9 sources its claims cite were checked for support.
Abstract
AlphaFold changed the field of structural biology by achieving three-dimensional (3D) structure prediction from protein sequence at experimental quality. The astounding success even led to claims that the protein folding problem is “solved”. However, protein folding problem is more than just structure prediction from sequence. Presently, it is unknown if the AlphaFold-triggered revolution could help to solve other problems related to protein folding. Here we assay the ability of AlphaFold to predict the impact of single mutations on protein stability (ΔΔG) and function. To study the question we extracted the pLDDT and metrics from AlphaFold predictions before and after single mutation in a protein and correlated the predicted change with the experimentally known ΔΔG values. Additionally, we correlated the same AlphaFold pLDDT metrics with the impact of a single mutation on structure using a large scale dataset of single mutations in GFP with the experimentally assayed levels of fluorescence. We found a very weak or no correlation between AlphaFold output metrics and change of protein stability or fluorescence. Our results imply that AlphaFold may not be immediately applied to other problems or applications in protein folding.
Overview
CoChat Summary
TL;DR
The paper tests whether AlphaFold confidence metrics can predict the effect of single mutations on protein stability (ΔΔG) and GFP fluorescence, using experimental mutation datasets. It finds weak or no useful correlation, concluding AlphaFold outputs are not directly reliable for these prediction tasks.
Key findings
- For 1154 mutations in 73 proteins, the correlation between mutation-induced change in local confidence and experimental stability change was weak: PCC = -0.17 ± 0.03 for ΔpLDDT, while Δ<pLDDT> was 0.02 ± 0.03.
- A multiple linear regression combining ΔpLDDT and Δ<pLDDT> did not improve prediction much: 0.12 ± 0.05 on the training set and 0.20 ± 0.04 on the test set.
- For 796 GFP single mutants, AlphaFold metrics also showed only weak association with function: PCC = 0.17 ± 0.03 for ΔpLDDT and 0.16 ± 0.04 for Δ<pLDDT>.
- Among destabilizing mutations, 87% had negative ΔpLDDT, but this still did not produce a meaningful correlation with ΔΔG.
Methods
- Experimental stability data came from ThermoMutDB v1.3; after filtering for single-point mutations measured at pH 3–9, 293–300 K, and proteins <250 aa, the authors analyzed 1154 mutations in 73 proteins.
- GFP function data came from a published dataset; the authors randomly selected 796 single mutants and used fluorescence as the functional readout.
- Wild-type and mutant structures were obtained from the AlphaFold Protein Structure Database or predicted with standalone AlphaFold, and analysis focused on ΔpLDDT and Δ<pLDDT>; the stability dataset was split into training/test sets by a 50% sequence identity threshold and analyzed with multiple linear regression.
Limitations
- The paper states that AlphaFold was not designed or validated to predict mutation effects on stability or function, so direct use is not expected to work well.
- The authors note that the available ΔΔG data are limited in size (they describe experimentally measured ΔΔG values as being on the order of 10,000), which they argue constrains deep-learning prediction; this is an interpretation made in the paper.
- The evidence is limited to the datasets studied here: single-point mutations in ThermoMutDB proteins and GFP mutants, so broader generalization is not stated in the paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
2 Valid · 0 Not valid · 4 Not checked · 19 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The correlation coefficient is -0.17 ± 0.03 (p-value = 10-8) for ΔpLDDT and 0.02 ± 0.03 (p-value = 0.44) for the Δ<pLDDT>.”
§ Using AlphaFold to predict the impact of single mutations on protein stability and function > Results > Correlation between ΔΔG and ΔpLDDT values
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Expectedly, the destabilizing effect of mutations was associated with decreasing pLDDTs: 87% of destabilizing mutations had negative ΔpLDDT (p-value = 10−22).”
§ Using AlphaFold to predict the impact of single mutations on protein stability and function > Results > Relationship of ΔpLDDT and amino acid properties
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, there was no correlation between ΔpLDDT and ΔΔG for that 87% of mutations with negative ΔpLDDT.”
§ Using AlphaFold to predict the impact of single mutations on protein stability and function > Results > Relationship of ΔpLDDT and amino acid properties
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found a very weak or no correlation between AlphaFold output metrics and change of protein stability or fluorescence.”
- Also stated in: § Correlation between ΔΔG and ΔpLDDT values · plain
“We did not observe a pronounced correlation between the mutation effect and the difference in confidence metrics (Fig 1).”
- Also stated in: § Discussion · plain
“We found a weak correlation of -0.17 ± 0.03 between ΔpLDDT and ΔΔG associated with specific mutations.”
§ Using AlphaFold to predict the impact of single mutations on protein stability and function > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Correlation between ΔΔG and ΔpLDDT values · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The correlation coefficient is 0.17 ± 0.03 (p-value = 3 ⋅ 10-6) for ΔpLDDT and 0.16 ± 0.04 (p-value = 10-5) for the Δ<pLDDT> (Fig 2).”
§ Using AlphaFold to predict the impact of single mutations on protein stability and function > Results > Correlation between GFP fluorescence and ΔpLDDT values
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
14 more claims
Create a free account to see all 25 claims and to verify the 2 references still open.
- Probably not a substantial claim. 2
- It may state two separate claims as one. 4
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“studies have reported an inability of AF2 to predict the effects of mutations on protein structure and stability14,49,50”
From The power and pitfalls of AlphaFold2 for structure prediction beyond rigid globular proteins (2024) · cites this paper as [50]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Beyond predicting the predominant state of naturally occurring proteins, we wanted to test the ability of AF-Cluster to predict effects of point mutations, a task that AF2 in its default settings has not achieved40.”
From Predicting multiple conformations via sequence clustering and AlphaFold2 (2024) · cites this paper as [40]
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“All correlations were adjusted for multiple hypotheses testing by Benjamini-Hochberg correction [22].”
MethodBasic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669 · cited 4×
“To identify the sequence identities between the proteins in the dataset of mutations we performed protein BLAST [18] search of protein sequences against themselves.”
MethodInfluentialHighly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764 · cited 3×
“AlphaFold is widely claimed to have revolutized protein 3D structure prediction from protein sequence, a 50-years long-standing challenge of protein physics and structural bioinformatics [1].”
BackgroundMethodInfluentialBerman, H. M. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.235 · Cited by 40,196
Highly accurate protein structure prediction for the human proteome
Tunyasuvunakool, K., Adler, J., Wu, Z., Green, T., Zielinski, M., Žídek, A., Bridgland, A., Cowie, A., Meyer, C., Laydon, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03828-1 · Cited by 3,025 · cited 2×
“Next, AlphaFold in collaboration with EMBL-EBI constructed the structure models for the whole protein sequence space [8].”
MethodKnowledge‐based protein secondary structure assignment
Frishman, D., & Argos, P. (1995) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.340230412 · Cited by 2,523 · cited 1×
“Information on solvent accessibility was taken from Stride [19].”
BackgroundGuerois, R., Nielsen, J. E., & Serrano, L. (2002) · Journal of Molecular Biology · doi:10.1016/s0022-2836(02)00442-4 · Cited by 1,728 · cited 3×
“Similarly, the same AlphaFold metrics had a very weak correlation with the impact of single mutations on protein function, fluorescence, of GFP. Recent results show that the use of AlphaFold models instead of template structures does not improve ΔΔG prediction by FoldX [12] [13].”
ResultInfluentialHarnessing protein folding neural networks for peptide–protein docking
Tsaban, T., Varga, J. K., Avraham, O., Ben-Aharon, Z., Khramushin, A., & Schueler-Furman, O. (2022) · Nature Communications · doi:10.1038/s41467-021-27838-9 · Cited by 1,205
Harnessing protein folding neural networks for peptide-protein docking
(2021) · doi:10.21203/rs.3.rs-781411/v1 · Cited by 1,203
Mariani, V., Biasini, M., Barbato, A., & Schwede, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt473 · Cited by 1,138 · cited 1×
“LDDT ranges from 0 to 100 and is a superposition-free metric indicating to what extent the protein model reproduces the reference structure [23].”
Background
Cited by
Harnessing protein folding neural networks for peptide–protein docking
Tsaban, T., Varga, J. K., Avraham, O., Ben-Aharon, Z., Khramushin, A., & Schueler-Furman, O. (2022) · Nature Communications · doi:10.1038/s41467-021-27838-9 · Cited by 1,205
A structural biology community assessment of AlphaFold2 applications
Akdel, M., Pires, D. E. V., Pardo, E. P., Jänes, J., Zalevsky, A. O., Mészáros, B., Bryant, P., Good, L. L., Laskowski, R. A., Pozzati, G., et al. (2022) · Nature Structural & Molecular Biology · doi:10.1038/s41594-022-00849-w · Cited by 675
“However, some reports have indicated that AF2 does not appear to be well suited to predict the structures of mutated proteins 54,55 .”
BackgroundAlphaFold2 and its applications in the fields of biology and medicine
Yang, Z., Zeng, X., Zhao, Y., & Chen, R. (2023) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-023-01381-z · Cited by 577
“Although there are researches showing that AF2 could predict the phenotypic effect of missense mutations,(209,210) it was also observed that the performance of missense mutations prediction is not good in other studies,(211) and there were only weak or no correlations between the output metrics of AF2 and changes in p…”
BackgroundPredicting multiple conformations via sequence clustering and AlphaFold2
Wayment-Steele, H. K., Ojoawo, A., Otten, R., Apitz, J. M., Pitsawong, W., Hömberger, M., Ovchinnikov, S., Colwell, L., & Kern, D. (2024) · Nature · doi:10.1038/s41586-023-06832-9 · Cited by 545
“Beyond predicting the predominant state of naturally occurring proteins, we wanted to test the ability of AF-Cluster to predict effects of point mutations, a task that AF2 in its default settings has not achieved 40 .”
Sampling alternative conformational states of transporters and receptors with AlphaFold2
del Alamo, D., Sala, D., Mchaourab, H. S., & Meiler, J. (2022) · eLife · doi:10.7554/elife.75751 · Cited by 511
“Several preprints have provided evidence that AF2, despite its accuracy, likely does not learn the energy landscapes underpinning protein folding and function ( Saldaño et al., 2021 ; Pak et al., 2021 ; Akdel et al., 2021 ).”
Background
Metadata
- Authors
- Pak, M. A., Markhieva, K. A., Novikova, M. S., Petrov, D. S., Vorobyev, I. S., Maksimova, E. S., Kondrashov, F. A., & Ivankov, D. N.
- Affiliations
- Skolkovo Institute of Science and Technology (RU)
- Peoples' Friendship University of Russia (RU)
- University of New Mexico (US)
- Ural Federal University (RU)
- Institute of Science and Technology Austria (AT)
- Okinawa Institute of Science and Technology Graduate University (JP)
- Corresponding author
- Ivankov, Dmitry N.
- Venue
- PLOS One
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-16
- Volume
- 18
- Issue
- 3
- Pages
- e0282689
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC10019719
- OpenAlex
- W4327566741
- Cited by
- 322
- References
- 32
- Citations by year
- 2026: 51 · 2025: 90 · 2024: 77 · 2023: 66
- FWCI
- 25.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Electronic Archive of Ural Federal University (ELAR UrFU) (submittedVersion, cc-by)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
- Keywords
- AlphaFold, single mutation, protein stability, protein folding, pLDDT, ΔΔG, protein function, green fluorescent protein, fluorescence, protein structure prediction, protein folding problem
- MeSH terms
- Amino Acid Sequence, Mutation, Proteins, Protein Folding, Protein Stability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using AlphaFold to predict the impact of single mutations on protein stability and function. https://app.cochat.ai/papers/10.1371/journal.pone.0282689
- The paper
- Pak, M. A., Markhieva, K. A., Novikova, M. S., Petrov, D. S., Vorobyev, I. S., Maksimova, E. S., Kondrashov, F. A., & Ivankov, D. N. (2023). Using AlphaFold to predict the impact of single mutations on protein stability and function. PLOS One. https://doi.org/10.1371/journal.pone.0282689
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.