Protein structure prediction in the era of AI: Challenges and limitations when applying to in silico force spectroscopy
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Mechanoactive proteins are essential for a myriad of physiological and pathological processes. Guided by the advances in single-molecule force spectroscopy (SMFS), we have reached a molecular-level understanding of how mechanoactive proteins sense and respond to mechanical forces. However, even SMFS has its limitations, including the lack of detailed structural information during force-loading experiments. That is where molecular dynamics (MD) methods shine, bringing atomistic details with femtosecond time-resolution. However, MD heavily relies on the availability of high-resolution structural data, which is not available for most proteins. For instance, the Protein Data Bank currently has 192K structures deposited, against 231M protein sequences available on Uniprot. But many are betting that this gap might become much smaller soon. Over the past year, the AI-based AlphaFold created a buzz on the structural biology field by being able to predict near-native protein folds from their sequences. For some, AlphaFold is causing the merge of structural biology with bioinformatics. Here, using an in silico SMFS approach pioneered by our group, we investigate how reliable AlphaFold structure predictions are to investigate mechanical properties of Staphylococcus bacteria adhesins proteins. Our results show that AlphaFold produce extremally reliable protein folds, but in many cases is unable to predict high-resolution protein complexes accurately. Nonetheless, the results show that AlphaFold can revolutionize the investigation of these proteins, particularly by allowing high-throughput scanning of protein structures. Meanwhile, we show that the AlphaFold results need to be validated and should not be employed blindly, with the risk of obtaining an erroneous protein mechanism.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Varadi, M., Anyango, S., Deshpande, M., Nair, S., Natassia, C., Yordanova, G., Yuan, D., Stroe, O., Wood, G., Laydon, A., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1061 · Cited by 7,850
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549 · cited 1×
“The success of AlphaFold, and the analog RoseTTAFold approach (Baek et al., 2021) that appeared a few months later, is partially due to their open-source nature, which makes them readily and freely available to anyone who is interested in trying these software.”
BackgroundProtein complex prediction with AlphaFold-Multimer
Evans, R., O’Neill, M., Pritzel, A., Antropova, N., Senior, A., Green, T., Žídek, A., Bates, R., Blackwell, S., Yim, J., et al. (2021) · doi:10.1101/2021.10.04.463034 · Cited by 3,808 · cited 10×
“By comparing the force profile obtained from crystallographic structures of the complexes, we showed that AlphaFold Multimer failed to predict important key structural motifs for some of the protein complexes.”
BackgroundMethodInfluentialHighly accurate protein structure prediction for the human proteome
Tunyasuvunakool, K., Adler, J., Wu, Z., Green, T., Zielinski, M., Žídek, A., Bridgland, A., Cowie, A., Meyer, C., Laydon, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03828-1 · Cited by 3,025 · cited 1×
“Furthermore, by pairing it with the European Bioinformatics Institute (EBI), AlphaFold has taken structural biology to the next level, allowing big consortiums to perform protein structure prediction to entire genomes, including human, mouse, Saccharomyces and E. coli (Tunyasuvunakool et al., 2021).”
BackgroundThe Protein-Folding Problem, 50 Years On
Dill, K. A., & MacCallum, J. L. (2012) · Science · doi:10.1126/science.1219021 · Cited by 1,699
Adhesion, invasion and evasion: the many functions of the surface proteins of Staphylococcus aureus
Foster, T. J., Geoghegan, J. A., Ganesh, V. K., & Höök, M. (2014) · Nature Reviews Microbiology · doi:10.1038/nrmicro3161 · Cited by 1,533
Dill, K. A., Ozkan, S. B., Shell, M. S., & Weikl, T. R. (2008) · Annual Review of Biophysics · doi:10.1146/annurev.biophys.37.092707.153558 · Cited by 1,163
A structural biology community assessment of AlphaFold2 applications
Akdel, M., Pires, D. E. V., Pardo, E. P., Jänes, J., Zalevsky, A. O., Mészáros, B., Bryant, P., Good, L. L., Laskowski, R. A., Pozzati, G., et al. (2022) · Nature Structural & Molecular Biology · doi:10.1038/s41594-022-00849-w · Cited by 675 · cited 1×
“In other words, some results suggest that both AlphaFold and RoseTTAFold are qualitatively great, but in many cases, they lack the level of details that is important to understand a protein function (Akdel et al., 2021; Eisenstein, 2021; Callaway, 2022).”
BackgroundAI-based structure prediction empowers integrative structural analysis of human nuclear pores
Mosalaganti, S., Obarska-Kosinska, A., Siggel, M., Taniguchi, R., Turoňová, B., Zimmerli, C. E., Buczak, K., Schmidt, F. H., Margiotta, E., Mackmull, M.-T., et al. (2022) · Science · doi:10.1126/science.abm9506 · Cited by 355
Can AlphaFold2 predict the impact of missense mutations on structure?
Buel, G. R., & Walters, K. J. (2022) · Nature Structural & Molecular Biology · doi:10.1038/s41594-021-00714-2 · Cited by 332
AF2Complex predicts direct physical interactions in multimeric proteins with deep learning
Gao, M., Nakajima An, D., Parks, J. M., & Skolnick, J. (2022) · Nature Communications · doi:10.1038/s41467-022-29394-2 · Cited by 252 · cited 1×
“This scoring function was shown to be more advantageous over the pTM and pLDDT scores used in AlphaFold 2 (Gao et al., 2022).”
MethodSkolnick, J., Gao, M., Zhou, H., & Singh, S. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c01114 · Cited by 251 · cited 1×
“The broad spread use of AI-based structure prediction leads us to ask the question: How reliable are the structures predicted by such models? Despite the growing number of success stories (Jumper et al., 2021a; Jumper et al., 2021b; Mosalaganti et al., 2021; Skolnick et al., 2021; Hartmann et al., 2022; Varadi et al.,…”
BackgroundAI revolutions in biology: The joys and perils of AlphaFold
Perrakis, A., & Sixma, T. K. (2021) · The EMBO Reports · doi:10.15252/embr.202154046 · Cited by 190 · cited 1×
“, 2022), researchers are accumulating evidence showing that AIbased structure prediction methods are still not perfect (Perrakis and Sixma, 2021; Outeiral et al., 2022), and that there is ample room for improvement.”
A structural biology community assessment of AlphaFold 2 applications
Akdel, M., Pires, D. E. V., Porta Pardo, E., Jänes, J., Zalevsky, A. O., Mészáros, B., Bryant, P., Good, L. L., Laskowski, R. A., Pozzati, G., et al. (2021) · doi:10.1101/2021.09.26.461876 · Cited by 122
Current structure predictors are not learning the physics of protein folding
Outeiral, C., Nissley, D. A., & Deane, C. M. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab881 · Cited by 82
Cited by
Integrating Computational Design and Experimental Approaches for Next-Generation Biologics
Son, A., Park, J., Kim, W., Lee, W., Yoon, Y., Ji, J., & Kim, H. (2024) · Biomolecules · doi:10.3390/biom14091073 · Cited by 29
Gomes, D. E. B., Yang, B., Vanella, R., Nash, M. A., & Bernardi, R. C. (2024) · Journal of the American Chemical Society · doi:10.1021/jacs.4c05869 · Cited by 18
Self-citationKim, J., Jeon, Y. J., Chang, I.-Y., Lee, J.-H., & You, H. J. (2025) · Experimental & Molecular Medicine · doi:10.1038/s12276-024-01381-1 · Cited by 4
(2024) · doi:10.21203/rs.3.rs-4446931/v1 · Cited by 4
Metadata
- Authors
- Gomes, P. S. F. C., Gomes, D. E. B., & Bernardi, R. C.
- Venue
- Frontiers in Bioinformatics
- Publisher
- Frontiers Media SA
- Published
- 2022-10-07
- Volume
- 2
- Pages
- 983306-983306
- ISSN
- 2673-7647 (ISSN-L)
- OpenAlex
- W4303021240
- Cited by
- 38
- References
- 16
- FWCI
- 2.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.