Validation of de novo designed water‐soluble and transmembrane β‐barrels by in silico folding and melting
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
In silico validation of de novo designed proteins with deep learning (DL)‐based structure prediction algorithms has become mainstream. However, formal evidence of the relationship between a high‐quality predicted model and the chance of experimental success is lacking. We used experimentally characterized de novo water‐soluble and transmembrane β‐barrel designs to show that AlphaFold2 and ESMFold excel at different tasks. ESMFold can efficiently identify designs generated based on high‐quality (designable) backbones. However, only AlphaFold2 can predict which sequences have the best chance of experimentally folding among similar designs. We show that ESMFold can generate high‐quality structures from just a few predicted contacts and introduce a new approach based on incremental perturbation of the prediction (“in silico melting”), which can reveal differences in the presence of favorable contacts between designs. This study provides a new insight on DL‐based structure prediction models explainability and on how they could be leveraged for the design of increasingly complex proteins; in particular membrane proteins which have historically lacked basic in silico validation tools.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,990
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549 · cited 1×
“Recently, deep learning (DL) models such as Alpha-Fold2 (Jumper et al., 2021), RoseTTaFold (Baek et al., 2021), and language models (LMs) (e.g ESMFold [Lin et al., 2023], OmegaFold [Wu et al., 2022], or RGN2 [Chowdhury et al., 2022]) have out-performed classic ab initio folding simulations.”
MethodSelf-citationWatson, J. L., Juergens, D., Bennett, N. R., Trippe, B. L., Yim, J., Eisenach, H. E., Ahern, W., Borst, A. J., Ragotte, R. J., Milles, L. F., et al. (2022) · doi:10.1101/2022.12.09.519842 · Cited by 2,369
De novo design of protein structure and function with RFdiffusion
Watson, J. L., Juergens, D., Bennett, N. R., Trippe, B. L., Yim, J., Eisenach, H. E., Ahern, W., Borst, A. J., Ragotte, R. J., Milles, L. F., et al. (2023) · Nature · doi:10.1038/s41586-023-06415-8 · Cited by 2,325
Self-citationRobust deep learning–based protein sequence design using ProteinMPNN
Dauparas, J., Anishchenko, I., Bennett, N., Bai, H., Ragotte, R. J., Milles, L. F., Wicky, B. I. M., Courbet, A., de Haas, R. J., Bethel, N., et al. (2022) · Science · doi:10.1126/science.add2187 · Cited by 2,210
Robust deep learning based protein sequence design using ProteinMPNN
Dauparas, J., Anishchenko, I., Bennett, N., Bai, H., Ragotte, R. J., Milles, L. F., Wicky, B. I. M., Courbet, A., de Haas, R. J., Bethel, N., et al. (2022) · doi:10.1101/2022.06.03.494563 · Cited by 2,107
The coming of age of de novo protein design
Huang, P.-S., Boyken, S. E., & Baker, D. (2016) · Nature · doi:10.1038/nature19946 · Cited by 1,478 · cited 2×
“De novo protein design (Huang et al., 2016; Korendo-vych & DeGrado, 2020) is the generation of protein sequences and structure from scratch with no detectable homology to natural proteins of similar structure (Brunette et al., 2015; Kuhlman et al., 2003; Watson et al., 2023) and functions (Dou et…”
BackgroundAdvances in protein structure prediction and design
Kuhlman, B., & Bradley, P. (2019) · Nature Reviews Molecular Cell Biology · doi:10.1038/s41580-019-0163-x · Cited by 806 · cited 1×
“Most de novo protein design pipelines build on a common paradigm: (i) sequence-free protein back-bones are assembled with selected structure properties and (ii) used to guide combinatorial design of sequences (Huang et al., 2016; Kuhlman & Bradley, 2019).”
BackgroundDe novo protein design by deep network hallucination
Anishchenko, I., Chidyausiku, T. M., Ovchinnikov, S., Pellock, S. J., & Baker, D. (2020) · doi:10.1101/2020.07.22.211482 · Cited by 629 · cited 1×
“AlphaFold2, RoseTTAFold, and ESMFold networks have also been inverted to design new protein sequences (Anishchenko et al., 2021; Goverde et al., 2023; Verkuil et al., 2022).”
BackgroundSelf-citation
Research works printed but not linked: 34
- 10.1016/j.bpj.2020.03.006 · DOI · Paper page
- 10.1371/journal.pcbi.1004398 · DOI · Paper page
- 10.1038/s41586-021-04184-w · doi:10.1038/s41586-021-04184-w · Paper page
- 10.1126/science.abj8754 · doi:10.1126/science.abj8754 · Paper page
- 10.1073/pnas.0702515104 · DOI · Paper page
- 10.1101/2023.12.20.572500 · DOI
- 10.1126/science.1113801 · DOI · Paper page
- 10.1038/nature16162 · DOI · Paper page
- 10.1038/s41467-022-33004-6 · DOI · Paper page
- 10.1021/acs.jpcb.1c00878 · DOI
- 10.1002/pro.3335 · DOI
- Elazar A, 2022, De novo‐designed transmembrane domains tune engineered receptor functions, Elife, 11, 10.7554/eLife.75660 · DOI · Paper page
- 10.1038/nbt1012 · DOI · Paper page
- 10.1126/science.1261172 · DOI · Paper page
- 10.1038/s41467-021-24050-7 · DOI
- 10.1017/S0033583519000131 · DOI · Paper page
- 10.1126/science.1089427 · DOI · Paper page
- 10.1038/s41592-020-0848-2 · DOI · Paper page
- 10.1126/science.ade2574 · doi:10.1126/science.ade2574 · Paper page
- 10.1073/pnas.1509508112 · DOI · Paper page
- 10.1126/science.aaq1739 · DOI · Paper page
- 10.1038/s41594-018-0141-6 · DOI · Paper page
- 10.1038/s41592-022-01488-1 · doi:10.1038/s41592-022-01488-1 · Paper page
- 10.1016/0022-2836(94)90064-7 · DOI · Paper page
- 10.1016/0022-2836(84)90301-2 · DOI
- 10.1016/j.jbc.2021.100558 · DOI · Paper page
- 10.1038/s41557-021-00688-0 · DOI · Paper page
- 10.1101/2022.12.21.521521v1 · doi:10.1101/2022.12.21.521521v1
- 10.1016/j.jmb.2021.167154 · DOI
- Vorobieva AA, 2021, De novo design of transmembrane β barrels, Science, 371, 10.1126/science.abc8182 · DOI · Paper page
- 10.1093/nar/gkw306 · DOI · Paper page
- 10.1038/nature08142 · DOI · Paper page
- 10.1101/2022.07.21.500999v1 · doi:10.1101/2022.07.21.500999v1
- 10.1093/nar/gki524 · DOI · Paper page
Cited by
AlphaDesign: a de novo protein design framework based on AlphaFold
(2025) · doi:10.1038/s44320-025-00119-z · Cited by 36
Efficient protein structure generation with sparse denoising models
Jendrusch, M., & Korbel, J. O. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01100-z · Cited by 10
Designing novel solenoid proteins with in silico evolution
(2025) · doi:10.1038/s42004-025-01817-3 · Cited by 10
Designing Novel Solenoid Proteins with In Silico Evolution
Pretorius, D., Nikov, G. I., Washio, K., Florent, S.-W., Taunt, H. N., Ovchinnikov, S., & Murray, J. W. (2025) · doi:10.1101/2025.04.23.646631 · Cited by 10
Self-citationPeng, Z., Usami, M., Nakada, A., Sekiya, Y., Fujita, S., Mijiddorj, B., Kawamura, I., & Kawano, R. (2025) · ACS Nano · doi:10.1021/acsnano.5c15080 · Cited by 8
Improving diffusion-based protein backbone generation with global-geometry-aware latent encoding
(2025) · doi:10.1038/s42256-025-01059-x · Cited by 7
Limitations of the refolding pipeline for de novo protein design
Korbeld, K. T., Viliuga, V., & Fürst, M. J. L. J. (2026) · Protein Science · doi:10.1002/pro.70613 · Cited by 5
Metadata
- Authors
- Hermosilla, A. M., Berner, C., Ovchinnikov, S., & Vorobieva, A. A.
- Venue
- Protein Science
- Publisher
- Wiley
- Published
- 2024-06-12
- Volume
- 33
- Issue
- 7
- Pages
- e5033-e5033
- ISSN
- 0961-8368 (ISSN-L)
- 1469-896X
- OpenAlex
- W4399581345
- Cited by
- 17
- References
- 20
- FWCI
- 1.98
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- National Science Foundation (MCB2032259)
- National Institutes of Health (DP5OD026389)
- Vlaams Instituut voor Biotechnologie
- Federation of European Biochemical Societies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.