Generative design of de novo proteins based on secondary-structure constraints using an attention-based diffusion model
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
SUMMARY: We report two generative deep learning models that predict amino acid sequences and 3D protein structures based on secondary structure design objectives via either overall content or per-residue structure. Both models are robust regarding imperfect inputs and offer de novo design capacity as they can discover new protein sequences not yet discovered from natural mechanisms or systems. The residue-level secondary structure design model generally yields higher accuracy and more diverse sequences. These findings suggest unexplored opportunities for protein designs and functional outcomes within the vast amino acid sequences beyond known proteins. Our models, based on an attention-based diffusion model and trained on a dataset extracted from experimentally known 3D protein structures, offer numerous downstream applications in conditional generative design of various biological or engineering systems. Future work may include additional conditioning, and an exploration of other functional properties of the generated proteins for various properties beyond structural objectives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
ColabFold - Making protein folding accessible to all
Mirdita, M., Schütze, K., Moriwaki, Y., Heo, L., Ovchinnikov, S., & Steinegger, M. (2021) · doi:10.1101/2021.08.15.456425 · Cited by 9,391
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Varadi, M., Anyango, S., Deshpande, M., Nair, S., Natassia, C., Yordanova, G., Yuan, D., Stroe, O., Wood, G., Laydon, A., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1061 · Cited by 7,850
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Protein complex prediction with AlphaFold-Multimer
Evans, R., O’Neill, M., Pritzel, A., Antropova, N., Senior, A., Green, T., Žídek, A., Bates, R., Blackwell, S., Yim, J., et al. (2021) · doi:10.1101/2021.10.04.463034 · Cited by 3,808
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E., Ghasemipour, S. K. S., Ayan, B. K., Mahdavi, S. S., Lopes, R. G., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.11487 · Cited by 2,528
Watson, J. L., Juergens, D., Bennett, N. R., Trippe, B. L., Yim, J., Eisenach, H. E., Ahern, W., Borst, A. J., Ragotte, R. J., Milles, L. F., et al. (2022) · doi:10.1101/2022.12.09.519842 · Cited by 2,369
Research works printed but not linked: 59
- López Barreiro, 2019, Multiscale modeling of silk and silk-based biomaterials—a review, Macromol. Biosci., 19, e1800253, 10.1002/mabi.201800253 · DOI · Paper page
- Gronau, 2012, A review of combined experimental and computational procedures for assessing biopolymer structure–process–property relationships, Biomaterials, 33, 8240, 10.1016/j.biomaterials.2012.06.054 · DOI
- Vepari, 2007, Silk as a biomaterial, Prog. Polym. Sci., 32, 991, 10.1016/j.progpolymsci.2007.05.013 · DOI · Paper page
- Ling, 2018, Nanofibrils in nature and materials engineering, Nat. Rev. Mater., 3, 1, 10.1038/natrevmats.2018.16 · DOI · Paper page
- Wegst, 2014, Bioinspired structural materials, Nat. Mater., 14, 23, 10.1038/nmat4089 · DOI · Paper page
- Gu, 2017, Hierarchically enhanced impact resistance of bioinspired composites, Adv. Mater., 29, 1700060, 10.1002/adma.201700060 · DOI · Paper page
- Barthelat, 2016, Structure and mechanics of interfaces in biological materials, Nat. Rev. Mater., 1, 1, 10.1038/natrevmats.2016.7 · DOI · Paper page
- Huang, 2016, Design of multistimuli responsive hydrogels using integrated modeling and genetically engineered silk–elastin-like proteins, Adv. Funct. Mater., 26, 4113, 10.1002/adfm.201600236 · DOI
- Krishnaji, 2013, Sequence–structure–property relationships of recombinant spider silk proteins: integration of biopolymer design, processing, and modeling, Adv. Funct. Mater., 23, 241, 10.1002/adfm.201200510 · DOI
- Paladino, 2017, Protein design: from computer models to artificial intelligence, WIREs Comput. Mol. Sci., 7, 10.1002/wcms.1318 · DOI
- Wang, 2018, Computational protein design with deep learning neural networks, Sci. Rep., 8, 6349, 10.1038/s41598-018-24760-x · DOI · Paper page
- Qin, 2020, Artificial intelligence method to design and fold alpha-helical structural proteins from the primary amino acid sequence, Extreme Mech. Lett., 36, 100652, 10.1016/j.eml.2020.100652 · DOI
- Ackbarow, 2007, Hierarchies, multiple energy barriers, and robustness govern the fracture mechanics of α-helical and β-sheet protein domains, Proc. Natl. Acad. Sci. USA, 104, 16410, 10.1073/pnas.0705759104 · DOI · Paper page
- Qin, 2010, Cooperative deformation of hydrogen bonds in beta-strands and beta-sheet nanocrystals, Phys. Rev. E Stat. Nonlin. Soft Matter Phys., 82, 061906, 10.1103/PhysRevE.82.061906 · DOI
- Xu, 2010, Mechanical energy transfer and dissipation in fibrous beta-sheet-rich proteins, Phys. Rev. E Stat. Nonlin. Soft Matter Phys., 81, 061910, 10.1103/PhysRevE.81.061910 · DOI
- Knowles, 2011, Nanomechanics of functional and pathological amyloid materials, Nat. Nanotechnol., 6, 469, 10.1038/nnano.2011.102 · DOI · Paper page
- Hu, 2006, Determining beta-sheet crystallinity in fibrous proteins by thermal analysis and infrared spectroscopy, Macromolecules, 39, 6161, 10.1021/ma0610109 · DOI · Paper page
- Qin, 2009, Hierarchical structure controls nanomechanical properties of vimentin intermediate filaments, PLoS One, 4, e7294, 10.1371/journal.pone.0007294 · DOI · Paper page
- Ackbarow, 2009, Alpha-helical protein networks are self-protective and flaw-tolerant, PLoS One, 4, e6015, 10.1371/journal.pone.0006015 · DOI
- Spivak, 2011, Category theoretic analysis of hierarchical protein materials and social networks, PLoS One, 6, e23911, 10.1371/journal.pone.0023911 · DOI
- Studart, 2013, Biological and bioinspired composites with spatially tunable heterogeneous architectures, Adv. Funct. Mater., 23, 4423, 10.1002/adfm.201300340 · DOI · Paper page
- Keten, 2012, Tunable nanomechanics of protein disulfide bonds in redox microenvironments, J. Mech. Behav. Biomed. Mater., 5, 32, 10.1016/j.jmbbm.2011.08.017 · DOI
- Wray, 2012, A silk-based scaffold platform with tunable architecture for engineering critically-sized tissue constructs, Biomaterials, 33, 9214, 10.1016/j.biomaterials.2012.09.017 · DOI
- Dinjaski, 2018, Predicting rates of in vivo degradation of recombinant spider silk proteins, J. Tissue Eng. Regen. Med., 12, e97, 10.1002/term.2380 · DOI
- Keten, 2010, Nanostructure and molecular mechanics of spider dragline silk protein assemblies, J. R. Soc. Interface, 7, 1709, 10.1098/rsif.2010.0149 · DOI · Paper page
- Xiao, 2013, Dissecting the structural determinants for the difference in mechanical stability of silk and amyloid beta-sheet stacks, Phys. Chem. Chem. Phys., 15, 8765, 10.1039/c3cp00067b · doi:10.1039/c3cp00067b
- Keten, 2008, Geometric confinement governs the rupture strength of H-bond assemblies at a critical length scale, Nano Lett., 8, 743, 10.1021/nl0731670 · DOI · Paper page
- Ackbarow, 2009, A multi-timescale strength model of alpha-helical protein domains, J. Phys. Condens. Matter, 21, 035111, 10.1088/0953-8984/21/3/035111 · doi:10.1088/0953-8984/21/3/035111
- Keten, 2009, Nanomechanical characterization of the triple β-helix domain in the cell puncture needle of bacteriophage T4 virus, Cell. Mol. Bioeng., 2, 66, 10.1007/s12195-009-0047-9 · doi:10.1007/s12195-009-0047-9
- Buehler, 2009, Deformation and failure of protein materials in physiologically extreme conditions and disease, Nat. Mater., 8, 175, 10.1038/nmat2387 · DOI · Paper page
- Jaleel, 2020, Expanding canonical spider silk properties through a DNA combinatorial approach, Materials (Basel), 13, 3596, 10.3390/ma13163596 · DOI
- Hayashi, 1999, Hypotheses that correlate the sequence, structure, and mechanical properties of spider silk proteins, Int. J. Biol. Macromol., 24, 271, 10.1016/S0141-8130(98)00089-0 · DOI · Paper page
- Liu, 2022, Presto: rapid protein mechanical strength prediction with an end-to-end deep learning model, Extreme Mech. Lett., 55, 101803, 10.1016/j.eml.2022.101803 · DOI
- Khare, 2022, CollagenTransformer: end-to-end transformer model to predict thermal stability of collagen triple helices using an NLP approach, ACS Biomater. Sci. Eng., 8, 4301, 10.1021/acsbiomaterials.2c00737 · DOI
- Zhang, 2018, Prediction of 8-state protein secondary structures by a novel deep learning architecture, BMC Bioinformatics, 19, 1, 10.1186/s12859-018-2280-5 · DOI · Paper page
- Pollastri, 2005, Porter: a new, accurate server for protein secondary structure prediction, Bioinformatics, 21, 1719, 10.1093/bioinformatics/bti203 · DOI · Paper page
- Mirabello, 2013, Porter, PaleAle 4.0: high-accuracy prediction of protein secondary structure and relative solvent accessibility, Bioinformatics, 29, 2056, 10.1093/bioinformatics/btt344 · DOI
- Høie, 2022, NetSurfP-3.0: accurate and fast prediction of protein structural features by protein language models and deep learning, Nucleic Acids Res., 50, W510, 10.1093/nar/gkac439 · DOI · Paper page
- Lew, 2021, A deep learning augmented genetic algorithm approach to polycrystalline 2D material fracture discovery and design, Appl. Phys. Rev., 8, 041414, 10.1063/5.0057162 · DOI
- Khare, 2022, Discovering design principles of collagen molecular stability using a genetic algorithm, deep learning, and experimental validation, Proc. Natl. Acad. Sci. USA, 119, 10.1073/pnas.2209524119 · DOI
- Yu, 2022, End-to-end deep learning model to predict and design secondary structure content of structural proteins, ACS Biomater. Sci. Eng., 8, 1156, 10.1021/acsbiomaterials.1c01343 · DOI
- Dong, 2018, A review of the autoencoder and its variants: a comparative perspective from target recognition in synthetic-aperture radar images, IEEE Geosci. Remote Sens. Mag., 6, 44, 10.1109/MGRS.2018.2853555 · DOI · Paper page
- Goodfellow, 2020, Generative adversarial networks, Commun. ACM, 63, 139, 10.1145/3422622 · DOI · Paper page
- Makoś, 2021, Generative adversarial networks for transition state geometry prediction, J. Chem. Phys., 155, 024116, 10.1063/5.0055094 · DOI
- Lebese, 2021, The use of generative adversarial networks to characterise new physics in multi-lepton final states at the LHC, Int. J. Mod. Phys. A
- Yang, 2021, End-to-end deep learning method to predict complete strain and stress tensors for complex hierarchical composite microstructures, J. Mech. Phys. Solids, 154, 104506, 10.1016/j.jmps.2021.104506 · DOI
- Yang, 2021, Deep learning model to predict complex stress and strain fields in hierarchical composites, Sci. Adv., 7
- Buehler, 2022, FieldPerceiver: domain agnostic transformer model to predict multiscale physical fields and nonlinear material properties through neural ologs, Mater. Today, 57, 9, 10.1016/j.mattod.2022.05.020 · DOI
- Ni, 2021, A deep learning approach to the inverse problem of modulus identification in elasticity, MRS Bull., 46, 19, 10.1557/s43577-020-00006-y · DOI
- Buehler, 2022, Modeling atomistic dynamic fracture mechanisms using a progressive transformer diffusion model, J. Appl. Mech., 89, 121009, 10.1115/1.4055730 · DOI
- Trippe, 2022, Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem, Preprint at arXiv
- Kabsch, 1983, Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features, Biopolymers, 22, 2577, 10.1002/bip.360221211 · DOI · Paper page
- Altschul, 1990, Basic local alignment search tool, J. Mol. Biol., 215, 403, 10.1016/S0022-2836(05)80360-2 · doi:10.1016/s0022-2836(05)80360-2 · Paper page
- Keten, 2010, Nanoconfinement controls stiffness, strength and mechanical toughness of β-sheet crystals in silk, Nat. Mater., 9, 359, 10.1038/nmat2704 · DOI · Paper page
- Keten, 2008, Asymptotic strength limit of hydrogen-bond assemblies in proteins at vanishing pulling rates, Phys. Rev. Lett., 100, 198301, 10.1103/PhysRevLett.100.198301 · DOI
- Nichol, 2021, 139, 8162
- Ho, 2022, Classifier-free diffusion guidance, Preprint at arXiv
- Du, 2021, The trRosetta server for fast and accurate protein structure prediction, Nat. Protoc., 16, 5634, 10.1038/s41596-021-00628-9 · DOI · Paper page
- Rego, 2015, 3Dmol.js: molecular visualization with WebGL, Bioinformatics, 31, 1322, 10.1093/bioinformatics/btu829 · DOI · Paper page
Cited by
Generalized biomolecular modeling and design with RoseTTAFold All-Atom
Krishna, R., Wang, J., Ahern, W., Sturmfels, P., Venkatesh, P., Kalvet, I., Lee, G. R., Morey-Burrows, F. S., Anishchenko, I., Humphreys, I. R., et al. (2024) · Science · doi:10.1126/science.adl2528 · Cited by 978
“Diffusion-based methods can generate proteins in the context of a protein target that bind with considerable affinity and specificity ( 45 ) and can be trained to explicitly condition on structural features( 46 ).”
Du, H., Zhang, R., Liu, Y., Wang, J., Lin, Y., Li, Z., Niyato, D., Kang, J., Xiong, Z., Cui, S., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3400011 · Cited by 254
Ni, B., & Buehler, M. J. (2024) · Extreme Mechanics Letters · doi:10.1016/j.eml.2024.102131 · Cited by 113
Self-citationBuehler, M. J. (2024) · ACS Engineering Au · doi:10.1021/acsengineeringau.3c00058 · Cited by 82
Self-citationAI and biosecurity: The need for governance
Bloomfield, D., Pannu, J., Zhu, A. W., Ng, M. Y., Lewis, A., Bendavid, E., Asch, S. M., Hernandez-Boussard, T., Cicero, A., & Inglesby, T. (2024) · Science · doi:10.1126/science.adq1977 · Cited by 50
Metadata
- Authors
- Ni, B., Kaplan, D. L., & Buehler, M. J.
- Venue
- Chem
- Publisher
- Elsevier BV
- Published
- 2023-07
- Volume
- 9
- Issue
- 7
- Pages
- 1828-1849
- ISSN
- 2451-9294 (ISSN-L)
- OpenAlex
- W4366520892
- Cited by
- 88
- References
- 23
- FWCI
- 6.58
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 378 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- Office of Naval Research (N00014-19-1-2375, N00014-20-1-2189)
- Army Research Office (79058LSCSB, W911NF-22-2-0213, W911NF2120130)
- U.S. Department of Agriculture (2021-69012-35978)
- SERDP (WP22-S1-3475)
- National Institutes of Health (R01AR077793, U01EB014976)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Generative design of de novo proteins based on secondary-structure constraints using an attention-based diffusion model. https://app.cochat.ai/papers/10.1016/j.chempr.2023.03.020
- The paper
- Ni, B., Kaplan, D. L., & Buehler, M. J. (2023). Generative design of de novo proteins based on secondary-structure constraints using an attention-based diffusion model. Chem. https://doi.org/10.1016/j.chempr.2023.03.020
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.