Latent generative landscapes as maps of functional diversity in protein sequence space
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Variational autoencoders are unsupervised learning models with generative capabilities, when applied to protein data, they classify sequences by phylogeny and generate de novo sequences which preserve statistical properties of protein composition. While previous studies focus on clustering and generative features, here, we evaluate the underlying latent manifold in which sequence information is embedded. To investigate properties of the latent manifold, we utilize direct coupling analysis and a Potts Hamiltonian model to construct a latent generative landscape. We showcase how this landscape captures phylogenetic groupings, functional and fitness properties of several systems including Globins, β-lactamases, ion channels, and transcription factors. We provide support on how the landscape helps us understand the effects of sequence variability observed in experimental data and provides insights on directed and natural protein evolution. We propose that combining generative properties and functional predictive power of variational autoencoders and coevolutionary analysis could be beneficial in applications for protein engineering and design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
UniProt: the universal protein knowledgebase in 2021
The UniProt Consortium, Bateman, A., Martin, M.-J., Orchard, S., Magrane, M., Agivetova, R., Ahmad, S., Alpi, E., Bowler-Barnett, E. H., Britto, R., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa1100 · Cited by 6,372
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Morcos, F., Pagnani, A., Lunt, B., Bertolino, A., Marks, D. S., Sander, C., Zecchina, R., Onuchic, J. N., Hwa, T., & Weigt, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1111471108 · Cited by 1,434
Self-citationProtein 3D Structure Computed from Evolutionary Sequence Variation
Marks, D. S., Colwell, L. J., Sheridan, R., Hopf, T. A., Pagnani, A., Zecchina, R., & Sander, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028766 · Cited by 1,144 · cited 16×
“The landscape map is then created with the collection of latent coordinates z 0 , z 1 and the value of the Hamiltonian for each of the sequences generated using Equation (8).”
MethodInfluentialProteinBERT: a universal deep-learning model of protein sequence and function
Brandes, N., Ofer, D., Peleg, Y., Rappoport, N., & Linial, M. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac020 · Cited by 1,009
Disease variant prediction with deep generative models of evolutionary data
Frazer, J., Notin, P., Dias, M., Gomez, A., Min, J. K., Brock, K., Gal, Y., & Marks, D. S. (2021) · Nature · doi:10.1038/s41586-021-04043-8 · Cited by 791
Improved contact prediction in proteins: using pseudolikelihoods to infer Potts models
Ekeberg, M., Lövkvist, C., Lan, Y., Weigt, M., & Aurell, E. (2013) · Physical Review E · doi:10.1103/physreve.87.012707 · Cited by 661
Ovchinnikov, S., Kamisetty, H., & Baker, D. (2014) · eLife · doi:10.7554/elife.02030 · Cited by 629
Deep generative models of genetic variation capture the effects of mutations
Riesselman, A. J., Ingraham, J. B., & Marks, D. S. (2018) · Nature Methods · doi:10.1038/s41592-018-0138-4 · Cited by 601
Research works printed but not linked: 79
- Onuchic, J. N. & Wolynes, P. G. Theory of protein folding. Curr. Opin. Struct. Biol. 14, 70–75 (2004). · DOI · Paper page
- Orengo, C. A. & Thornton, J. M. Protein families and their evolution-a structural perspective. Annu. Rev. Biochem. 74, 867–900 (2005). · DOI · Paper page
- Hopf, T. A. et al. The evcouplings python framework for coevolutionary sequence analysis. Bioinformatics 35, 1582–1584 (2019). · DOI · Paper page
- Sułkowska, J. I., Rawdon, E. J., Millett, K. C., Onuchic, J. N. & Stasiak, A. Conservation of complex knotting and slipknotting patterns in proteins. Proc. Natl Acad. Sci. 109, E1715–E1723 (2012). · DOI
- Jones, D. T., Buchan, D. W. A., Cozzetto, D. & Pontil, M. PSICOV: precise structural contact prediction using sparse inverse covariance estimation on large multiple sequence alignments. Bioinformatics 28, 184–190 (2011). · DOI · Paper page
- dos Santos, R. N., Morcos, F., Jana, B., Andricopulo, A. D. & Onuchic, J. N. Dimeric interactions and complex formation using direct coevolutionary couplings. Sci. Rep. 5, 13652 (2015). · DOI · Paper page
- Karmi, O. et al. Interactions between mitoneet and naf-1 in cells. PLoS One 12, 1–18 (2017). · DOI
- Quignot, C. et al. Interevdock3: a combined template-based and free docking server with increased performance through explicit modeling of complex homologs and integration of covariation-based contact maps. Nucleic Acids Res. 49, W277–W284 (2021). · DOI
- Cheng, R. R., Morcos, F., Levine, H. & Onuchic, J. N. Toward rationally redesigning bacterial two-component signaling systems using coevolutionary information. Proc. Natl Acad. Sci. USA 111, 2 (2014). · DOI · Paper page
- Sinner, C., Ziegler, C., Jung, Y. H., Jiang, X. & Morcos, F. Elihksir web server: Evolutionary links inferred for histidine kinase sensors interacting with response regulators. Entropy (Basel, Switz.) 23, 1–19 (2021).
- Zhou, Q. et al. Global pairwise rna interaction landscapes reveal core features of protein recognition. Nat. Commun. 9, 2511 (2018). · DOI · Paper page
- Bitbol, A.-F., Dwyer, R. S., Colwell, L. J. & Wingreen, N. S. Inferring interaction partners from protein sequences. Proc. Natl Acad. Sci. 113, 12180–12185 (2016). · DOI · Paper page
- Gueudré, T., Baldassi, C., Zamparo, M., Weigt, M. & Pagnani, A. Simultaneous identification of specifically interacting paralogs and interprotein contacts by direct coupling analysis. Proc. Natl Acad. Sci. 113, 12186–12191 (2016). · DOI · Paper page
- Dimas, R. P., Jiang, X.-L., de la Paz, J. A., Morcos, F. & Chan, C. T. Y. Engineering repressors with coevolutionary cues facilitates toggle switches with a master reset. Nucleic Acids Res. 47, 5449–5463 (2019). · DOI
- Rodriguez-Rivas, J., Croce, G., Muscat, M. & Weigt, M. Epistatic models predict mutable sites in sars-cov-2 proteins and epitopes. Proc. Natl Acad. Sci. 119, e2113118119 (2022). · DOI
- Jiang, X. L., Dimas, R. P., Chan, C. T. Y. & Morcos, F. Coevolutionary methods enable robust design of modular repressors by reestablishing intra-protein interactions. Nat. Commun. 12, 1–8 (2021). · DOI
- Tutol, J. N. et al. A single point mutation converts a proton-pumping rhodopsin into a red-shifted, turn-on fluorescent sensor for chloride. Chem. Sci. 12, 5655–5663 (2021). · doi:10.1039/d0sc06061e
- Chi, H. et al. Coupling a live cell directed evolution assay with coevolutionary landscapes to engineer an improved fluorescent rhodopsin chloride sensor. ACS Synth. Biol. 11, 1627–1638 (2022). · DOI
- de la Paz, J. A., Nartey, C. M., Yuvaraj, M. & Morcos, F. Epistatic contributions promote the unification of incompatible models of neutral molecular evolution. Proc. Natl Acad. Sci. USA 117, 5873–5882 (2020). · DOI · Paper page
- Du, X. et al. Deepppi: Boosting prediction of protein-protein interactions with deep neural networks. J. Chem. Inf. Model. 57, 1499–1510 (2017). · DOI · Paper page
- Tubiana, J., Cocco, S. & Monasson, R. Learning protein constitutive motifs from sequence data. eLife 8, 3 (2019). · DOI · Paper page
- Greener, J. G., Moffat, L. & Jones, D. T. Design of metalloproteins and novel protein folds using variational autoencoders. Sci. Rep. 8, 1–12 (2018). · DOI · Paper page
- Sgarbossa, D., Lupo, U. & Bitbol, A.-F. Generative power of a protein language model trained on multiple sequence alignments. eLife 12, e79854 (2023). · doi:10.7554/elife.79854
- Kingma, D. P. & Welling, M. Auto-encoding variational bayes. In Proc. 2nd International Conference on Learning Representations, ICLR 12 (2013).
- Kingma, D. P. & Welling, M. An introduction to variational autoencoders. arXiv.org (2019). · DOI · Paper page
- Park, S. & Kim, H. Facevae: Generation of a 3d geometric object using variational autoencoders. Electronics 10, 2792 (2021). · DOI
- Dean, S. N. & Walper, S. A. Variational autoencoder for generation of antimicrobial peptides. ACS Omega 5, 20746–20754 (2020). · DOI · Paper page
- Hawkins-Hooker, A. et al. Generating functional protein variants with variational autoencoders. PLOS Comput. Biol. 17, e1008736 (2021). · DOI · Paper page
- Dai, B., Wang, Y., Aston, J., Hua, G. & Wipf, D. Connections with robust pca and the role of emergent sparsity in variational autoencoder models. J. Mach. Learn. Res. 19, 1573–1614 (2018).
- Grønbech, C. H. et al. scvae: variational auto-encoders for single-cell gene expression data. Bioinformatics 36, 4415–4422 (2020). · DOI · Paper page
- Nissen, J. N. et al. Improved metagenome binning and assembly using deep variational autoencoders. Nat. Biotechnol. 39, 555–560 (2021). · DOI · Paper page
- Hong, Y., Lee, J. & Ko, J. A-prot: protein structure modeling using msa transformer. BMC Bioinforma. 23, 1–11 (2022). · DOI · Paper page
- Finn, R. D. et al. Pfam: the protein families database. Nucleic Acids Res. 42, D222–D230 (2013). · DOI · Paper page
- Eddy, S. R. Accelerated profile hmm searches. PLoS Comput. Biol. 7, 1–16 (2011). · DOI · Paper page
- Levy, R. M., Haldane, A. & Flynn, W. F. Potts hamiltonian models of protein co-variation, free energy landscapes, and evolutionary fitness. Curr. Opin. Struct. Biol. 43, 55–62 (2017). · DOI · Paper page
- Jacquin, H., Gilson, A., Shakhnovich, E., Cocco, S. & Monasson, R. Benchmarking inverse statistical approaches for protein structure and design with exactly solvable models. PLOS Comput. Biol. 12, e1004889 (2016). · DOI
- Cheng, R. R. et al. Connecting the sequence-space of bacterial signaling proteins to phenotypes using coevolutionary landscapes. Mol. Biol. Evolut. 33, 3054–3064 (2016). · DOI · Paper page
- Figliuzzi, M., Jacquier, H., Schug, A., Tenaillon, O. & Weigt, M. Coevolutionary landscape inference and the context-dependence of mutations in Beta-Lactamase TEM-1. Mol. Biol. Evolut. 33, 268–280 (2015). · DOI · Paper page
- Bisardi, M., Rodriguez-Rivas, J., Zamponi, F. & Weigt, M. Modeling sequence-space exploration and emergence of epistatic signals in protein evolution. Mol. Biol. Evolut. 39, 1 (2022). · DOI · Paper page
- McGee, F. et al. The generative capacity of probabilistic protein sequence models. Nat. Commun. 12, 6302 (2021). · DOI · Paper page
- Wright, S. et al. The roles of mutation, inbreeding, crossbreeding, and selection in evolution. Proc. Sixth Int. Congr. Genet., 1, 356–366 (1932).
- Mettananda, S., Gibbons, R. J. & Higgs, D. R. Understanding a-globin gene regulation and implications for the treatment of b-thalassemia. Ann. N. Y. Acad. Sci. 1368, 16–24 (2016). · DOI · Paper page
- Smith, M. R. Information theoretic generalized Robinson-Foulds metrics for comparing phylogenetic trees. Bioinformatics 36, 5007–5013 (2020). · DOI · Paper page
- Detlefsen, N. S., Hauberg, S. & Boomsma, W. Learning meaningful representations of protein sequences. Nat. Commun. 13, 1–12 (2022). · DOI · Paper page
- Tooke, C. L. et al. β-lactamases and β-lactamase inhibitors in the 21st century. J. Mol. Biol. 431, 3472–3500 (2019). · DOI · Paper page
- Bush, K. Past and present perspectives on β-lactamases. Antimicrob. Agents Chemother. 62, 10 (2018). · DOI · Paper page
- Palzkill, T. Structural and mechanistic basis for extended-spectrum drug-resistance mutations in altering the specificity of tem, ctx-m, and kpc β-lactamases. Front. Mol. Biosci. 5, 16 (2018). · DOI · Paper page
- Liakopoulos, A., Mevius, D. & Ceccarelli, D. A review of shv extended-spectrum β-lactamases: neglected yet ubiquitous. Front. Microbiol. 7, 1374 (2016). · DOI · Paper page
- Livermore, D. M. Defining an extended-spectrum β-lactamase. Clin. Microbiol. Infect. 14, 3–10 (2008). · DOI · Paper page
- Bennett, K. M. et al. Implementation of antibiotic rotation protocol improves antibiotic susceptibility profile in a surgical intensive care unit. J. Trauma - Inj., Infect. Crit. Care 63, 307–311 (2007).
- Karam, G., Chastre, J., Wilcox, M. H. & Vincent, J. L. Antibiotic strategies in the era of multidrug resistance. Crit. Care 20, 1–9 (2016). · DOI · Paper page
- Stiffler, M. A. et al. Protein structure from experimental evolution. Cell Syst. 10, 15–24.e5 (2020).
- Fantini, M., Lisi, S., De Los Rios, P., Cattaneo, A. & Pastore, A. Protein structural information and evolutionary landscape by in vitro evolution. Mol. Biol. Evolut. 37, 1179–1192 (2020). · DOI · Paper page
- Matos-Cruz, V. et al. Molecular prerequisites for diminished cold sensitivity in ground squirrels and hamsters. Cell Rep. 21, 3329–3337 (2017). · doi:10.1016/j.celrep.2017.11.083
- Bautista, D. M. et al. The menthol receptor trpm8 is the principal detector of environmental cold. Nature 448, 204–208 (2007). · DOI · Paper page
- Yin, Y. et al. Structural basis of cooling agent and lipid sensing by the cold-activated trpm8 channel. Science 363, 3 (2019). · DOI · Paper page
- Kao, M.-R., Yu, S.-M., Ua, T.-H. & Ho, D. Improvements of the productivity and saccharification efficiency of the cellulolytic β-glucosidase d2-bgl in pichia pastoris via directed evolution. Biotechnol. Biofuels 14, 126 (2021). · DOI
- Poelwijk, F. J., De Vos, M. G. J. & Tans, S. J. Tradeoffs and optimality in the evolution of gene regulation. Cell 146, 462–470 (2011). · DOI
- Meyer, A. J., Segall-Shapiro, T. H., Glassey, E., Zhang, J. & Voigt, C. A. Escherichia coli “marionette” strains with 12 highly optimized small-molecule sensors. Nat. Chem. Biol. 15, 196–204 (2018). · DOI · Paper page
- Ellefson, J. W., Ledbetter, M. P. & Ellington, A. D. Directed evolution of a synthetic phylogeny of programmable trp repressors. Nat. Chem. Biol. 14, 361–367 (2018). · DOI
- Collins, C. H., Leadbetter, J. R. & Arnold, F. H. Dual selection enhances the signaling specificity of a variant of the quorum-sensing transcriptional activator luxr. Nat. Biotechnol. 24, 708–712 (2006). · DOI · Paper page
- Tang, S. Y., Fazelinia, H. & Cirino, P. C. Arac regulatory protein mutants with altered effector specificity. J. Am. Chem. Soc. 130, 5267–5271 (2008). · DOI
- Snoek, T. et al. Evolution-guided engineering of small-molecule biosensors. Nucleic Acids Res. 48, e3–e3 (2020). · DOI
- Gane, A. et al. Protnlm: Model-based natural language protein annotation. Preprint at https://storage.googleapis.com/brain-genomics-public/research/proteins/protnlm/uniprot_2022_04/protnlm_preprint_draft.pdf (2023).
- Törönen, P., Medlar, A. & Holm, L. PANNZER2: a rapid functional annotation web server. Nucleic Acids Res. 46, W84–W88 (2018). · DOI · Paper page
- Falda, M. et al. Argot2: A large scale function prediction tool relying on semantic similarity of weighted gene ontology terms. BMC Bioinforma. 13, 1–9 (2012). · DOI · Paper page
- Cantalapiedra, C. P., Hernández-Plaza, A., Letunic, I., Bork, P. & Huerta-Cepas, J. eggNOG-mapper v2: functional annotation, orthology assignments, and domain prediction at the metagenomic scale. Mol. Biol. Evolut. 38, 5825–5829 (2021). · doi:10.1093/molbev/msab293
- Pillai, A. S. et al. Origin of complexity in haemoglobin evolution. Nature 581, 480–485 (2020). · DOI · Paper page
- Tsan-Yuk Lam, T. et al. Identifying sars-cov-2-related coronaviruses in malayan pangolins. Nature 583, 282–285 (2020). · DOI · Paper page
- Hatcher, E. L. et al. Virus variation resource - improved response to emergent viral outbreaks. Nucleic Acids Res. 45, D482–D490 (2017). · DOI · Paper page
- Facco, E., Pagnani, A., Russo, E. T. & Laio, A. The intrinsic dimension of protein sequence evolution. PLoS Computat. Biol. 15, e1006767 (2019). · DOI
- Radhakrishnan, A., Belkin, M. & Uhler, C. Overparameterized neural networks implement associative memory. Proc. Natl Acad. Sci. 117, 27162–27170 (2020). · DOI
- Abadi, M. et al. TensorFlow: Large-scale machine learning on heterogeneous systems. Software available from tensorflow.org. https://doi.org/10.48550/arXiv.1603.04467 (2015). · DOI · Paper page
- Figliuzzi, M., Barrat-Charlaix, P. & Weigt, M. How pairwise coevolutionary models capture the collective residue variability in proteins? Mol. Biol. Evolut. 35, 1018–1027 (2018). · DOI · Paper page
- Trinquier, J., Uguzzoni, G., Pagnani, A., Zamponi, F. & Weigt, M. Efficient generative modeling of protein sequences using simple autoregressive models. Nat. Commun. 12, 5800 (2021). · DOI · Paper page
- Price, M. N., Dehal, P. S. & Arkin, A. P. Fasttree: Computing large minimum evolution trees with profiles instead of a distance matrix. Mol. Biol. Evolut. 26, 1641–1650 (2009). · DOI · Paper page
- Hunter, J. D. Matplotlib: a 2d graphics environment. Comput. Sci. Eng. 9, 90–95 (2007). · DOI · Paper page
- Ashburner, M. et al. Gene ontology: tool for the unification of biology. Nat. Genet. 25, 25–29 (2000). · DOI · Paper page
- Binns, D. et al. QuickGO: a web-based tool for Gene Ontology searching. Bioinformatics 25, 3045–3046 (2009). · DOI · Paper page
Cited by
Proteome-scale prediction of molecular mechanisms underlying dominant genetic diseases
(2024) · doi:10.1371/journal.pone.0307312 · Cited by 15
(2025) · doi:10.1021/jacsau.4c01101 · Cited by 14
Proteome-scale prediction of molecular mechanisms underlying dominant genetic diseases
Badonyi, M., & Marsh, J. A. (2023) · doi:10.1101/2023.09.08.556798 · Cited by 6
Shukla, D., Martin, J., Morcos, F., & Potoyan, D. A. (2025) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.4c01774 · Cited by 4
Self-citation
Metadata
- Authors
- Ziegler, C., Martin, J., Sinner, C., & Morcos, F.
- Venue
- Nature Communications
- Published
- 2023-04-19
- Volume
- 14
- Issue
- 1
- Pages
- 2222-2222
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W4366425786
- Cited by
- 42
- References
- 16
- FWCI
- 3.14
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- National Science Foundation (MCB-1943442)
- U.S. Department of Health & Human Services | National Institutes of Health (R35GM133631)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Latent generative landscapes as maps of functional diversity in protein sequence space. https://app.cochat.ai/papers/10.1038/s41467-023-37958-z
- The paper
- Ziegler, C., Martin, J., Sinner, C., & Morcos, F. (2023). Latent generative landscapes as maps of functional diversity in protein sequence space. Nature Communications. https://doi.org/10.1038/s41467-023-37958-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.